We show
the practicality of two existing meta-learning algorithms Model-Agnostic
Meta-Learning and Fast Context Adaptation Via Meta-learning using an
evolutionary strategy for parameter optimization, as well as propose two novel
quantum adaptations of those algorithms using continuous quantum neural
networks, for learning to trade portfolios of stocks on the stock market. The
goal of meta-learning is to train a model on a variety of tasks, such that it
can solve new learning tasks using only a small number of training samples. In
our classical approach, we trained our meta-learning models on a variety of
portfolios that contained 5 randomly sampled Consumer Cyclical stocks from a
pool of 60. In our quantum approach, we trained our quantum meta-learning models on a simulated quantum computer with portfolios containing 2 randomly sampled Consumer Cyclical stocks. Our findings
suggest that both classical models could learn a new portfolio with 0.01% of
the number of training samples to learn the original portfolios and can achieve
a comparable performance within 0.1% Return on Investment of the Buy and Hold
strategy. We also show that our much smaller quantum meta-learned models with
only 60 model parameters and 25 training epochs have a similar learning pattern to our much larger classical meta-learned models that have over 250,000 model parameters and 2500 training epochs. Given
these findings, we also discuss the benefits of scaling up our experiments from a
simulated quantum computer to a real quantum computer. To the best of our
knowledge, we are the first to apply the ideas of both classical meta-learning
as well as quantum meta-learning to enhance stock trading.
References
[1]
Xiong, Z.R., et al. (2018) Practical Deep Reinforcement Learning Approach for Stock Trading.
[2]
Bellman, R. (1957) A Markovian Decision Process. Indiana University Mathematics Journal, 6, 679-684. https://doi.org/10.1512/iumj.1957.6.56038
[3]
Bollen, J., Mao, H.N. and Zeng, X.J. (2011) Twitter Mood Predicts the Stock Market. Journal of Computational Science, 2, 1-8. https://doi.org/10.1016/j.jocs.2010.12.007
[4]
Zhang, C.Y., et al. (2018) A Study on Overfitting in Deep Reinforcement Learning.
[5]
Finn, C., Abbeel, P. and Levine, S. (2017) Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks.
[6]
Zintgraf, L.M., et al. (2018) Fast Context Adaptation via Meta-Learning.
[7]
Sutton, R.S. and Barto, A.G. (2018) Reinforcement Learning: An Introduction. Second Edition, The MIT Press, Cambridge.
http://incompleteideas.net/book/the-book-2nd.html
[8]
Chen, T.P. and Chen, H. (1995) Universal Approximation to Nonlinear Operators by Neural Networks with Arbitrary Activation Functions and Its Application to Dynamical Systems. IEEE Transactions on Neural Networks, 6, 911-917.
https://doi.org/10.1109/72.392253
[9]
Wierstra, D., et al. (2011) Natural Evolution Strategies.
[10]
Salimans, T., et al. (2017) Evolution Strategies as a Scalable Alternative to Reinforcement Learning.
[11]
Fu, K., et al. (2019) Meta-SSD: Towards Fast Adaptation for Few-Shot Object Detection with Meta-Learning. IEEE Access, 7, 77597-77606.
https://doi.org/10.1109/ACCESS.2019.2922438
[12]
Mishra, N., et al. (2017) A Simple Neural Attentive Meta-Learner.
Andersen, U., et al. (2015) Hybrid Discrete- and Continuous-Variable Quantum Information. Nature Physics, 11, 713-719. https://doi.org/10.1038/nphys3410
[15]
Moon, K. and Girvin, S.M. (2005) Theory of Microwave Parametric Down-Con- version and Squeezing Using Circuit QED. Physical Review Letters, 95, Article ID: 140504. https://doi.org/10.1103/PhysRevLett.95.140504
[16]
Shen, C., Zhang, Z. and Duan, L.-M. (2014) Scalable Implementation of Boson Sampling with Trapped Ions. Physical Review Letters, 112, Article ID: 050504.
https://doi.org/10.1103/PhysRevLett.112.050504
[17]
Schuld, M. and Killoran, N. (2019) Quantum Machine Learning in Feature Hilbert Spaces. Physical Review Letters, 122, Article ID: 040504.
https://doi.org/10.1103/PhysRevLett.122.040504
[18]
Bergholm, V., et al. (2018) PennyLane: Automatic Differentiation of Hybrid Quantum-Classical Computations.
[19]
Jiang, Z.Y., Xu, D.X. and Liang, J.J. (2017) A Deep Reinforcement Learning Framework for the Financial Portfolio Management Problem.
[20]
Chou, Y.-H., et al. (2014) A Rule-Based Dynamic Decision-Making Stock Trading System Based on Quantum-Inspired Tabu Search Algorithm. IEEE Access, 2, 883-896.
https://doi.org/10.1109/ACCESS.2014.2352261
[21]
Gonçalves, C.P. (2015) Financial Market Modeling with Quantum Neural Networks.
[22]
Cai, X.-D., et al. (2015) Entanglement-Based Machine Learning on a Quantum Computer. Physical Review Letters, 114, Article ID: 110504.
https://doi.org/10.1103/PhysRevLett.114.110504
[23]
Li, B. and Hoi, S.C.H. (2014) Online Portfolio Selection: A Survey. ACM Computing Surveys, 46, 1-35. https://doi.org/10.1145/2512962