Prediction of financial market data with deep learning models has achieved some level of recent success. However, historical financial data suffer from an unknowable state space, limited observations, and the inability to model the impact of your own actions on the market can often be prohibitive when trying to find investment strategies using deep reinforcement learning. One way to overcome these limitations is to augment real market data with agent based artificial market simulation. Artificial market simulations designed to reproduce realistic market features may be used to create unobserved market states, to model the impact of your own investment actions on the market itself, and train models with as much data as necessary. In this study we propose a framework for training deep reinforcement learning models in agent based artificial price-order-book simulations that yield non-trivial policies under diverse conditions with market impact. Our simulations confirm that the proposed deep reinforcement learning model with unique task-specific reward function was able to learn a robust investment strategy with an attractive risk-return profile.
1 January 2020 in Journal of Artificial Societies and Social Simulation
In this study, we assessed the impact of capital adequacy ratio (CAR) regulation in the Basel regulatory framework. This regulation was established to make the banking network robust. However, a previous work argued that CAR regulation has a destabilization effect on financial markets. To assess impacts such as destabilizing effects, we conducted simulations of an artificial market, one of the computer simulations imitating real financial markets. In the simulation, we proposed and used a new model with continuous double auction markets, stylized trading agents, and two kinds of portfolio trading agents. Both portfolio trading agents had trading strategies incorporating Markowitz’s portfolio optimization. Additionally, one type of portfolio trading agent was under regulation. From the simulations, we found that portfolio optimization as each trader’s strategy stabilizes markets, and CAR regulation destabilizes markets in various aspects. These results show that CAR regulation can have negative effects on asset markets. As future work, we should confirm these effects empirically and consider how to balance between both positive and negative aspects of CAR regulation.
This paper proposes and analyzes a methodology of forecasting movements of the analysts’ net income estimates and those of stock prices. We achieve this by applying natural language processing and neural networks in the context of analyst reports. In the pre-experiment, we applied our method to extract opinion sentences from the analyst report while classifying the remaining parts as non-opinion sentences. Then, we performed two additional experiments. First, we employed our proposed method for forecasting the movements of analysts’ net income estimates by inputting the opinion and non-opinion sentences into separate neural networks. Besides the reports, we inputted the trend of the net income estimate to the networks. Second, we employed our proposed method for forecasting the movements of stock prices. Consequently, we found differences between security firms, which depend on whether analysts’ net income estimates tend to be forecasted by opinions or facts in the context of analyst reports. Furthermore, the trend of the net income estimate was found to be effective for the forecast as well as an analyst report. However, in experiments of forecasting movements of stock prices, the difference between opinion sentences and non-opinion sentences was not effective.