Prediction of financial market data with deep learning models has achieved some level of recent success. However, historical financial data suffer from an unknowable state space, limited observations, and the inability to model the impact of your own actions on the market can often be prohibitive when trying to find investment strategies using deep reinforcement learning. One way to overcome these limitations is to augment real market data with agent based artificial market simulation. Artificial market simulations designed to reproduce realistic market features may be used to create unobserved market states, to model the impact of your own investment actions on the market itself, and train models with as much data as necessary. In this study we propose a framework for training deep reinforcement learning models in agent based artificial price-order-book simulations that yield non-trivial policies under diverse conditions with market impact. Our simulations confirm that the proposed deep reinforcement learning model with unique task-specific reward function was able to learn a robust investment strategy with an attractive risk-return profile.
With the development of online platforms, people can share and obtain opinions quickly. It also makes individuals' preferences change dynamically and rapidly because they may change their minds when getting convincing opinions from other users. Unlike representative areas of recommendation research such as e-commerce platforms where items' features are fixed, in investment scenarios financial instruments' features such as stock price, also change dynamically over time. To capture these dynamic features and provide a better-personalized recommendation for amateur investors, this study proposes a Personalized Dynamic Recommender System for Investors, PDRSI. The proposed PDRSI considers two investor's personal features: dynamic preferences and historical interests, and two temporal environmental properties: recent discussions on the social media platform and the latest market information. The experimental results support the usefulness of the proposed PDRSI, and the ablation studies show the effect of each module. For reproduction, we follow Twitter's developer policy to share our dataset for future work.
1 January 2020 in Journal of Artificial Societies and Social Simulation
In this study, we assessed the impact of capital adequacy ratio (CAR) regulation in the Basel regulatory framework. This regulation was established to make the banking network robust. However, a previous work argued that CAR regulation has a destabilization effect on financial markets. To assess impacts such as destabilizing effects, we conducted simulations of an artificial market, one of the computer simulations imitating real financial markets. In the simulation, we proposed and used a new model with continuous double auction markets, stylized trading agents, and two kinds of portfolio trading agents. Both portfolio trading agents had trading strategies incorporating Markowitz’s portfolio optimization. Additionally, one type of portfolio trading agent was under regulation. From the simulations, we found that portfolio optimization as each trader’s strategy stabilizes markets, and CAR regulation destabilizes markets in various aspects. These results show that CAR regulation can have negative effects on asset markets. As future work, we should confirm these effects empirically and consider how to balance between both positive and negative aspects of CAR regulation.