In this paper, we propose a novel approach to optimize parameters for strategies in automated trading systems. Based on the framework of Reinforcement learning, our work includes the development of a learning environment, state representation, reward function, and learning algorithm for the cryptocurrency market. Considering two simple objective functions, cumulative return and Sharpe ratio, the results showed that Deep Reinforcement Learning approach with Double Deep Q-Network setting and the Bayesian Optimization approach can provide positive average returns. Among the settings being studied, Double Deep Q-Network setting with Sharpe ratio as reward function is the best Q-learning trading system. With a daily trading goal, the system shows outperformed results in terms of cumulative return, volatility and execution time when compared with the Bayesian Optimization approach. This helps traders to make quick and efficient decisions with the latest information from the market. In long-term trading, Bayesian Optimization is a method of parameter optimization that brings higher profits. Deep Reinforcement Learning provides solutions to the high-dimensional problem of Bayesian Optimization in upcoming studies such as optimizing portfolios with multiple assets and diverse trading strategies.
Energy systems are often socio-technical complex systems that are facing new challenges regarding technological and environmental changes. Because of their complex nature, they cannot be approached solely through analytical modeling, hence the inefficiency of most classical modeling approaches. In this article, a Hybrid Approach based on both systemic and analytical modeling is presented and applied to a case study. From this novel approach, a model—the Multi-Institution Building Energy System—is presented. It allowed us to highlight and detail the need for greater governance of energy systems. The socio-technical solutions identified to answer the issues of governance (Accuracy, Reliability and Fairness) were DevOps methodology and the use of Distributed Microservices Architecture. Based on this framework, the design of a Decision Support System assuring and exploiting state-of-the-art scalable tools for data management and machine learning factories is described in this article. Moreover, we wish to set up the conceptual basis necessary for the design of a generic theoretical framework of optimization applicable to complex socio-technical systems in the context of the management of a shared resource.
In this research, an agent-based model (ABM) of the stock market is constructed to detect the proportion of different types of traders. We model a simple stock market which has three different types of traders: noise traders, fundamental traders, and technical traders, trading a single asset. Bayesian optimization is used to tune the hyperparameters of the strategies of traders as well as of the stock market. The experimental results on Bayesian calibration with the Kolmogorov–Smirnov (KS) test demonstrated that the proposed separate calibrations reduced simulation error, with plausible estimated parameters. With empirical data of the Dow Jones Industrial Average (DJIA) index, we found that fundamental traders account for 9%–11% of all traders in the stock market. The statistical analysis of simulated data can produce the important stylized facts in real stock markets, such as the leptokurtosis, the heavy tail of the returns, and volatility clustering.
In this paper, we present a model which characterizes distributed computing algorithms. The goals of this model are to offer an abstract representation of asynchronous and heterogeneous distributed systems, to present a mechanism for specifying externally observable behaviours of distributed processes and to provide rules for combining these processes into networks with desired properties (good functioning, fairness...). Once these good properties are found, the determination of the optimal rules are studied. Subsequently, the model is applied to three classical distributed computing problems: namely the dining philosophers problem, the mutual exclusion problem and the deadlock problem, (generalizing results of our previous publications [1], [2]). The property of fairness has a special position that we discuss.