Eivind Bøhn

Eivind Bøhn

Auto-generated profile, based on publicly available information

Eivind Bøhn

SINTEF Digital

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
13 April 2023 in IEEE Transactions on Neural Networks and Learning Systems
Verified
Journal Article
Closed access
EBEivind Bøhn
Eivind Bøhn
Erlend M. CoatesErlend M. Coates
Erlend M. Coates
DRDirk Reinhardt
Dirk Reinhardt
TJTor Arne Johansen
Tor Arne Johansen
Attitude control of fixed-wing unmanned aerial vehicles (UAVs) is a difficult control problem in part due to uncertain nonlinear dynamics, actuator constraints, and coupled longitudinal and lateral motions. Current state-of-the-art autopilots are based on linear control and are thus limited in their effectiveness and performance. drl is a machine learning method to automatically discover optimal control laws through interaction with the controlled system that can handle complex nonlinear dynamics. We show in this article that deep reinforcement learning (DRL) can successfully learn to perform attitude control of a fixed-wing UAV operating directly on the original nonlinear dynamics, requiring as little as 3 min of flight data. We initially train our model in a simulation environment and then deploy the learned controller on the UAV in flight tests, demonstrating comparable performance to the state-of-the-art ArduPlane proportional-integral-derivative (PID) attitude controller with no further online learning required. Learning with significant actuation delay and diversified simulated dynamics were found to be crucial for successful transfer to control of the real UAV. In addition to a qualitative comparison with the ArduPlane autopilot, we present a quantitative assessment based on linear analysis to better understand the learning controller’s behavior.

30 March 2023 in Engineering Applications of Artificial Intelligence
Verified
Journal Article
Open access
EBEivind Bøhn
Eivind Bøhn
SGSebastien Gros
Sebastien Gros
SMSigne Moe
Signe Moe
TJTor Arne Johansen
Tor Arne Johansen

13 November 2019 in arXiv
Verified
Preprint
Open access
PDF file
EBEivind Bøhn
Eivind Bøhn
ECErlend M. Coates
Erlend M. Coates
SMSigne Moe
Signe Moe
TJTor Arne Johansen
Tor Arne Johansen
Contemporary autopilot systems for unmanned aerial vehicles (UAVs) are far more limited in their flight envelope as compared to experienced human pilots, thereby restricting the conditions UAVs can operate in and the types of missions they can accomplish autonomously. This paper proposes a deep reinforcement learning (DRL) controller to handle the nonlinear attitude control problem, enabling extended flight envelopes for fixed-wing UAVs. A proof-of-concept controller using the proximal policy optimization (PPO) algorithm is developed, and is shown to be capable of stabilizing a fixed-wing UAV from a large set of initial conditions to reference roll, pitch and airspeed values. The training process is outlined and key factors for its progression rate are considered, with the most important factor found to be limiting the number of variables in the observation vector, and including values for several previous time steps for these variables. The trained reinforcement learning (RL) controller is compared to a proportional-integral-derivative (PID) controller, and is found to converge in more cases than the PID controller, with comparable performance. Furthermore, the RL controller is shown to generalize well to unseen disturbances in the form of wind and turbulence, even in severe disturbance conditions.

20 October 2025 in Journal of Artificial Intelligence Research
Verified
Journal Article
Closed access
PDF file
PJPål V. B. Johnsen
Pål V. B. Johnsen
EBEivind Bøhn
Eivind Bøhn
SESølve Eidnes
Sølve Eidnes
FRFilippo Remonato
Filippo Remonato
SRSigne Riemer-Sørensen
Signe Riemer-Sørensen
Time series modelling in process industries faces the challenge of dealing with complex, multi-faceted and evolving data characteristics. Conventional single-model approaches often struggle to capture the interplay of diverse dynamics, resulting in suboptimal forecasts. Addressing this, we introduce the Recency-Weighted Temporally-Segmented (ReWTS, pronounced ‘roots’) ensemble model, a novel chunk-based approach for multi-step forecasting. The key characteristics of the ReWTS method are twofold: 1) It facilitates specialization of models into different dynamics by segmenting the training data into ‘chunks’ of data and training one model per chunk; 2) During forecasting, an optimization procedure assesses each model on the recent past and selects the active models, such that the appropriate mixture of previously learned dynamics can be recalled to forecast the future. This method not only captures the nuances of each period, but also adapts more effectively to changes over time compared to conventional ‘global’ models trained on all data in one go. We present a comparative analysis, using two years of data from a wastewater treatment plant and a drinking water treatment plant in Norway, demonstrating the ReWTS ensemble’s superiority. It consistently outperforms the global model in terms of mean squared forecasting error across various model architectures by 10-70% on both datasets, notably exhibiting greater resilience to outliers. We further explore the generalizability of ReWTS by applying it to four publicly available datasets. The results indicate that ReWTS is particularly valuable in non-stationary, heterogeneous environments with frequent concept drift, as exemplified by the process industry datasets. This approach shows promise in developing automatic, adaptable forecasting models for decision-making and control systems in process industries and other complex systems.


21 November 2019 in arXiv
Verified
Preprint
Open access
PDF file
EBEivind Bøhn
Eivind Bøhn
SMSigne Moe
Signe Moe
TJTor Arne Johansen
Tor Arne Johansen
Reinforcement Learning in domains with sparse rewards is a difficult problem, and a large part of the training process is often spent searching the state space in a more or less random fashion for any learning signals. For control problems, we often have some controller readily available which might be suboptimal but nevertheless solves the problem to some degree. This controller can be used to guide the initial exploration phase of the learning controller towards reward yielding states, reducing the time before refinement of a viable policy can be initiated. In our work, the agent is guided through an auxiliary behaviour cloning loss which is made conditional on a Q-filter, i.e. it is only applied in situations where the critic deems the guiding controller to be better than the agent. The Q-filter provides a natural way to adjust the guidance throughout the training process, allowing the agent to exceed the guiding controller in a manner that is adaptive to the task at hand and the proficiency of the guiding controller. The contribution of this paper lies in identifying shortcomings in previously proposed implementations of the Q-filter concept, and in suggesting some ways these issues can be mitigated. These modifications are tested on the OpenAI Gym Fetch environments, showing clear improvements in adaptivity and yielding increased performance in all robotic environments tested.