Björn Lütjens

Björn Lütjens


Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
15 February 2021 in IEEE Transactions on Neural Networks and Learning Systems
Verified
Journal Article
Closed access
MEMichael Everett
Michael Everett
BLBjörn Lütjens
Björn Lütjens
JHJonathan P. How
Jonathan P. How
Deep neural network-based systems are now state-of-the-art in many robotics tasks, but their application in safety-critical domains remains dangerous without formal guarantees on network robustness. Small perturbations to sensor inputs (from noise or adversarial examples) are often enough to change network-based decisions, which was recently shown to cause an autonomous vehicle to swerve into another lane. In light of these dangers, numerous algorithms have been developed as defensive mechanisms from these adversarial inputs, some of which provide formal robustness guarantees or certificates. This work leverages research on certified adversarial robustness to develop an online certifiably robust for deep reinforcement learning algorithms. The proposed defense computes guaranteed lower bounds on state-action values during execution to identify and choose a robust action under a worst case deviation in input space due to possible adversaries or noise. Moreover, the resulting policy comes with a certificate of solution quality, even though the true state and optimal action are unknown to the certifier due to the perturbations. The approach is demonstrated on a deep Q-network (DQN) policy and is shown to increase robustness to noise and adversaries in pedestrian collision avoidance scenarios, a classic control task, and Atari Pong. This article extends our prior work with new performance guarantees, extensions to other reinforcement learning algorithms, expanded results aggregated across more scenarios, an extension into scenarios with adversarial behavior, comparisons with a more computationally expensive method, and visualizations that provide intuition about the robustness algorithm.

26 August 2025 in Journal of Advances in Modeling Earth Systems
Verified
Journal Article
Open access
BLBjörn Lütjens
Björn Lütjens
RFRaffaele Ferrari
Raffaele Ferrari
DWDuncan Watson‐Parris
Duncan Watson‐Parris
NSNoelle E. Selin
Noelle E. Selin
Full‐complexity Earth system models (ESMs) are computationally very expensive, limiting their use in exploring the climate outcomes of multiple emission pathways. More efficient emulators that approximate ESMs can directly map emissions onto climate outcomes, and benchmarks are being used to evaluate their accuracy on standardized tasks and data sets. We investigate a popular benchmark in data‐driven climate emulation, ClimateBench, on which deep learning‐based emulators are currently achieving the best performance. We compare these deep learning emulators with a linear regression‐based emulator, akin to pattern scaling, and show that it outperforms the incumbent 100M‐parameter deep learning foundation model, ClimaX, on 3 out of 4 regionally resolved climate variables, notably surface temperature and precipitation. While emulating surface temperature is expected to be predominantly linear, this result is surprising for emulating precipitation. Precipitation is a much more noisy variable, and we show that deep learning emulators can overfit to internal variability noise at low frequencies, degrading their performance in comparison to a linear emulator. We address the issue of overfitting by increasing the number of climate simulations per emission pathway (from 3 to 50) and updating the benchmark targets with the respective ensemble averages from the MPI‐ESM1.2‐LR model. Using the new targets, we show that linear pattern scaling continues to be more accurate on temperature, but can be outperformed by a deep learning‐based technique for emulating precipitation. We publish our code and data at https://github.com/blutjens/climate‐emulator.

25 July 2025 in Journal of Advances in Modeling Earth Systems
Verified
Journal Article
Open access
SBSuyash Bire
Suyash Bire
BLBjörn Lütjens
Björn Lütjens
KAKamyar Azizzadenesheli
Kamyar Azizzadenesheli
AAAnimashree Anandkumar
Animashree Anandkumar
CHChris Hill
Chris Hill
A data‐driven emulator for the baroclinic double gyre ocean simulation is presented in this study. Traditional numerical simulations using partial differential equations (PDEs) often require substantial computational resources, hindering real‐time applications and inhibiting model scalability. This study presents a novel approach employing Fourier neural operators to address these challenges in an idealized double‐gyre ocean simulation. We propose a deep learning approach capable of learning the underlying dynamics of the ocean system, complementing the classical methods. Additionally, we show how Fourier neural operators allow us to train the network at one resolution and generate ensembles at a different resolution. We find that there is an intermediate time scale where the prediction skill is maximized.

19 November 2024 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
BLBjörn Lütjens
Björn Lütjens
BLBrandon Leshchinskiy
Brandon Leshchinskiy
OBOcéane Boulais
Océane Boulais
Farrukh Ahmed ChishtieFarrukh Ahmed Chishtie
Farrukh Ahmed Chishtie
Natalia Diaz RodriguezNatalia Diaz Rodriguez
Natalia Diaz Rodriguez
DNDava Newman
Dava Newman
Deep generative vision models are now able to synthesize realistic-looking satellite imagery. But, the possibility of hallucinations prevents their adoption for risk-sensitive applications, such as generating materials for communicating climate change. To demonstrate this issue, we train a generative adversarial network (pix2pixHD) to create synthetic satellite imagery of future flooding and reforestation events. We find that a pure deep learning-based model can generate photorealistic flood visualizations but hallucinates floods at locations that were not susceptible to flooding. To address this issue, we propose to condition and evaluate generative vision models on segmentation maps of physics-based flood models. We show that our physics-conditioned model outperforms the pure deep learning-based model and a handcrafted baseline. We evaluate the generalization capability of our method to different remote sensing data and different climate-related events (reforestation). We publish our code and dataset which includes the data for a third case study of melting Arctic sea ice and >30,000 labeled HD image triplets - or the equivalent of 5.5 million images at 128x128 pixels - for segmentation guided image-to-image translation in Earth observation. Code and data is available at github.com/blutjens/eieearth-public.

21 February 2023 in arXiv
Verified
Preprint
Open access
PDF file
BLBjörn Lütjens
Björn Lütjens
BLBrandon Leshchinskiy
Brandon Leshchinskiy
CRChristian Requena-Mesa
Christian Requena-Mesa
FCFarrukh Chishtie
Farrukh Chishtie
NDNatalia Díaz-Rodríguez
Natalia Díaz-Rodríguez
DNDava Newman
Dava Newman
As climate change increases the intensity of natural disasters, society needs better tools for adaptation. Floods, for example, are the most frequent natural disaster, and better tools for flood risk communication could increase the support for flood-resilient infrastructure development. Our work aims to enable more visual communication of large-scale climate impacts via visualizing the output of coastal flood models as satellite imagery. We propose the first deep learning pipeline to ensure physical-consistency in synthetic visual satellite imagery. We advanced a state-of-the-art GAN called pix2pixHD, such that it produces imagery that is physically-consistent with the output of an expert-validated storm surge model (NOAA SLOSH). By evaluating the imagery relative to physics-based flood maps, we find that our proposed framework outperforms baseline models in both physical-consistency and photorealism. We envision our work to be the first step towards a global visualization of how the climate challenge will shape our landscape. Continuing on this path, we show that the proposed pipeline generalizes to visualize reforestation. We also publish a dataset of over 25k labelled image-triplets to study image-to-image translation in Earth observation.

12 February 2021 in arXiv
Verified
Preprint
Open access
PDF file
BLBjörn Lütjens
Björn Lütjens
BLBrandon Leshchinskiy
Brandon Leshchinskiy
CRChristian Requena-Mesa
Christian Requena-Mesa
FCFarrukh Chishtie
Farrukh Chishtie
NDNatalia Díaz-Rodriguez
Natalia Díaz-Rodriguez
CRChedy Raïssi
Chedy Raïssi
As climate change increases the intensity of natural disasters, society needs better tools for adaptation. Floods, for example, are the most frequent natural disaster, but during hurricanes the area is largely covered by clouds and emergency managers must rely on nonintuitive flood visualizations for mission planning. To assist these emergency managers, we have created a deep learning pipeline that generates visual satellite images of current and future coastal flooding. We advanced a state-of-the-art GAN called pix2pixHD, such that it produces imagery that is physically-consistent with the output of an expert-validated storm surge model (NOAA SLOSH). By evaluating the imagery relative to physics-based flood maps, we find that our proposed framework outperforms baseline models in both physical-consistency and photorealism. While this work focused on the visualization of coastal floods, we envision the creation of a global visualization of how climate change will shape our earth.