Shinichi Nakajima

Dr. Shinichi Nakajima

orcid

Research Focus & Metrics

Academic Career Length

18Years (2009-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
19 January 2021 in Physical Review Letters
Verified
Journal Article
Open access
PDF file
KNKim A. Nicoli
Kim A. Nicoli
CAChristopher J. Anders
Christopher J. Anders
LFLena Funcke
Lena Funcke
THTobias Hartung
Tobias Hartung
KJKarl Jansen
Karl Jansen
PSPaolo Stornati
Paolo Stornati
In this Letter, we demonstrate that applying deep generative machine learning models for lattice field theory is a promising route for solving problems where Markov chain Monte Carlo (MCMC) methods are problematic. More specifically, we show that generative models can be used to estimate the absolute value of the free energy, which is in contrast to existing MCMC-based methods, which are limited to only estimate free energy differences. We demonstrate the effectiveness of the proposed method for two-dimensional ϕ4 theory and compare it to MCMC-based methods in detailed numerical experiments.

10 February 2020 in Physical Review E
Verified
Journal Article
Closed access
PDF file
KNKim A. Nicoli
Kim A. Nicoli
SNShinichi Nakajima
Shinichi Nakajima
NSNils Strodthoff
Nils Strodthoff
WSWojciech Samek
Wojciech Samek
KMKlaus-Robert Müller
Klaus-Robert Müller
PKPan Kessel
Pan Kessel
We propose a general framework for the estimation of observables with generative neural samplers focusing on modern deep generative neural networks that provide an exact sampling probability. In this framework, we present asymptotically unbiased estimators for generic observables, including those that explicitly depend on the partition function such as free energy or entropy, and derive corresponding variance estimators. We demonstrate their practical applicability by numerical experiments for the two-dimensional Ising model which highlight the superiority over existing methods. Our approach greatly enhances the applicability of generative neural samplers to real-world physical systems.

8 December 2023 in Physical Review D
Verified
Journal Article
Open access
PDF file
KNKim A. Nicoli
Kim A. Nicoli
CAChristopher J. Anders
Christopher J. Anders
THTobias Hartung
Tobias Hartung
KJKarl Jansen
Karl Jansen
PKPan Kessel
Pan Kessel
SNShinichi Nakajima
Shinichi Nakajima
We study the consequences of mode-collapse of normalizing flows in the context of lattice field theory. Normalizing flows allow for independent sampling. For this reason, it is hoped that they can avoid the tunneling problem of local-update Markov Chain Monte Carlo algorithms for multimodal distributions. In this work, we first point out that the tunneling problem is also present for normalizing flows but is shifted from the sampling to the algorithm’s training phase. Specifically, normalizing flows often suffer from mode-collapse for which the training process assigns vanishingly low probability mass to relevant modes of the physical distribution. This may result in a significant bias when the flow is used as a sampler in a Markov-Chain or with importance sampling. We propose a metric to quantify the degree of mode-collapse and derive a bound on the resulting bias. Furthermore, we propose various mitigation strategies in particular in the context of estimating thermodynamic observables, such as the free energy.

27 September 2017 in IEEE Transactions on Neural Networks and Learning Systems
Verified
Journal Article
Closed access
NGNico Gornitz
Nico Gornitz
LLLuiz Alberto Lima
Luiz Alberto Lima
KMKlaus-Robert Müller
Klaus-Robert Müller
MKMarius Kloft
Marius Kloft
SNShinichi Nakajima
Shinichi Nakajima
We present ClusterSVDD, a methodology that unifies support vector data descriptions (SVDDs) and k-means clustering into a single formulation. This allows both methods to benefit from one another, i.e., by adding flexibility using multiple spheres for SVDDs and increasing anomaly resistance and flexibility through kernels to k-means. In particular, our approach leads to a new interpretation of k-means as a regularized mode seeking algorithm. The unifying formulation further allows for deriving new algorithms by transferring knowledge from one-class learning settings to clustering settings and vice versa. As a showcase, we derive a clustering method for structured data based on a one-class learning scenario. Additionally, our formulation can be solved via a particularly simple optimization scheme. We evaluate our approach empirically to highlight some of the proposed benefits on artificially generated data, as well as on real-world problems, and provide a Python software package comprising various implementations of primal and dual SVDD as well as our proposed ClusterSVDD.

1 May 2021 in Neural Networks
Verified
Journal Article
Closed access
VSVignesh Srinivasan
Vignesh Srinivasan
CRCsaba Rohrer
Csaba Rohrer
AMArturo Marban
Arturo Marban
KMKlaus-Robert Müller
Klaus-Robert Müller
WSWojciech Samek
Wojciech Samek
SNShinichi Nakajima
Shinichi Nakajima

15 April 2025 in Physical Review Letters
Verified
Journal Article
Closed access
ABAndrea Bulgarelli
Andrea Bulgarelli
ECElia Cellini
Elia Cellini
KJKarl Jansen
Karl Jansen
SKStefan Kühn
Stefan Kühn
ANAlessandro Nada
Alessandro Nada
MPMarco Panero
Marco Panero
We introduce a novel technique to numerically calculate Rényi entanglement entropies in lattice quantum field theory using generative models. We describe how flow-based approaches can be combined with the replica trick using a custom neural-network architecture around a lattice defect connecting two replicas. Numerical tests for the ϕ^{4} scalar field theory in two and three dimensions demonstrate that our technique outperforms state-of-the-art Monte Carlo calculations, and exhibit a promising scaling with the defect size.