Stefan Heinen

Stefan Heinen

Auto-generated profile, based on publicly available information

Stefan Heinen

Empa Swiss Federal Laboratories for Materials Science and Technology Dübendorf Switzerland

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
28 October 2020 in Machine Learning: Science and Technology
Verified
Journal Article
Open access
GRGuido Falk Von Rudorff
Guido Falk Von Rudorff
SHStefan N Heinen
Stefan N Heinen
MBMarco Bragato
Marco Bragato
OLO Anatole von Lilienfeld
O Anatole von Lilienfeld
Reaction barriers are a crucial ingredient for first principles based computational retro-synthesis efforts as well as for comprehensive reactivity assessments throughout chemical compound space. While extensive databases of experimental results exist, modern quantum machine learning applications require atomistic details which can only be obtained from quantum chemistry protocols. For competing E2 and S N 2 reaction channels we report 4,466 transition state and 143,200 reactant complex geometries and energies at MP2/6-311G(d) and single point DF-LCCSD/cc-pVTZ level of theory, respectively, covering the chemical compound space spanned by the substituents NO2, CN, CH3, and NH2 and early halogens (F, Cl, Br) and hydrogen as nucleophiles and early halogens as leaving groups. Reactants are chosen such that the activation energy of the competing E2 and S N 2 reactions are of comparable magnitude. The correct concerted motion for each of the one-step reactions has been validated for all transition states. We demonstrate how quantum machine learning models can support data set extension, and discuss the distribution of key internal coordinates of the transition states.

10 August 2021 in The Journal of Chemical Physics
Verified
Journal Article
Open access
PDF file
SHStefan Heinen
Stefan Heinen
GRGuido Falk Von Rudorff
Guido Falk Von Rudorff
OLO. Anatole von Lilienfeld
O. Anatole von Lilienfeld
The interplay of kinetics and thermodynamics governs reactive processes, and their control is key in synthesis efforts. While sophisticated numerical methods for studying equilibrium states have well advanced, quantitative predictions of kinetic behavior remain challenging. We introduce a reactant-to-barrier (R2B) machine learning model that rapidly and accurately infers activation energies and transition state geometries throughout the chemical compound space. R2B exhibits improving accuracy as training set sizes grow and requires as input solely the molecular graph of the reactant and the information of the reaction type. We provide numerical evidence for the applicability of R2B for two competing text-book reactions relevant to organic synthesis, E2 and SN2, trained and tested on chemically diverse quantum data from the literature. After training on 1–1.8k examples, R2B predicts activation energies on average within less than 2.5 kcal/mol with respect to the coupled-cluster singles doubles reference within milliseconds. Principal component analysis of kernel matrices reveals the hierarchy of the multiple scales underpinning reactivity in chemical space: Nucleophiles and leaving groups, substituents, and pairwise substituent combinations correspond to systematic lowering of eigenvalues. Analysis of R2B based predictions of ∼11.5k E2 and SN2 barriers in the gas-phase for previously undocumented reactants indicates that on average, E2 is favored in 75% of all cases and that SN2 becomes likely for chlorine as nucleophile/leaving group and for substituents consisting of hydrogen or electron-withdrawing groups. Experimental reaction design from first principles is enabled due to R2B, which is demonstrated by the construction of decision trees. Numerical R2B based results for interatomic distances and angles of reactant and transition state geometries suggest that Hammond’s postulate is applicable to SN2, but not to E2.

18 March 2020 in Machine Learning: Science and Technology
Verified
Journal Article
Open access
SHStefan Heinen
Stefan Heinen
MSMax Schwilk
Max Schwilk
GRGuido Falk Von Rudorff
Guido Falk Von Rudorff
OLO Anatole von Lilienfeld
O Anatole von Lilienfeld
Computational quantum mechanics based molecular and materials design campaigns consume increasingly more high-performance computer resources, making improved job scheduling efficiency desirable in order to reduce carbon footprint or wasteful spending. We introduce quantum machine learning (QML) models of the computational cost of common quantum chemistry tasks. For 2D nonlinear toy systems, single point, geometry optimization, and transition state calculations the out of sample prediction error of QML models of wall times decays systematically with training set size. We present numerical evidence for a toy system containing two functions and three commonly used optimizer and for thousands of organic molecular systems including closed and open shell equilibrium structures, as well as transition states. Levels of electronic structure theory considered include B3LYP/def2-TZVP, MP2/6-311G(d), local CCSD(T)/VTZ-F12, CASSCF/VDZ-F12, and MRCISD+Q-F12/VDZ-F12. In comparison to conventional indiscriminate job treatment, QML based wall time predictions significantly improve job scheduling efficiency for all tasks after training on just thousands of molecules. Resulting reductions in CPU time overhead range from 10% to 90%.

18 July 2023 in The Journal of Chemical Physics
Verified
Journal Article
Open access
PDF file
DKDanish Khan
Danish Khan
SHStefan Heinen
Stefan Heinen
OLO. Anatole von Lilienfeld
O. Anatole von Lilienfeld
The feature vector mapping used to represent chemical systems is a key factor governing the superior data efficiency of kernel based quantum machine learning (QML) models applicable throughout chemical compound space. Unfortunately, the most accurate representations require a high dimensional feature mapping, thereby imposing a considerable computational burden on model training and use. We introduce compact yet accurate, linear scaling QML representations based on atomic Gaussian many-body distribution functionals (MBDF) and their derivatives. Weighted density functions of MBDF values are used as global representations that are constant in size, i.e., invariant with respect to the number of atoms. We report predictive performance and training data efficiency that is competitive with state-of-the-art for two diverse datasets of organic molecules, QM9 and QMugs. Generalization capability has been investigated for atomization energies, highest occupied molecular orbital–lowest unoccupied molecular orbital eigenvalues and gap, internal energies at 0 K, zero point vibrational energies, dipole moment norm, static isotropic polarizability, and heat capacity as encoded in QM9. MBDF based QM9 performance lowers the optimal Pareto front spanned between sampling and training cost to compute node minutes, effectively sampling chemical compound space with chemical accuracy at a sampling rate of ∼48 molecules per core second.

12 December 2022 in The Journal of Chemical Physics
Verified
Journal Article
Open access
PDF file
SHStefan Niklaus Heinen
Stefan Niklaus Heinen
GRGuido Falk Von Rudorff
Guido Falk Von Rudorff
OLO. Anatole von Lilienfeld
O. Anatole von Lilienfeld
We use energies and forces predicted within response operator based quantum machine learning (OQML) to perform geometry optimization and transition state search calculations with legacy optimizers but without the need for subsequent re-optimization with quantum chemistry methods.For randomly sampled initial coordinates of small organic query molecules we report systematic improvement of equilibrium and transition state geometry output as training set sizes increase.Out-of-sample S$_\mathrm{N}$2 reactant complexes and transition state geometries have been predicted using the LBFGS and the QST2 algorithm with an RMSD of 0.16 and 0.4 \r{A} --- after training on up to 200 reactant complexes relaxations and transition state search trajectories from the QMrxn20 data-set, respectively.For geometry optimizations, we have also considered relaxation paths up to 5'595 constitutional isomers with sum formula C$_7$H$_{10}$O$_2$ from the QM9-database. %Use of resulting OQML models within an LBFGS optimizer produces coordinates for the remaining test set with an RMSD of 0.15~\r{A} from reference.Using the resulting OQML models with an LBFGS optimizer reproduces the minimum geometry with an RMSD of 0.14~\r{A} only using $\sim$6000 training points obtained from normal mode sampling along the optimization paths of the training compounds without the need foractive learning.For converged equilibrium and transition state geometries subsequent vibrational normal mode frequency analysis indicates deviation from MP2 reference results by on average 14 and 26\,cm$^{-1}$, respectively.The success rate for reaching convergence, however, improves systematically with training set size, underscoring OQML's potential for universal applicability.

1 June 2024 in Machine Learning: Science and Technology
Verified
Journal Article
Open access
SHStefan Heinen
Stefan Heinen
DKDanish Khan
Danish Khan
GRGuido Falk von Rudorff
Guido Falk von Rudorff
KKKonstantin Karandashev
Konstantin Karandashev
DADaniel Jose Arismendi Arrieta
Daniel Jose Arismendi Arrieta
OLO Anatole von Lilienfeld
O Anatole von Lilienfeld
For many machine learning applications in science, data acquisition, not training, is the bottleneck even when avoiding experiments and relying on computation and simulation. Correspondingly, and in order to reduce cost and carbon footprint, training data efficiency is key. We introduce minimal multilevel machine learning (M3L) which optimizes training data set sizes using a loss function at multiple levels of reference data in order to minimize a combination of prediction error with overall training data acquisition costs (as measured by computational wall-times). Numerical evidence has been obtained for calculated atomization energies and electron affinities of thousands of organic molecules at various levels of theory including HF, MP2, DLPNO-CCSD(T), DFHFCABS, PNOMP2F12, and PNOCCSD(T)F12, and treating them with basis sets TZ, cc-pVTZ, and AVTZ-F12. Our M3L benchmarks for reaching chemical accuracy in distinct chemical compound sub-spaces indicate substantial computational cost reductions by factors of ∼1.01, 1.1, 3.8, 13.8, and 25.8 when compared to heuristic sub-optimal multilevel machine learning (M2L) for the data sets QM7b, QM9 LCCSD ( T ) , Electrolyte Genome Project, QM9 AE CCSD ( T ) , and QM9 EA CCSD ( T ) , respectively. Furthermore, we use M2L to investigate the performance for 76 density functionals when used within multilevel learning and building on the following levels drawn from the hierarchy of Jacobs Ladder: LDA, GGA, mGGA, and hybrid functionals. Within M2L and the molecules considered, mGGAs do not provide any noticeable advantage over GGAs. Among the functionals considered and in combination with LDA, the three on average top performing GGA and Hybrid levels for atomization energies on QM9 using M3L correspond respectively to PW91, KT2, B97D, and τ-HCTH, B3LYP ∗ (VWN5), and TPSSH.