We combine the high dimensional model representation (HDMR) idea of Rabitz and co-workers [J. Phys. Chem. 110, 2474 (2006)] with neural network (NN) fits to obtain an effective means of building multidimensional potentials. We verify that it is possible to determine an accurate many-dimensional potential by doing low dimensional fits. The final potential is a sum of terms each of which depends on a subset of the coordinates. This form facilitates quantum dynamics calculations. We use NNs to represent HDMR component functions that minimize error mode term by mode term. This NN procedure makes it possible to construct high-order component functions which in turn enable us to determine a good potential. It is shown that the number of available potential points determines the order of the HDMR which should be used.
For molecules with more than three atoms, it is difficult to fit or interpolate a potential energy surface (PES) from a small number of (usually ab initio) energies at points. Many methods have been proposed in recent decades, each claiming a set of advantages. Unfortunately, there are few comparative studies. In this paper, we compare neural networks (NNs) with Gaussian process (GP) regression. We re-fit an accurate PES of formaldehyde and compare PES errors on the entire point set used to solve the vibrational Schrödinger equation, i.e., the only error that matters in quantum dynamics calculations. We also compare the vibrational spectra computed on the underlying reference PES and the NN and GP potential surfaces. The NN and GP surfaces are constructed with exactly the same points, and the corresponding spectra are computed with the same points and the same basis. The GP fitting error is lower, and the GP spectrum is more accurate. The best NN fits to 625/1250/2500 symmetry unique potential energy points have global PES root mean square errors (RMSEs) of 6.53/2.54/0.86 cm−1, whereas the best GP surfaces have RMSE values of 3.87/1.13/0.62 cm−1, respectively. When fitting 625 symmetry unique points, the error in the first 100 vibrational levels is only 0.06 cm−1 with the best GP fit, whereas the spectrum on the best NN PES has an error of 0.22 cm−1, with respect to the spectrum computed on the reference PES. This error is reduced to about 0.01 cm−1 when fitting 2500 points with either the NN or GP. We also find that the GP surface produces a relatively accurate spectrum when obtained based on as few as 313 points.
6 October 2014 in International Journal of Quantum Chemistry
Development and applications of neural network (NN)‐based approaches for representing potential energy surfaces (PES) of bound and reactive molecular systems are reviewed. Specifically, it is shown that when the density of ab initio points is low, NNs‐based potentials with multibody or multimode structure are advantageous for representing high‐dimensional PESs. Importantly, with an appropriate choice of the neuron activation function, PESs in the sum‐of‐products form are naturally obtained, thus addressing a bottleneck problem in quantum dynamics. The use of NN committees is also analyzed and it is shown that while they are able to reduce the fitting error, the reduction is limited by the nonrandom nature of the fitting error. The approaches described here are expected to be directly applicable in other areas of science and engineering where a functional form needs to be constructed in an unbiased way from sparse data.
16 December 2005 in The Journal of Physical Chemistry A
In recent years, we have been witnessing a paradigm shift in computational materials science. In fact, traditional methods, mostly developed in the second half of the XXth century, are being complemented, extended, and sometimes even completely replaced by faster, simpler, and often more accurate approaches. The new approaches, that we collectively label by machine learning, have their origins in the fields of informatics and artificial intelligence, but are making rapid inroads in all other branches of science. With this in mind, this Roadmap article, consisting of multiple contributions from experts across the field, discusses the use of machine learning in materials science, and share perspectives on current and future challenges in problems as diverse as the prediction of materials properties, the construction of force-fields, the development of exchange correlation functionals for density-functional theory, the solution of the many-body problem, and more. In spite of the already numerous and exciting success stories, we are just at the beginning of a long path that will reshape materials science for the many challenges of the XXIth century.