Developing efficient deep learning model for predicting copolymer properties
We report data and topology selection methods for developing an efficient deep neural network (DNN) model that predicts sequenced-defined properties of polymers.
Chemistry↗
SEARCH · Engineering Papers
Results for “deep neural network”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
From lattice QCD to in-medium heavy-quark interactions via deep learning
Bottomonium states are key probes for experimental studies of the quark-gluon plasma (QGP) created in high-energy nuclear collisions. Theoretical models of bottomonium productions in high-energy nuclear collisions rely on the in-medium interactions between the bottom and antibottom quarks, which can be characterized by real (V R (T, r)) and imaginary (V I (T, r)) potentials, as functions of temperature and spatial separation. Recently, the masses and thermal widths of up to 3S and 2P bottomonium states in QGP were calculated using lattice quantum chromodynamics (LQCD). Starting from these LQCD results and through a novel application of deep neural network (DNN), here, we obtain model-independent results for V R (T, r) and V I (T, r). The temperature dependence of V R (T, r) was found to be very mild between T ≈ 0 - 330 MeV. Meanwhile, VI(T, r) shows rapid increase with T and r, which is much larger than the perturbation theory based expectations.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
Machine learning for nonintrusive model order reduction of the parametric inviscid transonic flow past an airfoil
Fluid flow in the transonic regime finds relevance in aerospace engineering, particularly in the design of commercial air transportation vehicles. Computational fluid dynamics models of transonic flow for aerospace applications are computationally expensive to solve because of the high degrees of freedom as well as the coupled nature of the conservation laws. While these issues pose a bottleneck for the use of such models in aerospace design, computational costs can be significantly minimized by constructing special, structure-preserving surrogate models called reduced-order models. In this work, we propose a machine learning method to construct reduced-order models via deep neural networks and we demonstrate its ability to preserve accuracy with a significantly lower computational cost. In addition, our machine learning methodology is physics-informed and constrained through the utilization of an interpretable encoding by way of proper orthogonal decomposition. Application to the inviscid transonic flow past the RAE2822 airfoil under varying freestream Mach numbers and angles of attack, as well as airfoil shape parameters with a deforming mesh, shows that the proposed approach adapts to high-dimensional parameter variation well. Notably, the proposed framework precludes the knowledge of numerical operators utilized in the data generation phase, thereby demonstrating its potential utility in the fast exploration of design space for diverse engineering applications. Comparison against a projection-based nonintrusive model order reduction method demonstrates that the proposed approach produces comparable accuracy and yet is orders of magnitude computationally cheap to evaluate, despite being agnostic to the physics of the problem.
97 MATHEMATICS AND COMPUTING↗
Deep learning for NLTE spectral opacities
Computer simulations of high energy density science experiments are computationally challenging, consisting of multiple physics calculations including radiation transport, hydrodynamics, atomic physics, nuclear reactions, laser–plasma interactions, and more. To simulate inertial confinement fusion (ICF) experiments at high fidelity, each of these physics calculations should be as detailed as possible. However, this quickly becomes too computationally expensive even for modern supercomputers, and thus many simplifying assumptions are made to reduce the required computational time. Much of the research has focused on acceleration techniques for the various packages in multiphysics codes. In this work, we explore a novel method for accelerating physics packages via machine learning. The non-local thermodynamic equilibrium (NLTE) package is one of the most expensive calculations in the simulations of indirect drive inertial confinement fusion, taking several tens of percent of the total wall clock time. We explore the use of machine learning to accelerate this package, by essentially replacing the physics calculation with a deep neural network that has been trained to emulate the physics code. Overall, we demonstrate the feasibility of this approach on a simple problem and perform a side-by-side comparison of the physics calculation and the neural network inline in an ICF Hohlraum simulation. We show that the neural network achieves a 10× speed up in NLTE computational time while achieving good agreement with the physics code for several quantities of interest.
70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
Machine learning accelerated turbulence modeling of transient flashing jets
We report modeling the sudden depressurization of superheated liquids through nozzles is a challenge because the pressure drop causes rapid flash boiling of the liquid. The resulting jet usually demonstrates a wide range of structures, including ligaments and droplets, due to both mechanical and thermodynamic effects. As the simulation comprises increasingly numerous phenomena, the computational cost begins to increase. One way to moderate the additional cost is to use machine learning surrogacy for specific elements of the calculation. This study presents a machine learning-assisted computational fluid dynamics approach for simulating the atomization of flashing liquids accounting for distinct stages, from primary atomization to secondary breakup to small droplets using the Σ - Y model coupled with the homogeneous relaxation model. Notably, the models for thermodynamic non-equilibrium (HRM) and Σ - Y are coupled, for the first time, with a deep neural network that simulates the turbulence quantities, which are then used in the prediction of superheated liquid jet atomization. The data-driven component of this method is used for turbulence modeling, avoiding the solution of the two-equation turbulence model typically used for Reynolds-averaged Navier-Stokes simulations for these problems. Both the accuracy and speed of the hybrid approach are evaluated, demonstrating adequate accuracy and at least 25% faster computational fluid dynamics simulations than the traditional approach. This acceleration suggests that perhaps additional components of the calculation could be replaced for even further benefit. Published under an exclusive license by AIP Publishing.
71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
A deep potential model with long-range electrostatic interactions
Machine learning models for the potential energy of multi-atomic systems, such as the deep potential (DP) model, make molecular simulations with the accuracy of quantum mechanical density functional theory possible at a cost only moderately higher than that of empirical force fields. However, the majority of these models lack explicit long-range interactions and fail to describe properties that derive from the Coulombic tail of the forces. To overcome this limitation, we extend the DP model by approximating the long-range electrostatic interaction between ions (nuclei + core electrons) and valence electrons with that of distributions of spherical Gaussian charges located at ionic and electronic sites. The latter are rigorously defined in terms of the centers of the maximally localized Wannier distributions, whose dependence on the local atomic environment is modeled accurately by a deep neural network. In the DP long-range (DPLR) model, the electrostatic energy of the Gaussian charge system is added to short-range interactions that are represented as in the standard DP model. The resulting potential energy surface is smooth and possesses analytical forces and virial. Missing effects in the standard DP scheme are recovered, improving on accuracy and predictive power. By including long-range electrostatics, DPLR correctly extrapolates to large systems the potential energy surface learned from quantum mechanical calculations on smaller systems. We illustrate the approach with three examples: the potential energy profile of the water dimer, the free energy of interaction of a water molecule with a liquid water slab, and the phonon dispersion curves of the NaCl crystal.
71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
Emerging opportunities for hybrid perovskite solar cells using machine learning
While there are several bottlenecks in hybrid organic–inorganic perovskite (HOIP) solar cell production steps, including composition screening, fabrication, material stability, and device performance, machine learning approaches have begun to tackle each of these issues in recent years. Different algorithms have successfully been adopted to solve the unique problems at each step of HOIP development. Specifically, high-throughput experimentation produces vast amount of training data required to effectively implement machine learning methods. Here, we present an overview of machine learning models, including linear regression, neural networks, deep learning, and statistical forecasting. Experimental examples from the literature, where machine learning is applied to HOIP composition screening, thin film fabrication, thin film characterization, and full device testing, are discussed. These paradigms give insights into the future of HOIP solar cell research. As databases expand and computational power improves, increasingly accurate predictions of the HOIP behavior are becoming possible.
Hering, Abigail R. (ORCID:0000000270806953)↗
Modeling the aqueous interface of amorphous TiO 2 using deep potential molecular dynamics
Amorphous titanium dioxide (a-TiO 2 ) is widely used as a coating material in applications such as electrochemistry and self-cleaning surfaces where its interface with water has a central role. However, little is known about the structures of the a-TiO 2 surface and aqueous interface, particularly at the microscopic level. In this work, we construct a model of the a-TiO 2 surface via a cut-melt-and-quench procedure based on molecular dynamics simulations with deep neural network potentials (DPs) trained on density functional theory data. After interfacing the a-TiO 2 surface with water, we investigate the structure and dynamics of the resulting system using a combination of DP-based molecular dynamics (DPMD) and ab initio molecular dynamics (AIMD) simulations. Both AIMD and DPMD simulations reveal that the distribution of water on the a-TiO 2 surface lacks distinct layers normally found at the aqueous interface of crystalline TiO 2 , leading to an ~10 times faster diffusion of water at the interface. Bridging hydroxyls (Ti 2 –O b H) resulting from water dissociation decay several times more slowly than terminal hydroxyls (Ti–O w H) due to fast Ti–O w H 2 → Ti–O w H proton exchange events. These results provide a basis for a detailed understanding of the properties of a-TiO 2 in electrochemical environments. Moreover, the procedure of generating the a-TiO 2 -interface employed here is generally applicable to studying the aqueous interfaces of amorphous metal oxides.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Computational synthesis of a new generation of 2D-based perovskite quantum materials
Perovskite-based optoelectronic devices have emerged as a promising energy source due to their potential for scalable production. This study introduces “perovskene,” a novel class of 2D materials derived from the ABC3-like perovskites, synthesized via a data-driven, high-throughput computational strategy. We harness machine learning and multitarget deep neural networks to systematically investigate the structure–property relations, paving the way for targeted material design and optimization in fields such as renewable energy, electronics, and catalysis. The characterization of over 1500 synthesized structures shows that more than 500 structures are stable, revealing properties such as ultra-low work function and large magnetic moment, underscoring the potential for advanced technological applications.
2D materials↗
Pressure-induced structural and dielectric changes in liquid water at room temperature
Understanding the pressure-dependent dielectric properties of water is crucial for a wide range of scientific and practical applications. In this study, we employ a deep neural network trained on density functional theory data to investigate the dielectric properties of liquid water at room temperature across a pressure range of 0.1–1000 MPa. We observe a nonlinear increase in the static dielectric constant ɛ 0 with increasing pressure, a trend that is qualitatively consistent with experimental observations. This increase in ɛ 0 is primarily attributed to the increase in water density under compression, which enhances collective dipole fluctuations within the hydrogen-bonding network as well as the dielectric response. Despite the increase in ɛ 0 , our results reveal a decrease in the Kirkwood correlation factor G K with increasing pressure. Furthermore, this decrease in G K is attributed to pressure-induced structural distortions in the hydrogen-bonding network, which weaken dipolar correlations by disrupting the ideal tetrahedral arrangement of water molecules.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Heterogeneous energetic material damage simulator (HEDS): A deep learning approach to simulate damage–sensitivity linkages
Damage in the microstructures of energetic materials (EMs), such as propellants and plastic bonded explosives (PBXs), can significantly alter their response to external loads. Both sensitization and desensitization can occur, causing concerns with safety and performance in the field; predictive models that connect damage and the sensitivity of EMs can enable design and provide confidence in their robustness and reliability. However, modeling of damage evolution is challenging for real microstructures of EMs; samples of damaged EMs are difficult to obtain, thereby hindering experiments and direct numerical simulations to determine the sensitivity of EMs at various stages of damage. Here, we develop an approach to generate synthetic, i.e., in silico produced, damaged microstructures for use in simulations to connect damage levels to sensitivity. The development of the present workflow to generate and impose varying levels of damage in microstructures, known as HEDS (Heterogeneous Energetic Material Damage Simulator), begins with a small set of images of damaged PBXs and combines a collection of deep neural network techniques to generate microstructures with varying levels of damage. By making the synthetic microstructures conform closely to those observed in available real, imaged microstructures, we develop an ensemble of damaged microstructures that can be used for in silico shock experiments. HEDS develops these microstructure ensembles as level set fields, which are directly employed in a sharp interface Eulerian hydrocode where shock simulations are performed to quantify the energy release rate from hotspot fields generated in the microstructure. These capabilities can be useful for the analysis and assessment of changes in the sensitivity of EMs and to design formulations that are less susceptible to damage-induced changes in sensitivity and performance.
Fang, Irene (ORCID:0009000844557122)↗
Anomalous nanoparticle surface diffusion in LCTEM is revealed by deep learning-assisted analysis
Significance Liquid cell transmission electron microscopy (LCTEM) is an emerging technique, which enables nanoscale visualization and tracking of single nanoparticles near interfaces with unprecedented spatial resolution. Here, we studied the diffusion of nanoparticles in LCTEM experiments using techniques powered by deep neural networks and statistical tests. We observed two underlying regimes of diffusive behavior which are governed by the interaction of the electron beam, the nanoparticle, the nearby substrate, and the liquid environment. This understanding forms the foundation to use LCTEM for single-nanoparticle tracking for a broad range of nanoparticles, interfaces, and liquids.
Jamali, Vida↗
Probing the self-ionization of liquid water with ab initio deep potential molecular dynamics
The chemical equilibrium between self-ionized and molecular water dictates the acid–base chemistry in aqueous solutions, yet understanding the microscopic mechanisms of water self-ionization remains experimentally and computationally challenging. Herein, Density Functional Theory (DFT)–based deep neural network (DNN) potentials are combined with enhanced sampling techniques and a global acid–base collective variable to perform extensive atomistic simulations of water self-ionization for model systems of increasing size. The explicit inclusion of long-range electrostatic interactions in the DNN potential is found to be crucial to accurately reproduce the DFT free energy profile of solvated water ion pairs in small (64 and 128 H 2 O) cells. The reversible work to separate the hydroxide and hydronium to a distance S is found to converge for simulation cells containing more than 500 H 2 O, and a distance of ∼ 8 Å is the threshold beyond which the work to further separate the two ions becomes approximately zero. The slow convergence of the potential of mean force with system size is related to a restructuring of water and an increase of the local order around the water ions. Calculation of the dissociation equilibrium constant illustrates the key role of long-range electrostatics and entropic effects in the water autoionization process.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Data-based filtered dissipation rate modelling for multi-modal turbulent combustion: evaluating a priori model generalizability
Manifold-based models offer a computationally efficient alternative to directly transporting the thermochemical state in computational simulations of turbulent reacting flows, projecting the high-dimensional thermochemical state-space onto a low-dimensional manifold. Recent efforts have yielded a manifold-based model applicable to multi-modal combustion, enabling reconstruction of the thermochemical state from solutions to two-dimensional manifold equations in mixture fraction and generalized progress variable that are parameterised by three scalar dissipation rates. In coarse-grained simulations such as Large Eddy Simulation (LES), closure of the multi-modal manifold equations and subfilter variances/covariance requires closure of three filtered scalar dissipation rates. Here, the present work adopts a data-based approach, providing closure for the three filtered scalar dissipation rates via deep neural networks (DNNs). High-fidelity datasets corresponding to an autoigniting n-dodecane jet flame and a bluff body swirl-stabilized confined lifted spray flame of two aviation fuels (Jet-A and C1) with different ignition propensities are leveraged to generate training data that spans a diverse range of thermodynamic conditions and combustion modes, including low- and high-temperature ignition regimes in addition to premixed and nonpremixed behaviour. A final DNN model is trained to enforce inherent physical constraints by learning nonlinear functional transformations of the three filtered scalar dissipation rates. The generalizability of this constrained DNN model is demonstrated a priori via conditional statistics evaluated on the lifted spray flame with C1–a configuration that had not been included in the training data. Excellent DNN agreement with conditional DNS statistics is observed, and integrated gradients are computed to identify the most sensitive input variables. The similarity of the marginal PDFs of the most informative input variables and outputs across configurations are quantified via the Wasserstein metric, demonstrating that data-based models may successfully generalize to unseen parametric conditions so long as the most informative input variables share similar distributions across training and testing datasets.
Data-based modelling↗
Application of machine learning for the estimation of electron energy distribution from optical emission spectra
Abstract This paper discusses the use of probabilistic deep neural networks for the prediction of the electron energy probability function in low-temperature non-thermal plasmas. The neural networks are trained using optical emission spectroscopy and Langmuir probe measurements, with the goal of providing a reliable estimate of the electron energy probability function solely from optical emission data. The performance of both non-Bayesian and Bayesian networks is evaluated. It is found that Bayesian models are preferable as they assign a higher level of uncertainty to their prediction especially when the dataset used to train them is small. This work describes one of the many potential applications of machine learning in plasma science and technology.
Physics↗
A data-driven approach to real-time vertical position estimation for NSTX-U vertical stability control
In this paper, a database of 77 996 plasma equilibrium reconstructions from 727 discharges during the initial operation of the NSTX-U spherical tokamak is analyzed to develop a statistically robust model of the plasma vertical position for real-time control. A variety of regression models are developed and tested, ranging in complexity from linear models to deep neural networks, and including input signals ranging from the four pairs of flux loops used historically on NSTX-U up to the full set of 389 real-time signals available to the plasma control system. A linear model based on 140 real-time magnetics signals is found to offer excellent accuracy, with a coefficient of determination R 2 = 0.906. The robustness of this model to limited training data, new operating scenarios, and signal errors is tested, and a procedure is demonstrated to tune the model parameters to optimize its robustness. A time-dependent plasma equilibrium solver, TokaMaker, is used to simulate vertical stability control in NSTX-U, demonstrating that it should be possible to iteratively tune the parameters of a linear vertical position model to stabilize both positive and negative triangularity plasmas in future experiments.
magnetic diagnostics↗
Machine learning-based real-time kinetic profile reconstruction in DIII-D
Abstract Kinetic equilibrium reconstruction plays a vital role in the physical analysis of plasma stability and control in fusion tokamaks. However, the traditional approach is subjective and prone to human biases. To address this, the consistent automatic kinetic equilibrium reconstruction (CAKE) method was introduced, providing objective results. Nonetheless, its offline nature limits its application in real-time plasma control systems (PCSs). To address this limitation, we present RTCAKENN, a machine learning model that approximates 7 CAKE-level output profiles, namely pressure, inverse q , toroidal current density, electron temperature and density, carbon ion impurity temperature and rotation profiles, using real-time available inputs. The deep neural network consists of an encoder layer, where the scalars and interdependent inputs such as plasma boundary coordinates and motional Stark effect data are encoded using multi-layer perceptrons (MLPs), while profile inputs are encoded by 1D convolutional layers. The encoded data is passed through a MLP for latent feature extraction, before being decoded in the decoding layers, which consist of upsampling and convolutional layers. RTCAKENN has been implemented in the DIII-D PCS and our model achieves accuracy comparable to CAKE and surpasses existing real-time alternatives. Through clever dropout training, RTCAKENN exhibits robustness and can operate even in the absence of Thomson scattering data or charge exchange recombination data. It executes in under 8 ms in the real-time environment, enabling future application in real-time control and analysis.
70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
Deep-Learning based Reconstruction of the Shower Maximum $X_{\mathrm{max}}$ using the Water-Cherenkov Detectors of the Pierre Auger Observatory
The atmospheric depth of the air shower maximum X max is an observable commonly used for the determination of the nuclear mass composition of ultra-high energy cosmic rays. Direct measurements of X max are performed using observations of the longitudinal shower development with fluorescence telescopes. At the same time, several methods have been proposed for an indirect estimation of X max from the characteristics of the shower particles registered with surface detector arrays. In this paper, we present a deep neural network (DNN) for the estimation of X max . The reconstruction relies on the signals induced by shower particles in the ground based water-Cherenkov detectors of the Pierre Auger Observatory. The network architecture features recurrent long short-term memory layers to process the temporal structure of signals and hexagonal convolutions to exploit the symmetry of the surface detector array. We evaluate the performance of the network using air showers simulated with three different hadronic interaction models. Thereafter, we account for long-term detector effects and calibrate the reconstructed X max using fluorescence measurements. Finally, we show that the event-by-event resolution in the reconstruction of the shower maximum improves with increasing shower energy and reaches less than 25 g/cm 2 at energies above 2 × 10 19 eV.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗