Silicon nitride crystallization study via molecular dynamics and the ultra-fast 3-body (UF3) machine-learned interatomic potential
Explore the source record for details and available documents.
Janicki, Tesia Danielle↗
SEARCH · Engineering Papers
Results for “learning dynamics”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Dynamic Spectrum Allocation in Urban Air Transportation System via Deep Reinforcement Learning
The emerging concepts of Urban Air Mobility (UAM) and Advanced Air Mobility (AAM) open a new paradigm for urban air transportation. A big challenge is that these new aerial vehicles will quickly saturate the already crowded aviation spectrum, which is an essential resource to ensure reliable communications for safe operations. In this paper, we consider an air transportation system where multiple aerial vehicles are operated to transport passengers or cargo from different sources to destinations along their pre-defined paths. During the flight, the minimum communication Quality of Service (QoS) requirement must be achieved to ensure flight safety. Our objective is to minimize the average mission completion time by jointly optimizing the velocity selection and spectrum allocation for all aerial vehicles. We formulate the optimization problem as a multi-stage Markov Decision Process (MDP) where the optimization variables are coupled together. A multi-agent Deep Reinforcement Learning (DRL) based solution is proposed where Value Decomposition Networks (VDN) algorithm is utilized to take discrete actions. Additionally, we propose a heuristic greedy algorithm as a baseline solution. Simulation results show that our learning based solution outperforms the heuristic greedy algorithm and another Orthogonal Multiple Access (OMA) solution in minimizing the mission completion time.
Ruixuan Han↗
Dynamic Spectrum Allocation in Urban Air Transportation System via Deep Reinforcement Learning
The emerging concepts of Urban Air Mobility (UAM) and Advanced Air Mobility (AAM) open a new paradigm for urban air transportation. A big challenge is that these new aerial vehicles will quickly saturate the already crowded aviation spectrum, which is an essential resource to ensure reliable communications for safe operations. In this paper, we consider an air transportation system where multiple aerial vehicles are operated to transport passengers or cargo from different sources to destinations along their pre-defined paths. During the flight, the minimum communication Quality of Service (QoS) requirement must be achieved to ensure flight safety. Our objective is to minimize the average mission completion time by jointly optimizing the velocity selection and spectrum allocation for all aerial vehicles. We formulate the optimization problem as a multi-stage Markov Decision Process (MDP) where the optimization variables are coupled together. A multi-agent Deep Reinforcement Learning (DRL) based solution is proposed where Value Decomposition Networks (VDN) algorithm is utilized to take discrete actions. Additionally, we propose a heuristic greedy algorithm as a baseline solution. Simulation results show that our learning based solution outperforms the heuristic greedy algorithm and another Orthogonal Multiple Access (OMA) solution in minimizing the mission completion time.
Ruixuan Han↗
Machine learning approach for the solution of the Riemann problem in fluid dynamics
Explore the source record for details and available documents.
Mathematics↗
Learning from Hydrodynamics Simulations with Mass Constraints for Density Reconstruction in Dynamic Tomography
Explore the source record for details and available documents.
Klasky, Marc Louis↗
Arrested Phase Separation in Double-Exchange Models: Large-Scale Simulation Enabled by Machine Learning
In this work, we present large-scale dynamical simulations of electronic phase separation in the single-band double-exchange model based on deep-learning neural-network potentials trained from small-size exact diagonalization solutions. We uncover an intriguing correlation-induced freezing behavior as doped holes are segregated from half filled insulating background during equilibration. While the aggregation of holes is stabilized by the formation of ferromagnetic clusters through Hund’s coupling between charge carriers and local magnetic moments, this stabilization also creates confining potentials for holes when antiferromagnetic spin-spin correlation is well developed in the background. The dramatically reduced mobility of the self-trapped holes prematurely disrupts further growth of the ferromagnetic clusters, leading to an arrested phase separation. Implications of our findings for phase separation dynamics in materials that exhibit colossal magnetoresistance effect are discussed.
75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
Theoretical Development of Controller Transfer applied to Dynamical Systems
Data-driven control strategies suffer from the necessity of training and its associated computational time and cost. This motivates the continuous increase of popularity of transfer learning based methods. In this paper, we have investigated transfer learning in the context of controller for dynamical systems. First, we have derived conditions under which controller can be transferred between two linear dynamical systems. Furthermore, we have introduced a novel algorithm to design the transferable and non-transferable control components for linear systems. Secondly, we have derived conditions under which a stabilizing controller can be transferred between two different nonlinear dynamical systems. Furthermore, we have used the notion of zero dynamics to transform the nonlinear dynamics into global normal form, to derive the transferability conditions on the controller. Finally, we have numerically evaluated the performance of our transfer learning based methods for two sets of example linear and nonlinear dynamical systems.
Chakraborty, Indrasis↗
Enabling probabilistic learning on manifolds through double diffusion maps
Here, we present a generative learning framework for probabilistic sampling that extends Probabilistic Learning on Manifolds (PLoM), which is designed to generate statistically consistent realizations of a random vector in a finite-dimensional Euclidean space, informed by a (representative) set of observations. In its original form, PLoM constructs a reduced-order probabilistic model by combining three main components: (a) kernel density estimation to approximate the underlying probability measure, (b) Diffusion Maps to characterize the manifold of the data, and (c) a reduced-order Itô Stochastic Differential Equation (ISDE) to sample from the learned distribution. However, its sampling dynamics are posed in the ambient space and the retained number of reduced coordinates is chosen by projection-reconstruction error. In practice, this often (i) requires more coordinates than the data’s intrinsic dimension to achieve stable sampling and (ii) lacks a smooth, basis-independent lifting back to the data domain; moreover, standard Diffusion Maps emphasize harmonic eigenfunctions and can miss non-harmonic latent structure. We address these limitations by decoupling geometry learning from sampling: a first Diffusion Maps pass identifies non-harmonic coordinates on which we formulate a full-order ISDE directly in the latent space, while Double Diffusion Maps captures multiscale geometric features and Geometric Harmonics (GH) learns a smooth lifting map to the ambient variables that is independent of the particular diffusion basis. This hybrid design preserves the system’s dynamical richness with a compact geometric representation and enables principled out-of-sample inference. The effectiveness and robustness of the proposed method are illustrated through two numerical studies: one based on data generated from two-dimensional Hermite polynomial functions and another based on high-fidelity simulations of a detonation wave in a reactive flow.
Double diffusion maps↗
Sub-grid scale model classification and blending through deep learning
In this article we detail the use of machine learning for spatio-temporally dynamic turbulence model classification and hybridization for large eddy simulations (LES) of turbulence. Here, our predictive framework is devised around the determination of local conditional probabilities for turbulence models that have varying underlying hypotheses. As a first deployment of this learning, we classify a point on our computational grid as that which requires the functional hypothesis, the structural hypothesis or no modelling at all. This ensures that the appropriate model is specified from a priori knowledge and an efficient balance of model characteristics is obtained in a particular flow computation. In addition, we also utilize the conditional-probability predictions of the same machine learning to blend turbulence models for another hybrid closure. Our test case for the demonstration of this concept is given by Kraichnan turbulence, which exhibits a strong interplay of enstrophy and energy cascades in the wavenumber domain. Our results indicate that the proposed methods lead to robust and stable closure and may potentially be used to combine the strengths of various models for complex flow phenomena prediction.
42 ENGINEERING↗
Heterogeneous Mixtures of Dictionary Functions to Approximate Subspace Invariance in Koopman Operators: Why Deep Koopman Operators Work
Abstract Koopman operators model nonlinear dynamics as a linear dynamic system acting on a nonlinear function as the state. This nonstandard state is often called a Koopman observable and is usually approximated numerically by a superposition of functions drawn from a dictionary . In a widely used algorithm, extended dynamic mode decomposition (EDMD), the dictionary functions are drawn from a fixed class of functions. Deep learning combined with EDMD has been used to learn novel dictionary functions in an algorithm called deep dynamic mode decomposition (deepDMD). The learned representation both (1) accurately models and (2) scales well with the dimension of the original nonlinear system. In this paper, we analyze the learned dictionaries from deepDMD and explore the theoretical basis for their strong performance. We explore State-Inclusive Logistic Lifting (SILL) dictionary functions to approximate Koopman observables. Error analysis of these dictionary functions show they satisfy a property of subspace approximation, which we define as uniform finite approximate closure. Typically, a Koopman dictionary’s nonlinear functions are homogeneous. In this paper, we discover that structured mixing of heterogeneous dictionary functions drawn from different classes of nonlinear functions achieve the same accuracy and dimensional scaling as the deep-learning-based deepDMD algorithm Yeung et al. ( In: 2019 American Control Conference (ACC), 2019). We specifically show this by building a heterogeneous dictionary comprised of SILL functions and conjunctive radial basis functions (RBFs). This mixed dictionary achieves similar accuracy and dimensional scaling to deepDMD with an order of magnitude reduction in parameters, while maintaining geometric interpretability. These results strengthen the viability of dictionary-based Koopman models to solving high-dimensional nonlinear learning problems.
Johnson, Charles A.↗
Machine learning–enabled identification of material phase transitions based on experimental data: Exploring collective dynamics in ferroelectric relaxors
Exploration of phase transitions and construction of associated phase diagrams are of fundamental importance for condensed matter physics and materials science alike, and remain the focus of extensive research for both theoretical and experimental studies. For the latter, comprehensive studies involving scattering, thermodynamics, and modeling are typically required. We present a new approach to data mining multiple realizations of collective dynamics, measured through piezoelectric relaxation studies, to identify the onset of a structural phase transition in nanometer-scale volumes, that is, the probed volume of an atomic force microscope tip. Machine learning is used to analyze the multidimensional data sets describing relaxation to voltage and thermal stimuli, producing the temperature-bias phase diagram for a relaxor crystal without the need to measure (or know) the order parameter. The suitability of the approach to determine the phase diagram is shown with simulations based on a two-dimensional Ising model. Finally, these results indicate that machine learning approaches can be used to determine phase transitions in ferroelectrics, providing a general, statistically significant, and robust approach toward determining the presence of critical regimes and phase boundaries.
36 MATERIALS SCIENCE↗
Development of a deep potential model for F and CF 2 etching of Si and SiO 2
An understanding of plasma-surface interactions at increasingly smaller scales is invaluable for the development of novel technologies and processing techniques. Molecular dynamics (MD) simulations can provide insights into atomic-scale interactions, though they are restricted by the availability of interatomic potentials. Machine learning methods, such as Deep Potential Molecular Dynamics (DeepMD), provide a systematic framework for the development of accurate and flexible ab initio-based models. In this work, we develop DeepMD models for the ion-enhanced etching of Si and SiO 2 by F and CF 2 radicals. We employ an active learning process to expand the data set on which the model is trained and demonstrate its effect on the model accuracy. The DeepMD results are compared to data from classical MD simulations and experiments. Physical sputtering yields of SiO 2 by Ar + ions show good agreement with previous simulation results using conventional interatomic potentials, though the predicted depth profiles are different. Etching yields are calculated as a function of ion energy and neutral to ion flux ratio for the Ar + ion-enhanced etching of SiO 2 and Si by F atoms, as well as for etching of SiO 2 by CF 2 radicals, showing reasonable agreement with experimental data. Finally, an ion-enhanced surface kinetic model is fitted to the DeepMD etch yields, and the fitted parameters are compared to quantities computed directly from DeepMD simulations. This study illustrates how molecular dynamics simulations using machine learning potentials can provide an accurate model of etching processes relevant to device manufacturing.
Kounis-Melas, Andreas [Princeton Univ., NJ (United↗
A novel machine learning-based optimization algorithm (ActivO) for accelerating simulation-driven engine design
A novel design optimization approach (ActivO) that employs an ensemble of machine learning algorithms is presented. The proposed approach is a surrogate-based scheme, where the predictions of a weak leaner and a strong learner are utilized within an active learning loop. The weak learner is used to identify promising regions within the design space to explore, while the strong learner is used to determine the exact location of the optimum within promising regions. For each design iteration, exploration is done by randomly selecting evaluation points within regions where the weak learner-predicted fitness is high. The global optimum obtained by using the strong learner as a surrogate is also evaluated to enable rapid convergence once the most promising region has been identified. First, the performance of ActivO was compared against five other optimizers on a cosine mixture function with 25 local optima and one global optimum. In the second problem, the objective was to minimize indicated specific fuel consumption of a compression-ignition internal combustion (IC) engine while adhering to desired constraints associated with in-cylinder pressure and emissions. In this work, the efficacy of the proposed approach is compared to that of a genetic algorithm, which is widely used within the internal combustion engine community for engine optimization, showing that ActivO reduces the number of function evaluations needed to reach the global optimum, and thereby time-to-design by 80%. Furthermore, the optimization of engine design parameters leads to savings of around 1.9% in energy consumption, while maintaining operability and acceptable pollutant emissions.
97 MATHEMATICS AND COMPUTING↗
Data Science Enabled Enabled Discovery of Superconductors (Final Progress Report)
This Final Technical Report describes efforts by 4 PIs at the University of Florida (Peter Hirschfeld, Richard Hennig, Greg Stewart and James Hamlin), over the period September 2019-August 2023, to use data science and machine learning techniques to discover new conventional superconductors. The PIs constructed a discovery loop with two theorists and two experimentalists to: develop algorithms to machine learn descriptors correlating strongly with the critical temperature Tc (PI's Peter Hirschfeld, UF Physics and Richard Hennig, UF Materials Science and En), synthesize and measure properties of promising materials, and feed back the knowledge gained into the prediction algorithm. This work was motivated by the theoretical prediction and experimental discovery of high-pressure, high-pressure hydride superconductors, and to find ways to recreate the high critical temperatures in these systems at ambient pressure. Highlights from the grant include: 1) a new equation for Tc in terms of moments of the electron-phonon spectral function, improving on the so-called Allen-Dynes equation (1975); 2) study of the metastable A15 superconductor Nb3Si, formed under explosive compression at ~1000GPa to determine the kinetic barrier to the ground state structure; 3) the development of ultra-fast machine-learned atomic potentials for molecular dynamics, and 4) the discovery of superconductivity at 19K in WB2 arising from metastable defect structures in the crystal.
75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
On-the-fly active learning of interpretable Bayesian force fields for atomistic rare events
Abstract Machine learned force fields typically require manual construction of training sets consisting of thousands of first principles calculations, which can result in low training efficiency and unpredictable errors when applied to structures not represented in the training set of the model. This severely limits the practical application of these models in systems with dynamics governed by important rare events, such as chemical reactions and diffusion. We present an adaptive Bayesian inference method for automating the training of interpretable, low-dimensional, and multi-element interatomic force fields using structures drawn on the fly from molecular dynamics simulations. Within an active learning framework, the internal uncertainty of a Gaussian process regression model is used to decide whether to accept the model prediction or to perform a first principles calculation to augment the training set of the model. The method is applied to a range of single- and multi-element systems and shown to achieve a favorable balance of accuracy and computational efficiency, while requiring a minimal amount of ab initio training data. We provide a fully open-source implementation of our method, as well as a procedure to map trained models to computationally efficient tabulated force fields.
36 MATERIALS SCIENCE↗
Mechanistic insights into superionic thioarsenate argyrodite solid electrolytes via machine learning interatomic potentials
The lithium argyrodite sulfide solid electrolyte Li 6 PS 5 Cl has attracted considerable interest for all-solid-state batteries owing to its high ionic conductivity, which can be further enhanced through ionic substitution. Although a variety of substitutions have been investigated, thioarsenate argyrodites remain comparatively underexplored. Here, we systematically investigate the phase stability and Li-ion conduction mechanisms in superionic Br-incorporated thioarsenate argyrodites using first-principles calculations and molecular dynamics simulations based on machine learning interatomic potentials (MLIPs). Systematic variation of S/Br site inversion reveals that an optimal degree of anion disorder significantly enhances inter-cage connectivity and facilitates long-range Li-ion diffusion. Configurational entropy serves as an effective quantitative descriptor of anion disorder, exhibiting a strong correlation with ionic conductivity. While greater anion disorder induced by site inversion and higher Br content enhances ionic conductivity up to 50 mS cm −1 , it simultaneously reduces structural stability. This trade-off results in an optimal window in which a moderate level of disorder yields conductivities exceeding 20 mS cm −1 while maintaining synthetic feasibility. In conclusion, this work highlights the reliability and efficiency of MLIPs for elucidating ion-transport mechanisms and accelerating the design of novel superionic argyrodites.
Jang, Myeongcho [Korea Institute of Science and Te↗
Hydrogen Bonding Inside Anionic Polymeric Brush Layer: Machine Learning-Driven Exploration of the Relative Roles of the Polymer Steric Effect, Charging, and Type of Screening Counterions
This paper employs a combination of all-atom molecular dynamics (MD) simulations and unsupervised machine learning (ML) for studying the water-water hydrogen bonds (HBs) inside the anionic poly-acrylic acid (PAA) brushes modeled using all-atom MD simulations. PAA brush layer with different charge fraction (f), namely f=0, f=0.25, and f=1, is considered. Water-water interactions, both inside and outside the brush layer, are represented through distinct clusters of tupules of variables representing distances associated with the interacting water molecules. While clusters representing the HBs are present for water inside and outside the brushes, several clusters representing the long-range water-water interactions are missing for the water molecules inside the highly charged (f=1) PAA brushes. More importantly, inside highly charged brushes, the edge of the clusters representing the water-water HBs is progressively shortened, as compared to that in the bulk. Both these results stem from the presence of the PAA brushes imparting the steric effect and the charge effect, or the effect associated with enhanced interactions of water molecules with PE charges and counterions, thereby disrupting the water connectivity. This water-charged-species interaction also increases the water-water HB angle, i.e., makes the water-water HBs less stable inside the highly charged PAA brush layer. The narrowing of the clusters representing the HBs and the alteration of the angle characterizing the HBs confirm that the conditions defining the water-water HBs change inside the PAA brush layer as a function of the charges on the PAA brush layer. Furthermore, we show that the use of the generic definition of HBs, as compared to using our simulation-motivated modified definition of water-water HBs, overpredict the number of water-water HBs inside the PAA brush layer. Finally, we employ this all-atom-MD-ML framework to quantify the effect of other types of screening counterions (Li + , Ca 2+ , and Y 3+ ions) in determining the water-water interactions and water-water HB properties inside the PAA brush layer. Furthermore, the findings of the present study, confirming the weakening of water-water HBs inside the PAA brush layer, points to the possibility that the water molecules will be more available for hydrating the brush layer and counterions, thereby leading to a more pronounced wetting of the PAA brush layer.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Physics-informed regularization and structure preservation for learning stable reduced models from data with operator inference
Operator inference learns low-dimensional dynamical-system models with polynomial nonlinear terms from trajectories of high-dimensional physical systems (non-intrusive model reduction). Here, this work focuses on the large class of physical systems that can be well described by models with quadratic and cubic nonlinear terms and proposes a regularizer for operator inference that induces a stability bias onto learned models. The proposed regularizer is physics informed in the sense that it penalizes higher-order terms with large norms and so explicitly leverages the polynomial model form that is given by the underlying physics. This means that the proposed approach judiciously learns from data and physical insights combined, rather than from either data or physics alone. Additionally, a formulation of operator inference is proposed that enforces model constraints for preserving structure such as symmetry and definiteness in linear terms. Numerical results demonstrate that models learned with operator inference and the proposed regularizer and structure preservation are accurate and stable even in cases where using no regularization and Tikhonov regularization leads to models that are unstable.
97 MATHEMATICS AND COMPUTING↗