Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “learning dynamics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

Data Assessment and Assimilation for Atmospheric Radiation Measurement Data Using Dynamic Bayesian Networks

A data-driven machine learning approach to scientific sensor data assessment may automatically learn directly from the structural and temporal patterns in abundant observations. The project has developed data assessment and assimilation models to screen datasets using dynamic Bayesian network (DBN) and deep learning (DL) methods, which rely on correlations between variables, across time, and between spatial locations, to detect poor or invalid data with a high degree of confidence.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

LaSDI: Parametric Latent Space Dynamics Identification

Enabling fast and accurate physical simulations with data has become an important area of computational physics to aid in inverse problems, design-optimization, uncertainty quantification, and other various decision-making applications. This paper presents a data-driven framework for parametric latent space dynamics identification procedure that enables fast and accurate simulations. The parametric model is achieved by building a set of local latent space model and designing an interaction among them. An individual local latent space dynamics model achieves accurate solution in a trust region. By letting the set of trust region to cover the whole parameter space, our model shows an increase in accuracy with an increase in training data. Herein we introduce two different types of interaction mechanisms, i.e., point-wise and region-based approach. Both linear and nonlinear data compression techniques are used. We illustrate the framework of Latent Space Dynamics Identification (LaSDI) enable a fast and accurate solution process on various partial differential equations, i.e., Burgers’ equations, radial advection problem, and nonlinear heat conduction problem, achieving 0 (100)x speed-up and 0 (1)% relative error with respect to the corresponding full order models.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

Model Structural Inference Using Local Dynamic Operators

This paper focuses on the problem of quantifying the effects of model-structure uncertainty in the context of time-evolving dynamical systems. This is motivated by multi-model uncertainty in computer physics simulations: developers often make different modeling choices in numerical approximations and process simplifications, leading to different numerical codes that ostensibly represent the same underlying dynamics. We consider model-structure inference as a two-step methodology: the first step is to perform system identification on numerical codes for which it is possible to observe the full state; the second step is structural uncertainty quantification, in which the goal is to search candidate models "close" to the numerical code surrogates for those that best match a quantity of interest (QOI) from some empirical data sets. Here, we (1) define a discrete, local representation of the structure of a partial differential equation, which we refer to as the "local dynamical operator" (LDO); (2) identify model structure nonintrusively from numerical code output; (3) nonintrusively construct a reduced-order model (ROM) of the numerical model through POD-DEIM-Galerkin projection; (4) perturb the ROM dynamics to approximate the behavior of alternate model structures; and (5) apply Bayesian inference and energy conservation laws to calibrate a LDO to a given QOI. We demonstrate these techniques using the two-dimensional rotating shallow water equations as an example system.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Learning Physically Interpretable Atmospheric Models From Data With WSINDy

The multiscale and turbulent nature of Earth's atmosphere has historically rendered accurate weather modeling a hard problem. Recently, there has been an explosion of interest surrounding data-driven approaches to weather modeling, which in many cases show improved forecasting accuracy and computational efficiency when compared to traditional methods. However, many of the current data-driven approaches employ highly parameterized neural networks, often resulting in uninterpretable models and limited gains in scientific understanding. In this work, we address the interpretability problem by explicitly discovering partial differential equations governing atmospheric phenomena, identifying symbolic mathematical models with direct physical interpretations. The purpose of this paper is to demonstrate that, in particular, the weak-form sparse identification of nonlinear dynamics (WSINDy) algorithm can learn effective atmospheric models from both simulated and assimilated data. Our approach adapts the standard WSINDy algorithm to work with high-dimensional fluid data of arbitrary spatial dimension.

58 GEOSCIENCES↗
DOE OSTI2022

Machine learning changes the rules for flux limiters

Learning to integrate non-linear equations from highly resolved direct numerical simulations has seen recent interest for reducing the computational load for fluid simulations. Here, we focus on determining a flux-limiter for shock capturing methods. Focusing on flux limiters provides a specific plug-and-play component for existing numerical methods. Since their introduction, an array of flux limiters has been designed. Using the coarse-grained Burgers' equation, we show that flux-limiters may be rank-ordered in terms of their log-error relative to high-resolution data. We then develop a theory to find an optimal flux-limiter and present flux-limiters that outperform others tested for integrating Burgers' equation on lattices with [Formula: see text], and 2x, 3x, 4x, and 8x coarse-grainings. We train a continuous piecewise linear limiter by minimizing the mean-squared misfit to six-grid point segments of high-resolution data, averaged over all segments. While flux limiters are generally designed to have an output of φ(r) = 1 at a flux ratio of r = 1, our limiters are not bound by this rule and yet produce a smaller error than standard limiters. Here we find that our machine learned limiters have distinctive features that may provide new rules-of-thumb for the development of improved limiters. Additionally, we use our theory to learn flux-limiters that outperform standard limiters across a range of values (as opposed to at a specific fixed value) of coarse-graining, number of discretized bins, and diffusion parameter. This demonstrates the ability to produce flux limiters that should be more broadly useful than standard limiters for general applications.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Ultra-fast interpretable machine-learning potentials

Abstract All-atom dynamics simulations are an indispensable quantitative tool in physics, chemistry, and materials science, but large systems and long simulation times remain challenging due to the trade-off between computational efficiency and predictive accuracy. To address this challenge, we combine effective two- and three-body potentials in a cubic B-spline basis with regularized linear regression to obtain machine-learning potentials that are physically interpretable, sufficiently accurate for applications, as fast as the fastest traditional empirical potentials, and two to four orders of magnitude faster than state-of-the-art machine-learning potentials. For data from empirical potentials, we demonstrate the exact retrieval of the potential. For data from density functional theory, the predicted energies, forces, and derived properties, including phonon spectra, elastic constants, and melting points, closely match those of the reference method. The introduced potentials might contribute towards accurate all-atom dynamics simulations of large atomistic systems over long-time scales.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Design of Hopfield Networks Based on Superconducting Coupled Oscillators

The global energy shortage has driven the development of many energy-efficient computational platforms beyond Moore's law, among which brain-inspired neuromorphic computing is one of the promising solutions. Associative memory and pattern recognition are important computations solved by brain-inspired Hopfield networks. Classical Hopfield networks store memories via fixed point attractors of their dynamics. In oscillatory Hopfield networks, these attractors are replaced by periodic orbits. Here, we design an oscillatory Hopfield network based on coupled superconducting oscillators. We first employ a mathematical phase reduction approach to map networks of coupled superconducting rapid single flux quantum (RSFQ) ring oscillators to coupled Kuramoto phase-oscillator networks. We use this theory to numerically optimize the hardware's mutual inductances in order to directly match the phase-reduced superconducting oscillators to a model of phase-oscillator-based Hopfield networks. The resulting network can store multiple oscillatory phase-locked memory patterns and recover the patterns based on the initial phase conditions. As different pattern recognition tasks, or learning, require tunable connectivity strengths between the oscillatory nodes, we further employ a coupler circuit that enables tuning the coupling strength between two oscillators by applying an external flux. We demonstrate the functionality of our design through numerical simulations of a small example network with oscillators operating at 86 GHz and recognizing patterns within 10 ns. Our approach enables the learning and retrieval of dynamical memory patterns with a wide range of applications where rhythmic dynamic output is beneficial.

Cheng, Ran↗
DOE OSTI2016

Physical Chemistry of Reaction Dynamics in Ionic Liquid

Work completed over the past year mainly involves finishing studies related to solvation dynamics in ionic liquids, amplifying and extending our initial PFG-NMR work on solute diffusion, and learning how to probe rotational dynamics in ionic liquids.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

High temperature stability and transport characteristics of hydrogen in alumina via multiscale computation

Here, the impact of hydrogen charge states on the stability and transport characteristics of hydrogen interstitials in alumina polymorphs is evaluated by multiscale computational methods including density functional theory (DFT), ab initio molecular dynamics (AIMD) and machine learned force fields. Thermodynamic calculations show that the protonic H i +1 interstitial is the most stable defect species for most values of the electronic bandgap in both and amorphous alumina (Al 2 O 3 ). Further, active learned Gaussian approximation potentials (GAP) were developed using AIMD data to study temperature dependent long time proton diffusion in alumina. Diffusivity calculations from GAP-MD simulations are found to be comparable with of the AIMD data, while being ~340 times faster and scalable to larger systems. Comparisons with diffusivity values for other interstitial charge states (H i 0 and H i -1 ) and published experimental literature indicate that H i +1 diffusion is the likely mechanism of hydrogen transport. A good agreement is obtained between H i +1 diffusivity calculated in α-Al 2 O 3 from DFT: 5.05 10 -3 exp(-0.81 eV/k B /T) cm 2 /s and reported experiment: 9.7X10 -4 exp(-0.83 eV/k B /T) cm 2 /s. Computationally and experimentally calculated energy barriers (0.81 and 0.83 eV respectively) only differ by 2.5%. Similarly, the pre-exponential diffusion coefficients only differ by 0.5 orders of magnitude. Moreover, the diffusivity of H i +1 in amorphous Al 2 O 3 in the 1000–2000 K range is calculated to be 2.53X10 -2 exp(-0.89 eV/k B /T), just one order of magnitude higher than the corresponding value in α-Al 2 O 3 . This suggests that local structural disorder does not significantly affect the energy landscape and diffusion behavior of H i +1 in Al 2 O 3 . Overall, these results show promise for the application of alumina polymorphs as hydrogen permeation barriers.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

Phase Diagram of a Deep Potential Water Model

Using the Deep Potential methodology, we construct a model that reproduces accurately the potential energy surface of the SCAN approximation of density functional theory for water, from low temperature and pressure to about 2400 K and 50 GPa, excluding the vapor stability region. The computational efficiency of the model makes it possible to predict its phase diagram using molecular dynamics. Satisfactory overall agreement with experimental results is obtained. Here, the fluid phases, molecular and ionic, and all the stable ice polymorphs, ordered and disordered, are predicted correctly, with the exception of ice III and XV that are stable in experiments, but metastable in the model. The evolution of the atomic dynamics upon heating, as ice VII transforms first into ice VII" and then into an ionic fluid, reveals that molecular dissociation and breaking of the ice rules coexist with strong covalent fluctuations, explaining why only partial ionization was inferred in experiments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2014

Mitochondrial Morphological Features Are Associated with Fission and Fusion Events

Mitochondria are dynamic organelles that undergo constant remodeling through the regulation of two opposing processes, mitochondrial fission and fusion. Although several key regulators and physiological stimuli have been identified to control mitochondrial fission and fusion, the role of mitochondrial morphology in the two processes remains to be determined. To address this knowledge gap, we investigated whether morphological features extracted from time-lapse live-cell images of mitochondria could be used to predict mitochondrial fate. That is, we asked if we could predict whether a mitochondrion is likely to participate in a fission or fusion event based on its current shape and local environment. Using live-cell microscopy, image analysis software, and supervised machine learning, we characterized mitochondrial dynamics with single-organelle resolution to identify features of mitochondria that are predictive of fission and fusion events. A random forest (RF) model was trained to correctly classify mitochondria poised for either fission or fusion based on a series of morphological and positional features for each organelle. Of the features we evaluated, mitochondrial perimeter positively correlated with mitochondria about to undergo a fission event. Similarly mitochondrial solidity (compact shape) positively correlated with mitochondria about to undergo a fusion event. Our results indicate that fission and fusion are positively correlated with mitochondrial morphological features; and therefore, mitochondrial fission and fusion may be influenced by the mechanical properties of mitochondrial membranes.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Accelerating high-strain continuum-scale brittle fracture simulations with machine learning

Failure in brittle materials under dynamic loading conditions is a result of the propagation and coalescence of microcracks. Simulating this discrete crack evolution at the continuum level is computationally expensive or, in some cases, intractable, resulting in the need to make broad assumptions or neglect key physics. In this work, we have developed an approach using machine learning that overcomes the current inability to represent meso-scale physics at the macro-scale. Our approach leverages damage and stress data from a computationally expensive high-fidelity model that explicitly resolves microcrack behavior to build an inexpensive machine learning emulator. Once trained, the machine learning emulator is used to predict the evolution of crack length statistics, which then informs a continuum-scale constitutive model. This results in a significant speed-up of the workflow by four orders of magnitude. Both the machine learning emulator and the continuum-scale model are validated against the high-fidelity model and experimental data, respectively, showing excellent agreement. There are two key findings. The first is that we can reduce the dimensionality of the problem, establishing that the machine learning emulator only needs the length of the longest crack and one of the maximum stress components to capture the necessary physics. Another compelling finding is that the emulator can be trained in one experimental setting and transferred successfully to predict behavior in a different setting.

36 MATERIALS SCIENCE↗
DOE OSTI2017

Experience curve development and cost reduction disaggregation for fuel cell markets in Japan and the US

Technology learning rates can be dynamic quantities as a technology moves from early development to piloting and from low volume manufacturing to high volume manufacturing. This work describes a generalizable technology analysis approach for disaggregating observed technology cost reductions and presents results of this approach for one specific case study (micro-combined heat and power fuel cell systems in Japan). We build upon earlier reports that combine discussion of fuel cell experience curves and qualitative discussion of cost components by providing greater detail on the contributing mechanisms to observed cost reductions, which were not quantified in earlier reports. Greater standardization is added to the analysis approach, which can be applied to other technologies. This paper thus provides a key linkage that has been missing from earlier literature on energy-related technologies by integrating the output of earlier manufacturing cost studies with observed learning rates to quantitatively estimate the different components of cost reduction including economies of scale and cost reductions due to product performance and product design improvements. This work also provides updated fuel cell technology price versus volume trends from the California Self-Generation Incentive Program, including extensive data for solid-oxide fuel cells (SOFC) reported here for the first time. The Japanese micro-CHP market is found to have a learning rate of 18% from 2005 to 2015, while larger SOFC fuel cell systems (200 kW and above) in the California market are found to have a flat (near-zero) learning rate, and these are attributed to a combination of exogenous, market, and policy factors.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2022

The bright frontiers of microbial metabolic optogenetics

In recent years, light-responsive systems from the field of optogenetics have been applied to several areas of metabolic engineering with remarkable success. By taking advantage of light's high tunability, reversibility, and orthogonality to host endogenous processes, optogenetic systems have enabled unprecedented dynamical controls of microbial fermentations for chemical production, metabolic flux analysis, and population compositions in co-cultures. In this article, we share our opinions on the current state of this new field of metabolic optogenetics. Furthermore, we make the case that it will continue to impact metabolic engineering in increasingly new directions, with the potential to challenge existing paradigms for metabolic pathway and strain optimization as well as bioreactor operation.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Enhancing Photosynthesis Simulation Performance in ESMs with Machine Learning-Assisted Solvers

When simulating vegetation dynamics, photosynthesis accounts for a large fraction of the computational cost in most Earth System Models (ESMs). This is largely since photosynthesis is represented as a system of nonlinear equations, and the solution requires the use of an initial guess followed by many iterations of the numerical solver to obtain a solution. We use machine learning (ML) to replicate the response surface of the model’s numerical solver to improve the choice of initial guess, therefore requiring fewer iterations to obtain a final solution. We implemented this test on the leaf-level calculations as well as at the canopy scale, and for both we observed fewer iterations of the photosynthesis solver when a ML-based initial guess was implemented. The model tested here is the Energy Exascale Earth System Model - Land Model (ELM). The ML-based algorithms used here are trained on simulations from the model itself and used only to improve the initial guess for the solver; therefore, the model maintains its own set of physics to obtain the final solution. This work shows novel ways to utilize ML-based methods to improve the performance of numerical solvers in ESMs.

Massoud, Elias [ORNL] (ORCID:0000000217725361)↗
DOE OSTI2023

Exploring the impact of ions on oxygen K-edge X-ray absorption spectroscopy in NaCl solution using the GW-Bethe-Salpeter-equation approach

X-ray absorption spectroscopy (XAS) is a powerful experimental tool to probe the local structure in materials with the core hole excitations. Here, the oxygen K-edge XAS spectra of the NaCl solution and pure water are computed by using a recently developed GW-Bethe-Salpeter equation approach, based on configurations modeled by path-integral molecular dynamics with the deep-learning technique. The neural network is trained on ab initio data obtained with strongly constrained and appropriately normed density functional theory. The observed changes in the XAS features of the NaCl solution, compared to those of pure water, are in good agreement between experimental and theoretical results. We provided detailed explanations for these spectral changes that occur when NaCl is solvated in pure water. Specifically, the presence of solvating ion pairs leads to localization of electron-hole excitons. As a result, our theoretical XAS results support the theory that the effects of the solvating ions on the H-bond network are mainly confined within the first hydration shell of ions, however beyond the shell the arrangement of water molecules remains to be comparable to that observed in pure water.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2017

Examining the role of fluctuations in the early stages of homogenous polymer crystallization with simulation and statistical learning

Here, we propose a relationship between the dynamics in the amorphous and crystalline domains during polymer crystallization: the fluctuations of ordering-rate about a material-specific value in the amorphous phase drive those fluctuations associated with the increase in percent crystallinity. This suggests a differential equation that satisfies the three experimentally observed time regimes for the rate of crystal growth. To test this postulated expression, we applied a suite of statistical learning tools to molecular dynamics simulations to extract the relevant phenomenology. This study shows that the proposed relationship holds in the early time regime. It illustrates the effectiveness of soft computing tools in the analysis of coarse-grained simulations in which patterns exist, but may not easily yield to strict quantitative evaluation. This ability assists us in characterizing the critical early time molecular arrangement during the primary nucleation phase of polymer melt crystallization. In addition to supporting the validity of the proposed kinetics expression, the simulations show that (i) the classical nucleation and growth mechanism is active in the early stages of ordering; (ii) the number of nuclei and their masses grow linearly during this early time regime; and (iii) a fixed inter-nuclei distance is established.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Building Intelligent Cyberinfrastructure to Learn Iteratively from both Observations and Models for Understanding Watershed Dynamics

Focal Area(s): Predictive modeling through the use of AI techniques and AI-derived model components; the use of AI and other tools to design a prediction system comprising of a hierarchy of models (e.g., AI-driven model/component/parameterization selection). Science Challenge: Watershed processes, such as the fate and transport of sediment, carbon and nutrients across landscapes and their fluxes to water bodies (e.g., streams, rivers and lakes), have important implications for global and regional carbon and nutrient dynamics, biogeochemical functioning of terrestrial ecosystems, and soil functions. The magnitude of lateral surface/subsurface transport and fluxes of sediment, carbon and nutrients are key factors controlling the vulnerability of watersheds to climate extremes such as droughts, wildfires, and floods. Recent field observations and other scientific evidence suggest that the magnitudes of lateral transport and fluxes of sediment, carbon and nutrients are governed primarily by the spatial and vertical heterogeneity of landscape and soil properties and by pedogenic processes. However, the current generation of land surface and watershed models do not mechanistically couple the terrestrial and hydrologic systems, nor do they represent sufficiently the spatial and vertical heterogeneity of land surface and subsurface properties. On the other hand, increasing complexity of coupled watershed and land surface models requires more data to parameterize, calibrate and validate. Remote sensing (RS) provides a means to acquire spatial data and characterize their heterogeneity at the watershed scale, overcoming a major limitation associated with conventional point measurements. To improve the representation of land-surface and surface/subsurface process coupling and sub-grid heterogeneity in watershed models, it is essential to build our predictive understanding by learning from both the multi-scale multi-process modeling and diverse multi-scale data while leveraging powerful artificial intelligence (AI) techniques.

54 ENVIRONMENTAL SCIENCES↗