Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “learning dynamics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Domain-wall-mediated polarization switching in ferroelectric AlScN: Strain relief and field-dependent dynamics

While scandium-doped aluminum nitride (AlScN) exhibits robust ferroelectricity and excellent thermal stability, its utility is limited by an exceptionally high coercive field (𝐸 𝑐 ) for polarization switching. Unraveling the atomistic switching dynamics is therefore critical for tailoring 𝐸 𝑐 . Here, in this study, we combine density functional theory and machine-learning molecular dynamics to elucidate the polarization switching mechanisms in AlScN over various Sc concentrations and applied electric fields. We find that excessive lattice strain strictly prohibits collective polarization switching, but the preexisting domain walls relieve strain and lead to a distinct switching dynamics—dictating a field-dependent switching mechanism. At low electric fields, switching occurs via gradual domain-wall propagation consistent with the Kolmogorov-Avrami-Ishibashi model. In contrast, high fields stimulate additional nucleation, driving a rapid, homogeneous reversal process described by the simultaneous nonlinear nucleation and growth model. These findings highlight the critical role of domain-wall dynamics and suggest domain engineering as a viable strategy to tailor coercive fields in AlScN and related ferroelectrics.

36 MATERIALS SCIENCE↗

Machine learning-accelerated path integral molecular dynamics simulations of reactive organic electrolytes

Hydrogen bonded electrolytes that exhibit accelerated proton transport via sequential reactive hops have drawn interest for their promise in clean energy applications. Molecular dynamics simulations of these electrolytes offer the opportunity to uncover microscopic mechanistic details that could be used to design and tune the properties of candidate electrolyte technologies. However, accurately modeling the proton transfer reactions and transport properties that give rise to high charge conductivites in these electrolytes proves computationally challenging because of the need to perform lengthy condensed phase simulations, treating both the electronic and nuclear degrees of freedom quantum mechanically. In this paper, we demonstrate that such a modeling task can be efficiently achieved with the use of density functional theory (DFT)-trained machine learning potentials (MLP) to accelerate path integral molecular dynamics (PIMD) simulations. We highlight the practical utility of this approach by using it to benchmark how closely PIMD simulations employing different DFT exchange–correlation functionals reproduce the composition-dependent densities, diffusion coefficients, and electrical conductivities of mixtures consisting of imidazole and levulinic acid. Even with the speedup afforded by our MLPs, PIMD simulations remain quite expensive. Furthermore, in order to render PIMD more computationally tractable, we introduce and benchmark the accuracy of a ring polymer contraction approach that leverages a computationally efficient short-range MLP to accelerate our PIMD simulations by an additional factor of four.

Chemical bonding↗

Investigation of Low-Energy Lattice Dynamics and Their Role in Superionic Na Diffusion and Ultralow Thermal Conductivity of Na 3 PSe 4 as a Solid-State Electrolyte

The atomic dynamics of Na 3 PSe 4 were investigated using a combination of neutron scattering experiments and ab initio and machine-learned molecular dynamics simulations to probe the interplay of fast ionic diffusion with atomic vibrations (phonons) of the host lattice. Our results reveal the existence of low-energy vibrational modes, simultaneously involving motions of Na + ions and framework polyanion subunits, and show that these modes become strongly overdamped in the superionic regime as they couple with the Na + hopping process. In particular, the Na+ migration energy landscape is strongly impacted by low-energy phonons derived from a soft acoustic branch of the host lattice, which modulates the diameter of the Na + diffusion channel at the bottleneck. We find that an additional factor for the enhanced Na + conductivity in Na 3 PSe 4 is the presence of Na-vacancies, which also affect the low-frequency dynamics and thermal vibration amplitudes, pointing to an interplay between Na + vacancies and host dynamics, jointly enhancing ionic diffusivity. Finally, we investigate the origin of ultralow thermal conductivities in Na 3 PSe 4 and Na 3 PS 4 using Green–Kubo simulations and find that low-energy acoustic phonon modes of the overall crystal framework provide a dominant contribution to the thermal conductivity.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Expanding the representation of aerosol, cloud, and precipitation processes with graph network-based simulators

We explored a novel framework for simulating the small-scale processes that drive the evolution of aerosol, cloud, and precipitation particles, which are a critical gap in the predictive understanding of weather and climate. Particle-based methods have emerged as an effective tool for modeling aerosol-cloud-precipitation interactions, but existing particle-based models are computationally too expensive to simulate the large domains relevant for the atmosphere or to represent the full suite of relevant processes. The lack of a comprehensive and efficient reference model is a critical bottleneck in our understanding of cloud and precipitation processes and our ability to parameterize these processes for regional- and global-scale simulations. To address this need, we explored an approach to accelerate and expand particle-based models using a new machine learning approach, graph network-based simulators (GNS). Rather than modeling the evolution of the system by numerically integrating continuity equations, the GNS represents dynamics through learned message passing. Our aim was to develop fast and accurate surrogate models for particle-based simulations. We explored applying GNS to simulate cloud droplet transport, growth, and evaporation under turbulent conditions, but we found the GNS over-smoothed the simulations. We then applied the GNS to simulate aerosol dynamics through gas condensation and found the GNS was able to reproduce the benchmark, physics-based simulation with high accuracy.

54 ENVIRONMENTAL SCIENCES↗

Machine-learning force-field models for dynamical simulations of metallic magnets

We review recent advances in machine-learning (ML) force-field methods for Landau–Lifshitz–Gilbert simulations of itinerant electron magnets, focusing on their scalability and transferability. Built on the principle of locality, a deep neural-network model is developed to efficiently and accurately predict electron-mediated forces governing spin dynamics. Symmetry-aware descriptors constructed through a group-theoretical approach ensure rigorous incorporation of both lattice and spin-rotation symmetries. The framework is demonstrated using the prototypical s-d exchange model widely employed in spintronics. ML-enabled large-scale simulations reveal novel nonequilibrium phenomena, including anomalous coarsening of tetrahedral spin order on the triangular lattice and the freezing of phase-separation dynamics in lightly hole-doped, strong-coupling square-lattice systems. These results establish ML force-field frameworks as scalable, accurate, and versatile tools for modeling nonequilibrium spin dynamics in itinerant magnets.

Artificial neural networks↗

Scalable learning of potentials to predict time-dependent Hartree–Fock dynamics

We propose a framework to learn the time-dependent Hartree–Fock (TDHF) inter-electronic potential of a molecule from its electron density dynamics. Although the entire TDHF Hamiltonian, including the inter-electronic potential, can be computed from first principles, we use this problem as a testbed to develop strategies that can be applied to learn a priori unknown terms that arise in other methods/approaches to quantum dynamics, e.g., emerging problems such as learning exchange–correlation potentials for time-dependent density functional theory. We develop, train, and test three models of the TDHF inter-electronic potential, each parameterized by a four-index tensor of size up to 60 × 60 × 60 × 60. Two of the models preserve Hermitian symmetry, while one model preserves an eight-fold permutation symmetry that implies Hermitian symmetry. Across seven different molecular systems, we find that accounting for the deeper eight-fold symmetry leads to the best-performing model across three metrics: training efficiency, test set predictive power, and direct comparison of true and learned inter-electronic potentials. All three models, when trained on ensembles of field-free trajectories, generate accurate electron dynamics predictions even in a field-on regime that lies outside the training set. To enable our models to scale to large molecular systems, we derive expressions for Jacobian-vector products that enable iterative, matrix-free training.

97 MATHEMATICS AND COMPUTING↗

Behavioral analysis of signals that guide learned changes in the amplitude and dynamics of the vestibulo-ocular reflex

We characterized the dependence of motor learning in the monkey vestibulo-ocular reflex (VOR) on the duration, frequency, and relative timing of the visual and vestibular stimuli used to induce learning. The amplitude of the VOR was decreased or increased through training with paired head and visual stimulus motion in the same or opposite directions, respectively. For training stimuli that consisted of simultaneous pulses of head and target velocity 80-1000 msec in duration, brief stimuli caused small changes in the amplitude of the VOR, whereas long stimuli caused larger changes in amplitude as well as changes in the dynamics of the reflex. When the relative timing of the visual and vestibular stimuli was varied, brief image motion paired with the beginning of a longer vestibular stimulus caused changes in the amplitude of the reflex alone, but the same image motion paired with a later time in the vestibular stimulus caused changes in the dynamics as well as the amplitude of the VOR. For training stimuli that consisted of sinusoidal head and visual stimulus motion, low-frequency training stimuli induced frequency-selective changes in the VOR, as reported previously, whereas high-frequency training stimuli induced changes in the amplitude of the VOR that were more similar across test frequency. The results suggest that there are at least two distinguishable components of motor learning in the VOR. One component is induced by short-duration or high-frequency stimuli and involves changes in only the amplitude of the reflex. A second component is induced by long-duration or low-frequency stimuli and involves changes in the amplitude and dynamics of the VOR.

NASA Discipline Neuroscience↗

Machine-Learned Force Field for Molecular Dynamics Simulations of Nonequilibrium Ammonia Synthesis on Iron Catalysts

Ammonia (NH 3 ) is one of the most important industrial chemicals. The conventional NH 3 synthesis method-the Haber–Bosch process-converts atmospheric nitrogen (N 2 ) into NH 3 using H 2 with an iron (Fe) catalyst. However, this process requires high pressures (100–200 atm) and temperatures (700–800 K) near thermal equilibrium. Recently, Fe-based nanocatalysts have been reported to produce promising NH 3 yields under atmospheric pressures and temperature-modulated nonequilibrium conditions. Understanding the mechanism of nonequilibrium catalysis with programmed temperature variation could help to optimize this fully electrified and less energy-intensive process. Although reactive molecular dynamics (RMD) simulations can be a useful tool to model nonequilibrium catalytic processes, they require the development of accurate force fields (i.e., interatomic potentials). Here, we present a machine-learned (ML) force field within the Deep Potential MD (DPMD) framework, trained using periodic density functional theory (DFT) calculations, to model NH 3 synthesis on Fe catalysts with various surface adsorbates such as *N, *H, *N 2 , *H 2 , *NH, *NH 2 , and *NH 3 . Here, we generated the DFT data from static models of elementary reactions on the most stable (110) surface of body-centered cubic Fe, which then were augmented by data from constant number of particles–volume–temperature (NVT) DFT-MD trajectories at various temperatures. Finally, we utilized the fully optimized ML force field to investigate reaction dynamics at an Fe(110) surface at linearly increasing temperatures using NVT-DPMD simulations. Our simulations indicate that pulsed temperature ramping could prove favorable for NH3 synthesis. For example, we conducted ramping under multiple sets of conditions: (i) from 900 to 1200 K over periods of 0.1–0.3 ns for Fe surfaces precovered with N or NH along with H; and (ii) from 300 to 600 K over 0.1–0.3 ns for Fe surfaces precovered with NH 3 . While our simulations so far are limited to short time scales (very rapid heating), these observations shed light on the mechanism of the high NH 3 synthesis rate achieved in a novel temperature-modulated nonequilibrium catalytic reactor using pulsed heating and cooling.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A physics-constrained deep learning treatment of runaway electron dynamics

An adjoint formulation leveraging a physics-informed neural network (PINN) is employed to advance the density moment of a runaway electron (RE) distribution forward in time. A distinguishing feature of this approach is that once the adjoint problem is solved, its solution can be used to project the RE density forward in time for an arbitrary initial momentum space distribution of REs. Furthermore, by employing a PINN, a parametric solution to the adjoint problem can be learned. Thus, once trained, this adjoint-deep learning framework is able to efficiently project the RE density forward in time across various plasma conditions while still including a fully kinetic description of RE dynamics. As an example application, the temporal evolution of the density of primary electrons is studied, with particular emphasis on evaluating the decay of a RE population when below threshold. Predictions from the adjoint-deep learning framework are found to be in good agreement with a traditional relativistic electron Fokker–Planck solver, for several distinct initial conditions, and across an array of physics parameters. Once trained, the PINN thus provides a means of generating RE density time histories with exceptionally low online execution time.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Effects of Learning on Performance When Computerized Dynamic Posturography Assessments Are Repeated

Background: Computerized dynamic posturography is widely used to measure balance control performance. Clinically, performance is assessed by comparing individual data against standards obtained from a normative population. When performing repeated assessments to track performance changes, one must be concerned with the influence of learning effects. Subjects do not have the opportunity to practice before the first session, and often a second session is not performed prior to an experiment. Thus, the objective of this activity was to examine learning effects on balance control performance. We hypothesize that subjects will perform better on the second session when compared to the first, and that the difference will be greater for more difficult conditions. Methods: Data were collected from 204 subjects using the NeuroCom Equitest system during quiet stance with arms crossed at the chest on up to two sessions. All subjects performed standard sensory organization tests (SOTs) including 1) normal vision, fixed support; 2) absent vision, fixed support; 3) sway-referenced vision, fixed support; 4) normal vision, swayreferenced support; 5) absent vision, sway-referenced support; and 6) sway-referenced vision, sway-referenced support. 120 of these subjects performed modified sensory organization tests (mSOTs 2 and 5) which included static (20 back) and dynamic (20, 0.33Hz) head tilts. Median equilibrium scores (mEQ) were calculated from peak-to-peak anterior-posterior sway across trials. Data collected on the first session were then compared with the second to examine learning effect. Results: There were no differences in mEQ scores between the first and second sessions for SOTs 1, 2, and 4, while mEQ scores were higher for the second session when compared to the first for SOTs 3, 5, and 6 and for all mSOTs. Discussion: An additional familiarization session or practice trials prior to the first session may be necessary for more challenging SOT and mSOT conditions to minimize learning effect.

Taylor, Laura C.↗

Liquid-like dynamics in a solid-state lithium electrolyte

Superionic materials represent a regime intermediate between the crystalline and liquid states of matter. Despite the considerable interest in potential applications for solid-state batteries or thermoelectric devices, it remains unclear whether the fast ionic diffusion observed in superionic materials reflects liquid-like dynamics or whether the hops of mobile ions are inherently coupled to more conventional lattice phonons. Here we reveal a crossover from crystalline vibrations to relaxational dynamics of ionic diffusion in the superionic compound Li 6 PS 5 Cl, a candidate solid-state electrolyte. By combining inelastic and quasi-elastic neutron-scattering measurements with first-principles-based machine-learned molecular dynamics simulations, we found that the vibrational density of states in the superionic state strongly deviates from the quadratic behaviour expected from the Debye law of lattice dynamics. The superionic dynamics emerges from overdamped phonon quasiparticles to give rise to a linear density of states characteristic of instantaneous normal modes in the liquid state. Further, we showed that the coupling of lattice phonons with a dynamic breathing of the Li+ diffusion bottleneck enables an order-of-magnitude increase in diffusivity. Thus, our results shed insights into superionics for future energy storage and conversion technologies.

25 ENERGY STORAGE↗

Neural controller for adaptive movements with unforeseen payloads

A theory and computer simulation of a neural controller that learns to move and position a link carrying an unforeseen payload accurately are presented. The neural controller learns adaptive dynamic control from its own experience. It does not use information about link mass, link length, or direction of gravity, and it uses only indirect uncalibrated information about payload and actuator limits. Its average positioning accuracy across a large range of payloads after learning is 3 percent of the positioning range. This neural controller can be used as a basis for coordinating any number of sensory inputs with limbs of any number of joints. The feedforward nature of control allows parallel implementation in real time across multiple joints.

Kuperstein, Michael↗

Architecture for Adaptive Intelligent Systems

We identify a class of niches to be occupied by 'adaptive intelligent systems (AISs)'. In contrast with niches occupied by typical AI agents, AIS niches present situations that vary dynamically along several key dimensions: different combinations of required tasks, different configurations of available resources, contextual conditions ranging from benign to stressful, and different performance criteria. We present a small class hierarchy of AIS niches that exhibit these dimensions of variability and describe a particular AIS niche, ICU (intensive care unit) patient monitoring, which we use for illustration throughout the paper. We have designed and implemented an agent architecture that supports all of different kinds of adaptation by exploiting a single underlying theoretical concept: An agent dynamically constructs explicit control plans to guide its choices among situation-triggered behaviors. We illustrate the architecture and its support for adaptation with examples from Guardian, an experimental agent for ICU monitoring.

ACTIVE CONTROL↗

Investigating permafrost carbon dynamics in Alaska with artificial intelligence

Abstract Positive feedbacks between permafrost degradation and the release of soil carbon into the atmosphere impact land–atmosphere interactions, disrupt the global carbon cycle, and accelerate climate change. The widespread distribution of thawing permafrost is causing a cascade of geophysical and biochemical disturbances with global impacts. Currently, few earth system models account for permafrost carbon feedback (PCF) mechanisms. This research study integrates artificial intelligence (AI) tools and information derived from field-scale surveys across the tundra and boreal landscapes in Alaska. We identify and interpret the permafrost carbon cycling links and feedback sensitivities with GeoCryoAI, a hybridized multimodal deep learning (DL) architecture of stacked convolutionally layered, memory-encoded recurrent neural networks (NN). This framework integratesin-situmeasurements and flux tower observations for teacher forcing and model training. Preliminary experiments to quantify, validate, and forecast permafrost degradation and carbon efflux across Alaska demonstrate the fidelity of this data-driven architecture. More specifically, GeoCryoAI logs the ecological memory and effectively learns covariate dynamics while demonstrating an aptitude to simulate and forecast PCF dynamics—active layer thickness (ALT), carbon dioxide flux (CO 2 ), and methane flux (CH 4 )—with high precision and minimal loss (i.e. ALT RMSE : 1.327 cm [1969–2022]; CO 2 RMSE : 0.697µmolCO 2 m −2 s −1 [2003–2021]; CH 4 RMSE : 0.715 nmolCH 4 m −2 s −1 [2011–2022]). ALT variability is a sensitive harbinger of change, a unique signal characterizing the PCF, and our model is the first characterization of these dynamics across space and time.

Environmental Sciences & Ecology↗

A general Bayesian algorithm for the autonomous alignment of beamlines

Autonomous methods to align beamlines can decrease the amount of time spent on diagnostics, and also uncover better global optima leading to better beam quality. The alignment of these beamlines is a high-dimensional expensive-to-sample optimization problem involving the simultaneous treatment of many optical elements with correlated and nonlinear dynamics. Bayesian optimization is a strategy of efficient global optimization that has proved successful in similar regimes in a wide variety of beamline alignment applications, though it has typically been implemented for particular beamlines and optimization tasks. In this paper, we present a basic formulation of Bayesian inference and Gaussian process models as they relate to multi-objective Bayesian optimization, as well as the practical challenges presented by beamline alignment. We show that the same general implementation of Bayesian optimization with special consideration for beamline alignment can quickly learn the dynamics of particular beamlines in an online fashion through hyperparameter fitting with no prior information. We present the implementation of a concise software framework for beamline alignment and test it on four different optimization problems for experiments on X-ray beamlines at the National Synchrotron Light Source II and the Advanced Light Source, and an electron beam at the Accelerator Test Facility, along with benchmarking on a simulated digital twin. We discuss new applications of the framework, and the potential for a unified approach to beamline alignment at synchrotron facilities.

47 OTHER INSTRUMENTATION↗

Surrogate Modelling of 3rd Integer Resonant Extraction at Fermilab Delivery Ring

We present an ongoing work in which a surrogate model is being developed to reproduce the response dynamics of the third-integer resonant extraction process in the Delivery Ring (DR) at Fermilab. This effort is in pursuit of smoothly extracting circulating beam to the Mu2e Experiment s production target, wherein the goal is to extract a uniform slice of the circulating $1e12$ protons in the DR over 25,000 turns (43~ms). The DR contains 3 harmonic sextupoles which excite a third-integer resonance as well as three fast, tune-ramping quadrupole magnets which drive the horizontal tune towards the $29/3$ resonance. In our initial work the surrogate model trains on a semi-analytical simulation provided in the same format as live data. Using Reinforcement Learning (and other potential ML methods), the trained surrogate acts as the environment in which a simple ML control agent could learn to dynamically adjust the quadrupole ramp at 430 break points within the 43 microsecond spill window. The control agent will be hosted on a dedicated Arria 10 FPGA, introducing its own requirements on control agent architecture. In this work we report the accuracy and fidelity of surrogate models in comparison to the response dynamics of the physics simulator.

Narayanan, Aakaash [Fermilab] (ORCID:0000000157944↗