Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “dynamic model learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,297 records · Page 72
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Digital Twin Framework for PIP-II Linac: AI-Driven Multi-Scale Modeling from Ion Source to 800 MeV

The PIP-II linac will enable >1.2 MW beam power for DUNE, requiring unprecedented operational reliability across its warm front-end (RFQ, MEBT) and five distinct SRF sections operating at 162.5/325/650 MHz. We present a comprehensive digital twin framework uniquely combining a fully differentiable fast beam transport code with neural network surrogates trained on high-fidelity PIC simulations, capturing space charge and nonlinear dynamics beyond traditional envelope codes while achieving 10⁴× speedup at <1% accuracy. End-to-end differentiability enables gradient-based optimization across 500+ parameters simultaneously—previously impossible with conventional tools—while the model incorporates static/dynamic errors and serves as a virtual commissioning platform for diverse hardware integration. The framework facilitates reinforcement learning for pulsed/CW mode transitions, predictive maintenance through anomaly detection, and autonomous tuning algorithm development with real-time execution capability. Validation against physics simulations shows excellent agreement for the front-end, with initial results demonstrating potential for 30% commissioning time reduction and proactive fault mitigation, providing a scalable blueprint for operating next-generation high-intensity accelerators.

Pathak, Abhishek [Fermilab] (ORCID:000000021704208↗
DOE OSTI2021

Learning from learning machines: improving the predictive power of energy-water-land nexus models with insights from complex measured and simulated data

Focal Area(s): Insights gleaned from complex data (observed and simulated) using AI; Predictive modeling through the use of AI techniques and AI-derived model components, including physics- and knowledge-informed models; Energy-water-land nexus and integrated energy systems – models of MultiSector dynamics. Science Challenge: Scientific communities are in need of tools for the computational integration of physics-based models, experimental data, and empirical/observational studies across a broad range of temporal and spatial scales to explore and meet EESSD grand challenges. We require AI algorithms for the discovery of process-drivers in the Earth-energy-human system and to link them with complex measured and simulated data. We aim to understand the energy-water-land nexus, particularly under extreme forcing scenarios and rare events, leveraging scale-aware AI process models, including probabilistic uncertainties, and benefiting from the emerging 5G-enabled landscape-scale sensing and edge computing capabilities. These models are needed to identify instabilities and tipping points that manifest extreme system behaviors with consequences for integrated energy systems and the environment. This work requires fundamental advances in uncertainty quantification, in particular, to identify and model unlikely but catastrophic outliers. Specifically, we need models that are interpretable to domain scientists and, essentially, explainable to public and private stake holders.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Multi-level optimization with the koopman operator for data-driven, domain-aware, and dynamic system security

Cyber-Physical Systems (CPSs) like the power grid are critically important but also increasingly vulnerable; ensuring reliable system operation in the face of disruptions is becoming more and more challenging. Multi-Level Optimization (MLO) is a powerful way to model adversarial interactions, which naturally makes it applicable to studying CPS security. However, MLO typically does not address underlying system dynamics, and incorporating nonlinear dynamics is generally infeasible. In this paper, we show how to combine MLO with the Koopman Operator (KO) to remedy this. The KO maps nonlinear dynamics to a lifted space in which those dynamics are linear, thus making it ideal for use with MLO. Moreover, the structure of the KO also provides convenient ways to incorporate domain knowledge into the data-driven process of learning the KO representation of a given system. Here we then demonstrate the use of MLO-KO on a small example problem taken from the power grid domain, discuss the scalability and computational cost of MLO-KO, and identify future research directions for this work.

42 ENGINEERING↗
DOE OSTI2024

Simulating water dynamics related to pedogenesis across space and time: Implications for four-dimensional digital soil mapping

Digital soil mapping (DSM) relies on machine-learning and geostatistics to represent soil property observations across space. DSM techniques are powerful but often empirical, being limited to the quality and density of point samples. Water dynamics are closely related to soil variability, and the physics that govern water movement are well known. Hydrological properties can hence be simulated by physical models through space and time, unveiling key characteristics about soils. We propose the use of hydrologic models to map soils across the surface (2D), depth (1D), and time (1D)–which provides a 4D approach to digital soil mapping (4DSM). The Distributed Hydrology Soil Vegetation Model (DHSVM) was applied to a watershed currently under pasture. Moisture sensors and wells were installed at different depths in the watershed on summit, sideslope and toeslope positions to validate the model. DHSVM simulations of soil moisture distribution and depth to saturation were performed during the hydrological year (October 2008-September 2009). Clusters of similar pixels based on soil moisture values were determined using Dynamic Time Warping (DTW) to align temporal data and K-means. Clustering was performed both seasonally and for the entire year. Temporal patterns simulated by DHSVM matched measurements given by moisture sensors and wells. Seasonal clusters differed from the annual cluster. Distinct clusters were observed for each season and with depth, showing that spatiotemporal soil variability is lost when statically assessing soils. Spatiotemporal clusters corroborated field observations of fragipan occurrence not explicitly spatially mapped by Soil Survey Geographic Database (SSURGO). If a connection can be made between water and soils, static and dynamic soil variability can be predicted using physically based hydrologic models. Hydrologic models can benefit soil mapping by enabling reliable 4D simulation of water dynamics, which are fundamental to soil variability and soil classification and directly relate to biological, physical and chemical soil processes not captured by typical soil sampling protocols.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

From Femtoseconds to Gigaseconds: The SolDeg Platform for the Performance Degradation Analysis of Silicon Heterojunction Solar Cells

Heterojunction Si solar cells exhibit notable performance degradation. Here, we modeled this degradation by electronic defects getting generated by thermal activation across energy barriers over time. To analyze the physics of this degradation, we developed the SolDeg platform to simulate the dynamics of electronic defect generation. First, femtosecond molecular dynamics simulations were performed to create a-Si/c-Si stacks, using the machine learning-based Gaussian approximation potential. Second, we created shocked clusters by a cluster blaster method. Third, the shocked clusters were analyzed to identify which of them supported electronic defects. Fourth, the distribution of energy barriers that control the generation of these electronic defects was determined. Fifth, an accelerated Monte Carlo method was developed to simulate the thermally activated time-dependent defect generation across the barriers. Our main conclusions are as follows. (1) The degradation of a-Si/c-Si heterojunction solar cells via defect generation is controlled by a broad distribution of energy barriers. (2) We developed the SolDeg platform to track the microscopic dynamics of defect generation across this wide barrier distribution and determined the time-dependent defect density N(t) from femtoseconds to gigaseconds, over 24 orders of magnitude in time. (3) We have shown that a stretched exponential analytical form can successfully describe the defect generation N(t) over at least 10 orders of magnitude in time. (4) We found that in relative terms, Voc degrades at a rate of 0.2%/year over the first year, slowing with advancing time. (5) We developed the time correspondence curve to calibrate and validate the accelerated testing of solar cells. We found a compellingly simple scaling relationship between accelerated and normal times t normal ∝ t accel T(accel)/T(normal) . (6) We also carried out experimental studies of defect generation in a-Si:H/c-Si stacks. We found a relatively high degradation rate at early times that slowed considerably at longer time scales.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Secondary structure determines electron transport in peptides

Proteins play a key role in biological electron transport, but the structure–function relationships governing the electronic properties of peptides are not fully understood. Despite recent progress, understanding the link between peptide conformational flexibility, hierarchical structures, and electron transport pathways has been challenging. Here, we use single-molecule experiments, molecular dynamics (MD) simulations, nonequilibrium Green’s function-density functional theory (NEGF-DFT), and unsupervised machine learning to understand the role of secondary structure on electron transport in peptides. Our results reveal a two-state molecular conductance behavior for peptides across several different amino acid sequences. MD simulations and Gaussian mixture modeling are used to show that this two-state molecular conductance behavior arises due to the conformational flexibility of peptide backbones, with a high-conductance state arising due to a more defined secondary structure (beta turn or 3 10 helices) and a low-conductance state occurring for extended peptide structures. These results highlight the importance of helical conformations on electron transport in peptides. Conformer selection for the peptide structures is rationalized using principal component analysis of intramolecular hydrogen bonding distances along peptide backbones. Molecular conformations from MD simulations are used to model charge transport in NEGF-DFT calculations, and the results are in reasonable qualitative agreement with experiments. Projected density of states calculations and molecular orbital visualizations are further used to understand the role of amino acid side chains on transport. Overall, our results show that secondary structure plays a key role in electron transport in peptides, which provides broad avenues for understanding the electronic properties of proteins.

Science & Technology - Other Topics↗
DOE OSTI2025

Data-Driven Compositional Optimization in Misspecified Regimes

With a manifold growth in the scale and intricacy of systems, the challenges of parametric misspecification become pronounced. These concerns are further exacerbated in compositional settings, which emerge in problems complicated by modeling risk and robustness. In “Data-Driven Compositional Optimization in Misspecified Regimes,” the authors consider the resolution of compositional stochastic optimization problems, plagued by parametric misspecification. In considering settings where such misspecification may be resolved via a parallel learning process, the authors develop schemes that can contend with diverse forms of risk, dynamics, and nonconvexity. They provide asymptotic and rate guarantees for unaccelerated and accelerated schemes for convex, strongly convex, and nonconvex problems in a two-level regime with extensions to the multilevel setting. Surprisingly, the nonasymptotic rate guarantees show no degradation from the rate statements obtained in a correctly specified regime and the schemes achieve optimal (or near-optimal) sample complexities for general T-level strongly convex and nonconvex compositional problems.

Business & Economics↗
NASA NTRSDate not supplied

DeepONet-Assisted Optimization of Surface Topography for Transition Delay in a Mach 4.5 Boundary Layer

We use deep learning, an ensemble variational technique (EnVar), and direct numerical simulations(DNS) to design an optimal topography for a two-dimensional roughness element that delays the on-set of laminar-turbulent transition in a Mach 4.5 flat-plate boundary layer. Deep operator networks (DeepONets), which have the known ability to learn complex nonlinear operators within dynamical systems, are used for machine learning. For the baseline configuration of a smooth flat plate, the second-mode waves at the DNS inflow cause a quick nonlinear breakdown of the high-speed boundary layer within the computational domain. Results reported in the present study validate the ability of DeepONets to model the transition delay via a given topography of the roughness element. The computing cost to optimize the rough-ness element for minimal skin-friction drag is substantially lowered by the DeepONets-based reduced-order model. In comparison to the baseline method of EnVar optimization based on DNS alone, the DeepONets-based EnVar optimizer is able to delay transition past the outflow boundary of the computational domain while utilizing almost 5–6 times fewer DNS.

Machine Learning↗
DOE OSTI2023

AL-ASMR: Active Learning of Atomistic Surrogate Models for Rare Events

Atomistic simulation with artificial intelligence (AI) is an emerging tool for understanding materials' properties and behaviors and predicting novel materials with optimized/targeted properties. Neural network potentials (NNPs) are outstanding in this field as they have shown a comparable accuracy to ab initio electronic structure calculations for reproducing potential energy surfaces while being several orders of magnitude faster. However, such NNPs can perform poorly outside of their training domain and typically fail catastrophically in the prediction of rare events in molecular dynamics (MD) simulations. For effective AL loops to distinguish the informative data from enhanced sampled configurations, we developed a decision engine by configurational similarity and uncertainty quantification (UQ) with data augmentation.

Jung, Gang Seob↗
DOE OSTI2021

Latent-space time evolution of non-intrusive reduced-order models using Gaussian process emulation

Non-intrusive reduced-order models (ROMs) have recently generated considerable interest for constructing computationally efficient counterparts of nonlinear dynamical systems emerging from various domain sciences. They provide a low-dimensional emulation framework for systems that may be intrinsically high-dimensional. This is accomplished by utilizing a construction algorithm that is purely data-driven. It is no surprise, therefore, that the algorithmic advances of machine learning have led to non-intrusive ROMs with greater accuracy and computational gains. However, in bypassing the utilization of an equation-based evolution, it is often seen that the interpretability of the ROM framework suffers. This becomes more problematic when black-box deep learning methods are used which are notorious for lacking robustness outside the physical regime of the observed data. In this article, we propose the use of a novel latent-space interpolation algorithm based on Gaussian process regression. Notably, this reduced-order evolution of the system is parameterized by control parameters to allow for interpolation in space. The use of this procedure also allows for a continuous interpretation of time which allows for temporal interpolation. The latter aspect provides information, with quantified uncertainty, about full-state evolution at a finer resolution than that utilized for training the ROMs. This research assesses the viability of this algorithm for an advection-dominated system given by the inviscid shallow water equations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Coolant Channel Design for Additively Manufactured Reactor Cores

Additive manufacturing (AM) methods are currently being explored for applications in nuclear reactors to make advanced reactors more efficient, safe, and reliable. The Transformational Challenge Reactor (TCR) program has explored AM for nuclear by designing a high-temperature gas reactor (HTGR) using an AM silicon carbide fuel form with uranium nitride–tristructural isotropic fuel. In this study, we detail the design process for the TCR fuel form’s coolant channels using computational fluid dynamics models with conjugate heat transfer. Additionally, this work discusses how these models were interfaced with other design teams, project milestones, and the agile design method used to mature the reactor design. The methodology deployed was able to create a channel design with lower maximum fuel temperatures and thermal stresses in the fuel form over traditional channel designs that can be manufactured subtractively. These results were achieved with only small manufacturing penalties. Results are discussed and presented on lessons learned for designing AM components for nuclear reactors. Finally, areas of opportunity are discussed for advanced design tools to further automate design activities and optimize reactors with fewer built-in assumptions.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2025

Design of Hopfield Networks Based on Superconducting Coupled Oscillators

The global energy shortage has driven the development of many energy-efficient computational platforms beyond Moore's law, among which brain-inspired neuromorphic computing is one of the promising solutions. Associative memory and pattern recognition are important computations solved by brain-inspired Hopfield networks. Classical Hopfield networks store memories via fixed point attractors of their dynamics. In oscillatory Hopfield networks, these attractors are replaced by periodic orbits. Here, we design an oscillatory Hopfield network based on coupled superconducting oscillators. We first employ a mathematical phase reduction approach to map networks of coupled superconducting rapid single flux quantum (RSFQ) ring oscillators to coupled Kuramoto phase-oscillator networks. We use this theory to numerically optimize the hardware's mutual inductances in order to directly match the phase-reduced superconducting oscillators to a model of phase-oscillator-based Hopfield networks. The resulting network can store multiple oscillatory phase-locked memory patterns and recover the patterns based on the initial phase conditions. As different pattern recognition tasks, or learning, require tunable connectivity strengths between the oscillatory nodes, we further employ a coupler circuit that enables tuning the coupling strength between two oscillators by applying an external flux. We demonstrate the functionality of our design through numerical simulations of a small example network with oscillators operating at 86 GHz and recognizing patterns within 10 ns. Our approach enables the learning and retrieval of dynamical memory patterns with a wide range of applications where rhythmic dynamic output is beneficial.

Cheng, Ran↗
DOE OSTI2025

Machine Learning-Accelerated First-Principles Molecular Dynamics Explains Anomalous Lattice Thermal Expansion in BaZr 0.78 Y 0.22 O 3-δ

Fuel cells are a vital clean energy technology that converts chemical energy directly into electricity with high efficiency, making them a cornerstone of a sustainable energy future. Herein we investigate the thermal and chemical lattice expansion behavior of hydrated BaZr 0.78 Y 0.22 O 3-δ using machine learning-accelerated ab initio molecular dynamics simulations. Here, our results reproduce the experimentally observed non-monotonic and anomalous temperature dependence of lattice expansion, which we attribute to the competing effects of thermal expansion and dehydration—two mechanisms that influence the lattice expansion in opposite directions. The importance of this work lies in its detailed demonstration of how advanced computational techniques can accurately capture complex environmental effects, providing a valuable framework for modeling similar phenomena in a variety of material systems and applications.

Proton conducting fuel cell↗
DOE OSTI2022

Machine Learning with Gradient-Based Optimization of Nuclear Waste Vitrification with Uncertainties and Constraints

Gekko is an optimization suite in Python that solves optimization problems involving mixed-integer, nonlinear, and differential equations. The purpose of this study is to integrate common Machine Learning (ML) algorithms such as Gaussian Process Regression (GPR), support vector regression (SVR), and artificial neural network (ANN) models into Gekko to solve data based optimization problems. Uncertainty quantification (UQ) is used alongside ML for better decision making. These methods include ensemble methods, model-specific methods, conformal predictions, and the delta method. An optimization problem involving nuclear waste vitrification is presented to demonstrate the benefit of ML in this field. ML models are compared against the current partial quadratic mixture (PQM) model in an optimization problem in Gekko. GPR with conformal uncertainty was chosen as the best substitute model as it had a lower mean squared error of 0.0025 compared to 0.018 and more confidently predicted a higher waste loading of 37.5 wt% compared to 34 wt%. The example problem shows that these tools can be used in similar industry settings where easier use and better performance is needed over classical approaches. Future works with these tools include expanding them with other regression models and UQ methods, and exploration into other optimization problems or dynamic control.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2024

AI-NERD: Elucidation of relaxation dynamics beyond equilibrium through AI-informed X-ray photon correlation spectroscopy

Abstract Understanding and interpreting dynamics of functional materials in situ is a grand challenge in physics and materials science due to the difficulty of experimentally probing materials at varied length and time scales. X-ray photon correlation spectroscopy (XPCS) is uniquely well-suited for characterizing materials dynamics over wide-ranging time scales. However, spatial and temporal heterogeneity in material behavior can make interpretation of experimental XPCS data difficult. In this work, we have developed an unsupervised deep learning (DL) framework for automated classification of relaxation dynamics from experimental data without requiring any prior physical knowledge of the system. We demonstrate how this method can be used to accelerate exploration of large datasets to identify samples of interest, and we apply this approach to directly correlate microscopic dynamics with macroscopic properties of a model system. Importantly, this DL framework is material and process agnostic, marking a concrete step towards autonomous materials discovery.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Neuromorphic intermediate representation: A unified instruction set for interoperable brain-inspired computing

Abstract Spiking neural networks and neuromorphic hardware platforms that simulate neuronal dynamics are getting wide attention and are being applied to many relevant problems using Machine Learning. Despite a well-established mathematical foundation for neural dynamics, there exists numerous software and hardware solutions and stacks whose variability makes it difficult to reproduce findings. Here, we establish a common reference frame for computations in digital neuromorphic systems, titled Neuromorphic Intermediate Representation (NIR). NIR defines a set of computational and composable model primitives as hybrid systems combining continuous-time dynamics and discrete events. By abstracting away assumptions around discretization and hardware constraints, NIR faithfully captures the computational model, while bridging differences between the evaluated implementation and the underlying mathematical formalism. NIR supports an unprecedented number of neuromorphic systems, which we demonstrate by reproducing three spiking neural network models of different complexity across 7 neuromorphic simulators and 4 digital hardware platforms. NIR decouples the development of neuromorphic hardware and software, enabling interoperability between platforms and improving accessibility to multiple neuromorphic technologies. We believe that NIR is a key next step in brain-inspired hardware-software co-evolution, enabling research towards the implementation of energy efficient computational principles of nervous systems. NIR is available atneuroir.org

Science & Technology - Other Topics↗
DOE OSTI2021

Analysis of Lobe Power Calculator and Indication System with Physics and Cycle Based Models

The Advanced Test Reactor (ATR) at INL measures reactor power through various methods, two of them being thermal and Nitrogen-16 (N-16) activity. Water power calculator (WPC) is a thermal power system that measures flow and temperature to determine thermal quadrant powers. The N-16 system utilizes a beta detector that outputs Nitrogen activation levels to calculate lobe power through an algorithm called Lobe Power Calculation and Indication system (LPCIS). The LPCIS utilizes the N-16 system and the WPC system to determine reactor core power levels. The WPC provides accurate calculations of quadrant and total reactor thermal power. With the use of WPC measurements, thermal-to-N-16 (T2N) power ratios are produced to determine if the two indication systems agree on core power. Relative magnitude equations are used to utilize N-16 coefficients and multipliers to improve the indications of the LPCIS. These correct indications are crucial for maintaining safety limits because operators rely on this information for decision making. Currently, the LPCIS system uses linear equations and matrices to calculate lobe power through multipliers and coefficients. Advancements in technology and system upgrades have increased the accuracy of power readings by making the system more dynamic. The new proposed coefficient and multiplier method implements a cycle specific and physics-based model intended for changing coefficients during operation. This calibration experiment focused on power splitting, outer shim and neck shim, as well as fuel burning into the reactor digital acquisition system (RDAS) weighting factors. Results demonstrated that the physics learning method yields a smaller error margin inside of the desired power range for the data set 166-A. Continuing to improve the physics-based model will help improve the power accuracy of the LPCIS system.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
NASA NTRS1979

The application of model-referenced adaptive control to robotic manipulators

The achievement of quality dynamic performance in manipulator systems is difficult using conventional control methods because of both the inherent geometric nonlinearities of these systems and the dependence of the system dynamics on the characteristics of manipulated objects. A model-referenced adaptive control law is developed for maintaining uniformly good performance over a wide range of motions and payloads. The effectiveness of the approach is demonstrated in several simulations and the system stability as a function of input is investigated. Also developed is a 'learning signal' approach designed to minimize initial transients arising from abrupt changes in the inertial payload.

Dubowsky, S.↗