Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Learning theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Modeling graphene sheet growth and dynamical matrix calculations using molecular dynamics

Molecular dynamics (MD) has been an incredibly useful tool to model physical processes that were synthesized experimentally but not fully understood. MD, through the use of semi-empirical inter-atomic potentials, has allowed understanding of different physical processes in materials science. Yet as well as providing useful insights into materials science, molecular dynamics has a wider range of usability. In this report, I will be detailing how MD can be used to study graphene formation from a carbon liquid which requires high temperatures and pressures. Beyond this, I will describe the usefulness of MD for understanding the physics for phonon transport quantum sensors. To do this, MD was employed to determine the dynamical matrix by treating atoms as coupled oscillators. An accurate understanding of the dynamical matrix of a system is required to calculate the non-equilibrium Green’s function used to describe the phonon transport within phonon wave-guides. I found that, across multiple pressures and temperatures, randomly placed carbon atoms will show evidence of pent-first formation with semi-empirical models. Density functional theory (DFT), on the other hand, was too computationally expensive to use for full scale MD simulations, but we have the possibility of training a machine learned interatomic potential to approximate DFT for carbon in the environments being studied for pent-first graphene sheet formation.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Deep Generative Modeling of Periodic Variable Stars Using Physical Parameters

The ability to generate physically plausible ensembles of variable sources is critical to the optimization of time domain survey cadences and the training of classification models on data sets with few to no labels. Traditional data augmentation techniques expand training sets by reenvisioning observed exemplars, seeking to simulate observations of specific training sources under different (exogenous) conditions. Unlike fully theory-driven models, these approaches do not typically allow principled interpolation nor extrapolation. Moreover, the principal drawback of theory-driven models lies in the prohibitive computational cost of simulating source observables from ab initio parameters. In this work, we propose a computationally tractable machine learning approach to generate realistic light curves of periodic variables capable of integrating physical parameters and variability classes as inputs. Our deep generative model, inspired by the transparent latent space generative adversarial networks, uses a variational autoencoder (VAE) architecture with temporal convolutional network layers, trained using the OGLE-III optical light curves and physical characteristics (e.g., effective temperature and absolute magnitude) from Gaia DR2. A test using the temperature–shape relationship of RR Lyrae demonstrates the efficacy of our generative “physics-enhanced latent space VAE” (PELS-VAE) model. Such deep generative models, serving as nonlinear nonparametric emulators, present a novel tool for astronomers to create synthetic time series over arbitrary cadences.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1999

A Quasi-Linear Behavioral Model and an Application to Self-Directed Learning

A model is presented that describes the relationship between one's knowledge of the world and the concomitant personal behaviors that serve as a mechanism to obtain desired outcomes. Integrated within this model are the differing roles that outcomes serve as motivators and as modifiers to one's worldview. The model is dichotomized between general and contextual applications. Because learner self-directedness (a personal characteristic) involves cognition and affection while self-directed learning (a pedagogic process) encompasses conation, behavior and introspection, the model can be dichotomized again in another direction. Presented also are the roles that cognitive motivation theories play in moving an individual through this behavioral model and the roles of wishes, self-efficacy, opportunity and self-influence.

Ponton, Michael K.↗
NASA NTRSDate not supplied

Expressing Functionality Using Design Patterns, A Real-World Example

Digital Engineering is a transformative strategy that leverages an integrated model-based approach to improve communication, decision making, design understanding, and acquisition efficiency of system development. As modern systems are derived from pre-existing systems, harvesting tacit knowledge from existing systems in a useful, model-based way will reduce the experiential learning and cognition required for new system development, contributing to a Digital Engineering transformation. This study enables such a technique by demonstrating the use of architectural theory in expressing tacit knowledge from existing systems and presenting that knowledge according to the model-based view offered by the Functional Architecture of Systems methodology. By validating the functional information expressed by the design pattern, this work solidifies design patterns as a critical component of a technical architecture and proposes a functional architecture viewpoint for describing mined knowledge in a usable, model-based, way suitable for archival in a modern knowledge management system.

Systems Engineering↗
DOE OSTI2025

Computational Investigation of a CO 2 Conversion Strategy via Diels–Alder Reaction in a Carbon Capture Solvent

Molecular-level insights into reactive separations are crucial for the design of new conversion pathways of carbon dioxide (CO 2 ). This work explores a postulated pathway that directs CO 2 to undergo inverse-electron-demand Diels–Alder reactions to produce heterocycles using the CO 2 chemically fixed on water-lean solvent molecules. Density functional theory calculations are applied to evaluate the lowest unoccupied molecular orbital (LUMO) energies of three types of reactants (1,3-butadiene, 1,3-cyclohexadiene, and 1,2,4,5-tetrazine) with various functional substituents. These calculations also provide a data set (5.8k data) for developing a machine learning model to efficiently predict LUMO energies. A computational screening of LUMO energies for an additional 47k diene and tetrazine candidates is performed, and a list of candidates with lowered LUMO energies by electron-withdrawing substituents is provided. These candidates are further examined by their reaction energy barriers computed from the interatomic potential or density functional theory. Two major energy barriers are identified, one for the proton transfer within the water-lean solvent and the other for the CO 2 transfer from the solvent molecule to the reactant candidate (diene or tetrazine). The functional substituents have a more significant impact on the second barrier but a very slight one on the first barrier. This exploratory work demonstrates a new possibility for guiding experimental efforts toward the chemical conversion of fixated CO 2 to value-added compounds.

Chemical reactions↗
DOE OSTI2024

Interpretable Machine Learning Models for Practical Antimonate Electrocatalyst Performance

Computationally predicting the performance of catalysts under reaction conditions is a challenging task due to the complexity of catalytic surfaces and their evolution in situ, different reaction paths, and the presence of solid-liquid interfaces in the case of electrochemistry. We demonstrate here how relatively simple machine learning models can be found that enable prediction of experimentally observed onset potentials. Inputs to our model are comprised of data from the oxygen reduction reaction on non-precious transition-metal antimony oxide nanoparticulate catalysts with a combination of experimental conditions and computationally affordable bulk atomic and electronic structural descriptors from density functional theory simulations. From human-interpretable genetic programming models, we identify key experimental descriptors and key supplemental bulk electronic and atomic structural descriptors that govern trends in onset potentials for these oxides and deduce how these descriptors should be tuned to increase onset potentials. Here, we finally validate these machine learning predictions by experimentally confirming that scandium as a dopant in nickel antimony oxide leads to a desired onset potential increase. Macroscopic experimental factors are found to be crucially important descriptors to be considered for models of catalytic performance, highlighting the important role machine learning can play here even in the presence of small datasets.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Improved Architectures and Training Algorithms for Deep Operator Networks

Operator learning techniques have recently emerged as a powerful tool for learning maps between infinite-dimensional Banach spaces. Trained under appropriate constraints, they can also be effective in learning the solution operator of partial differential equations (PDEs) in an entirely self-supervised manner. In this work we analyze the training dynamics of deep operator networks (DeepONets) through the lens of Neural Tangent Kernel theory, and reveal a bias that favors the approximation of functions with larger magnitudes. To correct this bias we propose to adaptively re-weight the importance of each training example, and demonstrate how this procedure can effectively balance the magnitude of back-propagated gradients during training via gradient descent. We also propose a novel network architecture that is more resilient to vanishing gradient pathologies. Taken together, our developments provide new insights into the training of DeepONets and consistently improve their predictive accuracy by a factor of 10-50x, demonstrated in the challenging setting of learning PDE solution operators in the absence of paired input-output observations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

First-Principles-Based Machine Learning Models for Phase Behavior and Transport Properties of CO 2

In this work, we construct distinct first-principles-based machine-learning models of CO 2 , reproducing the potential energy surface of the PBE-D3, BLYP-D3, SCAN and SCAN-rvv10 approximations of density functional theory. Here we employ the Deep Potential methodology to develop the models and consequently achieve a significant computational efficiency over ab initio molecular dynamics (AIMD) that allows for larger system sizes and time scales to be explored. Although our models are trained only with liquid phase configurations, they are able to simulate a stable interfacial system and predict vapor-liquid equilibrium properties, in good agreement with results from the literature. Because of the computational efficiency of the models, we are also able to obtain transport properties, such as viscosity and diffusion coefficients. We find that the SCAN-based model presents a temperature shift in the position of the critical point, while the SCAN-rvv10-based model shows improvement but still exhibits a temperature shift that remains approximately constant for all properties investigated in this work. We find that the BLYP-D3-based model generally performs better for liquid phase and vapor-liquid equilibrium properties, but the PBE-D3-based model is better suited for predicting transport properties.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Stability Constants of Lanthanide-nitrate Complexes in Aqueous Solutions: A Theoretical Study

Calculating stability constants for lanthanide--nitrate complexes in aqueous solution is challenging due to the complex free-energy landscapes of the participating species. In this work, we compare cluster-continuum solvation and condensed-phase approaches using universal machine learning interatomic potentials (MLIPs) for determining the stability constants of lanthanide--nitrate complexes in aqueous solutions. Within the cluster--continuum solvation framework at the B3LYP level of theory, reactions involving lanthanide coordination numbers of both 8 and 9 are found to be relevant. After an empirical linear free-energy correction, the cluster--continuum results fall on the same order-of-magnitude scale as the experimental stability constants. By contrast, MACE-MP0 MLIP underestimates lanthanide hydration numbers and gives PMF-derived stability constants with large deviations from experiment, whereas MACE-MATPES-R2SCAN improves both hydration structure and the stability-constant scale but still does not quantitatively reproduce the detailed lanthanide trend. Across both approaches, nitrate binding is best viewed as a labile coordination motif rather than a fixed mono- or bidentate structure, with hydration-shell structure influencing which configurations are favored. Overall, the cluster--continuum calculations provide a practical semi-quantitative baseline for the experimental stability-constant scale, while the explicit-solvent MLIP benchmarks show clear progress from MACE-MP0 to MACE-MATPES-r2SCAN but also highlight the need for lanthanide-targeted training, fine-tuning, or improved long-range and polarization treatments to obtain predictive thermodynamics for complex aqueous lanthanide chemistry.

Dinpajooh, Mohammadhasan↗
DOE OSTI2025

Classical-quantum scattering

We analyze the framework recently proposed by Oppenheim et al (2023 Nat. Commun. 14; 2023 Phys. Rev. X 13 041040; arXiv:2302.07283 [gr-qc]; 2023 J. High Energy Phys. JHEP08(2023)163) to model relativistic quantum fields coupled to relativistic, classical, stochastic fields (in particular, as a model of quantum matter coupled to ‘classical gravity’). Perhaps surprisingly, we find that we can define and calculate scattering probabilities which are Lorentz-covariant and conserve total probability, at least at tree level. As a concrete example, we analyze 2→2 scattering of quantum matter mediated by a classical Yukawa field. Mapping this to a gravitational coupling in the non-relativistic limit, and assuming that we can treat large objects as point masses, we find that the simplest possible ‘classical-quantum’ gravity theory constructed this way gives predictions for 2→2 gravitational scattering which are inconsistent with simple observations of, e.g. spacecraft undergoing slingshot maneuvers. We comment on lessons learned for attempts to couple quantum matter to ‘non-quantum’ gravity, or more generally, for attempts to couple relativistic quantum and classical systems.

Carney, Daniel↗
DOE OSTI2025

Why Do Nuclei Stick Together?

Although quantum chromodynamics (QCD) has long been accepted as the underlying theory of the strong nuclear force, connecting the structure and interactions of nuclei to the fundamental parameters of QCD remains challenging. In this talk, I will present new results from lattice QCD and effective field theory that explore how nuclear interactions look in a world where the quarks are much heavier than they are in nature, and discuss lessons that can be learned for nuclear physics as well as searches for physics beyond the Standard Model.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS1977

Storage and retrieval of mass spectral information

Computer handling of mass spectra serves two main purposes: the interpretation of the occasional, problematic mass spectrum, and the identification of the large number of spectra generated in the gas-chromatographic-mass spectrometric (GC-MS) analysis of complex natural and synthetic mixtures. Methods available fall into the three categories of library search, artificial intelligence, and learning machine. Optional procedures for coding, abbreviating and filtering a library of spectra minimize time and storage requirements. Newer techniques make increasing use of probability and information theory in accessing files of mass spectral information.

Hohn, M. E.↗
NASA NTRSDate not supplied

Let’s speak FRETish

FRET (https://github.com/NASA-SW-VnV/fret [github.com]) is a framework for the elicitation, formalization and analysis of requirements. FRET allows its user to enter requirements in a structured natural language called FRETish. Requirements written in FRETish are assigned unambiguous semantics. FRET supports its users in understanding this semantics and repairing requirements if applicable, by utilizing a variety of forms for each requirement: natural language description, formal mathematical logics, diagrams, and interactive simulation. FRET exports requirements into forms that can be used by a variety of analysis tools, including state-of-the-art model checkers and runtime monitoring tools. The talk will cover some of the theory behind the framework, present case studies from the aerospace and robotics domains, as well as current work on extending FRET for specifying requirements for software that learns.

FRET↗
DOE OSTI2024

Enhancing Distribution System Resilience: A First-Order Meta-RL Algorithm for Critical Load Restoration

The increasing frequency of extreme events and the integration of distributed energy resources (DERs) into modern grids have elevated the need for resilient and efficient critical load restoration strategies in distribution systems. However, the stochastic nature of renewable DERs, limited energy resource availability and the intricate nonlinearities inherent in complex grid control problem make the problem challenging. Although reinforcement learning (RL) and warm-start RL methods have shown promising results, their performance often falls short in rapidly adapting to new, unseen situations and typically requires exhaustive problem-specific tuning. To address these gaps, we propose a First-Order Meta-based RL (FOM-RL) algorithm within an online framework for adaptive and robust critical load restoration. By harnessing local DERs as the enabling technology, FOM-RL allows the RL agent to swiftly adapt to new unseen scenarios by leveraging previously acquired knowledge of different tasks. Experimental results provide evidence that proposed algorithm learns more efficiently and showcases generalization capabilities across diverse set of operational scenarios. Moreover, a rigorous theoretical analysis yields a tight sublinear regret bound, sensitive to temporal variability, with a task-averaged optimality gap bounded by O(VM+D*/(Tsquare root(M))). These results suggest that optimality improves with task similarity and an increased number of tasks M, reaffirming the efficacy and scalability of the proposed approach in addressing the complexities of critical load restoration in distribution systems.

complexity theory↗
DOE OSTI2022

Learning Optimal Multigrid Smoothers via Neural Networks

Multigrid methods are one of the most efficient techniques for solving large sparse linear systems arising from partial differential equations (PDEs) and graph Laplacians from machine learning applications. One of the key components of multigrid is smoothing, which aims at reducing high-frequency errors on each grid level. However, finding optimal smoothing algorithms is problem-dependent and can impose challenges for many problems. In this paper, we propose an efficient adaptive framework for learning optimized smoothers from operator stencils in the form of convolutional neural networks (CNNs). Here, the CNNs are trained on small-scale problems from a given type of PDEs based on a supervised loss function derived from multigrid convergence theories and can be applied to large-scale problems of the same class of PDEs. Numerical results on anisotropic rotated Laplacian problems and variable coefficient diffusion problems demonstrate improved convergence rates and solution time compared with classical hand-crafted relaxation methods.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Machine Learned Force Field Modeling of Metal Organic Frameworks for CO2 Direct Air Capture

Metal organic frameworks (MOFs) are a large class of porous materials and have garnered significant interest due to their large surface areas and their tunable physical and chemical properties. Numerous prior studies have been performed to screen large databases of this material class for promising DAC sorbent materials. These studies have often relied on classical model potentials. While density functional theory (DFT) calculations have been shown to be very accurate for modeling the interaction of CO2 with MOFs, such calculations are too computationally demanding for statistically significant adsorption predictions. To overcome this barrier, we developed methods for training models to achieve DFT-level accuracy for the forces and energies associated with MOF flexibility and CO2 adsorption using machine learned force fields (MLFFs). These methods were parametrized based on DFT calculations of CO2 in a flexible MOF and used to predict MOF structural properties as well as CO2 adsorption in several MOFs.

Findley, John↗
DOE OSTI2026

Ripening of Rh Nanoparticle Catalysts in Reverse Water–Gas Shift via a Data-Driven Model Combining Physics, Theory, and Experiment

Degradation via sintering is an ongoing challenge that impedes the broad commercial success of supported metallic nanoparticle catalysts. To mitigate degradation via informed catalyst design and process operations, here we aim to disambiguate the underlying mechanisms of sintering by combining theory and experiment in a quantitative framework. While mechanistic sintering models exist, they only model a single sintering pathway, even though multiple sintering mechanisms can occur simultaneously or dominate at different stages of the process. Data-driven machine learning models have emerged as a means to represent complex processes through data regression. However, machine learning models have very large data needs and lack mechanistic insights due to their black-box encoding. To develop an interpretive model of catalyst degradation via sintering, we constructed a hybrid model combining mechanistic “physics-based” models and data-driven methods to obtain both reliable predictions and mechanistic insights regarding experimentally observed sintering phenomena. Focusing on nanoparticle sintering in the Rh–TiO 2 catalyst for the reverse water–gas shift (RWGS) reaction, the hybrid model couples a mechanistic term for Ostwald ripening with energy values calculated via density functional theory (DFT) with a parametric, data-driven discrepancy function term for unmodeled mechanisms. The hybrid model is trained using Bayesian inference with data collected from small-angle X-ray scattering (SAXS) in situ experiments wherein average nanoparticle diameter versus time was measured at three relevant operating temperatures. The calibrated hybrid model results show that an Ostwald ripening-only model parameterized with fixed DFT energies does not fully capture the time and temperature dependence of the SAXS-observed sintering kinetics, and that an additional functional contribution, or DFT energy calibration, is required to reconcile simulation and experiment. Analysis of the hybrid-model error confirms that the hybrid model outperforms both the purely mechanistic and purely data-driven alternatives in terms of expected predictive accuracy for time-evolving average particle sizes. Furthermore, the results support the hypothesis that the Ostwald ripening mechanism is less important for explaining the sintering phenomena as operating temperature increases under an assumed fixed DFT parameterization. This could be explained in one of two ways: either latent, unmodeled sintering mechanisms dominate at higher temperatures, or the DFT uncertainty increases with temperature. The proposed modeling approach directly links theory to experiments and simulations via a statistical hybrid modeling framework and can be extended to other catalytic systems to improve predictive models and mechanistic understanding.

Bayesian hybrid modeling↗
DOE OSTI2024

Enhancing high-fidelity neural network potentials through low-fidelity sampling

The efficacy of neural network potentials (NNPs) critically depends on the quality of the configurational datasets used for training. Prior research using empirical potentials has shown that well-selected liquid–solid transitional configurations of a metallic system can be translated to other metallic systems. This study demonstrates that such validated configurations can be relabeled using density functional theory (DFT) calculations, thereby enhancing the development of high-fidelity NNPs. Training strategies and sampling approaches are efficiently assessed using empirical potentials and subsequently relabeled via DFT in a highly parallelized fashion for high-fidelity NNP training. Our results reveal that relying solely on energy and force for NNP training is inadequate to prevent overfitting, highlighting the necessity of incorporating stress terms into the loss functions. To optimize training involving force and stress terms, we propose employing transfer learning to fine-tune the weights, ensuring that the potential surface is smooth for these quantities composed of energy derivatives. This approach markedly improves the accuracy of elastic constants derived from simulations in both empirical potential-based NNPs and relabeled DFT-based NNPs. Overall, this study offers significant insights into leveraging empirical potentials to expedite the development of reliable and robust NNPs at the DFT level.

97 MATHEMATICS AND COMPUTING↗