Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Learning theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,153 records · Page 64
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Fundamental aspects of Spacetime and Quantum Fields

The proposal contained two goals: firstly, placing fundamental bound on thermalization in Quantum Field Theories (QFTs) and, secondly, developing our understanding of emergent spacetime from matrices through concrete models. Since the previous reporting period, in collaboration with Sean Hartnoll we have continued our study of entanglement edge modes in matrix quantum mechanics (MQM). This has resulted in two papers. The first applies our construction for the Matrix Quantum Hall system first to fuzzy sphere states known to correspond to stringy M2-branes in MQM. Entanglement in these states using machine learning methods have also been studied by Sean Hartnoll and Xizhi Han in previous work done under this grant. Our construction builds on this work, and further demonstrates how area laws on fuzzy geometries emerge from strongly coupled systems. The second paper generalizes this construction to all noncommutative geometries with curvature much larger than the noncommutativity parameter. We demonstrate that despite UV/IR mixing effects, the structure of entanglement edge mode irreducible representations is determined by the boundary area of subsystems. On manifolds without global symmetries, we have demonstrated that nonlocal effects inherent to noncommutative geometries resum into a change of frame of the metric structure, similar to the change from string frame to Einstein frame for entanglement entropies calculated in string theory. These advancements lay the groundwork for future progress in the understanding of emergent geometry from large-N theories. Using these techniques, we are currently working on applying our methods to noncom mutative geometries whose construction is not so well understood, such as the fuzzy 5-sphere. Despite their opacity these objects are quite important, as string physics in the bulk of holographic systems bears many features of noncommutative geometry. We have also laid the groundwork of applying our methods to tensor networks, one of the most powerful models for understanding how geometry emerges from entanglement.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Search for new physics using effective field theory in 13 TeV pp collision events that contain a top quark pair and a boosted Z or Higgs boson

A data sample containing top quark pairs ($\mathrm{t\bar{t}}$) produced in association with a Lorentz-boosted Z or Higgs boson is used to search for signs of new physics using effective field theory. The data correspond to an integrated luminosity of 138 fb$^{-1}$ of proton-proton collisions produced at a center-of-mass energy of 13 TeV at the LHC and collected by the CMS experiment. Selected events contain a single lepton and hadronic jets, including two identified with the decay of bottom quarks, plus an additional large-radius jet with high transverse momentum identified as a Z or Higgs boson decaying to a bottom quark pair. Machine learning techniques are employed to discriminate between $\mathrm{t\bar{t}}$Z or $\mathrm{t\bar{t}}$H events and events from background processes, which are dominated by $\mathrm{t\bar{t}}$ + jets production. No indications of new physics are observed. The signal strengths of boosted $\mathrm{t\bar{t}}$Z and $\mathrm{t\bar{t}}$H production are measured, and upper limits are placed on the $\mathrm{t\bar{t}}$Z and $\mathrm{t\bar{t}}$H differential cross sections as functions of the Z or Higgs boson transverse momentum. The effects of new physics are probed using a framework in which the standard model is considered to be the low-energy effective field theory of a higher energy scale theory. Eight possible dimension-six operators are added to the standard model Lagrangian and their corresponding coefficients are constrained via fits to the data.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

DFT Accurate Interatomic Potential for Molten NaCl from Machine Learning

Molten alkali chloride salts are a critical component in concentrated solar power and nuclear applications. Despite their ubiquity, the extreme chemical reactivity of molten alkali chlorides at high temperatures has presented a significant challenge in characterizing atomic structures and dynamic properties experimentally. In this work, we we investigate molten NaCl by performing high temperature molecular dynamics simulations using a Gaussian Approximation Potential (GAP) trained on Density Functional Theory (DFT) datasets. Our GAP model, trained with a meager 1000 atomic configurations, arrives at near ab initio accuracy with a mean absolute error of 1.5 meV/atom thus enabling fast analysis of high temperature salt properties on large length (5000 ion pairs) and time (> 1ns) scales currently inaccessible to ab initio simulations. Calculated structure factors and diffusion constants from our GAP model simulations show excellent agreement with experiments. Our results indicate that GAP models are able to capture the many-body interactions required to accurately model ionic-systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Analytical gradients for molecular-orbital-based machine learning

We report molecular-orbital-based machine learning (MOB-ML) enables the prediction of accurate correlation energies at the cost of obtaining molecular orbitals. Here, we present the derivation, implementation, and numerical demonstration of MOB-ML analytical nuclear gradients, which are formulated in a general Lagrangian framework to enforce orthogonality, localization, and Brillouin constraints on the molecular orbitals. The MOB-ML gradient framework is general with respect to the regression technique (e.g., Gaussian process regression or neural networks) and the MOB feature design. We show that MOB-ML gradients are highly accurate compared to other ML methods on the ISO17 dataset while only being trained on energies for hundreds of molecules compared to energies and gradients for hundreds of thousands of molecules for the other ML methods. The MOB-ML gradients are also shown to yield accurate optimized structures at a computational cost for the gradient evaluation that is comparable to a density-corrected density functional theory calculation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

A Multiple Filter Based Neural Network Approach to the Extrapolation of Adsorption Energies on Metal Surfaces for Catalysis Applications

Computational catalyst discovery involves the development of microkinetic reactor models based on estimated parameters determined from density functional theory (DFT). For complex surface chemistries, the number of reaction intermediates can be very large, and the cost of calculating the adsorption energies by DFT for all surface intermediates even for one active site model can become prohibitive. In this paper, we have identified appropriate descriptors and machine learning models that can be used to predict a significant part of these adsorption energies given data on the rest of them. Furthermore, our investigations also included the case when the species data used to train the predictive model are of different size relative to the species the model tries to predict—this is an extrapolation in the data space which is typically difficult with regular machine learning models. Due to the relative size of the available data sets, we have attempted to extrapolate from the larger species to the smaller ones in the current work. Here, we have developed a neural network based predictive model that combines an established additive atomic contribution based model with the concepts of a convolutional neural network that, when extrapolating, achieves a statistically significant improvement over the previous models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Visualizing the SEI formation between lithium metal and solid-state electrolyte

The solid electrolyte interphase (SEI) is regarded as the most important factor affecting the durability of lithium-metal anode in all-solid-state batteries (ASSBs). Despite its significance, the nucleation and growth mechanism of SEI is not yet well understood. Here, we elucidate the thermodynamics and kinetics governing SEI formation at the Li|β-Li 3 PS 4 interface at the atomic scale via thermodynamic phase equilibrium analysis and machine-learning-potential-assisted molecular dynamics (MD) simulations. An accurate moment tensor potential using the machine-learning method is developed for a reactive model of Li|β-Li 3 PS 4 . This potential enabled us to perform large-scale MD simulations with the model size expanded to the experimental dimensions (~40 nm) while maintaining the same level of accuracy as density functional theory calculations. The results reveal a four-stage evolution process at the Li|β-Li 3 PS 4 interface, namely (i) fast ion diffusion, (ii) nucleation, (iii) Li 2 S growth, and (iv) stabilization. Notably, we demonstrate that the SEI can be categorized into crystalline and amorphous regions. The simulated SEI thickness, structure, and composition closely match experimental findings, validating the accuracy of the MD simulations. We further disclose the significant impact of ion diffusion kinetic limitations on the phase formation and crystallization of interfacial products. Furthermore, we shed light on the detailed potential energy (PE) distribution of lithium along the direction perpendicular to the interface. Finally, this information is crucial for better understanding interfacial ion mobility.

25 ENERGY STORAGE↗
DOE OSTI2025

Two-dimensional ring polymer molecular dynamics determination of the MnO + + H 2 /D 2 reaction rates on a Δ-machine learned potential energy surface

In this work, we investigate the impact of nuclear quantum effects in the kinetics of the MnO + + H 2 reaction, a prototypical system for gas-phase H 2 activation by transition metal oxide ions. The DFT based potential energy surfaces (PESs) for the lowest-lying quintet and septet spin states reported in our previous work are improved by 2953 newly calculated CCSD(T)/AVDZ points using a delta-machine learning (Δ-ML) method. To examine nuclear quantum effects, the rate coefficients are computed using ring-polymer molecular dynamics (RPMD). Due to the mechanistic complexity of the reaction, two reaction coordinates are necessary to map out the free-energy surface and an extended RPMD rate theory is developed. The calculated RPMD rate coefficients on the new PES are in better agreement with experimental data. The calculated kinetic isotope effects (KIEs) range from 1.6 to 1.8, also in good agreement with the experimental values. Additionally, the converged RPMD rate coefficients are 2.3 to 3.1 times higher than their classical counterparts across the studied temperature range, suggesting the presence of moderate nuclear quantum effects in this reaction.

Liu, Yang [University of New Mexico, Albuquerque, ↗
DOE OSTI2022

Quantum advantages for Pauli channel estimation

We show that entangled measurements provide an exponential advantage in sample complexity for Pauli channel estimation, which is both a fundamental problem and a practically important subroutine for benchmarking near-term quantum devices. The specific task we consider is to simultaneously learn all the eigenvalues of an n-qubit Pauli channel to ±ε precision. We give an estimation protocol with an n-qubit ancilla that succeeds with high probability using only O(n/ε 2 ) copies of the Pauli channel, while proving that any ancilla-free protocol (possibly with adaptive control and channel concatenation) would need at least Ω(2 n/3 ) rounds of measurement. We further study the advantages provided by a small number of ancillas. For the case that a k-qubit ancilla (k≤n) is available, we obtain a sample complexity lower bound of Ω(2 (n-k)/3 ) for any nonconcatenating protocol, and a stronger lower bound of Ω(n 2n-k ) for any nonadaptive, nonconcatenating protocol, which is shown to be tight. We also show how to apply the ancilla-assisted estimation protocol to a practical quantum benchmarking task in a noise-resilient and sample-efficient manner, given reasonable noise assumptions. Our results provide a practically interesting example for quantum advantages in learning and also bring insights for quantum benchmarking.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Symbolic diagnostics to interpret and analyze neural network models

Embedded machine-learned models (EMLMs) have the promise to improve the predictive accuracy of engineering simulators in environments of national interest. EMLMs often comprise complex input-output maps (e.g., neural networks), which make them unamenable to rigorous analysis and generally difficult to interpret. In the face of decades of theory, this lack of interpretability is a significant barrier to building confidence in these models. This work outlines an approach to interpret EMLMs using sparse polynomial regression for comparison with theoretical understanding. To do so, we build on the concept of Locally Interpretable Model-agnostic Explanations (LIME) using physics-informed clustering, prototype selection, and library construction. While general, we demonstrate our method on tensor-basis neural networks used in Reynolds-Averaged Navier-Stokes simulations of hypersonic fluid flows. Results are presented for a simulated toy model and for direct numerical simulations (DNS) of turbulent flows over a flat plate.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2000

Experimental Verification of Electric Drive Technologies Based on Artificial Intelligence Tools

In this report, a fully integrated prototype of a flight servo control system is successfully developed and implemented using brushless dc motors. The control system is developed by the fuzzy logic theory, and implemented with a multilayer neural network. First, a neural network-based architecture is introduced for fuzzy logic control. The characteristic rules and their membership functions of fuzzy systems are represented as the processing nodes in the neural network structure. The network structure and the parameter learning are performed simultaneously and online in the fuzzy-neural network system. The structure learning is based on the partition of input space. The parameter learning is based on the supervised gradient decent method, using a delta adaptation law. Using experimental setup, the performance of the proposed control system is evaluated under various operating conditions. Test results are presented and discussed in the report. The proposed learning control system has several advantages, namely, simple structure and learning capability, robustness and high tracking performance and few nodes at hidden layers. In comparison with the PI controller, the proposed fuzzy-neural network system can yield a better dynamic performance with shorter settling time, and without overshoot. Experimental results have shown that the proposed control system is adaptive and robust in responding to a wide range of operating conditions. In summary, the goal of this study is to design and implement-advanced servosystems to actuate control surfaces for flight vehicles, namely, aircraft and helicopters, missiles and interceptors, and mini- and micro-air vehicles.

Rubaai, Ahmed↗
DOE OSTI2025

Bayesian prior construction for uncertainty quantification in first-principles statistical mechanics

First-principles statistical mechanics enables the prediction of thermodynamic and kinetic properties of materials, but is computationally expensive. Many approaches require surrogate models to calculate energies within Monte Carlo or molecular dynamics simulations. Inexpensive surrogates such as cluster expansions enable otherwise intractable calculations by interpolating data from higher accuracy methods, such as Density Functional Theory (DFT). Surrogate models introduce uncertainty into downstream calculations, in addition to any uncertainty inherent to DFT calculations. Bayesian frameworks address this by quantifying uncertainty and incorporating expert knowledge through priors. However, constructing effective priors remains challenging. This work introduces and describes practical strategies for building Bayesian cluster expansions, focusing on basis truncation, hyperparameter selection, and ground state replication. We analyze multiple basis truncation schemes, compare cross-validation to the evidence-approximation for hyperparameter optimization, and provide methods to find and enforce ground-state-preserving models through priors. Additionally, we compare the uncertainties between different approximations to DFT (LDA, PBE, SCAN) against the uncertainty introduced with the use of cluster expansion surrogate models. These approaches are demonstrated on the BCC Li x Mg 1-x and Li x Al 1-x alloys, which are both of interest for solid-state Li batteries. Our results provide guidelines for constructing and utilizing Bayesian cluster expansions, thereby improving the transparency of materials modeling. Furthermore, the approaches and insights developed in this work can be transferred to a wide range of cluster expansion surrogate models, including the atomic cluster expansion and related machine-learned interatomic potential architectures.

Alloy theory↗
NASA NTRS2002

Machine Learning for Biological Trajectory Classification Applications

Machine-learning techniques, including clustering algorithms, support vector machines and hidden Markov models, are applied to the task of classifying trajectories of moving keratocyte cells. The different algorithms axe compared to each other as well as to expert and non-expert test persons, using concepts from signal-detection theory. The algorithms performed very well as compared to humans, suggesting a robust tool for trajectory classification in biological applications.

Sbalzarini, Ivo F.↗
NASA NTRS2010

Landmark Detection in Orbital Images Using Salience Histograms

NASA's planetary missions have collected, and continue to collect, massive volumes of orbital imagery. The volume is such that it is difficult to manually review all of the data and determine its significance. As a result, images are indexed and searchable by location and date but generally not by their content. A new automated method analyzes images and identifies "landmarks," or visually salient features such as gullies, craters, dust devil tracks, and the like. This technique uses a statistical measure of salience derived from information theory, so it is not associated with any specific landmark type. It identifies regions that are unusual or that stand out from their surroundings, so the resulting landmarks are context-sensitive areas that can be used to recognize the same area when it is encountered again. A machine learning classifier is used to identify the type of each discovered landmark. Using a specified window size, an intensity histogram is computed for each such window within the larger image (sliding the window across the image). Next, a salience map is computed that specifies, for each pixel, the salience of the window centered at that pixel. The salience map is thresholded to identify landmark contours (polygons) using the upper quartile of salience values. Descriptive attributes are extracted for each landmark polygon: size, perimeter, mean intensity, standard deviation of intensity, and shape features derived from an ellipse fit.

Wagstaff, Kiri L.↗
NASA NTRSDate not supplied

Utilizing Experimental-based Line Positions for Semi-empirical IR Line Lists

Molecular IR line lists computed from semi-empirically refined ab initio potential energy surface and high quality ab initio dipole moment surface may have line position accuracy typically within 0.01 - 0.05 cm−1. For high resolution spectroscopy databases, it is necessary to integrate the computed theoretical IR intensities with the line positions accurately determined from experiments and (or) reliably derived from Effective Hamiltonian models. However, it is not a trivial task, and the choices in reality are heavily contingent upon the coverage, consistency, and accuracy of the data available for a specific molecule or isotopologue. We will present several approaches applied to recent Ames IR line lists of CO 2 1, N 2 O 2 , and OCS to demonstrate how challenging such integration may become, and what we have learned From these projects. Discussions will focus on the relation between each different scenario and the corresponding choice or solution, including their advantages and limits, how the semi-empirical IR line lists can help, and what else may be needed for future improvements. We will emphasize that the “Theory+Experiment” synergy may still play significant role in the determination of the best line positions.

Effective Hamiltonian models↗
DOE OSTI2023

Quantum logic gate synthesis as a Markov decision process

Reinforcement learning has witnessed recent applications to a variety of tasks in quantum programming. The underlying assumption is that those tasks could be modeled as Markov decision processes (MDPs). Here, we investigate the feasibility of this assumption by exploring its consequences for single-qubit quantum state preparation and gate compilation. By forming discrete MDPs, we solve for the optimal policy exactly through policy iteration. We find optimal paths that correspond to the shortest possible sequence of gates to prepare a state or compile a gate, up to some target accuracy. Our method works in both the absence and presence of noise and compares favorably to other quantum compilation methods, such as the Ross–Selinger algorithm. This work provides theoretical insight into why reinforcement learning may be successfully used to find optimally short gate sequences in quantum programming.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Machine Learning-Based Model Predictive Control of Two-Time-Scale Systems

In this study, we present a general form of nonlinear two-time-scale systems, where singular perturbation analysis is used to separate the dynamics of the slow and fast subsystems. Machine learning techniques are utilized to approximate the dynamics of both subsystems. Specifically, a recurrent neural network (RNN) and a feedforward neural network (FNN) are used to predict the slow and fast state vectors, respectively. Moreover, we investigate the generalization error bounds for these machine learning models approximating the dynamics of two-time-scale systems. Next, under the assumption that the fast states are asymptotically stable, our focus shifts toward designing a Lyapunov-based model predictive control (LMPC) scheme that exclusively employs the RNN to predict the dynamics of the slow states. Additionally, we derive sufficient conditions to guarantee the closed-loop stability of the system under the sample-and-hold implementation of the controller. A nonlinear chemical process example is used to demonstrate the theory. In particular, two RNN models are constructed: one to model the full two-time-scale system and the other to predict solely the slow state vector. Both models are integrated within the LMPC scheme, and we compare their closed-loop performance while assessing the computational time required to execute the LMPC optimization problem.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

What's Left for a Computational Chemist To Do in the Age of Machine Learning?

Machine learning (ML) has become a central focus of the computational chemistry community. In this paper, I will first discuss my personal history in the field. Then I will provide a broader view of how this resurgence in ML interest echoes and advances upon earlier efforts. Although numerous changes have brought about this latest wave, one of the most significant is the increased accuracy and efficiency of low-cost methods (e.g., density functional theory or DFT) that have made it possible to generate large data sets for ML models. ML has also been used to bypass, guide, or improve DFT. The field of computational chemistry thus finds itself at a crossroads as ML both augments and supersedes traditional efforts. I will present what I believe the role of the computational chemist will be in this evolving landscape, with specific focus on my experience in the development of autonomous workflows in computational materials discovery for open-shell transition-metal chemistry.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Adaptive Discovery and Mixed-Variable Optimization of Next Generation Synthesizable Microelectronic Materials

Design of new microelectronic materials is characterized by several challenges such as high-dimensionality of the atomic structure-composition variable space, formidable cost of directly using high-fidelity simulations for design optimization, dispersity in literature-reported similar materials and synthesis methods, complex physical mechanisms, and mixed qualitative and quantitative design variables that lead to a disjointed design space. Even though machine learning (ML) techniques have been employed to expedite materials innovation, existing methods treat ML and design optimization as two separate processes, failing to resolve the fundamental challenges associated with high dimensionality and mixed-variable complexity. We have developed a ML enhanced mixed-variable material design optimization framework to efficiently extract useful information from existing data in literature and physics-based simulations to guide the autonomous search for optimal materials. Our proposed framework is composed of four computational modules: (1) a natural language processing (NLP) based virtual screening module, (2) classification based concept exploration module, (3) a density functional theory (DFT)-based high-fidelity evaluation model, and (4) a novel latent-variable Gaussian process (LVGP) ML model for mixed-variable problems with uncertainty quantification, which seamlessly integrates with Bayesian Optimization (BO) and achieves superb efficiency through embedded physics-based dimension reduction. Our approach is demonstrated and validated using the testbed of functional materials exhibiting metal-insulation transitions (MITs), with the targeted reversible resistivity changes (∼10^5) near room temperature. At the end of the 30-month project, we have developed a series of new ML techniques using NLP, conditional variational autoencoders, active learning, latent-variable Gaussian processes, integrated with Bayesian optimization. Our project has resulted in new predicted MITs compounds and improved understanding of MITs microscopic mechanisms, which in turn will revolutionize microelectronics science to provide energy-saving solutions. Our research has improved both creativity and efficiency in transforming rare-event discoveries of new functional materials to persistent innovations. In addition to open-sourcing the online MIT database and the classification model, the LVGP open source code has been downloaded more than 15,000 times within two years. More than 40 MIT compounds have been identified and many have been pursued experimentally via collaborators. The research results are published in close to 20 collaborative papers in high-impact journals, such as Chem. Mater., Appl. Phys. Rev., Sci. Rep., among others of design space.

36 MATERIALS SCIENCE↗