Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Learning Theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,369 records · Page 76

Uncertainty-aware mixed-variable machine learning for materials design

Abstract Data-driven design shows the promise of accelerating materials discovery but is challenging due to the prohibitive cost of searching the vast design space of chemistry, structure, and synthesis methods. Bayesian optimization (BO) employs uncertainty-aware machine learning models to select promising designs to evaluate, hence reducing the cost. However, BO with mixed numerical and categorical variables, which is of particular interest in materials design, has not been well studied. In this work, we survey frequentist and Bayesian approaches to uncertainty quantification of machine learning with mixed variables. We then conduct a systematic comparative study of their performances in BO using a popular representative model from each group, the random forest-based Lolo model (frequentist) and the latent variable Gaussian process model (Bayesian). We examine the efficacy of the two models in the optimization of mathematical functions, as well as properties of structural and functional materials, where we observe performance differences as related to problem dimensionality and complexity. By investigating the machine learning models’ predictive and uncertainty estimation capabilities, we provide interpretations of the observed performance differences. Our results provide practical guidance on choosing between frequentist and Bayesian uncertainty-aware machine learning models for mixed-variable BO in materials design.

36 MATERIALS SCIENCE↗

Exploring Professor Motivations and Implementations of a Real-World Problem-Solving Project: A Case Study in Preparing Students for the Emerging Building Science Industry: Preprint

Engineering education literature offers a variety of theoretical and conceptual frameworks for project-based learning. This study explores the implementation of real-world problem-solving projects in engineering education. The research team analyzed the motivations and methods behind professors' adoption of such projects through exploratory qualitative interviews with seven professor participants who integrated a nation-wide student competition into their courses. We analyzed the resulting data using a constructivist grounded theory approach to identify key themes of professor practices. Findings reveal that the real-world aspect of the projects and alignment with values and research interests were primary motivators for implementation. While implementation methods varied significantly based on context (i.e., university setting, course type), we found that these projects could be effectively integrated into various classroom settings. The findings support the recommendation for non-academic institutions to develop and manage competitions that can be integrated into classrooms and which offer a point of engagement that is available to professors from a wide range of disciplines.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Revealing the Formation Energy–Exfoliation Energy–Structure Correlation of MAB Phases Using Machine Learning and DFT

MAB phases are popular as high-temperature materials with high damage tolerance and excellent electrical conductivity that are used to exfoliate two-dimensional (2D) transition metal borides (MBenes); a promising material for developing next- generation nanodevices. In this report, we explore the correlation between the formation energy, exfoliation energy and structural factors of MAB phases using DFT and machine learning. In order to do so, we developed three different machine learning models based on the support vector machine, deep neural network, and random forest regressor to study the stability of the MAB phases by calculating their formation energies. Furthermore, our support vector machine and deep neural network models are capable of predicting the formation energies with mean absolute errors less than 0.1 eV/atom. We demonstrated that the stability of a MAB phase for a given transition metal decreases when the A element changes from Al to Tl. The density functional theory (DFT) re- vealed that M-A and M-B bond strength strongly correlates with the stability of MAB phases. In addition, the exfoliation possibility of 2D MBenes becomes higher when the A element changes from Al to Tl due to weakening of M-A and M-B bonds.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Chaconne: A Statistical Approach to Nonlocal Compression for Supervised Learning, Semi-Supervised Learning, and Anomaly Detection

This project developed a novel statistical understanding of compression analytics (CA), which has challenged and clarified some core assumptions about CA, and enabled the development of novel techniques that address vital challenges of national security. Specifically, this project has yielded the development of novel capabilities including 1. Principled metrics for model selection in CA, 2. Techniques for deriving/applying optimal classification rules and decision theory to supervised CA, including how to properly handle class imbalance and differing costs of misclassification, 3. Two techniques for handling nonlocal information in CA, 4. A novel technique for unsupervised CA that is agnostic with regard to the underlying compression algorithm, 5. A framework for semisupervised CA when a small number of labels are known in an otherwise large unlabeled dataset. 6. The academic alliance component of this project has focused on the development of a novel exemplar-based Bayesian technique for estimating variable length Markov models (closely related to PPM [prediction by partial matching] compression techniques). We have developed examples illustrating the application of our work to text, video, genetic sequences, and unstructured cybersecurity log files.

99 GENERAL AND MISCELLANEOUS↗

Dataset of theoretical multinary perovskite oxides

Perovskite oxides (ternary chemical formula ABO 3 ) are a diverse class of materials with applications including heterogeneous catalysis, solid-oxide fuel cells, thermochemical conversion, and oxygen transport membranes. However, their multicomponent (chemical formula $A_xA^{'}_{1-x}B_yB^{'}_{1-y}O_3$) chemical space is underexplored due to the immense number of possible compositions. To expand the number of computed $A_xA^{'}_{1-x}B_yB^{'}_{1-y}O_3$ compounds we report a dataset of 66,516 theoretical multinary oxides, 59,708 of which are perovskites. First, 69,407 $A_{0.5}A^{'}_{0.5}B_{0.5}B^{'}_{0.5}O_3$ compositions were generated in the a - b + a - Glazer tilting mode using the computationally-inexpensive Structure Prediction and Diagnostic Software (SPuDS) program. Next, we optimized these structures with density functional theory (DFT) using parameters compatible with the Materials Project (MP) database. Our dataset contains these optimized structures and their formation (ΔH f ) and decomposition enthalpies (ΔH d ) computed relative to MP tabulated elemental references and competing phases, respectively. This dataset can be mined, used to train machine learning models, and rapidly and systematically expanded by optimizing more SPuDS-generated $A_{0.5}A^{'}_{0.5}B_{0.5}B^{'}_{0.5}O_3$ perovskite structures using MP-compatible DFT calculations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Location-oblivious data transfer with flying entangled qudits

We present a simple and practical quantum protocol involving two mistrustful agencies in Minkowski space, which allows Alice to transfer data to Bob at a space-time location that neither can predict in advance. The location depends on both Alice's and Bob's actions. The protocol guarantees unconditionally to Alice that Bob learns the data at a randomly determined location; it guarantees to Bob that Alice will not learn the transfer location even after the protocol is complete. The task implemented, transferring data at a space-time location that remains hidden from the transferrer, has no precise analog in nonrelativistic quantum cryptography. It illustrates further the scope for novel cryptographic applications of relativistic quantum theory.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

HD-Bind: Encoding of Molecular Structure with Low Precision, Hyperdimensional Binary Representations

Publicly available collections of drug-like molecules have grown to comprise tens of billions of compounds due to advances in combinatorial chemistry. Traditional methods for identifying "hit" molecules from a large collection of potential drug-like candidates have relied on biophysical theory to compute approximations to the Gibbs free energy of the binding interaction between the drug and its protein target. These approaches have the major drawback that they require exceptional computing capabilities for even relatively small collections of molecules. Hyperdimensional Computing (HDC) is a recently-proposed learning paradigm that represents data with high-dimension binary vectors; this allows the use of low-precision binary vector arithmetic to create models of the data that can be learned without the need for the gradient-based optimization required in many conventional machine learning and deep learning methods. This algorithmic simplicity allows for acceleration in hardware that has been previously demonstrated in a range of application areas. We consider existing HDC approaches for molecular property classification and introduce two novel encodings of a commonly-used molecular representation, the extended connectivity fingerprint (ECFP). We show that HDC-based inference methods are as much as 91 times more efficient than traditional machine learning methods, and achieve an acceleration of nearly nine orders of magnitude compared to molecular docking. Our results show that HDC accelerated methods retain competitive accuracy on a number of well-studied tasks such as molecular property predictions using the MoleculeNet dataset, and bind/no-bind activity classification using the DUD-E and LIT-PCBA datasets. Our work thus motivates further investigation into molecular representation learning to develop ultraefficient pre-screening tools.

Jones, William↗

Fundamental aspects of Spacetime and Quantum Fields

The proposal contained two goals: firstly, placing fundamental bound on thermalization in Quantum Field Theories (QFTs) and, secondly, developing our understanding of emergent spacetime from matrices through concrete models. Since the previous reporting period, in collaboration with Sean Hartnoll we have continued our study of entanglement edge modes in matrix quantum mechanics (MQM). This has resulted in two papers. The first applies our construction for the Matrix Quantum Hall system first to fuzzy sphere states known to correspond to stringy M2-branes in MQM. Entanglement in these states using machine learning methods have also been studied by Sean Hartnoll and Xizhi Han in previous work done under this grant. Our construction builds on this work, and further demonstrates how area laws on fuzzy geometries emerge from strongly coupled systems. The second paper generalizes this construction to all noncommutative geometries with curvature much larger than the noncommutativity parameter. We demonstrate that despite UV/IR mixing effects, the structure of entanglement edge mode irreducible representations is determined by the boundary area of subsystems. On manifolds without global symmetries, we have demonstrated that nonlocal effects inherent to noncommutative geometries resum into a change of frame of the metric structure, similar to the change from string frame to Einstein frame for entanglement entropies calculated in string theory. These advancements lay the groundwork for future progress in the understanding of emergent geometry from large-N theories. Using these techniques, we are currently working on applying our methods to noncom mutative geometries whose construction is not so well understood, such as the fuzzy 5-sphere. Despite their opacity these objects are quite important, as string physics in the bulk of holographic systems bears many features of noncommutative geometry. We have also laid the groundwork of applying our methods to tensor networks, one of the most powerful models for understanding how geometry emerges from entanglement.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Search for new physics using effective field theory in 13 TeV pp collision events that contain a top quark pair and a boosted Z or Higgs boson

A data sample containing top quark pairs ($\mathrm{t\bar{t}}$) produced in association with a Lorentz-boosted Z or Higgs boson is used to search for signs of new physics using effective field theory. The data correspond to an integrated luminosity of 138 fb$^{-1}$ of proton-proton collisions produced at a center-of-mass energy of 13 TeV at the LHC and collected by the CMS experiment. Selected events contain a single lepton and hadronic jets, including two identified with the decay of bottom quarks, plus an additional large-radius jet with high transverse momentum identified as a Z or Higgs boson decaying to a bottom quark pair. Machine learning techniques are employed to discriminate between $\mathrm{t\bar{t}}$Z or $\mathrm{t\bar{t}}$H events and events from background processes, which are dominated by $\mathrm{t\bar{t}}$ + jets production. No indications of new physics are observed. The signal strengths of boosted $\mathrm{t\bar{t}}$Z and $\mathrm{t\bar{t}}$H production are measured, and upper limits are placed on the $\mathrm{t\bar{t}}$Z and $\mathrm{t\bar{t}}$H differential cross sections as functions of the Z or Higgs boson transverse momentum. The effects of new physics are probed using a framework in which the standard model is considered to be the low-energy effective field theory of a higher energy scale theory. Eight possible dimension-six operators are added to the standard model Lagrangian and their corresponding coefficients are constrained via fits to the data.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Predicting the mechanical response of oligocrystals with deep learning

In this study, we employ data-driven homogenization approaches to predict the particular mechanical evolution of polycrystalline aggregates with tens of individual crystals. In these oligocrystals the differences in stress response due to microstructural variation is pronounced. Shell-like structures produced by metal-based additive manufacturing and the like make the prediction of the behavior of oligocrystals technologically relevant. The predictions of traditional homogenization theories based on grain volumes are not sensitive to variations in local grain neighborhoods. Direct simulation of the local response with crystal plasticity finite element methods is more detailed, but the computations are expensive. To represent the stress-strain response of a polycrystalline sample given its initial grain texture and morphology we have designed a novel neural network that incorporates a convolution component to observe and reduce the information in the crystal texture field and a recursive component to represent the causal nature of the history information. This model exhibits accuracy on par with crystal plasticity simulations at minimal computational cost per prediction.

36 MATERIALS SCIENCE↗

DFT Accurate Interatomic Potential for Molten NaCl from Machine Learning

Molten alkali chloride salts are a critical component in concentrated solar power and nuclear applications. Despite their ubiquity, the extreme chemical reactivity of molten alkali chlorides at high temperatures has presented a significant challenge in characterizing atomic structures and dynamic properties experimentally. In this work, we we investigate molten NaCl by performing high temperature molecular dynamics simulations using a Gaussian Approximation Potential (GAP) trained on Density Functional Theory (DFT) datasets. Our GAP model, trained with a meager 1000 atomic configurations, arrives at near ab initio accuracy with a mean absolute error of 1.5 meV/atom thus enabling fast analysis of high temperature salt properties on large length (5000 ion pairs) and time (> 1ns) scales currently inaccessible to ab initio simulations. Calculated structure factors and diffusion constants from our GAP model simulations show excellent agreement with experiments. Our results indicate that GAP models are able to capture the many-body interactions required to accurately model ionic-systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Accounting for Technological Change in Regulatory Impact Analyses: The Learning Curve Technique

Regulatory impact assessment is formally required by the U.S. and many other nations in order to help governments weigh the costs and benefits of proposed regulations, particularly as they compare to those of alternative actions and other government priorities. 1 One of the “best practices” of regulatory impact assessments, as established by the OECD, is to use estimates of costs that are grounded in economic theory. Economic theory indicates that changes in compliance costs should be expected over time as a result of factors related to technological innovation. But many U.S. regulatory impact assessments have traditionally employed a practice that is in conflict with this expectation: they take current estimates of the costs of complying with a proposed regulation and project that those costs will remain unchanged over the full time period that the regulation would be in effect.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Analytical gradients for molecular-orbital-based machine learning

We report molecular-orbital-based machine learning (MOB-ML) enables the prediction of accurate correlation energies at the cost of obtaining molecular orbitals. Here, we present the derivation, implementation, and numerical demonstration of MOB-ML analytical nuclear gradients, which are formulated in a general Lagrangian framework to enforce orthogonality, localization, and Brillouin constraints on the molecular orbitals. The MOB-ML gradient framework is general with respect to the regression technique (e.g., Gaussian process regression or neural networks) and the MOB feature design. We show that MOB-ML gradients are highly accurate compared to other ML methods on the ISO17 dataset while only being trained on energies for hundreds of molecules compared to energies and gradients for hundreds of thousands of molecules for the other ML methods. The MOB-ML gradients are also shown to yield accurate optimized structures at a computational cost for the gradient evaluation that is comparable to a density-corrected density functional theory calculation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A Multiple Filter Based Neural Network Approach to the Extrapolation of Adsorption Energies on Metal Surfaces for Catalysis Applications

Computational catalyst discovery involves the development of microkinetic reactor models based on estimated parameters determined from density functional theory (DFT). For complex surface chemistries, the number of reaction intermediates can be very large, and the cost of calculating the adsorption energies by DFT for all surface intermediates even for one active site model can become prohibitive. In this paper, we have identified appropriate descriptors and machine learning models that can be used to predict a significant part of these adsorption energies given data on the rest of them. Furthermore, our investigations also included the case when the species data used to train the predictive model are of different size relative to the species the model tries to predict—this is an extrapolation in the data space which is typically difficult with regular machine learning models. Due to the relative size of the available data sets, we have attempted to extrapolate from the larger species to the smaller ones in the current work. Here, we have developed a neural network based predictive model that combines an established additive atomic contribution based model with the concepts of a convolutional neural network that, when extrapolating, achieves a statistically significant improvement over the previous models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Visualizing the SEI formation between lithium metal and solid-state electrolyte

The solid electrolyte interphase (SEI) is regarded as the most important factor affecting the durability of lithium-metal anode in all-solid-state batteries (ASSBs). Despite its significance, the nucleation and growth mechanism of SEI is not yet well understood. Here, we elucidate the thermodynamics and kinetics governing SEI formation at the Li|β-Li 3 PS 4 interface at the atomic scale via thermodynamic phase equilibrium analysis and machine-learning-potential-assisted molecular dynamics (MD) simulations. An accurate moment tensor potential using the machine-learning method is developed for a reactive model of Li|β-Li 3 PS 4 . This potential enabled us to perform large-scale MD simulations with the model size expanded to the experimental dimensions (~40 nm) while maintaining the same level of accuracy as density functional theory calculations. The results reveal a four-stage evolution process at the Li|β-Li 3 PS 4 interface, namely (i) fast ion diffusion, (ii) nucleation, (iii) Li 2 S growth, and (iv) stabilization. Notably, we demonstrate that the SEI can be categorized into crystalline and amorphous regions. The simulated SEI thickness, structure, and composition closely match experimental findings, validating the accuracy of the MD simulations. We further disclose the significant impact of ion diffusion kinetic limitations on the phase formation and crystallization of interfacial products. Furthermore, we shed light on the detailed potential energy (PE) distribution of lithium along the direction perpendicular to the interface. Finally, this information is crucial for better understanding interfacial ion mobility.

25 ENERGY STORAGE↗

Two-dimensional ring polymer molecular dynamics determination of the MnO + + H 2 /D 2 reaction rates on a Δ-machine learned potential energy surface

In this work, we investigate the impact of nuclear quantum effects in the kinetics of the MnO + + H 2 reaction, a prototypical system for gas-phase H 2 activation by transition metal oxide ions. The DFT based potential energy surfaces (PESs) for the lowest-lying quintet and septet spin states reported in our previous work are improved by 2953 newly calculated CCSD(T)/AVDZ points using a delta-machine learning (Δ-ML) method. To examine nuclear quantum effects, the rate coefficients are computed using ring-polymer molecular dynamics (RPMD). Due to the mechanistic complexity of the reaction, two reaction coordinates are necessary to map out the free-energy surface and an extended RPMD rate theory is developed. The calculated RPMD rate coefficients on the new PES are in better agreement with experimental data. The calculated kinetic isotope effects (KIEs) range from 1.6 to 1.8, also in good agreement with the experimental values. Additionally, the converged RPMD rate coefficients are 2.3 to 3.1 times higher than their classical counterparts across the studied temperature range, suggesting the presence of moderate nuclear quantum effects in this reaction.

Liu, Yang [University of New Mexico, Albuquerque, ↗

Quantum advantages for Pauli channel estimation

We show that entangled measurements provide an exponential advantage in sample complexity for Pauli channel estimation, which is both a fundamental problem and a practically important subroutine for benchmarking near-term quantum devices. The specific task we consider is to simultaneously learn all the eigenvalues of an n-qubit Pauli channel to ±ε precision. We give an estimation protocol with an n-qubit ancilla that succeeds with high probability using only O(n/ε 2 ) copies of the Pauli channel, while proving that any ancilla-free protocol (possibly with adaptive control and channel concatenation) would need at least Ω(2 n/3 ) rounds of measurement. We further study the advantages provided by a small number of ancillas. For the case that a k-qubit ancilla (k≤n) is available, we obtain a sample complexity lower bound of Ω(2 (n-k)/3 ) for any nonconcatenating protocol, and a stronger lower bound of Ω(n 2n-k ) for any nonadaptive, nonconcatenating protocol, which is shown to be tight. We also show how to apply the ancilla-assisted estimation protocol to a practical quantum benchmarking task in a noise-resilient and sample-efficient manner, given reasonable noise assumptions. Our results provide a practically interesting example for quantum advantages in learning and also bring insights for quantum benchmarking.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Structural phase transitions in a MoWSe 2 monolayer: Molecular dynamics simulations and variational autoencoder analysis

Electrical and optoelectronic properties of two-dimensional (2D) transition metal dichalcogenides (TMDCs) can be tuned by exploiting their structural phase transitions. Here semiconducting (2H) to metallic (1T) phase transition is investigated in a strained MoWSe 2 monolayer using molecular dynamics (MD) simulations. Novel intermediate structures called α and β are found between the 2H and 1T phases. These intermediate structures are similar to those observed in a 2D MoS 2 by scanning transmission electron microscopy. Here, a deep generative model, namely the variational autoencoder (VAE) trained by MD data, is used to generate novel heterostructures with α and β interfaces. Quantum simulations based on density functional theory show that these heterostructures are stable and suitable for novel nanoelectronics applications.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗