Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Learning Theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,243 records · Page 69

Application of machine learning approaches in the analysis of mass absorption cross-section of black carbon aerosols: Aerosol composition dependencies and sensitivity analyses

Physics-based models typically require an in-depth understanding of a phenomenon and assumptions of the underlying process(es), which are often hard to obtain in practice, whereas data-driven machine learning models learn the structure and patterns in the training data without any prior theoretical assumptions and then use inference to develop useful predictions. A novel machine learning-based algorithm has been previously developed for the prediction of black carbon mass absorption cross-section (MAC BC ) and applied to a variety of different atmospheric environments. In contrast to light scattering theories which require assumptions about the underlying physics, this algorithm uses time-series data of aerosol properties to estimate the temporally-varying MAC BC at 870 nm. Here, we analyze our algorithm and discuss the influence of aerosol optical properties (such as Ångström exponents and single scattering albedo) and chemical composition on the model outputs and the associated accuracy. Additionally, we conduct sensitivity analyses on our models to understand how the predictions change in response to different sets of input variables. Our support vector machine (SVM) for regression model is the least sensitive to variations in the input variables, although all models tend to exhibit a degradation to their accuracy when scattering Ångström exponents are less than one.

54 ENVIRONMENTAL SCIENCES↗

Quantum Computing Algorithms and Applications for Coherent and Strongly Correlated Chemical Systems

This project advanced quantum algorithms, quantum information theory, strongly correlated electronic structure methods, molecular quantum materials, and exciton transport imaging in coherent condensed phase systems. Across the award period, the team developed new methods for open-quantum-system simulation, Hamiltonian learning, state tomography, reduced-density-matrix and contracted-quantum eigensolver approaches, and quantum diagnostics for device capability and openness.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

THE SHORT ROTATION PERIOD OF HI’IAKA, HAUMEA’S LARGEST SATELLITE

Hi’iaka is the larger outer satellite of the dwarf planet Haumea. Using relative photometry from the Hubble Space Telescope and Magellan and a phase dispersion minimization analysis, we have identified the rotation period of Hi’iaka to be ∼9.8 hr (double peaked). This is ∼120 times faster than its orbital period, creating new questions about the formation of this system and possible tidal evolution. The rapid rotation suggests that Hi’iaka could have a significant obliquity and spin precession that could be visible in light curves within a few years. We then turn to an investigation of what we learn about the (currently unclear) formation of the Haumea system and family based on this unexpectedly rapid rotation rate. We explore the importance of the initial semimajor axis and rotation period in tidal evolution theory and find that they strongly influence the time required to despin to synchronous rotation, relevant to understanding a wide variety of satellite and binary systems. We find that despinning tides do not necessarily lead to synchronous spin periods for Hi’iaka, even if it formed near the Roche limit. Therefore, the short rotation period of Hi’iaka does not rule out significant tidal evolution. Hi’iaka’s spin period is also consistent with formation near its current location and spin-up due to Haumea-centric impactors.

79 ASTRONOMY AND ASTROPHYSICS↗

Solving Stochastic Inverse Problems for Property–Structure Linkages Using Data-Consistent Inversion and Machine Learning

Determining process–structure–property linkages is one of the key objectives in material science, and uncertainty quantification plays a critical role in understanding both process–structure and structure–property linkages. In this work, we seek to learn a distribution of microstructure parameters that are consistent in the sense that the forward propagation of this distribution through a crystal plasticity finite element model matches a target distribution on materials properties. This stochastic inversion formulation infers a distribution of acceptable/consistent microstructures, as opposed to a deterministic solution, which expands the range of feasible designs in a probabilistic manner. Furthermore, to solve this stochastic inverse problem, we employ a recently developed uncertainty quantification framework based on push-forward probability measures, which combines techniques from measure theory and Bayes’ rule to define a unique and numerically stable solution. This approach requires making an initial prediction using an initial guess for the distribution on model inputs and solving a stochastic forward problem. To reduce the computational burden in solving both stochastic forward and stochastic inverse problems, we combine this approach with a machine learning Bayesian regression model based on Gaussian processes and demonstrate the proposed methodology on two representative case studies in structure–property linkages.

36 MATERIALS SCIENCE↗

Computationally Predicted High-Throughput Free-Energy Phase Diagrams for the Discovery of Solid-State Hydrogen Storage Reactions

The design of multinary solid-state material systems that undergo reversible phase changes via changes in temperature and pressure provides a potential means of safely storing hydrogen. However, fully mapping the stabilities of known or newly targeted compounds relative to competing phases at reaction conditions has previously required many stringent experiments or computationally demanding calculations of each compound’s change in Gibbs energy with respect to temperature, G(T). Here, we have extended the approach of constructing chemical potential phase diagrams based on ΔG f (T) to enable the analysis of phase stability at non-zero temperatures. We first performed density functional theory calculations to compute the formation enthalpies of binary, ternary, and quaternary compounds within several compositional spaces of current interest for solid-state hydrogen storage. Temperature effects on solid compound stability were then accounted for using our recently introduced machine learned descriptor for the temperature-dependent contribution G δ (T) to the Gibbs energy G(T). From these Gibbs energies, we evaluated each compound’s stability relative to competing compounds over a wide range of conditions and show using chemical potential and composition phase diagrams that the predicted stable phases and H2 release reactions are consistent with experimental observations. This demonstrates that our approach rapidly computes the thermochemistry of hydrogen release reactions for compounds at sufficiently high accuracy relative to experiment to provide a powerful framework for analyzing hydrogen storage materials. This framework based on G(T) enables the accelerated discovery of active materials for a variety of technologies that rely on solid-state reactions involving these materials.

08 HYDROGEN↗

Comparing Classical and Machine Learning Force Fields for Modeling Deformation of Metal–Organic Frameworks Relevant for Direct Air Capture

Deformation of metal–organic frameworks (MOFs) induced by adsorbate molecules can affect adsorption properties such as capacity and selectivity, but most computational studies of MOFs assume framework rigidity to simplify calculations. Although flexible force fields (FFs) for MOFs have been parametrized for specific materials, the generality of FFs for reliably modeling adsorbate-induced deformation to accuracy nearing that of density functional theory (DFT) has not been established. This work confirms using DFT calculations that adsorbate-induced deformation can affect CO 2 and H 2 O adsorption energies in a considerable fraction of MOFs promising for direct air capture (DAC). We then benchmark the efficacy of several general-purpose FFs in describing adsorbate-induced deformation for DAC against DFT. Our results show that current classical FFs are insufficient for describing MOF deformation, especially in cases of interest for DAC where strong interactions exist between adsorbed molecules and MOF frameworks. Some emerging machine learning force fields (MLFFs) we tested, particularly CHGNet, MACE-MP-0, and Equiformer V2, appear to be more promising than the classical FF for emulating the deformation behavior described by DFT. The best performing FF (CHGNet), however, fails to achieve the accuracy required for practical predictions with a mean absolute adsorption energy error of 0.124 eV.

adsorption↗

Essay: Bob Siemann-SLC Days at SLAC

Bob Siemann was a great experimentalist and an excellent teacher.We will greatly miss him. Bob came to SLAC in early 1991 to work on the Stanford Linear Collider (SLC). The SLC was a challenging accelerator which began operating in the late 1980's but still had numerous obstacles to be overcome years into operation. One of the compounding difficulties was making reproducible measurements, since the stability of the collider was poor and the diagnostics were insufficient. Bob dove into this challenge and helped design experiments and diagnostics that provided further clarity. I first got to know Bob while I was still a graduate student, trying to finish my thesis and performing some experimental studies on the SLC, which, at the time, was proving to be very difficult. Most of my expertise had been in beam theory and simulation. Dealing with the real issues of the accelerator was challenging. Bob helped me understand the difference between systematic and statistical errors, and separate operational issues from the fundamental physics. His way of teaching was not to provide an explanation but to ask enough questions so that I could find the answer on my own - this was the best way to learn. I later asked Bob to be a reader on my thesis. As in all things, he took this role extremely seriously. He read through the draft and marked every page to the point where I was regretting my decision. However, his questions again helped me understand my own work better and greatly improved my thesis. Bob was also the de facto leader of an effort focused on the damping rings and the bunch compressors. He was great to work with. He made people think for themselves and refused to simply provide answers. He also worked hard himself, expressing real interest and curiosity. After the studies of the SLC damping rings identified a sawtooth instability due to the vacuum chamber impedance as a source of many downstream fluctuations, Bob took charge of upgrading the rings. As part of this program, I suggested an extensive upgrade that also replaced the dipoles with combined function magnets which might have reduced the horizontal emittance another factor of 3. Although he was extremely busy, Bob helped me develop the proposal and understand the magnetic limitations as well as the potential impacts on the beam dynamics. He helped me consider issues well beyond my initial scope. While the proposal never went anywhere and I think Bob had been aware that there was no funding to pursue the option, he saw that it would be a great learning experience for me and it was. In the early 1990's I had simulated a new regime for the beam-ion instability and, with Frank Zimmermann, I developed a model for the effect which was predicted to occur within the high current, low emittance bunch trains in future storage rings or linear colliders. I thought this was pretty good work but Bob convinced me that the next step had to be confirming the theory with measurements. Because the growth rate was inversely dependent on beam sizes and proportional to the vacuum pressure, measurements required significantly increasing the vacuum pressure in existing facilities. Most people discounted trying such an experiment, but with Bob's urging and suggestions and John Byrd's excitement, we managed to make the measurements at the Advanced Light Source (ALS) at Berkeley. By the mid-1990's Bob was completely focused on advanced acceleration concepts and I was not interacting with him as often. At the time, SLAC was putting together a large effort in designing and documenting a design for the Next Linear Collider (NLC) while constructing the NLC Test Accelerator. Bob was worried that a straightforward extrapolation of the microwave technology would be difficult to bring to fruition because of the cost. He wanted to focus on more cost-effective approaches that could enable future accelerators for high energy physics. As usual, he was correct. The experimental programs that he started in direct laser acceleration and plasma-wakefield acceleration have made great progress. He accomplished this with lots of hard work and by engaging the people around him, especially students and postdocs. In the process, he created a group of extremely talented people which has enabled these technologies to be developed to the point where it seems likely that they are viable and will offer two cost-effective approaches to high-gradient acceleration.

43 PARTICLE ACCELERATORS↗

A theory of quark vs. gluon discrimination

Understanding jets initiated by quarks and gluons is of fundamental importance in collider physics. Efficient and robust techniques for quark versus gluon jet discrimination have consequences for new physics searches, precision αs studies, parton distribution function extractions, and many other applications. Numerous machine learning analyses have attacked the problem, demonstrating that good performance can be obtained but generally not providing an understanding for what properties of the jets are responsible for that separation power. In this paper, we provide an extensive and detailed analysis of quark versus gluon discrimination from first-principles theoretical calculations. Working in the strongly-ordered soft and collinear limits, we calculate probability distributions for fixed N-body kinematics within jets with up through three resolved emissions (O(α$3\atop{s}$)). This enables explicit calculation of quantities central to machine learning such as the likelihood ratio, the area under the receiver operating characteristic curve, and reducibility factors within a well-defined approximation scheme. Further, we relate the existence of a consistent power counting procedure for discrimination to ideas for operational flavor definitions, and we use this relationship to construct a power counting for quark versus gluon discrimination as an expansion in e C F -C A $\ll$1, the exponential of the fundamental and adjoint Casimirs. Our calculations provide insight into the discrimination performance of particle multiplicity and show how observables sensitive to all emissions in a jet are optimal. We compare our predictions to the performance of individual observables and neural networks with parton shower event generators, validating that our predictions describe the features identified by machine learning

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Fast and stable deep-learning predictions of material properties for solid solution alloys

We present a novel deep learning (DL) approach to produce highly accurate predictions of macroscopic physical properties of solid solution binary alloys and magnetic systems. The major idea is to make use of the correlations between different physical properties in alloy systems to improve the prediction accuracy of neural network (NN) models. We use multitasking NN models to simultaneously predict the total energy, charge density and magnetic moment. These physical properties mutually serve as constraints during the training of the multitasking NN, resulting in more reliable DL models because multiple physics properties are correctly learned by a single model. Two binary alloys, copper–gold (CuAu) and iron–platinum (FePt), were studied. Our results show that once the multitasking NN's are trained, they can estimate the material properties for a specific configuration hundreds of times faster than first-principles density functional theory calculations while retaining comparable accuracy. We used a simple measure based on the root-mean-squared errors to quantify the quality of the NN models, and found that the inclusion of charge density and magnetic moment as physical constraints leads to more stable models that exhibit improved accuracy and reduced uncertainty for the energy predictions.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Bayesian D‐Optimal Designs for Gaussian Process Surrogate Models

Computer experiments often employ space-filling strategies to create surrogate models with strong predictive performance. The impact of model parameter estimation for Gaussian process surrogates, however, is often overlooked. Obtaining a better initial estimate of the covariance lengthscale parameter, θ, can greatly improve the resulting Gaussian process fit through more effective sequential acquisitions during active learning. In this work, we propose a novel initial design maximizing the Bayesian D-optimality criterion of the Gaussian process lengthscale parameter. Previously published results have shown the emphasis on lengthscale estimation to be promising, but relied on an empirically driven design creation process. Our Bayesian D-optimal designs are rooted in information theory and lead to more informative sequential acquisitions by improving lengthscale estimation. In many cases, these gains eventually result in better surrogates than those seeded with space-filling initial designs. Furthermore, Bayesian D-optimal designs can be tailored to either isotropic or anisotropic covariance structures, and the Bayesian framework enables the inclusion of prior knowledge in the design process, offering greater flexibility and adaptability. Through several simulation studies, we demonstrate the advantages of Bayesian D-optimal designs in terms of both lengthscale estimation accuracy and predictive performance during active learning.

Bayesian experimental design↗

Optimization on Manifolds via Graph Gaussian Processes

This paper integrates manifold learning techniques within a Gaussian process upper confidence bound algorithm to optimize an objective function on a manifold. Our approach is motivated by applications where a full representation of the manifold is not available and querying the objective is expensive. We rely on a point cloud of manifold samples to define a graph Gaussian process surrogate model for the objective. Query points are sequentially chosen using the posterior distribution of the surrogate model given all previous queries. We establish regret bounds in terms of the number of queries and the size of the point cloud. Several numerical examples complement the theory and illustrate the performance of our method.

Bayesian optimization↗

Quantifying Cyber-Resilience Against Resource-Exhaustion Attacks

Resilience in the information sciences is notoriously difficult to define much less to measure. But in mechanical engi- neering, the resilience of a substance is mathematically defined as the area under the stress vs. strain curve. We took inspiration from mechanics in an attempt to define resilience precisely for information systems. We first examine the meaning of resilience in language and engineering terms and then translate these definitions to information sciences. Then we tested our definitions of resilience for a very simple problem in networked queuing systems. We discuss lessons learned and make recommendations for using this approach in future work.

cyber security↗

Phase transitions and dimensional cross-over in layered confined solids

The nature of solid phases and cross-over of order–disorder phase transitions from two-dimensional (2D) layers to three-dimensional (3D) bulk in confined atomic systems remain largely unexplained. To this end, we consider noble gases and aluminum confined between graphene sheets at different pressures and temperatures. Using crystal structure search methods and molecular dynamics based on machine-learned potentials with quantum-mechanical accuracy, we identify structures of multilayer confined solids that deviate from simple close packing. Upon heating, we find that confined 2D monolayers melt according to the two-step continuous Kosterlitz–Thouless–Halperin–Nelson–Young theory. However, multilayer solids transition continuously into an intermediate layered-hexatic phase before melting discontinuously into an isotropic liquid. This intermediate phase persists at least up to 12 layers studied here. This change can be qualitatively understood based on the cross-over from 2D topological defects toward 3D ones during melting as the number of layers increases.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Artificial Intelligence Guided Studies of van der Waals Magnets

A materials informatics framework to explore a large number of candidate van der Waals (vdW) materials is developed. In particular, in this study a large space of monolayer transition metal halides is investigated by combining high-throughput density functional theory calculations and artificial intelligence (AI) to accelerate the discovery of stable materials and the prediction of their magnetic properties. Here, the formation energy is used as a proxy for chemical stability. Semi-supervised learning is harnessed to mitigate the challenges of sparsely labeled materials data in order to improve the performance of AI models. This approach creates avenues for the rapid discovery of chemically stable vdW magnets by leveraging the ability of AI to recognize patterns in data, to learn mathematical representations of materials from data and to predict materials properties. Using this approach, previously unexplored vdW magnetic materials with potential applications in data storage and spintronics are identified.

36 MATERIALS SCIENCE↗

Neural network potentials with effective charge separation for non-equilibrium dynamics of ionic solids: a ZnO case study

Developing neural network potentials (NNPs) accurate under non-equilibrium dynamics is challenging, as such systems require extensive sampling beyond equilibrium phases. Here we construct high-fidelity NNPs for zinc oxide (ZnO), a polymorphic ionic solid, using density functional theory (DFT) reference data. To efficiently capture transitional configurations, we combine enhanced-sampling molecular dynamics with empirical potentials, data distillation, and pretraining on short-range atomic energies (A-Train), followed by transfer learning with DFT-relabeled datasets. This hierarchical approach improves transferability across polymorphs and stress states. We further introduce effective charge separation, treating long-range Coulombic terms analytically while short-range residual interactions are learned by the NNP. The optimal effective charges fall in the range 0.5–1.0 q e , consistent with dielectric-screened values derived from formal charges but distinct from Bader estimates. Motivated by this observation, we propose a simple data-driven protocol in which effective charges are optimized by comparing DFT reference energies with explicit Coulomb calculations, without additional NNP training. This strategy improves accuracy and transferability in DFT-level predictions of energies, forces, and stress. Together, these results provide a practical charge-selection framework for robust NNP development in ionic solids, enabling reliable simulation of polymorphic phase transformations and non-equilibrium dynamics.

Chemistry↗

Deep learning of accurate force field of ferroelectric HfO 2

The discovery of ferroelectricity in HfO 2 -based thin films opens up new opportunities for using this silicon-compatible ferroelectric to realize low-power logic circuits and high-density nonvolatile memories. The functional performances of ferroelectrics are intimately related to their dynamic responses to external stimuli such as electric fields at finite temperatures. Molecular dynamics is an ideal technique for investigating dynamical processes on large length and time scales, though its applications to new materials are often hindered by the limited availability and accuracy of classical force fields. Here we present a deep neural network–based interatomic force field of HfO 2 learned from ab initio data using a concurrent learning procedure. The model potential is able to predict structural properties such as elastic constants, equation of states, phonon dispersion relationships, and phase transition barriers of various hafnia polymorphs with accuracy comparable with density functional theory calculations. Here, the validity of this model potential is further confirmed by the reproduction of experimental sequences of temperature-driven ferroelectric-paraelectric phase transitions of HfO 2 with isobaric-isothermal ensemble molecular dynamics simulations. We suggest a general approach to extend the model potential of HfO 2 to related material systems including dopants and defects.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Extended Galerkin Neural Network Approximation of Singular Variational Problems with Error Control

We present extended Galerkin neural networks, a variational framework for approximating general boundary value problems (BVPs) with error control. The main contributions of this work are (1) a rigorous theory guiding the construction of new weighted least squares variational formulations suitable for use in neural network approximation of general BVPs, and (2) an “extended” feedforward network architecture which incorporates and is even capable of learning singular solution structures, thus greatly improving approximability of singular solutions. Furthermore, numerical results are presented for several problems, including steady Stokes flow around reentrant corners and in convex corners with Moffatt eddies in order to demonstrate efficacy of the method.

a posteriori error estimate↗

Fission with Exotic Nuclei (Full Technical Report)

Despite its importance for stockpile stewardship or nuclear forensics, data on fission is fragmentary: most experiments have only been performed on stable actinide nuclei and are often incomplete, and theoretical simulations often contain many parameters hard to constrain, which results in large uncertainties. Consequently, nuclear libraries have large gaps for important isotopes. The goal of this project was to prepare to take advantage of the unprecedented yields of radioactive isotopes at the upcoming DOE Facility for Rare Ion Beams and to leverage recent progress in the field of machine learning to develop a comprehensive program of fission studies that could address some of the most pressing problems in nuclear fission over the next several decades. Our project leveraged synergies between experimental nuclear physics, nuclear theory, and data science expertise at LLNL. On the experimental front, our main objective was to develop in-house expertise for inverse kinematics reactions with relativistic beams as well as to field and test new detectors to perform correlated measurements of fission properties. On the theoretical side, the objective was to develop a novel, high-fidelity and scalable approach of fissionfragment calculations based on emulating computationally expensive, quantum-mechanical calculations of nuclear properties with deep neural networks.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗