Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Learning theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

MadNIS - Neural multi-channel importance sampling

Theory predictions for the LHC require precise numerical phase-space integration and generation of unweighted events. We combine machine-learned multi-channel weights with a normalizing flow for importance sampling, to improve classical methods for numerical integration. We develop an efficient bi-directional setup based on an invertible network, combining online and buffered training for potentially expensive integrands. We illustrate our method for the Drell-Yan process with an additional narrow resonance.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Energy Materials Chemistry Integrating Theory, Experiment and Data Science (Final Report)

The Energy Materials Chemistry Integrating Theory, Experiment and Data Science (EM-CITED) project is a multidisciplinary research effort focused on accelerating discovery of scientific knowledge via incorporation of data science and artificial intelligence in materials chemistry research. The project aims to advance materials chemistry-aware data science to unify theory and experiment knowledge streams. The work resulted in foundational AI frameworks for materials chemistry – Deep Reasoning Networks (DRNets), Hierarchical Correlation Learning for Multi-property Prediction (H-CLMP), and Material-to-Spectrum (Mat2Spec) prediction – as well as a host of strategies for accelerated scientific discoveries through principled incorporation of data science in computational and experimental research.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Searching for Clues for a Matter Dominated Universe in Liquid Argon Time Projection Chambers

Liquid Argon Time Projection Chambers (LArTPCs) represent one of the most widely utilized neutrino detection techniques in neutrino experiments, for instance, in the Short Baseline Neutrino (SBN) program and the future large-scale LArTPC: Deep Underground Neutrino Experiment (DUNE). The high-end technique, facilitating excellent spatial and calorimetric reconstruction resolution, also enables testing exotic Beyond Standard Model (BSM) theories, such as baryon number violation (BNV) processes (e.g., proton-decay, neutron-antineutron oscillation). At the same time, Machine Learning (ML) techniques have demonstrated their ubiquitous use in recent decades; ML techniques have also become some of the most powerful tools in high-energy physics (HEP) analyses. Furthermore, the development of algorithms to cater to the needs of problems in HEP (i.e., triggering, reconstruction, improving sensitivity, etc.) has also become an active area of research. By developing a combined approach using Convolutional Neural Network (CNN) and Boosted Decision Tree (BDT) techniques, the sensitivity of neutron-antineutron oscillation in DUNE is evaluated for a projected exposure of 400kton·years. Additionally, to meet the triggering requirement to select such rare events in DUNE, such a search is only supported with highly efficient self-triggering algorithms. An ML-based self-triggering scheme for large-scale LArTPCs, such as DUNE, is also developed with the intention of implementation on field-programmable gate arrays (FPGAs). The ML-based approach for searching for neutron-antineutron oscillation can be demonstrated and validated on the current LArTPC MicroBooNE. The analysis in MicroBooNE represents the first-ever search for neutron-antineutron oscillation in a LArTPC. DUNE's projected 90% C.L. sensitivity to the neutron antineutron oscillation lifetime is 6.45×10³² years, assuming 1.327×10³⁵ neutron·years, equivalent to 10 years of DUNE far detector exposure (400kton·years). For MicroBooNE, assuming 372 seconds of exposure (equivalent to 3.13×10³⁶ neutron·years), the 90% C.L. lifetime sensitivity is found at 3.07×10²⁵ yrs, after accounting for Monte-Carlo statistical uncertainty and systematic uncertainty from detector effects.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

A Deep-Learning-Based Muon Neutrino CCQE Selection for Searches Beyond the Standard Model with MicroBooNE

The anomalous Low Energy Excess (LEE) of electron neutrinos and antineutrinos in MiniBooNE has inspired both theories and entire experiments to probe the heart of its mystery. One such experiment is MicroBooNE. This dissertation presents an important facet of its LEE investigation: how a powerful systematic can be levied on this signal through parallel study of a highly correlated channel in muon neutrinos. This constraint serves to strengthen MicroBooNE's ability to confirm or validate the cause of the LEE and will lay the groundwork for future oscillation experiments in Liquid Argon Time Projection Chamber (LArTPC) detector experiments like SBN and DUNE. In addition, this muon channel can be used to test oscillations directly, demonstrated through the world's first muon neutrino disappearance search with LArTPC data.

Cianci, Davio↗
DOE OSTI2024

Complexity of many-body interactions in transition metals via machine-learned force fields from the TM23 data set

Abstract This work examines challenges associated with the accuracy of machine-learned force fields (MLFFs) for bulk solid and liquid phases ofd-block elements. In exhaustive detail, we contrast the performance of force, energy, and stress predictions across the transition metals for two leading MLFF models: a kernel-based atomic cluster expansion method implemented using sparse Gaussian processes (FLARE), and an equivariant message-passing neural network (NequIP). Early transition metals present higher relative errors and are more difficult to learn relative to late platinum- and coinage-group elements, and this trend persists across model architectures. Trends in complexity of interatomic interactions for different metals are revealed via comparison of the performance of representations with different many-body order and angular resolution. Using arguments based on perturbation theory on the occupied and unoccupieddstates near the Fermi level, we determine that the large, sharpddensity of states both above and below the Fermi level in early transition metals leads to a more complex, harder-to-learn potential energy surface for these metals. Increasing the fictitious electronic temperature (smearing) modifies the angular sensitivity of forces and makes the early transition metal forces easier to learn. This work illustrates challenges in capturing intricate properties of metallic bonding with current leading MLFFs and provides a reference data set for transition metals, aimed at benchmarking the accuracy and improving the development of emerging machine-learned approximations.

Chemistry↗
DOE OSTI2023

Active Learning Framework

Machine learning (ML) of interatomic potentials show great promise to accelerate scientific simulation, e.g., by emulating expensive computations at a high accuracy but much reduced computational cost. Training datasets are calculated from computationally expensive ab initio quantum mechanics methods, density functional theory (DFT). Trained on this data, an ML model can be very successful in predicting energy and forces for new atomic configurations. A critical factor is the quality and diversity of the training dataset. Thus, a highly automated approach to dataset construction based on active learning framework is designed suitable for material physics. The active learning scheme begins with fully randomized atomic configurations. Then, many Molecular Dynamics (MD) trajectories are simulated using current ML potentials, where each MD trajectory is initialized to a random disordered configuration. The temperature is varied in order to diversify the sampled configuration during these simulations. The variance of predictions for eight neural networks within an ensemble is analyzed to determine whether the model is operating as expected. This helps in determining whether collecting more data would be helpful to the model by checking the ensemble variance is greater than the threshold. In this case, the MD trajectory is terminated and the final atomic configuration is placed on a queue (SQL database) for DFT calculations and added to training dataset. Periodically, ML model is retrained to the updated training model. This Active Learning loop is iterated until the cost of MD simulations becomes prohibitively expensive. The MD simulations will hopefully be sufficiently robust to support nucleation after many active learning iterations. In this sense, active learning scheme must automatically discover the important low energy and nonequilibrium physics.

Nebgen, Benjamin↗
DOE OSTI2020

Multiscale computational understanding and growth of 2D materials: a review

Abstract The successful discovery and isolation of graphene in 2004, and the subsequent synthesis of layered semiconductors and heterostructures beyond graphene have led to the exploding field of two-dimensional (2D) materials that explore their growth, new atomic-scale physics, and potential device applications. This review aims to provide an overview of theoretical, computational, and machine learning methods and tools at multiple length and time scales, and discuss how they can be utilized to assist/guide the design and synthesis of 2D materials beyond graphene. We focus on three methods at different length and time scales as follows: (i) nanoscale atomistic simulations including density functional theory (DFT) calculations and molecular dynamics simulations employing empirical and reactive interatomic potentials; (ii) mesoscale methods such as phase-field method; and (iii) macroscale continuum approaches by coupling thermal and chemical transport equations. We discuss how machine learning can be combined with computation and experiments to understand the correlations between structures and properties of 2D materials, and to guide the discovery of new 2D materials. We will also provide an outlook for the applications of computational approaches to 2D materials synthesis and growth in general.

Momeni, Kasra↗
DOE OSTI2022

Deep transfer operator learning for partial differential equations under conditional shift

Transfer learning enables the transfer of knowledge gained while learning to perform one task (source) to a related but different task (target), hence addressing the expense of data acquisition and labelling, potential computational power limitations and dataset distribution mismatches. Here, we propose a new transfer learning framework for task-specific learning (functional regression in partial differential equations) under conditional shift based on the deep operator network (DeepONet). Task-specific operator learning is accomplished by fine-tuning task-specific layers of the target DeepONet using a hybrid loss function that allows for the matching of individual target samples while also preserving the global properties of the conditional distribution of the target data. Inspired by conditional embedding operator theory, we minimize the statistical distance between labelled target data and the surrogate prediction on unlabelled target data by embedding conditional distributions onto a reproducing kernel Hilbert space. We demonstrate the advantages of our approach for various transfer learning scenarios involving nonlinear partial differential equations under diverse conditions due to shifts in the geometric domain and model dynamics. Our transfer learning framework enables fast and efficient learning of heterogeneous tasks despite considerable differences between the source and target domains.

42 ENGINEERING↗
DOE OSTI2020

Organismic materials for beyond von Neumann machines

The elementary basis of intelligence in organisms with a central nervous system includes neurons and synapses and their complex interconnections forming neural circuits. In non-neural organisms such as slime mold with gel-like media, viscosity modulation enables adaptation to changing environments. At a larger scale, collective intelligence emerges via social interactions and feedback in animal colonies. Learning and memory are therefore multi-scale features that evolve as a result of constant interactions with the environment. There is growing interest in emulating such features of intelligence in computing machines and autonomous systems. Materials that can respond to their environment in a manner similar to organisms (referred to as "organismic materials") therefore may be of interest as hardware components in artificial intelligence machines. In this brief review, we present a class of semiconductors called correlated oxides as candidates for learning machines. The term "correlated" refers to the fact that electrons in such lattices strongly interact and the ground state is not what is predicted by classical band theory. Such materials can undergo insulator-metal transitions at near ambient conditions under external stimuli such as thermal or electrical fields, strain, and chemical doping. Depending on the mechanism driving the transition, intermediate states can be metastable with different volatilities, and the time scales of phase change can be controlled over many orders of magnitude. The change in electronic properties can be sharp or gradual, leading to digital or analog behavior. These properties enable the realization of artificial neurons and synapses and emulate the associative and non-associative learning characteristics found in various organisms. We examine microscopic properties concerning electronic and structural transitions leading to collective behavior and theoretical treatments of the ground state and dynamical response, showcasing VO 2 as a model system. Next, we briefly review algorithms designed from the plasticity demonstrated by phase changing systems. Finally, we conclude the brief review with suggestions for future research toward realizing non-von Neumann machines.

42 ENGINEERING↗
DOE OSTI2022

Deep learning the properties of inorganic perovskites

We report the ability to accurately and quickly predict the stability of materials and their structural and electronic properties remains a grand challenge in materials science. Density functional theory is widely used as a means of predicting these material properties, but is known to be computationally expensive and scales as the cube of the number of electrons in the material’s unit cell. In this article, for a previously published dataset of inorganic perovskites, we show that a single neural network model using only the elemental properties of the compounds’ constituents can predict lattice constants to within 0.1 Å, heat of formation to within 0.2 eV, and band gaps to within 0.7 eV RMSE. We also compare the performance of the trained network to two widely used regression techniques, namely random forest and Kernel ridge regression, and find that the neural network’s predictions are more accurate for each of the properties. The simultaneous accurate prediction of multiple key properties of technologically relevant materials is promising for rational design and optimization in known and novel chemical spaces.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Use of Graph Theory and Neural Networks for Microstructural Classification

Recent advances in materials data analytics have provided new avenues for determining process-structure-property (PSP) linkages in a variety of materials. Machine learning techniques including few-shot learning have increased the efficiency of classifying microscopy images for the purposes of material characterization. Modifications in segmentation also show potential in improving the accuracy of our current pyCHIP classifier. Replacing previous encoders trained on ImageNet with those trained on microscopy images like MicroNet has initially shown better performance at classifying images of irradiated samples. Additionally, different normalization approaches were tested to show no discernable effect on classification. The Louvain method for community detection is analyzed on a set of irradiated samples with different parameters to determine which proved beneficial under what circumstances. We suggest that microscopy experiments be automated in the future using a combination of these techniques to enable high-throughput analyses.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Investigating magnetic van der Waals materials using data-driven approaches

In this work, we investigate magnetic monolayers of the form A i A ii B 4 X 8 based on the well-known intrinsic topological magnetic van der Waals (vdW) material MnBi 2 Te 4 (MBT) using first-principles calculations and machine learning techniques. We select an initial subset of structures to calculate the thermodynamic properties, electronic properties, such as the band gap, and magnetic properties, such as the magnetic moment and magnetic order using density functional theory (DFT). Data analytics approaches are used to gain insight into the microscopic origin of materials’ properties. The dependence of materials’ properties on chemical composition is also explored. For example, we find that the formation energy and magnetic moment depend largely on A and B sites whereas the band gap depends on all three sites. Finally, we employ machine learning tools to accelerate the search for novel vdW magnets in the MBT family with optimized properties. Finally, this study creates avenues for rapidly predicting novel materials with desirable properties that could enable applications in spintronics, optoelectronics, and quantum computing.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Electrochemical Degradation of Pt 3 Co Nanoparticles Investigated by Off-Lattice Kinetic Monte Carlo Simulations with Machine-Learned Potentials

In fuel cell applications, the durability of catalysts is critical for large-scale industrial implementation. However, limited synthesis controllability and spectroscopic resolution impede a comprehensive understanding of degradation mechanisms at the atomic level. In this study, we develop a machine-learned potential (MLP) to simulate the degradation processes for Pt3Co nanoparticles. The precision of MLP is determined to be comparable to that of density functional theory calculations. Using off-lattice kinetic Monte Carlo simulations with MLP, we successfully replicate established experimental trends and offer a logical resolution to ongoing debates regarding atomic orderings. Based on the simulation results, we suggest design principles for Pt3Co nanoparticles that combine high activity and durability. Finally, we validate the wide applicability of our method by successfully applying it to Pt3Ni and Pt3Co0.5Ni0.5 nanoparticles. The research serves as a guideline for developing MLPs for alloy electrochemical catalysts and lays the foundation for designing more durable and active fuel-cell catalysts.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Bridging the Gap between the X-ray Absorption Spectroscopy and the Computational Catalysis Communities in Heterogeneous Catalysis: A Perspective on the Current and Future Research Directions

X-ray absorption spectroscopy (XAS) [extended X-ray absorption fine structure (EXAFS) and X-ray absorption near-edge structure (XANES)] is a key technique within the heterogeneous catalysis community to probe the structure and properties of the active site(s) for a diverse range of catalytic materials. Furthermore, the interpretation of the raw experimental data to derive an atomistic picture of the catalyst requires modeling and analysis; the EXAFS data are compared to a model, and a goodness of fit parameter is used to judge the best fit. This EXAFS modeling can often be nontrivial and time-consuming; overcoming or improving these limitations remains a central challenge for the community. Considering these limitations, this Perspective highlights how recent developments in analysis software, increased availability of reliable computational models, and application of data science tools can be used to improve the speed, accuracy, and reliability of EXAFS interpretation. In particular, we emphasize the advantages of combining theory and EXAFS as a unified technique that should be treated as a standard (when applicable) to identify catalytic sites and not two separate complementary methods. Building on the recent trends in the computational catalysis community, we also present a community-driven approach to adopt FAIR Guiding Principles for the collection, analysis, dissemination, and storage of XAS data. Written with both the experimental and theory audience in mind, we provide a unified roadmap to foster collaborations between the two communities.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Mitigating Green's function Monte Carlo signal-to-noise problems using contour deformations

The Green's function Monte Carlo (GFMC) method provides accurate solutions to the nuclear many-body problem and predicts properties of light nuclei starting from realistic two- and three-body interactions. Controlling the GFMC fermion sign problem is crucial, as the signal-to-noise ratio decreases exponentially with imaginary time, requiring significant computing resources. Inspired by similar scenarios in lattice quantum field theory and spin systems, in this work, we employ integration contour deformations to improve the GFMC signal-to-noise ratio. Machine learning techniques are used to select optimal contours with minimal variance from parametrized families of deformations. As a proof of principle, we consider the deuteron binding energies and Euclidean density response functions. Here, we only observe mild signal-to-noise improvement for the binding energy case. On the other hand, we achieve an order of magnitude reduction of the variance for Euclidean density response functions, paving the way for computing electron- and neutrino-nucleus cross sections of larger nuclei.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Mitigating Green's function Monte Carlo signal-to-noise problems using contour deformations

The Green's function Monte Carlo (GFMC) method provides accurate solutions to the nuclear many-body problem and predicts properties of light nuclei starting from realistic two- and three-body interactions. Controlling the GFMC fermion-sign problem is crucial, as the signal-to-noise ratio decreases exponentially with Euclidean time, requiring significant computing resources. Inspired by similar scenarios in lattice quantum field theory and spin systems, in this work, we employ integration contour deformations to improve the GFMC signal-to-noise ratio. Machine learning techniques are used to select optimal contours with minimal variance from parameterized families of deformations. As a proof of principle, we consider the deuteron binding energies and Euclidean density response functions. We only observe mild signal-to-noise improvement for the binding energy case. On the other hand, we achieve an order of magnitude reduction of the variance for Euclidean density response functions, paving the way for computing electron- and neutrino-nucleus cross-sections of larger nuclei.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2020

Machine Learning for Neutron Resonance Evaluations [Slides]

The performance of nuclear reactors and other nuclear systems depends on a precise understanding of the neutron interaction cross sections for materials used in these systems. These cross sections exhibit a resonance structure whose shape is determined in part by the angular momentum quantum numbers of the resonances. The correct assignment of the quantum numbers of neutron resonances is therefore of paramount importance. In this presentation, we describe the application of machine learning to automate the quantum number assignments. Scikit-learn classifiers were trained on simulated resonance data whose statistical properties were chosen to mimic real data. We explored the use of several physics (and random matrix theory)-motivated features for training the classifiers, including the nearest neighbor spacing distribution, cumulative level distribution, and channel width distributions. Initial results demonstrated that we can determine resonance spin groups somewhat reliably. We are now investigating the application of our approach to 52 Cr resonance data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗