Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Learning Theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

Product Distribution Theory for Control of Multi-Agent Systems

Product Distribution (PD) theory is a new framework for controlling Multi-Agent Systems (MAS's). First we review one motivation of PD theory, as the information-theoretic extension of conventional full-rationality game theory to the case of bounded rational agents. In this extension the equilibrium of the game is the optimizer of a Lagrangian of the (probability distribution of) the joint stare of the agents. Accordingly we can consider a team game in which the shared utility is a performance measure of the behavior of the MAS. For such a scenario the game is at equilibrium - the Lagrangian is optimized - when the joint distribution of the agents optimizes the system's expected performance. One common way to find that equilibrium is to have each agent run a reinforcement learning algorithm. Here we investigate the alternative of exploiting PD theory to run gradient descent on the Lagrangian. We present computer experiments validating some of the predictions of PD theory for how best to do that gradient descent. We also demonstrate how PD theory can improve performance even when we are not allowed to rerun the MAS from different initial conditions, a requirement implicit in some previous work.

Lee, Chia Fan↗

Reducing Operator Complexity of Galerkin Coarse-grid Operators with Machine Learning

Here, we propose a data-driven and machine-learning-based approach to compute non-Galerkin coarse-grid operators in multigrid (MG) methods, addressing the well-known issue of increasing operator complexity. Guided by the MG theory on spectrally equivalent coarse-grid operators, we have developed novel machine learning algorithms that utilize neural networks combined with smooth test vectors from multigrid eigenvalue problems. The proposed method demonstrates promise in reducing the complexity of coarse-grid operators while maintaining overall MG convergence for solving parametric partial differential equation problems. Numerical experiments on anisotropic rotated Laplacian and linear elasticity problems are provided to showcase the performance and comparison with existing methods for computing non-Galerkin coarse-grid operators.

97 MATHEMATICS AND COMPUTING↗

Estimation of the Surface Fluxes for Heat and Momentum in Unstable Conditions with Machine Learning and Similarity Approaches for the LAFE Data Set

Abstract Measurements of three flux towers operated during the land atmosphere feedback experiment (LAFE) are used to investigate relationships between surface fluxes and variables of the land–atmosphere system. We study these relations by means of two machine learning (ML) techniques: multilayer perceptrons (MLP) and extreme gradient boosting (XGB). We compare their flux derivation performance with Monin–Obukhov similarity theory (MOST) and a similarity relationship using the bulk Richardson number (BRN). The ML approaches outperform MOST and BRN. Best agreement with the observations is achieved for the friction velocity. For the sensible heat flux and even more so for the latent heat flux, MOST and BRN deviate from the observations while MLP and XGB yield more accurate predictions. Using MOST and BRN for latent heat flux, the root mean square errors (RMSE) are 107 Wm $$^{-2}$$ - 2 and 121 Wm $$^{-2}$$ - 2 , respectively, as well as the intercepts of the regression lines are $$\approx 110$$ ≈ 110 Wm $$^{-2}$$ - 2 . For the ML methods, the RMSEs reduce to 31 Wm $$^{-2}$$ - 2 for MLP and 33 Wm $$^{-2}$$ - 2 for XGB as well as the intercepts to just 4 Wm $$^{-2}$$ - 2 for MLP and $$-1$$ - 1 Wm $$^{-2}$$ - 2 for XGB with slopes of the regression lines close to 1, respectively. These results indicate significant deficiencies of MOST and BRN, particularly for the derivation of the latent heat flux. In fact, in contrast to the established theories, feature importance weighting demonstrates that the ML methods base their improved derivations on net radiation, the incoming and outgoing shortwave radiations, the air temperature gradient, and the available water contents, but not on the water vapor gradient. The results imply that further studies of surface fluxes and other turbulent variables with ML techniques provide great promise for deriving advanced flux parameterizations and their implementation in land–atmosphere system models.

54 ENVIRONMENTAL SCIENCES↗

Supervised learning of a chemistry functional with damped dispersion

Abstract Kohn–Sham density functional theory is widely used in chemistry, but no functional can accurately predict the whole range of chemical properties, although recent progress by some doubly hybrid functionals comes close. Here, we optimized a singly hybrid functional called CF22D with higher across-the-board accuracy for chemistry than most of the existing non-doubly hybrid functionals by using a flexible functional form that combines a global hybrid meta-nonseparable gradient approximation that depends on density and occupied orbitals with a damped dispersion term that depends on geometry. We optimized this energy functional by using a large database and performance-triggered iterative supervised training. We combined several databases to create a very large, combined database whose use demonstrated the good performance of CF22D on barrier heights, isomerization energies, thermochemistry, noncovalent interactions, radical and nonradical chemistry, small and large systems, simple and complex systems and transition-metal chemistry.

Liu, Yiwei (ORCID:0000000288126163)↗

Preface to the Focus Section on Machine Learning in Seismology

Machine learning (ML) is a collection of algorithms and statistical models that enable computers to extract relevant patterns and information from large data sets. Unlike physical modeling approaches, in which scientists develop theories based on physical laws to compare with real–world observations, ML approaches learn directly from data without explicitly reasoning about the underlying physical mechanisms. ML algorithms are often categorized into supervised and unsupervised learning (see fig. 2 in Kong et al., 2018). Supervised learning algorithms build a model from existing labeled input data with the goal of predicting the labels of new data.

58 GEOSCIENCES↗

Supervised learning and the finite-temperature string method for computing committor functions and reaction rates

A central object in the computational studies of rare events is the committor function. Though costly to compute, the committor function encodes complete mechanistic information of the processes involving rare events, including reaction rates and transition-state ensembles. Under the framework of transition path theory, Rotskoff et al. [Proceedings of the 2nd Mathematical and Scientific Machine Learning Conference, Proceedings of Machine Learning Research (PLMR, 2022), Vol. 145, pp. 757–780] proposes an algorithm where a feedback loop couples a neural network that models the committor function with importance sampling, mainly umbrella sampling, which collects data needed for adaptive training. Here, in this work, we show additional modifications are needed to improve the accuracy of the algorithm. The first modification adds elements of supervised learning, which allows the neural network to improve its prediction by fitting to sample-mean estimates of committor values obtained from short molecular dynamics trajectories. The second modification replaces the committor-based umbrella sampling with the finite-temperature string (FTS) method, which enables homogeneous sampling in regions where transition pathways are located. We test our modifications on low-dimensional systems with non-convex potential energy where reference solutions can be found via analytical or finite element methods, and show how combining supervised learning and the FTS method yields accurate computation of committor functions and reaction rates. We also provide an error analysis for algorithms that use the FTS method, using which reaction rates can be accurately estimated during training with a small number of samples. The methods are then applied to a molecular system in which no reference solution is known, where accurate computations of committor functions and reaction rates can still be obtained.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Machine learning and LHC event generation

First-principle simulations are at the heart of the high-energy physics research program. They link the vast data output of multi-purpose detectors with fundamental theory predictions and interpretation. This review illustrates a wide range of applications of modern machine learning to event generation and simulation-based inference, including conceptional developments driven by the specific requirements of particle physics. New ideas and tools developed at the interface of particle physics and machine learning will improve the speed and precision of forward simulations, handle the complexity of collision data, and enhance inference as an inverse simulation problem.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Cluster-Graph Fingerprinting: A Framework for Quantitative Analysis of Machine-Learned Interatomic Model Training and Simulation Data

Machine-learned interatomic models represent a significant advancement in simulation methods, extending the predictive ability of first-principles methods to previously inaccessible length and time scales. However, the data-driven nature of these models can lead to difficult-to-detect errors that can compromise prediction accuracy. To address this challenge, we introduce a novel fingerprinting approach based on the Chebyshev Interaction Model for Efficient Simulation (ChIMES) ML-IAM graph-based descriptor. Our strategy enables efficient and statistically rigorous analysis of system configurations used in ML-IAM training and those generated by their application, e.g., in molecular dynamics simulations. We demonstrate that these fingerprints can effectively assess novelty of a configuration relative to an existing data set and determine dissimilarity among individual configurations, which are two key tasks in workflows for active learning-based ML-IAM training, data set curation, and on-the-fly uncertainty quantification.

36 MATERIALS SCIENCE↗

Large-momentum effective theory

Since the parton model was introduced by Feynman more than 50 years ago, much has been learned about the partonic structure of the proton through a large body of high-energy experimental data and dedicated global fits. However, limited progress has been made in calculating partonic observables such as the parton distribution function (PDFs) from the fundamental theory of strong interactions, quantum chromodynamics (QCD). Recently some advocated for a formalism, large-momentum effective theory (LaMET), through which one can extract parton physics from the properties of the proton traveling at a moderate boost factor such as γ ~ 2 – 5 . The key observation behind this approach is that Lorentz symmetry allows the standard formalism of partons in terms of light-front operators to be replaced by an equivalent one with large-momentum states and time-independent operators of a universality class. With LaMET, the PDFs, generalized PDFs or generalized parton distributions, transverse-momentum-dependent PDFs, and light-front wave functions can all be extracted in principle from lattice simulations of QCD (or other nonperturbative methods) through standard effective field theory matching and running. Future lattice QCD calculations with exascale computational facilities could help one to understand the experimental data related to the hadronic structure, including those from the upcoming electron-ion colliders dedicated to exploring the partonic landscape of the proton. In this work, the progress made in the past few years in the development of the LaMET formalism and its applications is reviewed, with an emphasis on a demonstration of its effectiveness from initial lattice QCD simulations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Construction of generalized quasilinear diffusion coefficient using neural networks with physical restrictions

The quasilinear diffusion coefficient (D QL ) derived from our machine learning framework shows comparable trends with the ground truth D QL obtained from GENRAY-CQL3D simulations. Additionally, for the strong absorption cases, the radial current drive profiles generated using the D QL from our model exhibit consistent behavior with those obtained from the original simulation. These findings indicate the potential of our surrogate modeling approach with physical restrictions to replicate key wave–plasma interaction characteristics while reducing computational costs. Traditionally, calculating D QL for wave–particle interactions relies on computationally intensive wave simulations coupled with Fokker–Planck solvers. To address this challenge, we developed a machine learning-based surrogate model with physical restrictions derived from cold plasma theory and bounce-averaged damping effects. First, we establish the propagation domain of Lower Hybrid Waves in the (N∥, ρ) space by identifying the accessibility limit and determining the upper and lower bounds of N∥ using the Potential Power Deposition (PPD) method. Subsequently, leveraging a database constructed using Latin hypercube sampling alongside the underlying physical restrictions (e.g. PPD), machine learning methods including U-Net and Recurrent Neural Networks are employed to design a physics-restricted machine learning framework capable of reconstructing D QL .

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Applications of flow models to the generation of correlated lattice QCD ensembles

Machine-learned normalizing flows can be used in the context of lattice quantum field theory to generate statistically correlated ensembles of lattice gauge fields at different action parameters. This work demonstrates how these correlations can be exploited for variance reduction in the computation of observables. Three different proof-of-concept applications are demonstrated using a novel residual flow architecture: continuum limits of gauge theories, the mass dependence of QCD observables, and hadronic matrix elements based on the Feynman–Hellmann approach. In all three cases, it is shown that statistical uncertainties are significantly reduced when machine-learned flows are incorporated as compared with the same calculations performed with uncorrelated ensembles or direct reweighting. Published by the American Physical Society 2024

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Machine learning assisted prediction of tungsten heavy alloy plasma facing component performance for fusion energy applications

Tungsten and tungsten heavy alloys (WHAs), known for their remarkably high hardness, durability, and corrosion resistance, play a critical role in the thriving development of nuclear fusion reactors in recent years. However, the exploration in tungsten alloys for the nuclear-related applications has been limited by the difficulty of manufacturing and the complexity of experiments to reproduce the environment of nuclear reaction. Therefore, this project aims to utilize nanoscale simulation methods such as density functional theory (DFT) and molecular dynamics (MD) with the help of machine learning techniques to not only understand the mechanisms of tungsten alloys but also allow us to computationally predict their mechanical behaviors under extreme environments. One critical problem of the application of WHAs in nuclear reactors is the surface melting. In the current design of the SPARC reactor, the WHA, W97Ni2.1Fe0.9 or W97NiFe, is chosen to be the first wall components to confine the plasma where the particles are fiercely moving and colliding into each other to create nuclear fusion reaction. This process will generate extremely high heat flux onto these WHA tiles, leaving high surface temperature that could possibly melt the surface of the WHA tiles, As illustrated in Fig. 1(a). a laser experiment previously done illustrates that a rough surface damage would be made after the surface melting where the matrix area mainly composed of nickel and iron as shown in Fig. 1(b), will first melt and then leave vacancies between these tungsten grains. Unfortunately, these kinds of roughness on the first-wall components could be deadly to the plasma inside a Tokmak reactor because the heat that is supposed to dissipate at a designed ratio through the tiles may in turn be excessively absorbed and accumulated on any uneven area of the surface, which will eventually make the whole nuclear reaction fail. In this project, we will introduce a machine learning potential, Allegro, based on DFT calculation and then build a MD model for W-Ni-Fe alloys.

36 MATERIALS SCIENCE↗

Accurate Prediction of Voltage of Battery Electrode Materials Using Attention-Based Graph Neural Networks

Performing first-principles calculations to discover electrodes’ properties in the large chemical space is a challenging task. While machine learning (ML) has been applied to effectively accelerate those discoveries, most of the applied methods ignore the materials’ spatial information and only use predefined features: based only on chemical compositions. Here, we propose two attention-based graph convolutional neural network techniques to learn the average voltage of electrodes. Our proposed methods, which combine both atomic composition and atomic coordinates in 3D-space, improve the accuracy in voltage prediction significantly when compared to composition-based ML models. The first model directly learns the chemical reaction of electrodes and metal ions to predict their average voltage, whereas the second model combines electrodes’ ML predicted formation energy (E form ) to compute their average voltage. Our E form -based model demonstrates improved accuracy in transferability from our subset of learned Li ions to Na ions. Moreover, we predicted the theoretical voltage of 10 Na x MPO 4 F (M = Ti, Cr, Fe, Cu, Mn, Co, and Ni) fluorophosphate battery frameworks, which are unavailable in the Material Project database. It could be shown that we can expect average voltages higher than 3.1 V from those Na battery frameworks except from the NaTiPO 4 F and TiPO 4 F pair of electrodes, which offer an average voltage of 1.32 V.

25 ENERGY STORAGE↗

Breeding Realistic D‐Brane Models

Abstract Intersecting branes provide a useful mechanism to construct particle physics models from string theory with a wide variety of desirable characteristics. The landscape of such models can be enormous, and navigating towards regions which are most phenomenologically interesting is potentially challenging. Machine learning techniques can be used to efficiently construct large numbers of consistent and phenomenologically desirable models. In this work we phrase the problem of finding consistent intersecting D‐brane models in terms of genetic algorithms, which mimic natural selection to evolve a population collectively towards optimal solutions. For a four‐dimensional supersymmetric type IIA orientifold with intersecting D6‐branes, we demonstrate that unique, fully consistent models can be easily constructed, and, by a judicious choice of search environment and hyper‐parameters, of the found models contain the desired Standard Model gauge group factor. Having a sizable sample allows us to draw some preliminary landscape statistics of intersecting brane models both with and without the restriction of having the Standard Model gauge factor.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Editorial: The Future of Nuclear Structure: Challenges and Opportunities in the Microscopic Description of Nuclei

The past two decades have witnessed tremendous progress in the microscopic description of atomic nuclei. The Topical Review `The Future of Nuclear Structure' aims at summarizing the current state-of-the-art microscopic calculations in Nuclear Theory and to give a useful reference for young researches who wish to learn more about this exciting discipline.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Multi-objective materials bayesian optimization with active learning of design constraints: Design of ductile refractory multi-principal-element alloys

We report Bayesian Optimization (BO) has emerged as a powerful framework to efficiently explore and exploit materials design spaces. To date, most BO approaches to materials design have focused on the materials discovery problem as if it were a single expensive-to-query ‘black box’ in which the target is to optimize a single objective (i.e., material property or performance metric). Also, such approaches tend to be constraint agnostic. Here, we present a novel multi-information BO framework capable of actively learning materials design as a multiple objectives and constraints problem. We demonstrate this framework by optimally exploring a Refractory Multi-Principal-Element Alloy (MPEA) space, here specifically, the system Mo-Nb-Ti-V-W. The MPEAs are explored to optimize two density-functional theory (DFT) derived ductility indicators (Pugh’s Ratio and Cauchy pressure) while learning design constraints relevant to the manufacturing of high-temperature gas-turbine components. Alloys in the BO Pareto-front are analyzed using DFT to gain an insight into fundamental atomic and electronic underpinning for their superior performance, as evaluated within this framework.

36 MATERIALS SCIENCE↗

Isotope effects in x-ray absorption spectra of liquid water

The isotope effects in x-ray absorption spectra of liquid water are studied by a many-body approach within electron-hole excitation theory. The molecular structures of both light and heavy water are modeled by path-integral molecular dynamics based on the advanced deep-learning technique. The neural network is trained on ab initio data obtained with SCAN density functional theory. The experimentally observed isotope effect in x-ray absorption spectra is reproduced semiquantitatively in theory. Compared to the spectrum in normal water, the blueshifted and less pronounced pre- and main-edge in heavy water reflect that the heavy water is more structured at short- and intermediate-range of the hydrogen-bond network. In contrast, we find the isotope effect on the spectrum is negligible at post-edge, which is consistent with the identical long-range ordering in both liquids as observed in the diffraction experiment.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Interpretation of Ion Irradiation and Neutron Irradiation Damage in Additively Manufactured 316 Stainless Steel using Multiscale Modeling

The accelerated adoption of nuclear energy necessitates advanced manufacturing technologies, such as additive manufacturing, to meet heightened supply chain requirements and support innovative reactor technologies. Due to the unique microstructural characteristics of additively manufactured materials under distinct solidification conditions, comprehensive evaluation of their performance in reactor environments is essential. The Advanced Materials and Manufacturing Technologies program under the Department of Energy's Office of Nuclear Energy focuses on understanding the irradiation performance and damage evolution of laser powder bed fusion 316 stainless steel, with an emphasis on integrating ion and neutron irradiation data to accelerate the development and qualification of materials for advanced nuclear reactor applications. While ion irradiation is a cost- and time-effective method, modeling and simulation are required to interpret the data for the broader range of irradiation conditions encountered in advanced reactors. In fiscal year 2025, integrated multiscale modeling and simulations were conducted to assess irradiation damage in additively manufactured 316 stainless steel. Key outcomes include predictions of chromium enrichment at grain boundaries, nickel enrichment at dislocation cell walls and void surfaces, and heterogeneous void evolution under ion and neutron irradiation conditions. Cluster dynamics simulations revealed the coarsening of voids at high irradiation temperatures and the suppression of void growth by high network dislocation density, while also demonstrating significant growth and coarsening of voids and self-interstitial atom loops at low dose rates. Machine learning-accelerated atomistic simulations highlighted the impact of the local environment and chromium concentration on vacancy diffusivity, providing key insights on the influence of composition on void swelling and radiation-induced segregation. Additionally, molecular dynamics simulations demonstrated the presence of defect production bias and a significant effect of carbon content on defect cluster behavior. These combined efforts aim to predict the performance of additively manufactured materials under various reactor conditions, supporting their qualification for nuclear reactor applications by interpreting ion irradiation data. This report underscores the potential of integrated multiscale modeling to analyze ion irradiation data in the effort to accelerate the qualification of additively manufactured materials for nuclear reactor components.

316 stainless steel↗