Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Learning theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

On the specificity between mapping of initial and final states of the magneto Rayleigh-Taylor instability

In this LDRD we investigated the application of machine learning methods to understand dimensionality reduction and evolution of the Rayleigh-Taylor instability (RTI). As part of the project, we undertook a significant literature review to understand current analytical theory and machine learning based methods to treat evolution of this instability. We note that we chose to refocus on assessing the hydrodynamic RTI as opposed to the magneto-Rayleigh-Taylor instability originally proposed. This choice enabled utilizing a wealth of analytic test cases and working with relatively fast running open-source simulations of single-mode RTI. This greatly facilitated external collaboration with URA summer fellowship student, Theodore Broeren. In this project we studied the application of methods from dynamical systems learning and traditional regression methods to recover behavior of RTI ranging from the fully nonlinear to weakly nonlinear (wNL) regimes. Here we report on two of the tested methods SINDy and a more traditional regression-based approach inspired by analytic wNL theory with which we had the most success. We conclude with a discussion of potential future extensions to this work that may improve our understanding from both theoretical and phenomenological perspectives.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Phase Selection Rules of Multi‐Principal Element Alloys

Abstract Computational prediction of phase stability of multi‐principal element alloys (MPEAs) holds a lot of promise for rapid exploration of the enormous design space and autonomous discovery of superior structural and functional properties. Regardless of many plausible works that rely on phenomenological theory and machine learning, precise prediction is still limited by insufficient data and the lack of interpretability of some machine learning algorithms, e.g., convolutional neural network. In this work, a comprehensive approach is presented, encompassing the development of a complete dataset that contains 72 387 density functional theory calculations, as well as a predictive global phenomenological descriptor. The phase selection descriptor, based on atomic electronegativity and valence electron concentration, significantly outperforms the widely used valence electron concentration, excelling in both accuracy (with an f1 score of 63% compared to 47%) and its ability to predict the HCP phase (0.48 recall compared to 0). The comprehensive data mining on the global design space of 61 425 quaternary MPEAs made from 28 possible metals, together with the phenomenological theory and physical interpretation, will set up a solid computational science foundation for data‐driven exploration of MPEAs.

Chemistry↗
DOE OSTI2024

Selective consolidation of learning and memory via recall-gated plasticity

In a variety of species and behavioral contexts, learning and memory formation recruits two neural systems, with initial plasticity in one system being consolidated into the other over time. Moreover, consolidation is known to be selective; that is, some experiences are more likely to be consolidated into long-term memory than others. Here, we propose and analyze a model that captures common computational principles underlying such phenomena. The key component of this model is a mechanism by which a long-term learning and memory system prioritizes the storage of synaptic changes that are consistent with prior updates to the short-term system. This mechanism, which we refer to as recall-gated consolidation, has the effect of shielding long-term memory from spurious synaptic changes, enabling it to focus on reliable signals in the environment. We describe neural circuit implementations of this model for different types of learning problems, including supervised learning, reinforcement learning, and autoassociative memory storage. These implementations involve synaptic plasticity rules modulated by factors such as prediction accuracy, decision confidence, or familiarity. We then develop an analytical theory of the learning and memory performance of the model, in comparison to alternatives relying only on synapse-local consolidation mechanisms. We find that recall-gated consolidation provides significant advantages, substantially amplifying the signal-to-noise ratio with which memories can be stored in noisy environments. We show that recall-gated consolidation gives rise to a number of phenomena that are present in behavioral learning paradigms, including spaced learning effects, task-dependent rates of consolidation, and differing neural representations in short- and long-term pathways.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Selective consolidation of learning and memory via recall-gated plasticity

In a variety of species and behavioral contexts, learning and memory formation recruits two neural systems, with initial plasticity in one system being consolidated into the other over time. Moreover, consolidation is known to be selective; that is, some experiences are more likely to be consolidated into long-term memory than others. Here, we propose and analyze a model that captures common computational principles underlying such phenomena. The key component of this model is a mechanism by which a long-term learning and memory system prioritizes the storage of synaptic changes that are consistent with prior updates to the short-term system. This mechanism, which we refer to as recall-gated consolidation, has the effect of shielding long-term memory from spurious synaptic changes, enabling it to focus on reliable signals in the environment. We describe neural circuit implementations of this model for different types of learning problems, including supervised learning, reinforcement learning, and autoassociative memory storage. These implementations involve synaptic plasticity rules modulated by factors such as prediction accuracy, decision confidence, or familiarity. We then develop an analytical theory of the learning and memory performance of the model, in comparison to alternatives relying only on synapse-local consolidation mechanisms. We find that recall-gated consolidation provides significant advantages, substantially amplifying the signal-to-noise ratio with which memories can be stored in noisy environments. We show that recall-gated consolidation gives rise to a number of phenomena that are present in behavioral learning paradigms, including spaced learning effects, task-dependent rates of consolidation, and differing neural representations in short- and long-term pathways.

Lindsey, Jack W. (ORCID:0000000309307327)↗
DOE OSTI2022

From predicting to learning dissipation from pair correlations of active liquids

Active systems, which are driven out of equilibrium by local non-conservative forces, can adopt unique behaviors and configurations. Towards designing such materials, an important challenge is to precisely connect the static structure of active systems to the dissipation of energy induced by the local driving. Here, we use tools from liquid-state theories and machine learning to take on these challenges. We first demonstrate analytically for an isotropic active matter system that dissipation and pair correlations are closely related when driving forces behave like an active temperature. We then extend a nonequilibrium mean-field framework for predicting these pair correlations which, unlike most existing approaches, is applicable even for strongly interacting particles and far from equilibrium, to predict dissipation in these systems. Based on this theory, we reveal analytically a robust relation between dissipation and structure which holds even as the system approaches a nonequilibrium phase transition. Finally, we construct a neural network which maps static configurations of particles to their dissipation rate without any prior knowledge of the underlying dynamics. Furthermore, our results open novel perspectives on the interplay between dissipation and organization out-of-equilibrium.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Defect Production and Microstructural Feature Impact for Radiation Damage in Additively Manufactured 316 Stainless Steel

This milestone presents multi-scale modeling research results for additively manufactured 316 stainless steel. A combination of phase field, cluster dynamics, molecular dynamics, and density functional theory with machine learning is used, allowing for predictions of radiation-driven microstructural evolution in additively manufactured 316 stainless steel over a range of temperatures, damage rates, neutron spectra, and microstructures, and supporting the development of combined ion and neutron irradiation for material qualification. Informed by ion irradiation and neutron irradiation results across the Advanced Materials and Manufacturing Technologies program, we investigate the unique aspects of radiation-driven microstructure evolution in additively manufactured 316 stainless steel. In particular, we focus on understanding the impact of carbon concentration (varying, for example, between the 316L and 316H standards) on void formation; radiation-induced segregation at dislocation cells and grain boundaries; and the evolution of dislocation loops and network dislocation populations. We find that the unique characteristics of the additively manufactured microstructures must be accounted for in understanding the evolution of dislocation populations under thermal and irradiation conditions, such as the variation in sink strengths arising due to the variation in dislocation density. We also find that the radiation-induced segregation of Cr and Ni to grain boundaries and cell walls differs due to the differences in their defect sink biases. We also find that increasing the Ni content can slow vacancy diffusion, which may provide a mechanism for the observed reduction in transient swelling rate for austenitic Fe-Cr-Ni alloys with increasing Ni content. In addition, ion irradiations have shown that increasing carbon content in 316 SS results in a larger population of smaller voids, suggesting reduced vacancy diffusion. Our results show that the carbon content of additively manufactured 316 SS has a significant impact on the migration rate of defect clusters. The presence of carbon atoms results in carbon-vacancy trapping, significantly reducing the diffusion rate of vacancies. Carbon atoms may also be trapped near the surface of a void, which may reduce void growth by trapping vacancies that diffuse toward the void.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
NASA NTRS2004

An Approach to V&V of Embedded Adaptive Systems

Rigorous Verification and Validation (V&V) techniques are essential for high assurance systems. Lately, the performance of some of these systems is enhanced by embedded adaptive components in order to cope with environmental changes. Although the ability of adapting is appealing, it actually poses a problem in terms of V&V. Since uncertainties induced by environmental changes have a significant impact on system behavior, the applicability of conventional V&V techniques is limited. In safety-critical applications such as flight control system, the mechanisms of change must be observed, diagnosed, accommodated and well understood prior to deployment. In this paper, we propose a non-conventional V&V approach suitable for online adaptive systems. We apply our approach to an intelligent flight control system that employs a particular type of Neural Networks (NN) as the adaptive learning paradigm. Presented methodology consists of a novelty detection technique and online stability monitoring tools. The novelty detection technique is based on Support Vector Data Description that detects novel (abnormal) data patterns. The Online Stability Monitoring tools based on Lyapunov's Stability Theory detect unstable learning behavior in neural networks. Cases studies based on a high fidelity simulator of NASA's Intelligent Flight Control System demonstrate a successful application of the presented V&V methodology. ,

Liu, Yan↗
DOE OSTI2024

Structures of neural network effective theories

We develop a diagrammatic approach to effective field theories (EFTs) corresponding to deep neural networks at initialization, which dramatically simplifies computations of finite-width corrections to neuron statistics. The structures of EFT calculations make it transparent that a single condition governs criticality of all connected correlators of neuron preactivations. Understanding of such EFTs may facilitate progress in both deep learning and field theory simulations. Published by the American Physical Society 2024

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Machine learning potential assisted exploration of complex defect potential energy surfaces

Abstract Atomic-scale defects generated in materials under both equilibrium and irradiation conditions can significantly impact their physical and mechanical properties. Unraveling the energetically most favorable ground-state configurations of these defects is an important step towards the fundamental understanding of their influence on the performance of materials ranging from photovoltaics to advanced nuclear fuels. Here, using fluorite-structured thorium dioxide (ThO 2 ) as an exemplar, we demonstrate how density functional theory and machine learning interatomic potential can be synergistically combined into a powerful tool that enables exhaustive exploration of the large configuration spaces of small point defect clusters. Our study leads to several unexpected discoveries, including defect polymorphism and ground-state structures that defy our physical intuitions. Possible physical origins of these unexpected findings are elucidated using a local cluster expansion model developed in this work.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Development of a machine-learning-based ionic-force correction model for quantum molecular dynamic simulations of warm dense matter

In this work Δ learning is used to map orbital-free density functional theory (OF-DFT) ionic forces to the corresponding Kohn-Sham (KS) DFT ionic forces. The development of the approximate force difference in terms of the ion positions is constructed and serves as a stand in for the ground truth force difference. Descriptor vectors for ion configurations are constructed using all distance between ions in conjunction with an indexing based on a nearest neighbor ranking. It is demonstrated that such a scheme of descriptors can uniquely describe an ionic configuration up to a rotation and reflection when no ambiguity in the nearest neighbor ranking exists. How to handle the case when an ambiguity exists in the nearest neighbor ranking is discussed. As a proof of principle, the model is trained and tested on warm dense hydrogen at temperatures between 1 and 15 eV. Once tested, the model was used to perform molecular dynamic simulations of warm dense hydrogen. Furthermore, the resulting energies and pressures are within 1% and 2% of their respective target KS values.

36 MATERIALS SCIENCE↗
DOE OSTI2020

A Machine Learning Assisted Development of a Model for the Populations of Convective and Stratiform Clouds

Abstract Traditional parameterizations of the interaction between convection and the environment have relied on an assumption that the slowly varying large‐scale environment is in statistical equilibrium with a large number of small and short‐lived convective clouds. They fail to capture nonequilibrium transitions such as the diurnal cycle and the formation of mesoscale convective systems as well as observed precipitation statistics and extremes. Informed by analysis of radar observations, cloud‐permitting model simulation, theory, and machine learning, this work presents a new stochastic cloud population dynamics model for characterizing the interactions between convective and stratiform clouds, with the goal of informing the representation of these interactions in global climate models. Fifteen wet seasons of precipitating cloud observations by a C‐band radar at Darwin, Australia are fed into a machine learning algorithm to obtain transition functions that close a set of coupled equations relating large‐scale forcing, mass flux, the convective cell size distribution, and the stratiform area. Under realistic large‐scale forcing, the derived transition functions show that, on the one hand, interactions with stratiform clouds act to dampen the variability in the size and number of convective cells and therefore in the convective mass flux. On the other, for a given convective area fraction, a larger number of smaller cells is more favorable for the growth of stratiform area than a smaller number of larger cells. The combination of these two factors gives rise to solutions with a few convective cells embedded in a large stratiform area, reminiscent of mesoscale convective systems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Self-Learning Kinetic Monte Carlo Simulations of Radiation Damage in Nuclear Fuels

Understanding how irradiation affects the thermo-physical and mechanical properties of nuclear materials, such as thermal conductivity degradation in fuels and embrittlement of structural components, is critical to the safety and efficiency of nuclear reactors. These effects are largely governed by the formation and evolution of atomic-scale point defects and defect clusters. Due to their small sizes, however, these defects are invisible under high-resolution scanning transmission electron microscopy. This project aims to fill this experimental knowledge gap by integrating density functional theory (DFT), machine learning interatomic potential (MLIP), and kinetic Monte Carlo (KMC) techniques to predict longtime evolution of irradiation-induced defects in nuclear fuels.

36 - MATERIALS SCIENCE↗
DOE OSTI2022

Modeling Flow and Transport in Fractured Rock using Machine Learning [Slides]

Fractured systems in the subsurface play a role in many natural and engineered applications such as geologic carbon sequestration, hydraulic fracturing and underground nuclear test detection. Structural information (fracture size, orientation, etc.) plays a key role in governing the dominant physics for these systems but can only be known statistically. Traditional modeling approaches either ignore or idealize structural information at these larger scales because we lack a computational framework that utilizes it in its entirety. The work presented here integrates computational physics, machine learning and graph theory to make a paradigm shift from computationally intensive high-fidelity models to coarse-scale graphs without loss of critical structural information. We exploit the underlying discrete structure of fracture networks in systems considering flow through fractures and fracture propagation. We demonstrate that compact graph representations require significantly fewer degrees of freedom (dof) to capture micro-fracture information and further accelerate these models with Machine Learning.

58 GEOSCIENCES↗
DOE OSTI2025

Enhancing stability, magnetic anisotropy, and coercivity of manganese aluminum: Machine learning, ab initio , and micromagnetic modeling

The binary manganese aluminum (MnAl) alloy with L⁢1 0 crystal structure is a promising rare earth (RE) element-free permanent magnetic material because of its exceptional magnetic properties. However, experimentally synthesizing it in a stable bulk form is extremely challenging. Here, in this study, an alternative method of stabilizing the material, a pathway for experimental synthesis and validation, is proposed and theoretically verified. This is done by partially substituting Mn and Al sites with Fe and Ni and identifying its enhanced phase stability, saturation magnetization density, magnetic anisotropy, and coercivity from density functional theory (DFT), machine learning (ML) crystal graph convolution neural network (CGCNN), and micro-magnetic modeling. When considering a fixed 50% Ni, the magnetic anisotropy increases with the increasing Fe content but decreases the formation energy. The calculated formation energies, elastic constants, and phonon frequencies demonstrate that the binary and quaternary compositions are stable. Most importantly, in 50% Fe and Ni-substituted-equiatomic phase, magnetic anisotropy constants and saturation magnetization density increase by 56% and 23% as compared to the MnAl. Further, the coercivity of the equiatomic phase predicted with micro-magnetic modeling is higher by 17% than the parent compound.

Bhandari, Churna [Ames National Laboratory, and Io↗
DOE OSTI2020

Deep reinforcement learning for complex evaluation of one-loop diagrams in quantum field theory

In this paper we present a technique based on deep reinforcement learning that allows for numerical analytic continuation of integrals that are often encountered in one-loop diagrams in quantum field theory. To extract certain quantities of two-point functions, such as spectral densities, mass poles or multiparticle thresholds, it is necessary to perform an analytic continuation of the correlator in question. At one-loop level in Euclidean space, this results in the necessity to deform the integration contour of the loop integral in the complex plane of the square of the loop momentum, to avoid nonanalyticities in the integration plane. Using a toy model for which an exact solution is known, we train a reinforcement learning agent to perform the required contour deformations. We report our study shows great promise for an agent to be deployed in iterative numerical approaches used to compute nonperturbative two-point functions, such as the quark propagator Dyson-Schwinger equation, or more generally, Fredholm equations of the second kind, in the complex domain.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗