Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Learning Theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,459 records · Page 81

A new approach for designing self-organizing systems and application to adaptive control

There is tremendous interest in the design of intelligent machines capable of autonomous learning and skillful performance under complex environments. A major task in designing such systems is to make the system plastic and adaptive when presented with new and useful information and stable in response to irrelevant events. A great body of knowledge, based on neuro-physiological concepts, has evolved as a possible solution to this problem. Adaptive resonance theory (ART) is a classical example under this category. The system dynamics of an ART network is described by a set of differential equations with nonlinear functions. An approach for designing self-organizing networks characterized by nonlinear differential equations is proposed.

Ramamoorthy, P. A.↗

Reconfigurable fuzzy cell

This invention relates to a reconfigurable fuzzy cell comprising a digital control programmable gain operation amplifier, an analog-to-digital converter, an electrically erasable PROM, and 8-bit counter and comparator, and supporting logic configured to achieve in real-time fuzzy systems high throughput, grade-of-membership or membership-value conversion of multi-input sensor data. The invention provides a flexible multiplexing-capable configuration, implemented entirely in hardware, for effectuating S-, Z-, and PI-membership functions or combinations thereof, based upon fuzzy logic level-set theory. A membership value table storing 'knowledge data' for each of S-, Z-, and PI-functions is contained within a nonvolatile memory for storing bits of membership and parametric information in a plurality of address spaces. Based upon parametric and control signals, analog sensor data is digitized and converted into grade-of-membership data. In situ learn and recognition modes of operation are also provided.

Salazar, George A.↗

Neural Flight Control System

The Neural Flight Control System (NFCS) was developed to address the need for control systems that can be produced and tested at lower cost, easily adapted to prototype vehicles and for flight systems that can accommodate damaged control surfaces or changes to aircraft stability and control characteristics resulting from failures or accidents. NFCS utilizes on a neural network-based flight control algorithm which automatically compensates for a broad spectrum of unanticipated damage or failures of an aircraft in flight. Pilot stick and rudder pedal inputs are fed into a reference model which produces pitch, roll and yaw rate commands. The reference model frequencies and gains can be set to provide handling quality characteristics suitable for the aircraft of interest. The rate commands are used in conjunction with estimates of the aircraft s stability and control (S&C) derivatives by a simplified Dynamic Inverse controller to produce virtual elevator, aileron and rudder commands. These virtual surface deflection commands are optimally distributed across the aircraft s available control surfaces using linear programming theory. Sensor data is compared with the reference model rate commands to produce an error signal. A Proportional/Integral (PI) error controller "winds up" on the error signal and adds an augmented command to the reference model output with the effect of zeroing the error signal. In order to provide more consistent handling qualities for the pilot, neural networks learn the behavior of the error controller and add in the augmented command before the integrator winds up. In the case of damage sufficient to affect the handling qualities of the aircraft, an Adaptive Critic is utilized to reduce the reference model frequencies and gains to stay within a flyable envelope of the aircraft.

Gundy-Burlet, Karen↗

Digital Technologies at NASA for Science and Engineering

While scientific and engineering advancements used to rely primarily on theoretical studies and physical experiments, today digital technology enabled by petaflops-scale supercomputers is an equal, if not a greater, contributor to such achievements. In addition, computational modeling and simulation serves as a predictive tool that is not otherwise available. As a result, the use of high performance computing is integral to NASA's work in all mission areas such as space exploration, aeronautics, and scientific discovery. But traditional supercomputing alone is not sufficient for all of the space agency's needs. The success of many NASA missions depends on solving complex computing challenges, some of which are NP-hard (decision theory) if using classical solution methods. Quantum computing promises an unprecedented ability to solve such intractable problems by harnessing quantum mechanical effects such as tunneling, superposition, and entanglement. Another disruptive digital technology is neuromorphic computing that uses brain-inspired lessons to generate new architectures that are much more energy efficient, and capable of massive parallel processing and learning in-situ. Finally, with large amounts of observational and computational data sets, the opportunities of big data and data analytics can be leveraged to enable deep learning and knowledge discovery - it's all a massive digital transformation. This talk will be an overview how NASA utilizes digital technologies for its science and engineering efforts.

Biswas, Rupak↗

Blackout Diffusion: Generative Diffusion Models in Discrete-State Spaces

Typical generative diffusion models rely on a Gaussian diffusion process for training the backward transformations, which can then be used to generate samples from Gaussian noise. However, real world data often takes place in discrete-state spaces, including many scientific applications. Here, we develop a theoretical formulation for arbitrary discrete-state Markov processes in the forward diffusion process using exact (as opposed to variational) analysis. We relate the theory to the existing continuous-state Gaussian diffusion as well as other approaches to discrete diffusion, and identify the corresponding reverse-time stochastic process and score function in the continuous-time setting, and the reverse-time mapping in the discrete-time setting. As an example of this framework, we introduce “Blackout Diffusion”, which learns to produce samples from an empty image instead of from noise. Numerical experiments on the CIFAR-10, Binarized MNIST, and CelebA datasets confirm the feasibility of our approach. Generalizing from specific (Gaussian) forward processes to discrete-state processes without a variational approximation sheds light on how to interpret diffusion models, which we discuss.

Santos, Javier E.↗

Temporally-consistent koopman autoencoders for forecasting dynamical systems

Absence of sufficiently high-quality data often poses a key challenge in data-driven modeling of high-dimensional spatio-temporal dynamical systems. Koopman Autoencoders (KAEs) harness the expressivity of deep neural networks (DNNs), the dimension reduction capabilities of autoencoders, and the spectral properties of the Koopman operator to learn a reduced-order feature space with simpler, linear dynamics. However, the effectiveness of KAEs is hindered by limited and noisy training datasets, leading to poor generalizability. To address this, we introduce the Temporally-Consistent Koopman Autoencoder (tcKAE), designed to generate accurate long-term predictions even with limited and noisy training data. This is achieved through a consistency regularization term that enforces prediction coherence across different time steps, thus enhancing the robustness and generalizability of tcKAE over existing models. We provide analytical justification for this approach based on Koopman spectral theory and empirically demonstrate tcKAE’s superior performance over state-of-the-art KAE models across a variety of test cases, including simple pendulum oscillations, kinetic plasma, and fluid flow data.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Measurements and interpretations of W ± Z production cross-sections in pp collisions at $\sqrt{s}=13$ TeV with the ATLAS detector

Measurements of integrated and differential cross-sections for W ± Z production in proton-proton collisions are presented. The data collected by the ATLAS detector at the Large Hadron Collider from 2015 to 2018 at a centre-of-mass energy of $\sqrt{s}=13$ TeV are used, corresponding to an integrated luminosity of 140 fb −1 . The W ± Z candidate events are reconstructed using leptonic decay modes of the gauge bosons into electrons or muons. The integrated cross-section per lepton flavour for the production of W ± Z is measured in the detector fiducial region with a relative precision of 4%. The measured value is compared with the Standard Model prediction at a precision of up to next-to-next-to-leading-order in QCD and next-to-leading-order in electroweak. Cross-sections for W + Z and W − Z production and their ratio are presented. The W ± Z production is also measured differentially as functions of various kinematic variables, including new observables sensitive to CP-violation effects. All measurements are compared with state-of-the-art Standard Model predictions from fixed-order calculations or Monte Carlo generators based on next-to-leading-order matrix elements interfaced with parton showers. An effective field theory interpretation of the measurements is performed, considering both CP-conserving and CP-violating dimension-6 operators modifying the W ± Z production. In the absence of observed deviations from the Standard Model, limits on CP-conserving Wilson coefficients are extracted using the transverse mass of the W ± Z system. For CP-violating coefficients a machine learning approach is used to construct an observable with enhanced sensitivity to CP-violation effects.

hadron-hadron scattering↗

Proper orthogonal descriptors for efficient and accurate interatomic potentials

Here, we present the proper orthogonal descriptors for efficient and accuracy representation of the potential energy surface. The potential energy surface is represented as a many-body expansion of parametrized potentials in which the potentials are functions of atom positions and parameters. The proper orthogonal decomposition is employed to decompose the parametrized potentials into a set of proper orthogonal descriptors (PODs). Because of the rapid convergence of the proper orthogonal decomposition, relevant snapshots can be sampled exhaustively to represent the atomic neighborhood environment accurately with a small number of descriptors. The proper orthogonal descriptors are used to develop interatomic potentials by using a linear expansion of the descriptors and determining the expansion coefficients from a weighted least-squares regression against a density functional theory (DFT) training set. We present a comprehensive evaluation of the POD potentials on previously published DFT data sets comprising Li, Mo, Cu, Ni, Si, Ge, and Ta elements. The data sets represent a diverse pool of metals, transition metals, and semiconductors. The accuracy of the POD potentials are comparable to that of state-of-the-art machine learning potentials such as the spectral neighbor analysis potential (SNAP) and the atomic cluster expansion (ACE).

97 MATHEMATICS AND COMPUTING↗

Effects of Composition and Oxidation States on the Structures of Chromium-Containing Sodium Silicate Glasses: Molecular Dynamics Simulations using Machine Learning Interatomic Potentials

Chromium represents a significant challenge for the vitrification of high-level nuclear waste into silicate and borosilicate glasses due to its low solubility and variable oxidation states, which can limit the waste loading due to promotion of crystallization or phase separation during processing. In this study, we modeled chromium containing silicate glasses using molecular dynamics simulations with three machine learning interatomic potentials (MLIPs), MACE, CHGNet, and PFP were employed, to gain insights on glass composition and oxidation states on the structures of these glasses. One of the goals is to evaluate their ability of these MLIPs to accurately represent the general structure of silicate glasses and chromium local environments as a function of chromium oxidation states. Density Functional Theory (DFT) based calculations and experimental data such as neutron structure factors were used to validate the structural models. It was found that the foundation models of all three MLIPs are able to reproduce general structural features of the sodium silicate glass structure consistent with experimental and DFT data, but only CHGNet and PFP can accurately capture the oxidation states and local environment of chromium: tetrahedral for Cr6+ and octahedral for Cr3+. Furthermore, we studied the effect of varying Cr3+/ Cr6+ (Cr3+/Crtotal) ratio and total chromium content using PFP. Our results show that Cr6+ enhances network polymerization by reducing non-bridging oxygens through Na? charge compensation required due to the formation of chromate (CrO42-) species, while Cr³? acts as a network modifier that disrupts connectivity. System size effects on the structural characteristics and chromium environments were also tested using the PFP potential. This work highlights the importance of careful validation on the precision, transferability, and potential of MLIPs for modeling glasses containing transition metal elements that can exist in multiple oxidation states. It is also encouraging to see the foundational models are all three MLFFs are able to reproduce the basic sodium silicate glass structures, while suggesting additional training or refining is needed to improve the description of more complex systems containing transition metals.

Puga, Christina L.↗

Invariant Molecular Representations for Heterogeneous Catalysis

Catalyst screening is a critical step in the discovery and development of heterogeneous catalysts, which are vital for a wide range of chemical processes. In recent years, computational catalyst screening, primarily through density functional theory (DFT), has gained significant attention as a method for identifying promising catalysts. However, the computation of adsorption energies for all likely chemical intermediates present in complex surface chemistries is computationally intensive and costly due to the expensive nature of these calculations and the intrinsic idiosyncrasies of the methods or data sets used. This study introduces a novel machine learning (ML) method to learn adsorption energies from multiple DFT functionals by using invariant molecular representations (IMRs). To do this, we first extract molecular fingerprints for the reaction intermediates and later use a Siamese-neural-network-based training strategy to learn invariant molecular representations or the IMR across all available functionals. Our Siamese network-based representations demonstrate superior performance in predicting adsorption energies compared with other molecular representations. Notably, when considering mean absolute values of adsorption energies as 0.43 eV (PBE-D3), 0.46 eV (BEEF-vdW), 0.81 eV (RPBE), and 0.37 eV (scan+rVV10), our IMR method has achieved the lowest mean absolute errors (MAEs) of 0.18 0.10, 0.16, and 0.18 eV, respectively. These results emphasize the superior predictive capacity of our Siamese network-based representations. The empirical findings in this study illuminate the efficacy, robustness, and dependability of our proposed ML paradigm in predicting adsorption energies, specifically for propane dehydrogenation on a platinum catalyst surface.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Machine learning applied to classifying neutron resonances

The performance of nuclear reactors and other nuclear systems depends on a precise understanding of the neutron interaction cross sections for materials used in these systems. These cross sections exhibit resonance structure whose shape is determined in part by the angular momentum quantum numbers of the resonances. The correct assignment of the quantum numbers of neutron resonances is therefore of paramount importance. In this project, we apply a machine learning technique, namely decision trees, to automate the quantum number assignments. The tree is trained from simulated data generated to mimic the errors found in real data. We explore the use of several physics-motivated features for training our trees, including the nearest neighbor spacing distribution, cumulative level distribution, and channel width distributions. Initial results using random matrix theory motivated fits which demonstrated that we can determine resonance spin groups somewhat reliably. If we use these fits as features in our trees, we can train them to spot outliers corresponding to misassigned resonances. We found that with the large number of features used in this project that the decision tree tended to over t training data resulting in poor performance with respect to the test data. By reducing the number of features, we can achieve nearly perfect assignment of quantum numbers with our training data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Bespoke Liquid/Liquid Interfaces (Final Technical Report)

The goal of DE-SC0001815 was to advance the basic science of liquid:liquid interface formation, to develop a deeper understanding of the mechanisms of phase separation and the essential relationships between solution composition, organization and dynamics that underlie the kinetic regime of solvent extraction. This included learning how interfacial organization and dynamics alters the properties of the primary coordination sphere of ions and the free energy of transport of ions complexes across a phase boundary. We relied primarily upon classical molecular dynamics studies to determine the equilibrium ensembles of these complex systems, but also utilized ab-initio MD and cluster-based density functional theory (DFT) calculations when more detailed investigation of the electronic structure was needed. We continued development of graph-theory based analyses to elucidate hierarchical correlations and expanded into geometric topology methods to quantify the collectively organized structures that can organize at a liquid/liquid interface during solute transport. One of the main conclusions was from the observation of two distinct mechanisms for solute transport - those that derive from amplifications of interfacial heterogeneity and surface roughness, and those wherein surface roughness has been dampened and instead collectively organized macrostructures work to bring solutes into the organic phase. It was our aim to create a concrete chemical model of the underlying driving forces behind interfacial primary and secondary structure formation and to map out the energetic features of solute transport so that tailored liquid/liquid can be developed that have characteristic kinetic features associated with mass transport.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Computational Exploration of High Entropy Alloys as Promising Materials for Future Beam Windows

With the ever-increasing demand for high beam power, the currently used beam-intercepting devices (BIDs) such as targets, and beam windows may not be able to handle the high power required for future accelerator complexes or the lifetime may be reduced drastically. As beam power increases, the damage incurred by BIDs, including thermal shock, fatigue, and irradiation damage, also rises. Therefore, it is imperative to design materials that can withstand high beam power for longer lifetimes. High entropy alloys (HEAs) have emerged as potential alternative materials for designing next-generation BIDs. In this study, we primarily focus on materials for developing beam windows for next-generation accelerator complexes. We propose an integrated approach that combines various computational techniques to study and design new materials. Specifically, we use CALPHAD, density functional theory (DFT), and molecular dynamics (MD) to comprehensively investigate the defect properties of suitable HEAs, offering potential alternatives for future beam windows. We begin by scanning the extensive phase space provided by Cr-Mn-V-Ti-Al-Co HEAs, selecting 8 compositions after evaluating approximately 120,000 unique compositions using CALPHAD. We, then employ DFT-informed machine learning techniques to develop force-field parameters. Finally, MD simulations using these developed force-field parameters will be used to study the effects of radiation damage on the defect and mechanical properties of the selected alloys. This research explains the use of the CALPHAD approach and shows how critical modeling (DFT and MD) is in developing novel material such as HEAs. It also highlights the promising role of machine learning in this field. The results from this study will greatly improve the novel materials development to be used in next-generation accelerator components, leading to higher beam power and longer operational times of BIDs.

43 PARTICLE ACCELERATORS↗

Materials under high pressure: a chemical perspective

At high pressure, the typical behavior of elements dictated by the periodic table, including oxidation numbers, stoichiometries in compounds, and reactivity, to name but a few, is altered dramatically. As pressure is applied, the energetic ordering of atomic orbitals shifts, allowing core orbitals to become chemically active, atypical electron congurations to occur, and in some cases,non-atom-centered orbitals to form in the interstices of solid structures. Strange stoichiometries, structures, and bonding motifs result. Crystal structure prediction tools, not burdened by preconceived notions about structural chemistry learned at atmospheric pressure, have been applied to great success to explore phase diagrams at high pressure, identifying novel structures in diverse chemical systems. Several of these phases have been subsequently synthesized. Experimentally, access to high-pressure regimes has been bolstered by advances in diamond anvil cell and dynamic com- pression techniques. Here, the joint efforts of experiment and theory have led to startling success stories in the realm of high-temperature superconductivity, identifying many novel phases (some of which have been synthesized) whose superconducting transition approaches room temperature.

36 MATERIALS SCIENCE↗

Unraveling complex causal processes that affect sustainability requires more integration between empirical and modeling approaches

Scientists seek to understand the causal processes that generate sustainability problems and determine effective solutions. Yet, causal inquiry in nature–society systems is hampered by conceptual and methodological challenges that arise from nature–society interdependencies and the complex dynamics they create. Here, we demonstrate how sustainability scientists can address these challenges and make more robust causal claims through better integration between empirical analyses and process- or agent-based modeling. To illustrate how these different epistemological traditions can be integrated, we present four studies of air pollution regulation, natural resource management, and the spread of COVID-19. The studies show how integration can improve empirical estimates of causal effects, inform future research designs and data collection, enhance understanding of the complex dynamics that underlie observed temporal patterns, and elucidate causal mechanisms and the contexts in which they operate. These advances in causal understanding can help sustainability scientists develop better theories of phenomena where social and ecological processes are dynamically intertwined and prior causal knowledge and data are limited. The improved causal understanding also enhances governance by helping scientists and practitioners choose among potential interventions, decide when and how the timing of an intervention matters, and anticipate unexpected outcomes. Methodological integration, however, requires skills and efforts of all involved to learn how members of the respective other tradition think and analyze nature–society systems.

42 ENGINEERING↗

Multi-task graph neural networks for simultaneous prediction of global and atomic properties in ferromagnetic systems *

Abstract We introduce a multi-tasking graph convolutional neural network, HydraGNN, to simultaneously predict both global and atomic physical properties and demonstrate with ferromagnetic materials. We train HydraGNN on an open-source ab initio density functional theory (DFT) dataset for iron-platinum with a fixed body centered tetragonal lattice structure and fixed volume to simultaneously predict the mixing enthalpy (a global feature of the system), the atomic charge transfer, and the atomic magnetic moment across configurations that span the entire compositional range. By taking advantage of underlying physical correlations between material properties, multi-task learning (MTL) with HydraGNN provides effective training even with modest amounts of data. Moreover, this is achieved with just one architecture instead of three, as required by single-task learning (STL). The first convolutional layers of the HydraGNN architecture are shared by all learning tasks and extract features common to all material properties. The following layers discriminate the features of the different properties, the results of which are fed to the separate heads of the final layer to produce predictions. Numerical results show that HydraGNN effectively captures the relation between the configurational entropy and the material properties over the entire compositional range. Overall, the accuracy of simultaneous MTL predictions is comparable to the accuracy of the STL predictions. In addition, the computational cost of training HydraGNN for MTL is much lower than the original DFT calculations and also lower than training separate STL models for each property.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Extended Rice–Thomson analysis and atomistic simulations revealing grain boundary effects on fracture in refractory high-entropy alloys

Significance This work serves to extend the fundamental ductile vs. brittle fracture theory, specifically the Rice–Thomson criterion, by introducing a grain boundary ahead of an initiating crack which propagates at an oblique angle to impinge the boundary. Atomistic fracture simulations on two refractory complex concentrated alloys, the brittle NbMoTaW and the ductile Nb 45 Ta 25 Ti 15 Hf 15 , demonstrate qualitative correspondence with the extended Rice–Thomson criterion and experimental observations. Abstract Understanding how grain boundaries mediate fracture remains a critical challenge in designing ductile, high-performance refractory alloys. Here, we extend the Rice–Thomson criterion to account for the angle between cracks and the impinging grain boundaries (GBs), capturing the competition between intergranular fracture and dislocation-mediated plasticity. Using machine learning interatomic potentials, we performed molecular statics simulations to probe fracture mechanisms in nanocrystalline NbMoTaW and Nb 45 Ta 25 Ti 15 Hf 15 , each with two different grain sizes, revealing trends consistent with experimental observations and the extended Rice model. Comparison with averaged R-curves for bulk samples demonstrates that GBs enhance ductility in Nb 45 Ta 25 Ti 15 Hf 15 in both grain sizes investigated. In contrast, GBs only locally improve fracture resistance in NbMoTaW when cracks are temporarily pinned at GBs inclined at high angles from the crack, but generally promote brittle intergranular fracture. These contrasting behaviors are attributed to differences in GB cohesion, reflecting clear alloying trends that align with ab-initio calculations and trends observed experimentally. Our results bridge classical fracture theory, atomistic simulations, and experimental observations, providing a comprehensive understanding of the fracture mechanisms in nanocrystalline refractory complex concentrated alloys.

36 MATERIALS SCIENCE↗

High-energy photon-hadron scattering in holographic QCD

This article provides an in-depth look at hadron high-energy scattering by using gravity dual descriptions of strongly coupled gauge theories. Just like deeply inelastic scattering (DIS) and deeply virtual Compton scattering (DVCS) serve as clean experimental probes into nonperturbative internal structure of hadrons, elastic scattering amplitude of a hadron and a (virtual) photon in gravity dual can be exploited as a theoretical probe. Since the scattering amplitude at sufficiently high energy (small Bjorken x) is dominated by parton contributions (=Pomeron contributions) even in strong coupling regime, there is a chance to learn a lesson for generalized parton distribution (GPD) by using gravity dual models. We begin with refining derivation of the Brower-Polchinski-Strassler-Tan (BPST) Pomeron kernel in gravity dual, paying particular attention to the role played by the complex spin variable j. The BPST Pomeron on warped spacetime consists of a Kaluza-Klein tower of 4D Pomerons with nonlinear trajectories, and we clarify the relation between Pomeron couplings and the Pomeron form factor. We emphasize that the saddle-point value j* of the scattering amplitude in the complex j-plane representation is a very important concept in understanding qualitative behavior of the scattering amplitude. The total Pomeron contribution to the scattering is decomposed into the saddle-point contribution and at most a finite number of pole contributions, and when the pole contributions are absent (which we call saddle-point phase), kinematical variable (q,x,t)-dependence of ln(1/q) evolution and ln(1/x) evolution parameters {gamma}{sub eff} and {lambda}{sub eff} in DIS and t-slope parameter B of DVCS in HERA experiment are all reproduced qualitatively in gravity dual. All of these observations shed a new light on modeling of GPD. Straightforward application of those results to other hadron high-energy scattering is also discussed.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗