Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “learning theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Modeling the behavior of concentrated aqueous HNO 3 using machine learning interatomic potentials

We develop two multi-defect machine learning interatomic potentials (MLIPs) trained at the BLYP-D2 and PBE-D3 density functional theories using the DeepMD-kit, allowing for the investigation of structural and thermodynamic properties of nitric acid over a wide range of concentrations via molecular dynamics (MD) simulations. We directly compute the degree of dissociation, α, and pK a from MD simulations, revealing that HNO 3 behaves as a weaker acid at higher concentrations, noting that our standard-state pK a value is in excellent agreement with the experimental one. In general, good agreement is observed with experimental results such as α and density outside the training dataset, with only modest deviations at low-to-medium concentrations. We benchmark our custom multi-defect DeepMD MLIPs against foundational models MACE-MP0 and MACE-OFF23. The foundation models capture some aspects of HNO 3 /NO 3 − solvation in concentrated nitric acid but show noticeable density errors and miss subtle structural features relevant to spectroscopy, whereas the bespoke DeepMD MLIPs yield more compact solvation shells, reproduce density-concentration trends, and run ∼12–15× faster than MACE-MP0. Although classical FFs are still more efficient and match experimental densities better, they lack chemical reactivity and thus cannot predict α or pK a , underscoring the need for system-specific reactive MLIPs beyond universal MLIPs.

Dinpajooh, Mohammadhasan [Pacific Northwest Nation↗
NASA NTRS2013

How to Demonstrate Microgravity in your Classroom

Learn why zero gravity is a misnomer and learn how to demonstrate microgravity to students and the general public. In this session, a short theory segment will explain and reinforce these concepts so that you may explain to others. Session participants will also see simple equipment that demonstrates microgravity during the session and can just as well be done in the classroom or museum exhibit hall. The hands-on demonstration devices range from a leaky water bottle to an electronic drop tower with an on-board camera. The session will also include demonstration techniques for Physics, Forces & Motion, and orbits. This material is useful for middle school forces and motions instruction, high school physics instruction, public demonstrations at conferences & school open houses, travelling museum exhibits, fixed museum exhibits, and independent student projects or experiments. These activities also connect the terrestrial demonstration with planetary & moon motion, comet trajectory, and more.

DeLombard, Richard↗
DOE OSTI2021

Sparse expansions of multicomponent oxide configuration energy using coherency and redundancy

We report that compressed sensing has become a widely accepted paradigm to construct high dimensional cluster expansion models used for statistical mechanical studies of atomic configuration in complex multicomponent crystalline materials. However, strict sampling requirements necessary to obtain minimal coherence measurements for compressed sensing to guarantee accurate estimation of model parameters are difficult and in some cases impossible to satisfy due to the inability of physical systems to access certain configurations. Nevertheless, the dependence of energy on atomic configuration can still be adequately learned without these strict requirements by using compressed sensing by way of coherent measurements using redundant function sets known as frames. We develop a particular frame constructed from the union of all occupancy-based cluster expansion basis sets. We illustrate how using this highly redundant frame yields sparse expansions of the configuration energy of complex oxide materials that are competitive and often surpass the prediction accuracy and sparsity of models obtained from standard cluster expansions.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
NASA NTRS1998

Preliminary Work for Examining the Scalability of Reinforcement Learning

Researchers began studying automated agents that learn to perform multiple-step tasks early in the history of artificial intelligence (Samuel, 1963; Samuel, 1967; Waterman, 1970; Fikes, Hart & Nilsonn, 1972). Multiple-step tasks are tasks that can only be solved via a sequence of decisions, such as control problems, robotics problems, classic problem-solving, and game-playing. The objective of agents attempting to learn such tasks is to use the resources they have available in order to become more proficient at the tasks. In particular, each agent attempts to develop a good policy, a mapping from states to actions, that allows it to select actions that optimize a measure of its performance on the task; for example, reducing the number of steps necessary to complete the task successfully. Our study focuses on reinforcement learning, a set of learning techniques where the learner performs trial-and-error experiments in the task and adapts its policy based on the outcome of those experiments. Much of the work in reinforcement learning has focused on a particular, simple representation, where every problem state is represented explicitly in a table, and associated with each state are the actions that can be chosen in that state. A major advantage of this table lookup representation is that one can prove that certain reinforcement learning techniques will develop an optimal policy for the current task. The drawback is that the representation limits the application of reinforcement learning to multiple-step tasks with relatively small state-spaces. There has been a little theoretical work that proves that convergence to optimal solutions can be obtained when using generalization structures, but the structures are quite simple. The theory says little about complex structures, such as multi-layer, feedforward artificial neural networks (Rumelhart & McClelland, 1986), but empirical results indicate that the use of reinforcement learning with such structures is promising. These empirical results make no theoretical claims, nor compare the policies produced to optimal policies. A goal of our work is to be able to make the comparison between an optimal policy and one stored in an artificial neural network. A difficulty of performing such a study is finding a multiple-step task that is small enough that one can find an optimal policy using table lookup, yet large enough that, for practical purposes, an artificial neural network is really required. We have identified a limited form of the game OTHELLO as satisfying these requirements. The work we report here is in the very preliminary stages of research, but this paper provides background for the problem being studied and a description of our initial approach to examining the problem. In the remainder of this paper, we first describe reinforcement learning in more detail. Next, we present the game OTHELLO. Finally we argue that a restricted form of the game meets the requirements of our study, and describe our preliminary approach to finding an optimal solution to the problem.

Clouse, Jeff↗
NASA NTRS2003

Intelligent Machines in the 21st Century: Automating the Processes of Inference and Inquiry

The last century saw the application of Boolean algebra toward the construction of computing machines, which work by applying logical transformations to information contained in their memory. The development of information theory and the generalization of Boolean algebra to Bayesian inference have enabled these computing machines. in the last quarter of the twentieth century, to be endowed with the ability to learn by making inferences from data. This revolution is just beginning as new computational techniques continue to make difficult problems more accessible. However, modern intelligent machines work by inferring knowledge using only their pre-programmed prior knowledge and the data provided. They lack the ability to ask questions, or request data that would aid their inferences. Recent advances in understanding the foundations of probability theory have revealed implications for areas other than logic. Of relevance to intelligent machines, we identified the algebra of questions as the free distributive algebra, which now allows us to work with questions in a way analogous to that which Boolean algebra enables us to work with logical statements. In this paper we describe this logic of inference and inquiry using the mathematics of partially ordered sets and the scaffolding of lattice theory, discuss the far-reaching implications of the methodology, and demonstrate its application with current examples in machine learning. Automation of both inference and inquiry promises to allow robots to perform science in the far reaches of our solar system and in other star systems by enabling them to not only make inferences from data, but also decide which question to ask, experiment to perform, or measurement to take given what they have learned and what they are designed to understand.

Knuth, Kevin H.↗
NASA NTRS2009

Apollo CSM Power Generation System Design Considerations, Failure Modes and Lessons Learned

The objectives of this slide presentation are to: review the basic design criteria for fuel cells (FC's), review design considerations during developmental phase that affected Block I and Block II vehicles, summarize the conditions that led to the failure of components in the FC's, and state the solution implemented for each failure. It reviews the location of the fuel cells, the fuel cell theory the design criteria going into development phase and coming from the development phase, failures and solutions of Block I and II, and the lessons learned.

Interbartolo, Michael↗
NASA NTRSDate not supplied

A Machine Learning-Derived Atomistic Potential for Y2Si2O7

Incorporation of SiC/SiC ceramic matrix composite (CMC) hot section components into aircraft engines promises to increase efficiency and safety. However, SiC/SiC CMCs are subject to water vapor-induced oxidation and recession at the high temperatures of engine operation, and thus environmental barrier coatings (EBCs) are required to reduce this degradation and enable their widespread adoption. An understanding of EBCs failure mechanisms, including thermochemical and thermomechanical mechanisms, is essential as coating degradation leads to reduced CMC component service life. Computational modeling approaches can provide insight into EBC material properties important for coating design. However, density functional theory (DFT) is computationally expensive and atomistic potentials are lacking for materials of interest. In this work, we utilize a machine learning approach and DFT training data to parameterize atomistic potentials for two candidate EBC materials, Y2Si2O7 and Yb2Si2O7. These potentials enable near DFT-accurate calculations of thermodynamic and thermomechanical properties essential to EBC design.

Cameron J Bodenschatz↗
NASA NTRS1991

Neurocontrol and fuzzy logic: Connections and designs

Artificial neural networks (ANNs) and fuzzy logic are complementary technologies. ANNs extract information from systems to be learned or controlled, while fuzzy techniques mainly use verbal information from experts. Ideally, both sources of information should be combined. For example, one can learn rules in a hybrid fashion, and then calibrate them for better whole-system performance. ANNs offer universal approximation theorems, pedagogical advantages, very high-throughput hardware, and links to neurophysiology. Neurocontrol - the use of ANNs to directly control motors or actuators, etc. - uses five generalized designs, related to control theory, which can work on fuzzy logic systems as well as ANNs. These designs can copy what experts do instead of what they say, learn to track trajectories, generalize adaptive control, and maximize performance or minimize cost over time, even in noisy environments. Design tradeoffs and future directions are discussed throughout.

Werbos, Paul J.↗
DOE OSTI2023

Postdisaster Routing of Movable Energy Resources for Enhanced Distribution System Resilience: A Deep Reinforcement Learning-Based Approach

The deployment of movable energy resources (MERs) can be an effective strategy to restore critical loads to enhance power system resilience when no other energy sources are available after the occurrence of an extreme event. Since the optimal locations of MERs following an extreme event are dependent on system operating states (e.g., the loads at each node, on/off status of system branches, and so on), existing analytical and population-based approaches must repeat the entire analysis and calculation when the system operating states change. On the contrary, if deep reinforcement learning (DRL)-based algorithms are sufficiently trained with a wide range of scenarios, they can quickly find optimal or near-optimal locations irrespective of changes in system states. A deep Q-learning-based approach is proposed for optimal MER deployment to enhance power system resilience. MERs can be also utilized to complement other types of resources, if available. The proposed approach operates in two stages after the occurrence of extreme events. In the first stage, the distribution network is represented as a graph, and the network is then reconfigured using tie switches by using Kruskal’s spanning forest search algorithm (KSFSA). To maximize critical load recovery, the optimal or near-optimal locations of MERs are chosen in the second stage. Further, case studies on a 33-node distribution system and a modified IEEE 123-node system demonstrate the effectiveness of the proposed approach for postdisaster routing of MERs.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Machine-learning modeling of magnetization dynamics in quasi-equilibrium and driven metallic spin systems

Here, we present a perspective on recent progress in machine-learning (ML) force-field approaches for large-scale Landau–Lifshitz–Gilbert (LLG) simulations of metallic spin systems. Building on a generalization of the Behler–Parrinello (BP) architecture originally developed for quantum molecular dynamics, we develop scalable and transferable ML models that faithfully capture the complex, environment-dependent electron-mediated exchange fields characteristic of itinerant magnets. A central ingredient of this framework is the implementation of symmetry-aware magnetic descriptors based on group-theoretical bispectrum formalisms. Leveraging these ML force fields, LLG simulations faithfully reproduce hallmark non-collinear magnetic orders—such as the 120° and tetrahedral states—on the triangular lattice, and successfully capture the complex spin textures emerging in the mixed-phase states of a square-lattice double-exchange model under thermal quench. We further discuss a generalized potential theory that extends the BP formalism to incorporate both conservative and nonconservative electronic torques, thereby enabling ML models to learn nonequilibrium exchange fields from computationally demanding microscopic approaches such as nonequilibrium Green’s-function techniques. This extension yields quantitatively accurate predictions of voltage-driven domain-wall motion and establishes a foundation for quantum-accurate, multiscale modeling of nonequilibrium spin dynamics and spintronic functionalities.

Descriptors↗
DOE OSTI2022

Physically Informed Machine Learning Prediction of Electronic Density of States

The electronic structure of a material, such as its density of states (DOS), provides key insights into its physical and functional properties and serves as a valuable source of high-quality features for many materials screening and discovery workflows. Still, the computational cost of calculating the DOS, most commonly with density functional theory (DFT), becomes prohibitive for meeting high-fidelity or high-throughput requirements, necessitating a cheaper but sufficiently accurate surrogate. To fulfill this demand, we develop a general machine learning method based on graph neural networks for predicting the DOS purely from atomic positions, six orders of magnitude faster than DFT. This approach can effectively use large materials databases and be applied generally across the entire periodic table to materials classes of arbitrary compositional and structural diversity. We furthermore devise a highly adaptable scheme for physically informed learning which encourages the DOS prediction to favor physically reasonable solutions defined by any set of desired constraints. This functionality provides a means for ensuring that the predicted DOS is reliable enough to be used as an input to downstream materials screening workflows to predict more complex functional properties, which rely on accurate physical features.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Detection of multi-reference character imbalances enables a transfer learning approach for virtual high throughput screening with coupled cluster accuracy at DFT cost

Appropriately identifying and treating molecules and materials with significant multi-reference (MR) character is crucial for achieving high data fidelity in virtual high-throughput screening (VHTS). Despite development of numerous MR diagnostics, the extent to which a single value of such a diagnostic indicates the MR effect on a chemical property prediction is not well established. We evaluate MR diagnostics for over 10 000 transition-metal complexes (TMCs) and compare to those for organic molecules. We observe that only some MR diagnostics are transferable from one chemical space to another. By studying the influence of MR character on chemical properties (i.e., MR effect) that involve multiple potential energy surfaces (i.e., adiabatic spin splitting, ΔE H–L , and ionization potential, IP), we show that differences in MR character are more important than the cumulative degree of MR character in predicting the magnitude of an MR effect. Motivated by this observation, we build transfer learning models to predict CCSD(T)-level adiabatic ΔE H–L and IP from lower levels of theory. By combining these models with uncertainty quantification and multi-level modeling, we introduce a multi-pronged strategy that accelerates data acquisition by at least a factor of three while achieving coupled cluster accuracy (i.e., to within 1 kcal mol –1 MAE) for robust VHTS.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Electronic structure theory on modeling short-range noncovalent interactions between amino acids

While short-range noncovalent interactions (NCIs) are proving to be of importance in many chemical and biological systems, these atypical bindings happen within the so-called van der Waals envelope and pose an enormous challenge for current computational methods. We introduce SNCIAA, a database of 723 benchmark interaction energies of short-range noncovalent interactions between neutral/charged amino acids originated from protein x-ray crystal structures at the “gold standard” coupled-cluster with singles, doubles, and perturbative triples/complete basis set [CCSD(T)/CBS] level of theory with a mean absolute binding uncertainty less than 0.1 kcal/mol. Subsequently, a systematic assessment of commonly used computational methods, such as the second-order Møller−Plesset theory (MP2), density functional theory (DFT), symmetry-adapted perturbation theory (SAPT), composite electronic-structure methods, semiempirical approaches, and the physical-based potentials with machine learning (IPML) on SNCIAA is carried out. It is shown that the inclusion of dispersion corrections is essential even though these dimers are dominated by electrostatics, such as hydrogen bondings and salt bridges. Overall, MP2, ωB97M-V, and B3LYP+D4 turned out to be the most reliable methods for the description of short-range NCIs even in strongly attractive/repulsive complexes. SAPT is also recommended in describing short-range NCIs only if the δMP2 correction has been included. The good performance of IPML for dimers at close-equilibrium and long-range conditions is not transferable to the short-range. We expect that SNCIAA will assist the development/improvement/validation of computational methods, such as DFT, force-fields, and ML models, in describing NCIs across entire potential energy surfaces (short-, intermediate-, and long-range NCIs) on the same footing.

Chemistry↗
NASA NTRS2003

Hearing is Believing

This paper presents a discussion on the cochlear implant. This device was developed by Adam Kissiah, who suffers from hearing loss. Driven by his own hearing problem and three failed corrective surgeries, Kissiah started working in the mid-1970s on this surgically implantable device that provides hearing sensation to persons with severe-to-profound hearing loss who receive little or no benefit from hearing aids. Uniquely, the cochlear implant concept was not based on theories of medicine, as Kissiah had no medical background whatsoever. Instead, he utilized the technical expertise he learned while working as an electronics instrumentation engineer at NASA s Kennedy Space Center for the basis of his invention. This took place over 3 years, when Kissiah would spend his lunch breaks and evenings in Kennedy s technical library, studying the impact of engineering principles on the inner ear. In April of 2003, Kissiah was inducted into the Space Foundation's U.S. Space Technology Hall of Fame for his invention

Source record↗
NASA NTRS1998

Using Collective Intelligence to Route Internet Traffic

A Collective Intelligence (COIN) is a community of interacting reinforcement learning (RL) algorithms designed so that their collective behavior maximizes a global utility function. We introduce the theory of COINs, then present experiments using that theory to design COINs to control internet traffic routing. These experiments indicate that COINs outperform previous RL-based systems for such routing that have previously been investigated.

Wolpert, David H.↗
NASA NTRS2004

Cosmic Ray Propagation Models

Astrophysics of cosmic rays and gamma rays depends very much on the quality of the data, which become increasingly accurate each year and therefore more constraining. While direct measurements of cosmic rays are possible in only one location on the outskirts of the Milky Way, the Galactic diffuse gamma-ray emission provides insights into the spectra of cosmic rays in distant locations, therefore complementing the local cosmic-ray studies. This connection, however, requires extensive modeling and is yet to be explored in detail. The GUST mission, which is scheduled for launch in 2007 and is capable of measuring gamma-rays in the range 20 MeV - 300 GeV, will change the status quo dramatically. Galactic diffuse gamma-ray emission gathered by GUST will require adequate theoretical models. The efforts will be rewarded by the wealth of information on cosmic ray spectra and fluxes in remote locations. In its turn, a detailed cosmic ray propagation model will provide a reliable basis for other studies such as search for dark matter signals in cosmic rays and diffuse gamma rays, spectrum and origin of the extragalactic gamma-ray emission, theories of nucleosynthesis and evolution of elements etc. In this talk, I will discuss what we can learn studying the cosmic ray propagation and diffuse gamma-ray emission.

Moskalenko, I. V.↗
NASA NTRS2004

Propagation of Cosmic Rays

Astrophysics of cosmic rays and gamma rays depends very much on the quality of the data, which become increasingly accurate each year and therefore more constraining. While direct measurements of cosmic rays are possible in only one location on the outskirts of the Milky Way, the Galactic diffuse gamma-ray emission provides insights into the spectra of cosmic rays in distant locations, therefore complementing the local cosmic-ray studies. This connection, however, requires extensive modeling and is yet to be explored in detail. The GLAST mission, which is scheduled for launch in 2007 and is capable of measuring gamma-rays in the range 20 MeV - 300 GeV, will change the status quo dramatically. The detailed spectra and skymaps of the Galactic diffuse gamma-ray emission gathered by GLAST will require adequate theoretical models. The efforts will be rewarded by the wealth of information on cosmic ray spectra and fluxes in remote locations. In its turn, a detailed cosmic ray propagation model will provide a reliable basis for other studies such as search for dark matter signals in cosmic rays and diffuse gamma rays, spectrum and origin of the extragalactic gamma-ray'emission, theories of nucleosynthesis and evolution of elements etc. In this talk, I will discuss what we can learn studying the cosmic ray propagation and diffuse gamma-ray emission.

Moskalenko, I. V.↗
DOE OSTI2020

Quantum Information for Particle Theorists

Lectures given at the Theoretical Advanced Study Institute (TASI 2020), 1-26 June 2020. The topics covered include quantum circuits, entanglement, quantum teleportation, Bell inequalities, quantum entropy and decoherence, classical versus quantum measurement, the area law for entanglement entropy in quantum field theory, and simulating quantum field theory on a quantum computer. Along the way we confront the fundamental sloppiness of how we all learned (and some of us taught) quantum mechanics in college. Links to a Python notebook and Mathematica notebooks will allow the reader to reproduce and extend the calculations, as well as perform five experiments on a quantum simulator.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗