Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Learning Theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,297 records · Page 72

A Computational Framework to Accelerate the Discovery of Perovskites for Solar Thermochemical Hydrogen Production: Identification of Gd Perovskite Oxide Redox Mediators

A high-throughput computational framework to identify novel multinary perovskite redox mediators is presented, and this framework is applied to discover the Gd-containing perovskite oxide compositions Gd 2 BB'O 6 , GdA'B 2 O 6 , and GdA'BB'O 6 that split water. The computational scheme uses a sequence of empirical approaches to evaluate the stabilities, electronic properties, and oxygen vacancy thermodynamics of these materials, including contributions to the enthalpies and entropies of reduction, ΔH TR and ΔS TR . This scheme uses the machine-learned descriptor τ to identify compositions that are likely stable as perovskites, the bond valence method to estimate the magnitude and phase of BO 6 octahedral tilting and provide accurate initial estimates of perovskite geometries, and density functional theory including magnetic- and defect-sampling to predict STCH-relevant properties. Eighty-three promising STCH candidate perovskite oxides down-selected from 4392 Gd-containing compositions are reported, three of which are referred to experimental collaborators for characterization and exhibit STCH activity. Our results demonstrate that the high-throughput computational scheme described herein—which is used to evaluate Gd-containing compositions but can be applied to any multinary perovskite oxide compositional space(s) of interest—accelerates the discovery of novel STCH active redox mediators with reasonable computational expense.

36 MATERIALS SCIENCE↗

Predictive Design of Hybrid Improper Ferroelectric Double Perovskite Oxides

The computational design of suitable multiferroic double perovskite oxides requires finding materials that exhibit sizable polarization, magnetization, and coupling between them. Oxides with the chemical formula of AA'BB'O 6 with building blocks of ABO 3 single perovskite oxides in centrosymmetric Pnma symmetry are strong candidates that have been reported to satisfy such criteria. The system lowers to noncentrosymmetric, polar P2 1 symmetry if A/A' layered and B/B' rocksalt cation orderings are imposed. A detailed compositional search over a variety of chemical spaces followed by evaluating their polarization may lead to the identification of more of these compounds with ferroelectric ordering. The standard density functional theory practices to estimate polarization within the Berry phase formalism require the systems to be perfectly insulating. The number of compounds that can be evaluated using this method is therefore limited. In this work, we introduce a predictive learning strategy based on importance sampling to build a series of machine learning models using results from first-principles simulations to predict polarization and the corresponding switching barrier. The geometry-driven features related to charge states and cationic radii play key roles in predicting the switching barrier with complementary contributions from the key structural mode-based order parameters. These modes become important to draw reasonable predictions of polarization components from machine learning models. In conclusion, our predictive models identify candidates with high polarizations and low switching barriers from a pool of double perovskite oxides, suitable for future investigation for their potential applications in spintronic devices.

36 MATERIALS SCIENCE↗

Operando probing dynamic migration of copper carbonyl during electrocatalytic CO2 reduction

Single crystals and shape-controlled nanocrystals are well known to exhibit facet-dependent catalytic properties. However, few studies have investigated how those nanocrystals evolve and (de)activate during reactions, calling for the development of nanoscale time-resolved operando methods. In this context, we have designed Cu nanocubes as a model system to elucidate the underlying driving force of dynamic nanocatalyst reconstruction during the CO2 reduction reaction (CO2RR). Operando electrochemical liquid-cell scanning transmission electron microscopy (EC-STEM) and synchrotron-based X-ray spectroscopy reveal the size- and potential-dependent complete transformation from (100)-oriented Cu@Cu2O nanocubes to polycrystalline metallic Cu nanograins under CO2RR conditions. In addition, machine learning-assisted operando four-dimensional STEM reveals that large Cu nanograins derived from nanocubes form mainly crystalline domains, while their smaller counterparts are more amorphous due to faster evolution kinetics. In situ Raman spectroscopy and density functional theory calculations suggest that CO drives the ejection of single Cu atoms, resulting in few-nanometre Cu clusters and the surface migration of highly mobile copper carbonyl (Cu–CO) species. Combined, these multimodal operando methods and theoretical approaches pave the way for understanding the complex structural evolution of energy-related nanocatalysts under electrochemical conditions.

Yang, Yao↗

miniTimeCube as a neutron scatter camera

We present Monte Carlo (MC) simulation results from a study of a compact plastic-scintillator detector suitable for imaging fast neutrons in the 1 – 10 MeV energy range: the miniTimeCube (mTC). Originally designed for antineutrino detection, the mTC consists of 24 MultiChannel Plate (MCP) photodetectors surrounding a 13 cm cube of boron-doped plastic scintillator. Our simulation results show that waveform digitization of 1536 optically sensitive channels surrounding the scintillator should allow for spatiotemporal determination of individual neutron-proton scatters in the detector volume to ~ 100 picoseconds and ~5 mm. A Bayesian estimation framework is presented for multiple-scatter reconstruction, and is used to estimate the incoming direction and energy of simulated individual neutrons. Finally, we show how populations of reconstructed neutrons can be used to estimate the direction and energy spectrum of nearby simulated neutron sources.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

First principles reactive simulation for equation of state prediction

The high cost of density functional theory (DFT) has hitherto limited the ab initio prediction of the equation of state (EOS). In this article, we employ a combination of large scale computing, advanced simulation techniques, and smart data science strategies to provide an unprecedented ab initio performance analysis of the high explosive pentaerythritol tetranitrate (PETN). Comparison to both experiment and thermochemical predictions reveals important quantitative limitations of DFT for EOS prediction and thus the assessment of high explosives. In particular, we find that DFT predicts the energy of PETN detonation products to be systematically too high relative to the unreacted neat crystalline material, resulting in an underprediction of the detonation velocity, pressure, and temperature at the Chapman–Jouguet state. The energetic bias can be partially accounted for by high-level electronic structure calculations of the product molecules. Furthermore we demonstrate a modeling strategy for mapping chemical composition across a wide parameter space with limited numerical data, the results of which suggest additional molecular species to consider in thermochemical modeling.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Physics-informed neural networks for inverse problems in nano-optics and metamaterials

In this paper, we employ the emerging paradigm of physics-informed neural networks (PINNs) for the solution of representative inverse scattering problems in photonic metamaterials and nano-optics technologies. In particular, we successfully apply mesh-free PINNs to the difficult task of retrieving the effective permittivity parameters of a number of finite-size scattering systems that involve many interacting nanostructures as well as multi-component nanoparticles. Our methodology is fully validated by numerical simulations based on the finite element method (FEM). The development of physics-informed deep learning techniques for inverse scattering can enable the design of novel functional nanostructures and significantly broaden the design space of metamaterials by naturally accounting for radiation and finite-size effects beyond the limitations of traditional effective medium theories.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Analytical framework and tool kit for SEA follow-up

Most Strategic Environmental Assessment (SEA) research and applications have so far neglected the ex post stages of the process, also called SEA follow-up. Tool kits and methodological frameworks for engaging effectively with SEA follow-up have been conspicuously missing. In particular, little has so far been learned from the much more mature evaluation literature although many aspects are similar. This paper provides an analytical framework and tool kit for SEA follow-up. It is based on insights and tools developed within programme evaluation and environmental systems analysis. It is also grounded in empirical studies into real planning and programming practices at the regional level, but should have relevance for SEA processes at all levels. The purpose of the framework is to promote a learning-oriented and integrated use of SEA follow-up in strategic decision making. It helps to identify appropriate tools and their use in the process, and to systematise the use of available data and knowledge across the planning organization and process. It distinguishes three stages in follow-up: scoping, analysis and learning, identifies the key functions and demonstrates the informational linkages to the strategic decision-making process. The associated tool kit includes specific analytical and deliberative tools. Many of these are applicable also ex ante, but are then used in a predictive mode rather than on the basis of real data. The analytical element of the framework is organized on the basis of programme theory and 'DPSIR' tools. The paper discusses three issues in the application of the framework: understanding the integration of organizations and knowledge; understanding planners' questions and analytical requirements; and understanding interests, incentives and reluctance to evaluate.

54 ENVIRONMENTAL SCIENCES↗

Ab initio generalized Langevin equation

We introduce a machine learning–based approach called ab initio generalized Langevin equation (AIGLE) to model the dynamics of slow collective variables (CVs) in materials and molecules. In this scheme, the parameters are learned from atomistic simulations based on ab initio quantum mechanical models. Force field, memory kernel, and noise generator are constructed in the context of the Mori–Zwanzig formalism, under the constraint of the fluctuation–dissipation theorem. Combined with deep potential molecular dynamics and electronic density functional theory, this approach opens the way to multiscale modeling in a variety of situations. Here, we demonstrate this capability with a study of two mesoscale processes in crystalline lead titanate, namely the field-driven dynamics of a planar ferroelectric domain wall, and the dynamics of an extensive lattice of coarse-grained electric dipoles. In the first case, AIGLE extends the reach of ab initio simulations to a regime of noise-driven motions not accessible to molecular dynamics. In the second case, AIGLE deals with an extensive set of CVs by adopting a local approximation for the memory kernel and retaining only short-range noise correlations. The scheme is computationally more efficient than molecular dynamics by several orders of magnitude and mimics the microscopic dynamics at low frequencies where it reproduces accurately the dominant far-infrared absorption frequency.

97 MATHEMATICS AND COMPUTING↗

Data-driven learning of nonlocal physics from high-fidelity synthetic data

A key challenge to nonlocal models is the analytical complexity of deriving them from first principles, and frequently their use is justified a posteriori. Here, we extract nonlocal models from data, circumventing these challenges and providing data-driven justification for the resulting model form. Extracting data-driven surrogates is a major challenge for machine learning (ML) approaches, due to nonlinearities and lack of convexity — it is particularly challenging to extract surrogates which are provably well-posed and numerically stable. Our scheme not only yields a convex optimization problem, but also allows extraction of nonlocal models whose kernels may be partially negative while maintaining well-posedness even in small-data regimes. To achieve this, based on established nonlocal theory, we embed in our algorithm sufficient conditions on the non-positive part of the kernel that guarantee well-posedness of the learnt operator. These conditions are imposed as inequality constraints to meet the requisite conditions of the nonlocal theory. We demonstrate this workflow for a range of applications, including reproduction of manufactured nonlocal kernels; numerical homogenization of Darcy flow associated with a heterogeneous periodic microstructure; nonlocal approximation to high-order local transport phenomena; and approximation of globally supported fractional diffusion operators by truncated kernels.

42 ENGINEERING↗

Physics-Based Feature Extraction from Bulk Time-Series PMU Datasets for Event Detection

In this work, two physics-based feature extraction techniques are developed for bulk time-series phasor measurement unit (PMU) datasets collected from the field to train the machine learning model for anomaly detection. Two approaches have been developed to extract useful features for different types of events. An admittance-based feature extraction technique is developed to detect events that involve line outages and system topology variations. The developed algorithm extracts the system equivalent admittance variation. Additionally, Fielder’s Theory is utilized to further reduce the potential computation burden by sectionalizing large-scale grids and datasets into smaller areas. Second, an oscillation-based feature extraction technique is developed to detect low-frequency oscillations in power grids. The dominant oscillation modes in the grids are extracted using energy-sorted Prony analysis. The extracted dominant oscillation modes by the developed work exhibit a high fitting resolution. Finally, the developed techniques have been validated using large-scale and real-world datasets.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Reducing Urban Traffic Congestion Using Deep Learning and Model Predictive Control

This article proposes a deep learning (DL)-based control algorithm—DL velocity-based model predictive control (VMPC)—for reducing traffic congestion with slowly time-varying traffic signal controls. This control algorithm consists of system identification using DL and traffic signal control using VMPC. For the training process of DL, we established a modeling error entropy loss as the criteria inspired by the theory of stochastic distribution control (SDC) originated by the fourth author. Herein, simulation results show that the proposed algorithm can reduce traffic congestion with a slowly varying traffic signal control input. Results of an ablation study demonstrate that this algorithm compares favorably to other model-based controllers in terms of prediction error, signal varying speed, and control effectiveness.

97 MATHEMATICS AND COMPUTING↗

Chromium-doped uranium dioxide fuels: A review

UO 2 doped with parts per million CR 2 O 3 powder is considered a potential near term accident tolerant fuel candidate. Here, the results of decades of industry and academic research into Cr-doped UO 2 are analyzed and their shortcomings are critiqued. Focusing on the incorporation mechanisms of Cr into the fuel matrix, we explore a mechanistic understanding of the characteristic properties of Cr-doped UO 2 , notably, enhanced fission gas retention attributed to enlarged grain sizes following sintering, along with marginal improvements in the thermophysical properties. The findings of recent X-ray Adsorption Near Edge Spectroscopy studies were compared and put into conversation with historic data regarding the incorporation of Cr in UO 2 . On the basis of defect mechanisms, the case is made for the substitutional incorporation of Cr governing the lattice solubility but not the enhanced U diffusivity. Instead, Cr/CR 2 O 3 redox chemistry in a well-defined oxygen potential explains the differences in the U diffusivity and O/M ratio. The primary mechanism of doping enhanced grain growth is found to be liquid assisted sintering due to a CRO (1) eutectic phase at the grain boundaries. The role of inhomogeneities in Cr concentration in UO 2 at various length scales across the materials microstructure is highlighted and connected to promising experimental and modeling work to fill in the gaps in the current understanding of Cr-doped UO 2 . The review considers both the open scientific questions and engineering applications to illustrate the deep connections between the practice and theory in the design of accident tolerant nuclear fuels. In conclusion, the review ends with an outline of future works that combine meticulous irradiation studies and high resolution experiments with next generation modeling and simulations techniques empowered by machine learning advances to accelerate the fabrication and adoption of Cr-doped UO 2 light water reactors.

Cleveland, Mack Wesley [Massachusetts Inst. of Tec↗

Finite-element-based simulations of electrodes for CO 2 cascade reduction reactions

The multielectron reduction of CO 2 to liquid fuels could be a path to scalable energy storage, but reaching this goal requires major advances in catalysis and systems engineering. Cascade catalysis, which couples sequential reactions without isolating intermediates, has emerged as a promising route to enhance selectivity and efficiency in CO 2 reduction (CO 2 R). In this review, we examine how finite-element-based simulations of continuum model [finite element method (FEM)] approaches are being used to analyze and guide CO 2 R cascade systems. We first outline the fundamentals of cascade catalysis and recent advances in catalytic materials (metallic, molecular, and hybrid architectures). We then focus on FEM developments at the electrode and device scales, emphasizing how these models capture transport phenomena, local microenvironments, and geometry-dependent effects. To clarify design principles, we present case studies of cascade electrodes organized in systems without and with integrated semiconductors. We further emphasize the integration of FEM with multiscale frameworks (density functional theory, molecular dynamics, kinetic Monte Carlo) and its role in bridging atomic-level insights with device-level performance. Finally, we identify current limitations and future prospects, including improved boundary conditions, coupling with operando experiments, and machine learning-accelerated model development. Together, these insights provide design principles for next-generation CO 2 R cascade systems for efficient solar fuel production.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Searle's"Dualism Revisited"

A recent article in which John Searle claims to refute dualism is examined from a scientific perspective. John Searle begins his recent article 'Dualism Revisited' by stating his belief that the philosophical problem of consciousness has a scientific solution. He then claims to refute dualism. It is therefore appropriate to examine his arguments against dualism from a scientific perspective. Scientific physical theories contain two kinds of descriptions: (1) Descriptions of our empirical findings, expressed in an every-day language that allows us communicate to each other our sensory experiences pertaining to what we have done and what we have learned; and (2) Descriptions of a theoretical model, expressed in a mathematical language that allows us to communicate to each other certain ideas that exist in our mathematical imaginations, and that are believed to represent, within our streams of consciousness, certain aspects of reality that we deem to exist independently of their being perceived by any human observer. These two parts of our scientific description correspond to the two aspects of our general contemporary dualistic understanding of the total reality in which we are imbedded, namely the empirical-mental aspect and the theoretical-physical aspect. The duality question is whether this general dualistic understanding of ourselves should be regarded as false in some important philosophical or scientific sense.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Bridging the time scale in exascale computing of chemical systems (Final Technical Report)

This report summarizes the work carried out with support of the United States Department of Energy under Award DE-SC0019441. The theme of this project was to develop and apply methods that allowed for the acceleration of atomistic calculations, particularly in challenging areas such as multiphase systems, electrified interfaces, uncertainty estimation, and applications requiring chemical accuracy, which tend to be applications where simulation time is severely bottlenecked by the computational time requirements. Much of the focus was on the application of emerging machine-learning methodologies, although a wide range of methodologies were employed. This report has two major sections. The first focuses on the methodological advances themselves. Within this part, we report a number of major advances, a few examples of which are described here. We report the first machine-learning scheme for the acceleration of electronically grand-canonical calculations (that is, those applicable to electrochemistry). We report new methods of performing transfer learning, in which physics-based priors can be used to provide predictions, often with uncertainty estimates, of images well outside of training sets; we also offer ways to fine-tune these transfer-learning models. We provide a new systematic means to generate and apply minimal training data sets to very large (10,000’s of atoms) systems, with only small training sets appropriate for electronic structure. We developed new methodologies to integrate surface vibrations into surface adsorption calculations. We made advances to the applicability of diffusion Monte Carlo methods to allow (learned) force prediction, finite-size error correction, and force-free means of searching for transition states. We integrated machine-learned atomistic predictions into mechanism generation codes. Additionally, we released new software including AmpTorch, a modernized version of our original atomistic machine-learning code Amp. The second part of this report focuses on the scientific applications that accompanied, and were often enabled by, the methodological advances described earlier. A few examples follow, but full details are in the individual chapters of the report. For example, we developed a general theory of phonon-induced friction on molecular adsorbates. We showed fundamentally how solvent influences the adsorption and desorption process and how it differs from the processes typically involved at the solid–gas interface, making aqueous-phase and electrocatalysis different from traditional thermocatalysis. We examined how metal–insulator and magnetic transitions can be probed, and accelerated exciton dynamics via Frenkel Hamiltonian parameters. We showed that the nearsighted force-training approach, developed within this project, can predict both the stability and reactivity of large nanoparticles, and can also lead to insights on catalyst coverage on binding energies and entropies. These applied studies, which generally integrated with our method development, allowed us to push forward the theoretical understanding of several reaction classes.

08 HYDROGEN↗

Ductility mechanisms in complex concentrated refractory alloys from atomistic fracture simulations

The striking variation in damage tolerance among refractory complex concentrated alloys is examined through the analysis of atomistic fracture simulations, contrasting behavior in elemental Nb with that in brittle NbMoTaW and ductile Nb45Ta25Ti15Hf15. We employ machine-learning interatomic potentials (MLIPs), including a new MLIP developed for NbTaTiHf, in atomistic simulations of crack tip extension mechanisms based on analyses of atomistic fracture resistance curves. While the initial behavior of sharp cracks shows good correspondence with the Rice theory, fracture resistance curves reveal marked changes in fracture modes for the complex alloys as crack extension proceeds. In NbMoTaW, compositional complexity appears to promote dislocation nucleation relative to pure Nb, despite theoretical predictions that the alloy should be relatively more brittle. In Nb45Ta25Ti15Hf15, alloying alters the fracture mode compared to elemental Nb, promoting crack tip blunting and enhancing resistance to crack propagation.

Computational methods↗

Accurate numerical simulations of open quantum systems using spectral tensor trains

Decoherence between qubits is a major bottleneck in quantum computations. Decoherence results from intrinsic quantum and thermal fluctuations as well as noise in the external fields that perform the measurement and preparation processes. With prescribed colored noise spectra for intrinsic and extrinsic noise, we present a numerical method, Quantum Accelerated Stochastic Propagator Evaluation (Q-ASPEN), to solve the time-dependent noise-averaged reduced density matrix in the presence of intrinsic and extrinsic noise. Q-ASPEN is arbitrarily accurate and can be applied to provide estimates for the resources needed to error-correct quantum computations. We employ spectral tensor trains, which combine the advantages of tensor networks and pseudospectral methods, as a variational ansatz to the quantum relaxation problem and optimize the ansatz using methods typically used to train neural networks. Here, the spectral tensor trains in Q-ASPEN make accurate calculations with tens of quantum levels feasible. We present benchmarks for Q-ASPEN on the spin-boson model in the presence of intrinsic noise and on a quantum chain of up to 32 sites in the presence of extrinsic noise. In our benchmark, the memory cost of Q-ASPEN scales as a low-order polynomial in the size of the system once the number of system states surpasses the number of basis functions used in the spectral expansion.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Multistage nucleation pathway in LiF molten salt mirrors the crystal–melt interface structure

Despite over a century of studies, fundamental questions remain about the processes governing crystal nucleation from melts or solutions. Research over the past three decades has presented mounting evidence for kinetic pathways of crystal nucleation that are more complex than envisioned by the simplest forms of classical theory. Such observations have been presented for colloidal and elemental systems with covalent and metallic bonding. Despite the technological and geochemical importance of molten salts, similar studies for these ionically bonded systems are currently lacking. Here we develop a machine learning interatomic potential for a model ionic system: LiF. The potential features quantum-level accuracy for both liquid and multiple solid polymorphs over wide temperature and pressure ranges and accurately reproduces experimentally measured properties. Thanks to the efficiency of the potential, which enables microsecond-scale molecular dynamics simulations, induction times for nucleation of LiF solids from their melts are computed over a range of undercoolings. With the aid of a set of robust local order parameters established here, the simulations reveal that homogeneous crystal nucleation in undercooled melts preferentially initiates from liquid regions showing slow dynamics and high bond orientational order simultaneously, and the second-shell order of both precritical nuclei and the surface of postcritical nuclei is dominated by hexagonal close packing and body-centered cubic local structure, even though the nucleus core is dominated by face-centered cubic structure corresponding to the stable rocksalt crystal structure. Finally, we establish a connection between the crystallization pathway and the equilibrium crystal-melt interface structure.

Applied Physical Sciences↗