Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Learning Theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

Goldstone-Apple Valley Radio Telescope System Theory of Operation

The purpose of this learning module is to enable learners to describe how the Goldstone-Apple Valley Radio Telescope (GAVRT) system functions in support of Apple Valley Science and Technology Center's (AVSTC) client schools' radio astronomy activities.

Radio Telescope↗

Tradeoffs in the utility of learned knowledge

Planning systems which make use of domain theories can produce more accurate plans and achieve more goals as the quality of their domain knowledge improves. MTR, a multi-strategy learning system, was designed to learn from system failures and improve domain knowledge used in planning. However, augmented domain knowledge can decrease planning efficiency. We describe how improved knowledge that becomes expensive to use can be approximated to yield calculated tradeoffs in accuracy and efficiency.

Kedar, Smadar↗

Attribution of heterogeneous stress distributions in low-grain polycrystals under conditions leading to damage

In high-purity polycrystalline metallic materials, voids tend to favor grain boundaries as nucleation sites due to the elevated stress states produced by granular interactions and the weakened grain boundary from the relative atomic disorder. To quantify the key factors of this elevated stress state, simple compression of a small multi-grain cylinder of body-centered cubic tantalum was simulated using a single crystal plasticity model that incorporates non-Schmid effects. Four increasingly complex synthetic microstructures were created to tractably incorporate grain boundary interactions, and a statistically significant number of combinations were performed by varying the initial crystallographic orientations of the microstructure. Most of these simulations produce the maximum von Mises stress on a grain boundary and less frequently at the multi-grain junctions. To build a statistical model for the maximum von Mises stress at the grain boundary, physically based features that could contribute to the elevated stress state were selected. Then, a learning algorithm based on information theory was used to identify which of these features contributed the most information to the data set. The identified features include a grain’s propensity to accommodate both elastic and plastic deformations and their directional components. The misalignment of the direction of each grain’s mechanical response was found to be strongly correlated to the magnitude of the stress near the grain boundary. For all of the synthetic microstructures, the statistical models produce a residual distribution that is nearly Gaussian with a variance of, at most, 10% of the prior distribution. The successful performance of the statistical model implies the correct identification of the physical features that cause severe stress localization in polycrystalline materials. The statistical models constructed here can be used to formulate a physically motivated void nucleation model which is sensitive to a microstructure’s propensity to produce elevated stress states. As a result, these statistical models also enable the design of material microstructures, in which the crystallographic orientation is chosen to resist void nucleation.

36 MATERIALS SCIENCE↗

Efficient 3D Molecular Design with an E(3) Invariant Transformer VAE

This work introduces a three-dimensional (3D) invariant graph-to-string transformer variational autoencoders (VAE) (Vagrant) for generating molecules with accurate density functional theory (DFT)-level properties. Vagrant learns to model the joint probability distribution of a 3D molecular structure and its properties by encoding molecular structures into a 3D-aware latent space. Directed navigation through this latent space implicitly optimizes the 3D structure of a molecule, and the latent embedding can be used to condition a generative transformer to predict the candidate structure as a one-dimensional (1D) sequence. Additionally, we introduce two novel sampling methods that exploit the latent characteristics of a VAE to improve performance. Here, we show that our method outperforms comparable 3D autoregressive and diffusion methods for predicting quantum chemical property values of novel molecules in terms of both sample quality and computational efficiency.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Upscaling Reactive Transport and Clogging in Shale Microcracks by Deep Learning

Fracture networks in shales exhibit multiscale features. A rock system may contain a few main fractures and thousands of microcracks, whose length and aperture are orders of magnitude smaller than the former. It is computationally prohibitive to resolve all the fractures explicitly for such multiscale fracture networks. One traditional approach is to model the small-scale features (e.g., microcracks in shales) as an effective medium. Although this fracture-matrix conceptualization significantly reduces the problem complexity, there are classes of physical processes that cannot be accurately upscaled by effective medium approximations, e.g., microcrack clogging during mineral reactions. Here, we employ deep learning in place of effective medium theory to upscale physical processes in small-scale features. Specifically, we consider reactive transport in a fracture-microcrack network where microcracks can be clogged by precipitation. A deep learning multiscale algorithm is developed, in which the microcracks are upscaled as a wall boundary condition of the main fractures. The wall boundary condition is constructed by recurrent neural networks, which take concentration histories as input and predict the solute transport from main fractures to microcracks. The deep learning multiscale algorithm is firstly employed in specific scenarios, then a general model is developed which can work under various conditions. The new approach is validated against fully resolved simulations and an analytical solution, providing a reliable and efficient solution for problems that cannot be upscaled by effective medium models.

58 GEOSCIENCES↗

Stability of heterogeneous single-atom catalysts: a scaling law mapping thermodynamics to kinetics

Heterogeneous single-atom catalysts (SACs) hold the promise of combining high catalytic performance with maximum utilization of often precious metals. We extend the current thermodynamic view of SAC stability in terms of the binding energy (E bind ) of single-metal atoms on a support to a kinetic (transport) one by considering the activation barrier for metal atom diffusion. A rapid computational screening approach allows predicting diffusion barriers for metal–support pairs based on E bind of a metal atom to the support and the cohesive energy of the bulk metal (E c ). Metal–support combinations relevant to contemporary catalysis are explored by density functional theory. Assisted by machine-learning methods, we find that the diffusion activation barrier correlates with (E bind ) 2 /E c in the physical descriptor space. This diffusion scaling-law provides a simple model for screening thermodynamics to kinetics of metal adatom on a support.

36 MATERIALS SCIENCE↗

Data-driven studies of magnetic two-dimensional materials

We use a data-driven approach to study the magnetic and thermodynamic properties of van der Waals (vdW) layered materials. We investigate monolayers of the form A 2 B 2 X 6 , based on the known material Cr 2 Ge 2 Te 6 , using density functional theory (DFT) calculations and machine learning methods to determine their magnetic properties, such as magnetic order and magnetic moment. We also examine formation energies and use them as a proxy for chemical stability. We show that machine learning tools, combined with DFT calculations, can provide a computationally efficient means to predict properties of such two-dimensional (2D) magnetic materials. Our data analytics approach provides insights into the microscopic origins of magnetic ordering in these systems. For instance, we find that the X site strongly affects the magnetic coupling between neighboring A sites, which drives the magnetic ordering. Our approach opens new ways for rapid discovery of chemically stable vdW materials that exhibit magnetic behavior.

42 ENGINEERING↗

Hydrogen-induced degradation dynamics in silicon heterojunction solar cells via machine learning

Abstract Among silicon-based solar cells, heterojunction cells hold the world efficiency record. However, their market acceptance is hindered by an initial 0.5% per year degradation of their open circuit voltage which doubles the overall cell degradation rate. Here, we study the performance degradation of crystalline-Si/amorphous-Si:H heterojunction stacks. First, we experimentally measure the interface defect density over a year, the primary driver of the degradation. Second, we develop SolDeg, a multiscale, hierarchical simulator to analyze this degradation by combining Machine Learning, Molecular Dynamics, Density Functional Theory, and Nudged Elastic Band methods with analytical modeling. We discover that the chemical potential for mobile hydrogen develops a gradient, forcing the hydrogen to drift from the interface, leaving behind recombination-active defects. We find quantitative correspondence between the calculated and experimentally determined defect generation dynamics. Finally, we propose a reversed Si-density gradient architecture for the amorphous-Si:H layer that promises to reduce the initial open circuit voltage degradation from 0.5% per year to 0.1% per year.

14 SOLAR ENERGY↗

Machine learning for design principles for single atom catalysts towards electrochemical reactions

Machine learning (ML) integrated density functional theory (DFT) calculations have recently been used to accelerate the design and discovery of heterogeneous catalysts such as single atom catalysts (SACs) through the establishment of deep structure–activity relationships. Here, this review provides recent progress in the ML-aided rational design of heterogeneous catalysts with the focus on SACs in terms of structure–activity relationships, feature importance analysis, high-throughput screening, stability, and metal–support interactions for electrochemistry. Support vector machine (SVM), random forest regression (RFR), and deep neural networks (DNN) along with atomic properties are mainly used for the design of SACs. The ML results have shown that the number of electrons in the d orbital, oxide formation enthalpy, ionization energy, Bader charge, d-band center, and enthalpy of vaporization are mainly the most important parameters for the defining of the structure–activity relationships for electrochemistry. However, the black-box nature of ML techniques occasionally makes a physical interpretation of descriptors, such as the Bader charge, d-band center, and enthalpy of vaporization, non-trivial. At the current stage, ML application is limited by the lack of a large and high-quality database. Future prospects for the development of a large database and a generalized ML algorithm for SAC design are discussed to give insights for further studies in this field.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Learning molecular energies using localized graph kernels

We report that recent machine learning methods make it possible to model potential energy of atomic configurations with chemical-level accuracy (as calculated from ab initio calculations) and at speeds suitable for molecular dynamics simulation. Best performance is achieved when the known physical constraints are encoded in the machine learning models. For example, the atomic energy is invariant under global translations and rotations; it is also invariant to permutations of same-species atoms. Although simple to state, these symmetries are complicated to encode into machine learning algorithms. In this paper, we present a machine learning approach based on graph theory that naturally incorporates translation, rotation, and permutation symmetries. Specifically, we use a random walk graph kernel to measure the similarity of two adjacency matrices, each of which represents a local atomic environment. This Graph Approximated Energy (GRAPE) approach is flexible and admits many possible extensions. Finally, we benchmark a simple version of GRAPE by predicting atomization energies on a standard dataset of organic molecules.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Faster Johnson–Lindenstrauss transforms via Kronecker products

The Kronecker product is an important matrix operation with a wide range of applications in signal processing, graph theory, quantum computing and deep learning. In this work, we introduce a generalization of the fast Johnson–Lindenstrauss projection for embedding vectors with Kronecker product structure, the Kronecker fast Johnson–Lindenstrauss transform (KFJLT). The KFJLT reduces the embedding cost by an exponential factor of the standard fast Johnson–Lindenstrauss transform’s cost when applied to vectors with Kronecker structure, by avoiding explicitly forming the full Kronecker products. Here, we prove that this computational gain comes with only a small price in embedding power: consider a finite set of $p$ points in a tensor product of $d$ constituent Euclidean spaces $\bigotimes _{k=d}^{1}{\mathbb{R}}^{n_k}$, and let $N = \prod _{k=1}^{d}n_k$. With high probability, a random KFJLT matrix of dimension $m \times N$ embeds the set of points up to multiplicative distortion $(1\pm \varepsilon )$ provided $m \gtrsim \varepsilon ^{-2} \, \log ^{2d - 1} (p) \, \log N$. We conclude by describing a direct application of the KFJLT to the efficient solution of large-scale Kronecker-structured least squares problems for fitting the CP tensor decomposition.

Kronecker structure↗

Thermal disorder and phonon softening in the ferroelectric phase transition of lead titanate

We report a molecular dynamics study of ab initio quality of the ferroelectric phase transition in crystalline PbTi⁢O3. We model anharmonicity accurately in terms of potential energy and polarization surfaces trained on density functional theory data with modern machine learning techniques. Our simulations demonstrate that the transition has a strong order-disorder character, in agreement with diffraction experiments, and provide fresh insight into the approach to equilibrium across the phase transition. We find that the emergence and disappearance of the macroscopic polarization is driven by dipolar switching at the nanometer scale. We also computed the infrared optical absorption spectra in both the ferroelectric and the paraelectric phases, finding good agreement with the experimental Raman frequencies. Often, the almost ideal displacive character of the soft mode detected by Raman scattering in the paraelectric phase has been contrasted with the order-disorder character of the transition suggested by diffraction experiments. We settle this issue by showing that the soft mode coexists with a strong Debye relaxation associated with thermal disordering of the dipoles. The Debye relaxation feature is centered at zero frequency and appears near the transition temperature in both the ferroelectric and the paraelectric phases.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Dependence of the electronic structure of the EuS/InAs interface on the bonding configuration

The EuS/InAs interface has recently attracted attention for the possibility of inducing magnetic exchange correlations in a strong spin-orbit semiconductor, which could be useful for topological quantum devices. We use density functional theory with a machine-learned Hubbard U correction [Yu et al., npj Comput. Mater. 6, 180 (2020)] to elucidate the effect of the bonding configuration at the interface on the electronic structure. For all interface configurations considered here, we find that the EuS valence band maximum (VBM) lies below the InAs VBM. In addition, dispersed states emerge at the top of the InAs VBM at the interface, which do not exist in either material separately. These states are contributed mainly by the InAs layer adjacent to the interface. They are localized at the interface and may be attributed to charge transfer from the EuS to the InAs. The interface configuration affects the position of the EuS VBM with respect to the InAs VBM, as well as the dispersion of the interface states. For all interface configurations studied here, the induced magnetic moment in the InAs is small. Our results suggest that this interface, in its coherent form studied here, may not be promising for inducing equilibrium magnetic properties in InAs.

36 MATERIALS SCIENCE↗

MO-D-BRD-02: In Memoriam of Bengt Bjarngard: SBRT II: Small Field Dosimetry - TG155

Specialized radiation treatment such as SRS/SRT. SBRT, IMRT, VMAT, Tomotherapy, CyberKnife and Gamma Knife use small fields or combination of small fields where dosimetry is challenging and uncertain due to non-equilibrium conditions such as longitudinal and lateral disequilibrium. Additionally the primary photon fluence is greatly affected by the obstruction of the source size by the jaws creating a large dose gradient across the field. Electronic equilibrium is a phenomenon associated with the range of secondary particles which depend on the beam energy, photon spectrum and the composition of the medium. Additionally, the finite size of detectors creates volume averaging and fluence perturbations especially in small fields. The IAEA/AAPM has provided a frame work for non-compliant reference dosimetry in small fields1. The AAPM TG-1552 has adopted this frame work to provide guidelines in relative dosimetry. This course provides the insight of TG-155 that defines small field, provides recommendations for suitable detectors and associated correction factors to convert reading to dose. Recommendations of a good working practice for relative dosimetry measurements (PDD, TMR, output factor, etc.) and dose calculations based on the new formulation is are elaborated. It also discusses beam modeling and dose calculations as a critical step in clinical utilization of small field radiotherapy. Small errors in beam data, approximations in dose algorithms, or misaligned of detectors and field settings can propagate into large errors in planned and delivered dose. The modeling and treatment planning aspects of small field dosimetry are reviewed with emphasis on the most critical parts for ensuring accurate and safe radiation therapy. Discussion on k(fmsr, fclin) for commercially available detectors are also provided.1 P. Alfonso, P. Andreo, R. Capote, M. S. Huq, W. Kilby, P. Kjall, T. R. Mackie, H. Palmans, K. Rosser, J. Seuntjens, W. Ullrich and S. Vatnitsky, “A new formalism for reference dosimetry of small and nonstandard fields,” Med Phys 35, 5179–5186 (2008).2 I. J. Das, P. Francescon, A. Ahnesjo, M. M. Aspradakis, C. W. Cheng, G. X. Ding, G. S. Ibbott, M. Oldham, M. S. Huq, C. S. Reft and S. O.A., “Task Group 155 report: Small fields and non-equilibrium condition photon beam dosimetry,” Med Phys (under review). Learning Objectives: Physics of cavity theory for non-equilibrium condition and definition of small fields Description of absolute and relative dosimetry in the context of TG-155 Choice of detector in small field dosimetry, perturbations and corrections (K(fmsr, fclin)) for accurate dosimetry Understand the advantages and limitations of commercially available detectors for small field dosimetry.

60 APPLIED LIFE SCIENCES↗

Integrated Research Infrastructure Architecture Blueprint Activity (Final Report 2023)

The complexity of scientific pursuits is increasing rapidly with aspects that require dynamic integration of experiment, observation, theory, modeling, simulation, visualization, machine learning (ML), artificial intelligence (AI), and analysis. Research projects across the Department of Energy (DOE) are increasingly data and compute intensive. Innovative research teams are accelerating the pace of discovery by using high-performance computational and data tools in their research workflows and leveraging multiple research infrastructures. Additionally, several recent high-level U.S. government reports underscore the necessity of a new advanced computing ecosystem for international competitiveness and national security. International competitors are moving forward with major research infrastructure integration efforts that seek to capture a competitive advantage in the global innovation race. Owing to its unparalleled constellation of world-class experimental and observational facilities and high-performance and extreme-scale computational, data, and networking infrastructure, DOE is positioned to be a global leader in this new era of integrated science. However, this new integration paradigm will demand continuing evolution to ensure the U.S. remains a global leader in research and innovation. The DOE Office of Science (SC) has seized on the strategic importance of integration and has adopted a vision for Integrated Research Infrastructure (IRI): To empower researchers to meld DOE’s world-class research tools, infrastructure, and user facilities seamlessly and securely in novel ways to radically accelerate discovery and innovation. To respond to the evolving computational requirements of research and the competitive international innovation landscape, experimental facilities could be connected with high performance computing resources for near real-time analysis, and resources should be provided for merging enormous and diverse data for AI/ML techniques and analysis.

97 MATHEMATICS AND COMPUTING↗

Rapid Design of Cost-Effective Refractory High Entropy Alloys Strengthened by Precipitation

Funded by the ARPA-E ULTIMATE program, this project aims to develop cost-effective refractory high entropy alloys (RHEAs) for gas turbine blades applications at 1300 degree Celsius and above. The alloy design focuses on carbides precipitation strengthening in a strong and ductile solid solution BCC matrix. The goal is to achieve balanced mechanical properties including room temperature ductility & fracture toughness and high temperature strength and creep resistance, while maintaining comparable oxidation resistance and densities to Ni-base superalloys. To accelerate alloy design, multiscale modeling including CALPHAD and first-principles density functional theory (DFT) calculations and machine learning are performed. Specifically, high throughput phase diagram calculations and screening are carried out using CALPHAD; DFT calculations are performed to predict intrinsic ductility, grain boundary strengthening potential, coefficient of thermal expansion (CTE) and temperature-dependent elastic constants. Temperature dependent yield stress, creep strain and CTE are also predicted using machine learning. Down-selected alloys are synthesized in small buttons of about 250g using arc melting for rapid evaluation on microstructure and mechanical properties before employing plasma arc melting and additive manufacturing for producing large ingots. Preliminary computational and experimental results of this project will be presented and future direction in RHEA development will be discussed.

high temperature materials↗

Practical applications of machine-learned flows on gauge fields

Normalizing flows are machine-learned maps between different lattice theories which can be used as components in exact sampling and inference schemes. Ongoing work yields increasingly expressive flows on gauge fields, but it remains an open question how flows can improve lattice QCD at state-of-the-art scales. We discuss and demonstrate two applications of flows in replica exchange (parallel tempering) sampling, aimed at improving topological mixing, which are viable with iterative improvements upon presently available flows.

Abbott, Ryan↗

Convergence Rates for Empirical Estimation of Binary Classification Bounds

Bounding the best achievable error probability for binary classification problems is relevant to many applications including machine learning, signal processing, and information theory. Many bounds on the Bayes binary classification error rate depend on information divergences between the pair of class distributions. Recently, the Henze–Penrose (HP) divergence has been proposed for bounding classification error probability. We consider the problem of empirically estimating the HP-divergence from random samples. We derive a bound on the convergence rate for the Friedman–Rafsky (FR) estimator of the HP-divergence, which is related to a multivariate runs statistic for testing between two distributions. The FR estimator is derived from a multicolored Euclidean minimal spanning tree (MST) that spans the merged samples. We obtain a concentration inequality for the Friedman–Rafsky estimator of the Henze–Penrose divergence. We validate our results experimentally and illustrate their application to real datasets.

97 MATHEMATICS AND COMPUTING↗