SEARCH · Engineering Papers

Results for “Learning theory”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,117 records · Page 62

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Single-Point Extrapolation to the Complete Basis Set Limit through Deep Learning

Machine learning (ML) offers an attractive method for making predictions about molecular systems while circumventing the need to run expensive electronic structure calculations. Once trained on ab initio data, the promise of ML is to deliver accurate predictions of molecular properties that were previously computationally infeasible. In this work, we develop and train a graph neural network model to correct the basis set incompleteness error (BSIE) between a small and large basis set at the RHF and B3LYP levels of theory. Our results show that, when compared to fitting to the total potential, an ML model fitted to correct the BSIE is better at generalizing to systems not seen during training. We test this ability by training on single molecules while evaluating on molecular complexes. We also show that ensemble models yield better behaved potentials in situations where the training data is insufficient. However, even when only fitting to the BSIE, acceptable performance is only achieved when the training data sufficiently resemble the systems one wants to make predictions on. As a result, the test error of the final model trained to predict the difference between the cc-pVDZ and cc-pV5Z potential is 0.184 kcal/mol for the B3LYP density functional, and the ensemble model accurately reproduces the large basis set interaction energy curves on the S66x8 dataset.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2021

Platform Agnostic Streaming Data Application Performance Models

The mapping of computational needs onto execution resources is, by and large, a manual task, and users are frequently guided simply by intuition and past experiences. We present a queueing theory based performance model for streaming data applications that takes steps towards a better understanding of resource mapping decisions, thereby assisting application developers to make good mapping choices. The performance model (and associated cost model) are agnostic to the specific properties of the compute resource and application, simply characterizing them by their achievable data throughput. We illustrate the model with a pair of applications, one chosen from the field of computational biology and the second is a classic machine learning problem.

Faber, Clayton↗

DOE OSTI2023

Theory and Implementation of the Spectacular Nonlinear Viscoelastic Constitutive Model

This report is a comprehensive guide to the nonlinear viscoelastic Spectacular model, which is an isotropic, thermo-rheologically simple constitutive model for glass-forming materials, such as amorphous polymers. Spectacular is intermediate in complexity to the previous PEC and SPEC models (Potential Energy Clock and Simplified Potential Energy Clock models, respectively). The model form consists of two parts: a Helmholtz free energy functional and a nonlinear material clock that controls the rate of viscoelastic relaxation. The Helmholtz free energy is derived from a series expansion about a reference state. Expressions for the stress and entropy functionals are derived from the Helmholtz free energy following the Rational Mechanics approach. The material clock depends on a simplified expression for the potential energy, which itself is a functional of the temperature and strain histories. This report describes the thermo-mechanical theory of Spectacular, the numerical methods for time-integrating the model, model verification for its implementation in LAMÉ, a user guide for its implementation in LAMÉ, and ideas for future work. A number of appendices provide supplementary mathematical details and a description of the procedure used to derive the simplified potential energy from the full expression for the potential energy. The goal of this report is create a convenient point-of-entry for engineers who wish to learn more about Spectacular, but also to serve as a reference manual for advanced users of the model.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Novel experimental probes of QCD in SIDIS and e + e - annihilation (Final Technical Report)

The research addressed with this award seeks to advance our understanding of the structure and dynamics underlying the properties of visible matter. In our current understanding the nucleons (protons and neutrons) are not fundamental but are comprised of quarks and gluons, which are collectively called partons. A static quark picture fails to explain the properties of the nucleons, such as their mass and intrinsic spin, which are thought to emerge dynamically from the quark-gluon interactions via the strong force. In this work, novel observables employing correlations of particles produced in the scattering of high energy electrons off protons at the CLAS12 experiment at Jefferson Lab were analyzed to probe quark-gluon interactions. The ultimate goal of this line of inquiry is to be able to describe the properties of protons and neutrons from first principles, similar to how studying the hydrogen atom has led to the formulation of the theory of Quantum Electrodynamics. Because quarks cannot be observed directly but only as part of more complex composite particles, a smaller, complimentary part of this work was the analysis of particle production in electron-positron annihilation at the Belle II experiment to understand the production of particles from initial quarks. This takes advantage of the fact that in e + e - annihilation the initial quark dynamics is known, unlike in the scattering of nucleons. Several new applications using Machine Learning algorithms for event tagging and reconstruction to support this program were developed as part of this award. In addition, we had a significant role in the development of the physics program for the future Electron-Ion Collider, which is a new collider to be build in the US within the next decade.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2022

Stability and distortion of fcc LaH 10 with path-integral molecular dynamics

The synthesis of the high-temperature superconductor LaH 10 requires pressures in excess of 100 GPa, wherein it adopts a face-centered cubic structure. Upon decompression, this structure undergoes a distortion, which still supports superconductivity, but with a lower critical temperature. Previous calculations have shown that quantum and anharmonic effects are necessary to stabilize the cubic structure, but have not resolved the low pressure distortion. Using large scale path-integral molecular dynamics enabled by a machine learned potential, we show that a rhombohedral distortion appears at sufficiently low pressures. Here, we also highlight the importance of quantum zero-point motion in stabilizing the cubic structure.

08 HYDROGEN↗

DOE OSTI2020

Machine Learning Algorithm Identifies an Antibiotic Vocabulary for Permeating Gram-Negative Bacteria

Drug discovery faces a crisis. The industry has used up the “obvious” space in which to find novel drugs for biomedical applications, and productivity is declining. One strategy to combat this is rational approaches to expand the search space without relying on chemical intuition, to avoid rediscovery of similar spaces. Here, we present proof of concept of an approach to rationally identify a “chemical vocabulary” related to a specific drug activity of interest without employing known rules. We focus on the pressing concern of multidrug resistance in Pseudomonas aeruginosa by searching for submolecules that promote compound entry into this bacterium. By synergizing theory, computation, and experiment, we validate our approach, explain the molecular mechanism behind identified fragments promoting compound entry, and select candidate compounds from an external library that display good permeation ability.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2022

Multifidelity Ensemble Kalman Filtering Using Surrogate Models Defined by Theory-Guided Autoencoders

Data assimilation is a Bayesian inference process that obtains an enhanced understanding of a physical system of interest by fusing information from an inexact physics-based model, and from noisy sparse observations of reality. The multifidelity ensemble Kalman filter (MFEnKF) recently developed by the authors combines a full-order physical model and a hierarchy of reduced order surrogate models in order to increase the computational efficiency of data assimilation. The standard MFEnKF uses linear couplings between models, and is statistically optimal in case of Gaussian probability densities. This work extends the MFEnKF into to make use of a broader class of surrogate model such as those based on machine learning methods such as autoencoders non-linear couplings in between the model hierarchies. We identify the right-invertibility property for autoencoders as being a key predictor of success in the forecasting power of autoencoder-based reduced order models. We propose a methodology that allows us to construct reduced order surrogate models that are more accurate than the ones obtained via conventional linear methods. Numerical experiments with the canonical Lorenz'96 model illustrate that nonlinear surrogates perform better than linear projection-based ones in the context of multifidelity ensemble Kalman filtering. We additionality show a large-scale proof-of-concept result with the quasi-geostrophic equations, showing the competitiveness of the method with a traditional reduced order model-based MFEnKF.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

17 O NMR Spectroscopy Reveals CO 2 Speciation and Dynamics in Hydroxide-Based Carbon Capture Materials

Carbon dioxide capture technologies are set to play a vital role in mitigating the current climate crisis. Solid-state 17 O NMR spectroscopy can provide key mechanistic insights that are crucial to effective sorbent development. In this work, we present the fundamental aspects and complexities for the study of hydroxide-based CO 2 capture systems by 17 O NMR. We perform static density functional theory (DFT) NMR calculations to assign peaks for general hydroxide CO 2 capture products, finding that 17 O NMR can readily distinguish bicarbonate, carbonate and water species. However, in application to CO 2 binding in two test case hydroxide-functionalised metal-organic frameworks (MOFs) – MFU-4l and KHCO 3 -cyclodextrin-MOF, we find that a dynamic treatment is necessary to obtain agreement between computational and experimental spectra. We therefore introduce a workflow that leverages machine-learning force fields to capture dynamics across multiple chemical exchange regimes, providing a significant improvement on static DFT predictions. In MFU-4l, we parameterise a two-component dynamic motion of the bicarbonate motif involving a rapid carbonyl seesaw motion and intermediate hydroxyl proton hopping. For KHCO 3 -CD-MOF, we combined experimental and modelling approaches to propose a new mixed carbonate-bicarbonate binding mechanism and thus, we open new avenues for the study and modelling of hydroxide-based CO 2 capture materials by 17 O NMR.

NMR spectroscopy↗

DOE OSTI2023

How the birth and death of shear layers determine confinement evolution: from the L → H transition to the density limit

Electric field profile structure—especially its shear—is a natural order parameter for the edge plasma, and characterizes confinement regimes ranging from the H-mode (Wagner et al. 1982 Phys. Rev. Lett.49, 1408–1412 (doi:10.1103/PhysRevLett.49.1408)) to the density limit (DL) (Greenwald et al. 1988 Nucl. Fusion28, 2199–2207 (doi:10.1088/0029-5515/28/12/009)). The theoretical developments and lessons learned during 40 years of H-mode studies (Connor & Wilson 1999 Plasma Phys. Control. Fusion42, R1–R74 (doi:10.1088/0741-3335/42/1/201); Wagner 2007 Plasma Phys. Control. Fusion49, B1–B33 (doi:10.1088/0741-3335/49/12b/s01)) are applied to the shear layer collapse paradigm (Hong et al. 2017 Nucl. Fusion58, 016041 (doi:10.1088/1741-4326/aa9626)) for the onset of DL phenomena. Results from recent experiments on edge shear layers and DL phenomenology are summarized and discussed in the light of L → H transition physics. The theory of shear layer collapse is then developed. In this work, we demonstrate that shear layer physics captures both the well known current (Greenwald) scaling of the DL (Greenwald 2002 Plasma Phys. Control. Fusion44, R27–R53 (doi:10.1088/0741-3335/44/8/201); Greenwald et al. 2014 Phys. Plasmas21, 110501 (doi:10.1063/1.4901920)), as well as the emerging power scaling (Zanca, Sattin, JET Contributors 2019 Nucl. Fusion59, 126011 (doi:10.1088/1741-4326/ab3b31)). The derivation of the power scaling theory exploits an existing model, originally developed for the L → H transition (Diamond, Liang, Carreras, Terry 1994 Phys. Rev. Lett.72, 2565–2568 (doi:10.1103/PhysRevLett.72.2565); Kim & Diamond 2003 Phys. Rev. Lett.90, 185006 (doi:10.1103/PhysRevLett.90.185006)). We describe the enhanced particle transport events that occur following shear layer collapse. Open problems and future directions are discussed.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2022

Depletion-Driven Assembly of Polymer-Coated Nanocrystals

Depletion-driven assembly has been widely studied for micron-sized colloids, but questions remain at the nanoscale where the governing physics are impacted by stabilizing surface ligands or wrapping polymers, whose dimensions are similar to those of the colloidal core and the depletant. Here, we probe how wrapping colloidal tin-doped indium oxide nanocrystals with polymers affects their depletion-induced interactions and assembly in solutions of polyethylene glycol. Copolymers of polyacrylic acid grafted with polyethylene oxide provide nanocrystal wrappings with different effective polymer graft densities and molecular weights. (Ultra) small angle X-ray scattering, coarse-grained molecular dynamics simulation, and molecular thermodynamic theory were combined to analyze how depletant size and polymer wrapping characteristics affect depletion interactions, structure, and phase behavior. The results show how depletant molecular weight, as well as surface density and molecular weight of polymer grafts, set thresholds for assembly. These signatures are unique to depletion-driven assembly of nanoscale colloids and mirror phase behaviors of grafted nanoparticle–polymer composites. Optical and rheological responses of depletion-driven assemblies of nanocrystals with different polymer shell architectures were probed to learn how their structural differences impact properties. Finally, we discuss how these wrinkles for depletion-driven assembly at the nanoscale may provide fresh opportunities for designing responsive depletion interactions and dynamically reconfigurable materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2021

Deep Bayesian local crystallography

Abstract The advent of high-resolution electron and scanning probe microscopy imaging has opened the floodgates for acquiring atomically resolved images of bulk materials, 2D materials, and surfaces. This plethora of data contains an immense volume of information on materials structures, structural distortions, and physical functionalities. Harnessing this knowledge regarding local physical phenomena necessitates the development of the mathematical frameworks for extraction of relevant information. However, the analysis of atomically resolved images is often based on the adaptation of concepts from macroscopic physics, notably translational and point group symmetries and symmetry lowering phenomena. Here, we explore the bottom-up definition of structural units and symmetry in atomically resolved data using a Bayesian framework. We demonstrate the need for a Bayesian definition of symmetry using a simple toy model and demonstrate how this definition can be extended to the experimental data using deep learning networks in a Bayesian setting, namely rotationally invariant variational autoencoders.

36 MATERIALS SCIENCE↗

DOE OSTI2022

From Theory to Large-Scale Simulations, or Living Without “The Paradox of Choice”

Navigating the challenges we face at work and in life is often difficult, and can even make us question our past decisions. This dilemma is even worse nowadays because of the many options available to us, leaving us not enough time to explore them all: the paradox of choice. My life experience offers another perspective on how to make choices; wherein I had to rely more on serendipity, coincidence, and embracing risks. This paper presents a brief description of my career path in space science—from a small village in the countryside to one of the top science Laboratories in the world—and lessons learned through the process of becoming a more resilient scientist. I came to the United States from Bulgaria about 30 years ago, seeking a better education and job opportunities. Navigating a career of research scientist, not only did I find jobs that motivated me every day, I also met amazing people to work with along the way. As a woman in science, I hope my story can inspire and attract young researchers (girls and boys alike) to our community, helping to grow and diversify the next generation of space scientists.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2023

Trust-Enhancing Probabilistic Transfer Learning for Sparse and Noisy Data Environments

There is an increasing aspiration to utilize machine learning (ML) for various tasks of relevance to national security. ML models have thus far been mostly applied to tasks and domains that, while impactful, have sufficient volume of data. For predictive tasks of national security relevance, ML models of great capacity (ability to approximate nonlinear trends in input-output maps) are often needed to capture the complex underlying physics. However, scientific problems of relevance to national security are often accompanied by various sources of sparse and/or incomplete data, including experiments and simulations, across different regimes of operation, of varying degrees of fidelity, and include noise with different characteristics and/or intensity. State-of-the-art ML models, despite exhibiting superior performance on the task and domain they were trained on, may suffer detrimental loss in performance in such sparse data environments. This report summarizes the results of the Laboratory Directed Research and Development project entitled Trust-Enhancing Probabilistic Transfer Learning for Sparse and Noisy Data Environments. The objective of the project was to develop a new transfer learning (TL) framework that aims to adaptively blend the data across different sources in tackling one task of interest, resulting in enhanced trustworthiness of ML models for mission- and safety-critical systems. The proposed framework determines when it is worth applying TL and how much knowledge is to be transferred, despite uncontrollable uncertainties. The framework accomplishes this by leveraging concepts and techniques from the fields of Bayesian inverse modeling and uncertainty quantification, relying on strong mathematical foundations of probability and measure theories to devise new uncertainty-aware TL workflows.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2024

Computational Advances in Ionic Liquid Applications for Green Chemistry: A Critical Review of Lignin Processing and Machine Learning Approaches

The valorization and dissolution of lignin using ionic liquids (ILs) is critical for developing sustainable biorefineries and a circular bioeconomy. This review aims to critically assess the current state of computational and machine learning methods for understanding and optimizing IL-based lignin dissolution and valorization processes reported since 2022. The paper examines various computational approaches, from quantum chemistry to machine learning, highlighting their strengths, limitations, and recent advances in predicting and optimizing lignin-IL interactions. Key themes include the challenges in accurately modeling lignin’s complex structure, the development of efficient screening methodologies for ionic liquids to enhance lignin dissolution and valorization processes, and the integration of machine learning with quantum calculations. These computational advances will drive progress in IL-based lignin valorization by providing deeper molecular-level insights and facilitating the rapid screening of novel IL-lignin systems.

09 BIOMASS FUELS↗

DOE OSTI2022

Scale-invariant machine-learning model accelerates the discovery of quaternary chalcogenides with ultralow lattice thermal conductivity

We design an advanced machine-learning (ML) model based on crystal graph convolutional neural network that is insensitive to volumes (i.e., scale) of the input crystal structures to discover novel quaternary chalcogenides, AMM'Q 3 (A/M/M' = alkali, alkaline earth, post-transition metals, lanthanides, and Q = chalcogens). These compounds are shown to possess ultralow lattice thermal conductivity (κ l ), a desired requirement for thermal-barrier coatings and thermoelectrics. Upon screening the thermodynamic stability of ~1 million compounds using the ML model iteratively and performing density-functional theory (DFT) calculations for a small fraction of compounds, we discover 99 compounds that are validated to be stable in DFT. Taking several DFT-stable compounds, we calculate their κ l using Peierls–Boltzmann transport equation, which reveals ultralow κ l (<2 Wm -1 K -1 at room temperature) due to their soft elasticity and strong phonon anharmonicity. Our work demonstrates the high efficiency of scale-invariant ML model in predicting novel compounds and presents experimental-research opportunities with these new compounds.

36 MATERIALS SCIENCE↗

DOE OSTI2026

Computing the Critical Temperature of the Affine-Transformed $D=3$ Ising Model Using Masked Autoregressive Flow

The simple Ising model provides a rich environment to build and study lattice field theories. As part of an ongoing project to construct a conformal field theory (CFT) on an arbitrarily curved manifold, in this work we develop methods to measure the critical temperature $β_c$ of the affine-transformed Ising model on the face-centered cubic (FCC) lattice. The main challenge in this endeavor is finding a computationally efficient and accurate method of interpolating and extrapolating Monte Carlo observables with respect to coupling coefficients and temperature. Herein, we compare two such methods. A traditional statistical approach uses the multiple histogram (MH) method, while a newer machine learning approach uses a masked autoregressive flow (MAF) to estimate the underlying probability density function of a set of observables. While the MH method is specifically designed to interpolate and extrapolate Monte Carlo observables, we find that MAF is a viable alternative for measuring $β_c$ with a computational cost that scales more favorably. Furthermore, we comment on additional advantages of MAF relevant to our work, such as extrapolating in system volume.

Svenson, Kai [Texas U.]↗

DOE OSTI2022

Cross-platform analysis of public responses to the 2019 Ridgecrest earthquake sequence on Twitter and Reddit

Online social networks (OSNs) have become a powerful tool to study collective human responses to extreme events such as earthquakes. Most previous research concentrated on a single platform and utilized users’ behaviors on a single platform to study people’s general responses. In this study, we explore the characteristics of people’s behaviors on different OSNs and conduct a cross-platform analysis of public responses to earthquakes. Our findings support the Uses and Gratification theory that users on Reddit and Twitter are engaging with platforms that they may feel best reflect their sense of self. Using the 2019 Ridgecrest earthquakes as our study cases, we collected 510,579 tweets and 45,770 Reddit posts (including 1437 submissions and 44,333 comments) to answer the following research questions: (1) What were the similarities and differences between public responses on Twitter and Reddit? (2) Considering the different mechanisms of Twitter and Reddit, what unique information of public responses can we learn from Reddit as compared with Twitter? By answering these research questions, we aim to bridge the gap of cross-platform public responses research towards natural hazards. Our study evinces that the users on the two different platforms have both different topics of interest and different sentiments towards the same earthquake, which indicates the necessity of investigating cross-platform OSNs to reveal a more comprehensive picture of people’s general public responses towards certain disasters. Our analysis also finds that r/conspiracy subreddit is one of the major venues where people discuss the 2019 Ridgecrest earthquakes on Reddit and different misinformation/conspiracies spread on Twitter and Reddit platforms (e.g., “Big one is coming” on Twitter and “Nuclear test” on Reddit).

58 GEOSCIENCES↗

DOE OSTI2024

Understanding the effect of density functional choice and van der Waals treatment on predicting the binding configuration, loading, and stability of amine-grafted metal organic frameworks

Metal organic frameworks (MOFs) are crystalline, three-dimensional structures with high surface areas and tunable porosities. Made from metal nodes connected by organic linkers, the exact properties of a given MOF are determined by node and linker choice. MOFs hold promise for numerous applications, including gas capture and storage. M2(4,4′-dioxidobiphenyl-3,3′-dicarboxylate)—henceforth simply M2(dobpdc), with M = Mg, Mn, Fe, Co, Ni, Cu, or Zn—is regarded as one of the most promising structures for CO2 capture applications. Further modification of the MOF with diamines or tetramines can significantly boost gas species selectivity, a necessity for the ultra-dilute CO2 concentrations in the direct-air capture of CO2. There are countless potential diamines and tetramines, paving the way for a vast number of potential sorbents to be probed for CO2 adsorption properties. The number of amines and their configuration in the MOF pore are key drivers of CO2 adsorption capacity and kinetics, and so a validation of computational prediction of these quantities is required to suitably use computational methods in the discovery and screening of amine-functionalized sorbents. In this work, we study the predictive accuracy of density functional theory and related calculations on amine loading and configuration for one diamine and two tetramines. In particular, we explore the Perdew–Burke–Ernzerhof (PBE) functional and its formulation for solids (PBEsol) with and without the Grimme-D2 and Grimme-D3 pairwise corrections (PBE+D2/3 and PBEsol+D2/3), two revised PBE functionals with the Grimme-D2 and Grimme-D3 pairwise corrections (RPBE+D2/3 and revPBE+D2/3), and the nonlocal van der Waals correlation (vdW-DF2) functional. We also investigate a universal graph deep learning interatomic potential’s (M3GNet) predictive accuracy for loading and configuration. These results allow us to identify a useful screening procedure for configuration prediction that has a coarse component for quick evaluation and a higher accuracy component for detailed analysis. Our general observation is that the neural network-based potential can be used as a high-level and rapid screening tool, whereas PBEsol+D3 gives a completely qualitatively predictive picture across all systems studied, and can thus be used for high accuracy motif predictions. We close by briefly exploring the predictions of relative thermal stability for the different functionals and dispersion corrections.

Chemistry↗