Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “structured machine learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,369 records · Page 76
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Numerical evidence against advantage with quantum fidelity kernels on classical data

Quantum machine learning techniques are commonly considered one of the most promising candidates for demonstrating practical quantum advantage. In particular, quantum kernel methods have been demonstrated to be able to learn certain classically intractable functions efficiently if the kernel is well aligned with the target function. In the more general case, quantum kernels are known to suffer from exponential “flattening” of the spectrum as the number of qubits grows, preventing generalization and necessitating the control of the inductive bias by hyperparameters. We show that the general-purpose hyperparameter-tuning techniques proposed to improve the generalization of quantum kernels lead to the kernel becoming well approximated by a classical kernel, removing the possibility of quantum advantage. We provide extensive numerical evidence for this phenomenon utilizing multiple previously studied quantum feature maps and both synthetic and real data. Our results show that unless novel techniques are developed to control the inductive bias of quantum kernels, they are unlikely to provide a quantum advantage on classical data that lacks special structure.

Quantum Information, Science & Technology↗
DOE OSTI2025

gRASPA

GPU Monte Carlo Simulation Code with a taste of RASPA We present enhancements in Monte Carlo simulation speed and functionality within an open-source code, gRASPA, which uses graphical processing units (GPUs) to achieve significant performance improvements compared to serial, CPU implementations of Monte Carlo. The code supports a wide range of Monte Carlo simulations, including canonical ensemble (NVT), grand canonical, NVT Gibbs, Widom test particle insertions, and continuous-fractional component Monte Carlo. Implementation of grand canonical transition matrix Monte Carlo (GC-TMMC) and a novel feature to allow different moves for the different components of metal-organic framework (MOF) structures exemplify the capabilities of gRASPA for precise free energy calculations and enhanced adsorption studies, respectively. The introduction of a High-Throughput Computing (HTC) mode permits many Monte Carlo simulations on a single GPU device for accelerated materials discovery. The code can incorporate machine learning (ML) potentials. The open-source nature of gRASPA promotes reproducibility and openness in science, and users may add features to the code and optimize it for their own purposes. The code is written in CUDA/C++ and SYCL/C++ to support different GPU vendors. The gRASPA code is publicly available at https://github.com/snurr-group/gRASPA.

Li, Zhao [Purdue/Northwestern/Notre Dame Universit↗
DOE OSTI2022

Predicting the oxidation states of Mn ions in the oxygen-evolving complex of photosystem II using supervised and unsupervised machine learning

Abstract Serial Femtosecond Crystallography at the X-ray Free Electron Laser (XFEL) sources enabled the imaging of the catalytic intermediates of the oxygen evolution reaction of Photosystem II (PSII). However, due to the incoherent transition of the S-states, the resolved structures are a convolution from different catalytic states. Here, we train Decision Tree Classifier and K-means clustering models on Mn compounds obtained from the Cambridge Crystallographic Database to predict the S-state of the X-ray, XFEL, and CryoEM structures by predicting the Mn’s oxidation states in the oxygen-evolving complex. The model agrees mostly with the XFEL structures in the dark S 1 state. However, significant discrepancies are observed for the excited XFEL states (S 2 , S 3, and S 0 ) and the dark states of the X-ray and CryoEM structures. Furthermore, there is a mismatch between the predicted S-states within the two monomers of the same dimer, mainly in the excited states. We validated our model against other metalloenzymes, the valence bond model and the Mn spin densities calculated using density functional theory for two of the mismatched predictions of PSII. The model suggests designing a more optimized sample delivery and illumiation systems are crucial to precisely resolve the geometry of the advanced S-states to overcome the noncoherent S-state transition. In addition, significant radiation damage is observed in X-ray and CryoEM structures, particularly at the dangler Mn center (Mn4). Our model represents a valuable tool for investigating the electronic structure of the catalytic metal cluster of PSII to understand the water splitting mechanism.

Plant Sciences↗
DOE OSTI2017

Toward a Visualization-Supported Workflow for Cyber Alert Management using Threat Models and Human-Centered Design

Cyber network analysts follow complex processes in their investigations of potential threats to their network. Much research is dedicated to providing automated tool support in the effort to make their tasks more efficient, accurate, and timely. This tool support comes in a variety of implementations from machine learning algorithms that monitor streams of data to visual analytic environments for exploring rich and noisy data sets. Cyber analysts, however, often speak of a need for tools which help them merge the data they already have and help them establish appropriate baselines against which to compare potential anomalies. Furthermore, existing threat models that cyber analysts regularly use to structure their investigation are not often leveraged in support tools. We report on our work with cyber analysts to understand they analytic process and how one such model, the MITRE ATT&CK Matrix [32], is used to structure their analytic thinking. We present our efforts to map specific data needed by analysts into the threat model to inform our eventual visualization designs. We examine data mapping for gaps where the threat model is under-supported by either data or tools. We discuss these gaps as potential design spaces for future research efforts. We also discuss the design of a prototype tool that combines machine-learning and visualization components to support cyber analysts working with this threat model.

Cyber Security↗
DOE OSTI2025

Computational investigation of water glasses using machine-learning potentials

The molecular origins of water’s anomalous properties have long been a subject of scientific inquiry. The liquid–liquid phase transition hypothesis, which posits the existence of distinct low-density and high-density liquid states separated by a first-order phase transition terminating at a critical point, has gained increasing experimental and computational support and offers a thermodynamically consistent framework for many of water’s anomalies. However, experimental challenges in avoiding crystallization near the postulated liquid–liquid critical point have focused attention to water’s canonical glassy states: low-density and high-density amorphous ice. Here, we use two Deep Potential machine-learning models, trained on the Strongly Constrained and Appropriately Normed density functional and the highly accurate Many-Body Polarizable potential, to conduct an investigation of water’s glassy phenomenology based on quantum mechanical calculations. Despite not being explicitly trained on amorphous ices, both models accurately capture the structure and transformation of the water glasses, including their interconversion along different thermodynamic paths. Isobaric quenching of liquid water at various pressures generates a continuum of intermediate amorphous ices and density fluctuations increase near the liquid–liquid critical pressure. The glass transition temperatures of the amorphous ices produced at different pressures exhibit two distinct branches, corresponding to low-density and high-density amorphous ice behaviors, consistent with experiment and the liquid–liquid transition hypothesis. Extrapolating transformation pressures from isothermal compressions to experimental compression rates brings our simulations into excellent agreement with data. Our findings demonstrate that machine-learning potentials trained on equilibrium phases can effectively model nonequilibrium glassy behavior and pave the way for studying long-timescale, out-of-equilibrium processes with quantum mechanical accuracy.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Active Learning Guided Computational Discovery of Plant-Based Redoxmers for Organic Nonaqueous Redox Flow Batteries

Organic nonaqueous redox flow batteries (ONRFBs) are promising energy storage devices due to their scalability and reliance on sourceable materials. However, finding suitable redox-active organic molecules (redoxmers) for these batteries remains a challenge. Using plant-based compounds as precursors for these redoxmers can decrease their costs and environmental toxicity. In this computational study, flavonoid molecules have been examined as potential redoxmers for ONRFBs. Flavone and isoflavone derivatives were selected as catholyte (positive charge carrier) and anolyte (negative charge carrier) molecules, respectively. To drive their redox potentials to the opposite extremes, in silico derivatization was performed using a novel algorithm to generate a library of > 40000 candidate molecules that penalizes overly complex structures. A multiobjective Bayesian optimization based active learning algorithm was then used to identify best redoxmer candidates in these search spaces. Furthermore, our study provides methodologies for molecular design and optimization of natural scaffolds and highlights the need of incorporating expert chemistry awareness of the natural products and the basic rules of synthetic chemistry in machine learning.

25 ENERGY STORAGE↗
NASA NTRSDate not supplied

Multidisciplinary Design Optimization and Analysis of an Open Rotor Stage: Part 1

Successful design of open rotor propulsors requires effective analysis across multiple disciplines, including aerodynamics, acoustics, and structures. A viable design must not only be efficient but must also produce an acceptable level of noise and meet all static and dynamic structural requirements. For design and optimization, this is especially challenging because running high fidelity analyses is resource-intensive, and optimizing a design may require many thousands of cases to be analyzed. For this reason, the NASA team has applied design methodology that utilizes low-cost aerodynamic methods, machine learning models, and high-fidelity analyses when necessary. This includes standard two-dimensional methods such as throughflow analysis and quasi-3D blade-to-blade CFD, as well as some newly developed methods. Optimization using 3D CFD is necessary to maximize performance, and this is considered as well. All optimizations are carried out subject to structural constraints evaluated using finite element analysis. Doing this accurately requires a robust trunnion design, capable of pitching the blade between cruise and takeoff conditions while maintaining acceptable factor of safety. Hot to cold analysis must also be applied in order to correctly determine the as-manufactured shape. For acoustics, the unsteady pressures on the blade surfaces must be predicted, and this can be done either through full-annulus unsteady CFD or through a nonlinear harmonic method (NLH). NLH can run much faster, allowing some acoustic considerations to be made earlier in the design process. The design process is ongoing, and this presentation will review the current status and planned next steps. This part of the talk will focus on aerodynamic performance and be followed by a talk on structures and acoustics.

Design↗
DOE OSTI2021

Computation of the Thermal Expansion Coefficient of Graphene with Gaussian Approximation Potentials

Direct experimental measurement of thermal expansion coefficient without substrate effects is a challenging task for two-dimensional (2D) materials, and its accurate estimation with large-scale ab initio molecular dynamics is computationally very expensive. Machine learning-based interatomic potentials trained with ab initio data have been successfully used in molecular dynamics simulations to decrease the computational cost without compromising the accuracy. In this work, we investigated using Gaussian approximation potentials to reproduce the density functional theory-level accuracy for graphene within both lattice dynamical and molecular dynamical methods, and to extend their applicability to larger length and time scales. Two such potentials are considered, GAP17 and GAP20. GAP17, which was trained with pristine graphene structures, is found to give closer results to density functional theory calculations at different scales. Further vibrational and structural analyses verify that the same conclusions can be deduced with density functional theory level in terms of the reasoning of the thermal expansion behavior, and the negative thermal expansion behavior is associated with long-range out-of-plane phonon vibrations. Thus, it is argued that the enabled larger system sizes by machine learning potentials may even enhance the accuracy compared to small-size-limited ab initio molecular dynamics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Inelastic Neutron Scattering Study of Magnetic Exchange Pathways in MnS

We report an investigation of the magnetic structure and magnetic exchange pathways in MnS via neutron scattering methods, aided by density functional theory (DFT) modeling. The material has been confirmed to undergo antiferromagnetic (AFM) ordering at 152 K, with the magnetic structure representing AFM stacking of ferromagnetic (FM) (111) planes of Mn magnetic moments. Correspondingly, the magnetic structure is described by a propagation vector k = (1/2, 1/2, 1/2), with the volume of the magnetic unit cell being 8 times larger than the volume of the nuclear unit cell. Analysis of inelastic neutron scattering (INS) data collected on a powder sample of MnS revealed that the next-nearest-neighbor magnetic exchange constant (J 2 ) exceeds the nearest-neighbor exchange constant (J 1 ) by more than 3 times, while in the case of MnO, which exhibits the same nuclear and magnetic structures as MnS, the J 2 /J 1 ratio was reported to be below 1.5. Although for MnO the signs of both J 1 and J 2 indicated AFM exchange interactions, machine-learning INS data analysis in combination with DFT calculations suggests that the INS data collected on MnS are best described with J 1 < 0 and J 2 > 0, corresponding to FM and AFM exchange couplings, respectively. To achieve a satisfactory fit to the experimentally observed data, the Hamiltonian used to model the INS spectra also included the next-next-nearest-neighbor magnetic exchange constant (J 3 ). The best-fit model has been obtained with the values of the exchange constants J 1 = -0.27 meV, J 2 = 1.05 meV, and J 3 = -0.19 meV.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2019

Isotope effects in liquid water via deep potential molecular dynamics

A comprehensive microscopic understanding of ambient liquid water is a major challenge for ab initio simulations as it simultaneously requires an accurate quantum mechanical description of the underlying potential energy surface (PES) as well as extensive sampling of configuration space. Due to the presence of light atoms (e.g. 𝐻 or 𝐷), nuclear quantum fluctuations lead to observable changes in the structural properties of liquid water (e.g. isotope effects), and therefore provide yet another challenge for ab initio approaches. In this work, we demonstrate that the combination of dispersion-inclusive hybrid density functional theory (DFT), the Feynman discretised path-integral (PI) approach, and machine learning (ML) constitutes a versatile ab initio based framework that enables extensive sampling of both thermal and nuclear quantum fluctuations on a quite accurate underlying PES. In particular, we employ the recently developed deep potential molecular dynamics (DPMD) model – a neural-network representation of the ab initio PES – in conjunction with a PI approach based on the generalised Langevin equation (PIGLET) to investigate how isotope effects influence the structural properties of ambient liquid 𝐻⁢2⁢𝑂 and 𝐷⁢2⁢𝑂. Through a detailed analysis of the interference differential cross sections as well as several radial and angular distribution functions, we demonstrate that this approach can furnish a semi-quantitative prediction of these subtle isotope effects.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Evidence of short chains in liquid sulfur

High energy x-ray pair distribution function measurements show the average coordination number of the first shell in liquid sulfur is 1.86 ± 0.04 across the λ-transition, not precisely 2.0 as widely accepted. This indicates that upon melting, liquid sulfur does not comprise solely of S 8 rings but also possesses a significant number of short chains. Intensities of the pre-peak and first diffraction peak of the x-ray structure factor and third peak height of the pair distribution function all show deviations at the λ-transition temperature T λ , associated with the break-up of S 8 rings and the start of oligomer polymerization. A significant number of non-bonded or loosely bonded “interstitial atoms,” with an average coordination number of 0.20 ± 0.005, are also observed in the so-called “forbidden zone” between the first and second shells upon melting. The number of interstitial atoms is found to decrease to a minimum at the λ-transition, but the majority persist into the high temperature polymerized liquid. Furthermore, the existence of short chains and nearby interstitial atoms represent the two main factors required to initiate the S 8 -ring to chain transition, as proposed by recent molecular dynamics simulations.

Chemical bonding↗
DOE OSTI2022

In silico design of microporous polymers for chemical separations and storage

Polymers of intrinsic microporosity (PIMs) are a family of materials with potential to be effective and scalable solutions for challenging adsorbent and membrane applications. The broad range of repeat unit chemistry, microporous structural features, and polymer processing makes exploration of the expansive PIM design space inefficient via chemical and materials intuition alone. Computational techniques such as molecular simulations and machine learning can provide a leap in capabilities to address this polymer design challenge and will be central to the future development of PIMs. In this work, we highlight recent microporous material studies that arrived at key results by employing computational techniques and provide our perspective on the prospects for in silico design and development of PIMs.

adsorption↗
DOE OSTI2018

Bi-sparsity pursuit: A paradigm for robust subspace recovery

The success of sparse models in computer vision and machine learning is due to the fact that, high dimensional data is distributed in a union of low dimensional subspaces in many real-world applications. The underlying structure may, however, be adversely affected by sparse errors. In this paper, we propose a bi-sparse model as a framework to analyze this problem, and provide a novel algorithm to recover the union of subspaces in the presence of sparse corruptions. We further show the effectiveness of our method by experiments on real-world vision data.

42 ENGINEERING↗
DOE OSTI2025

Electronic and thermal properties of the phase-change memory material, Ge 2 Sb 2 Te 5 , and results from spatially resolved transport calculations

Here, we report new insights into the electronic, structural, and transport (heat and charge) properties of the phase-change memory material amorphous Ge 2 Sb 2 Te 5 . Using realistic structural models of Konstantinou et al., (2019), we analyze the topology, electronic states, and lattice dynamics with density functional methods, including hybrid-functional calculations and machine-learned interatomic potentials. The Kohn–Sham orbitals near the Fermi level display a strong electron–phonon coupling, and exhibit large energy fluctuations at room temperature. The conduction tail states exhibit larger phonon-induced fluctuations than the valence tail states. To resolve transport at the atomic scale, we employ space-projected electronic conductivity and site-projected thermal conductivity methods. Local analysis of heat transport highlights the role of filamentary networks dominated by Te, with Sb and Ge making progressively smaller contributions.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2024

Data Generation for Machine Learning Interatomic Potentials and Beyond

The field of data-driven chemistry is undergoing an evolution, driven by innovations in machine learning models for predicting molecular properties and behavior. Recent strides in ML-based interatomic potentials have paved the way for accurate modeling of diverse chemical and structural properties at the atomic level. The key determinant defining MLIP reliability remains the quality of the training data. A paramount challenge lies in constructing training sets that capture specific domains in the vast chemical and structural space. This Review navigates the intricate landscape of essential components and integrity of training data that ensure the extensibility and transferability of the resulting models. We delve into the details of active learning, discussing its various facets and implementations. We outline different types of uncertainty quantification applied to atomistic data acquisition and the correlations between estimated uncertainty and true error. The role of atomistic data samplers in generating diverse and informative structures is highlighted. Furthermore, we discuss data acquisition via modified and surrogate potential energy surfaces as an innovative approach to diversify training data. The Review also provides a list of publicly available data sets that cover essential domains of chemical space.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Modeling Single-Crystal Battery Materials: From Fundamental Understanding to Performance Evaluation

The performance of rechargeable batteries is fundamentally influenced by the physicochemical properties and microstructural features of their key material components. Recent experimental advancements have highlighted the potential of single-crystal (SC) morphologies to address inherent limitations of polycrystalline (PC) electrodes and solid-state electrolytes, offering tunable charge transport kinetics and improved cell cycling performance. Here, this review examines how state-of-the-art computational modeling, from atomistic and mesoscale to continuum-level approaches, including machine learning methodologies, has been utilized to investigate the critical factors governing the electrochemical behavior of SC battery materials. We explore how predictive modeling can elucidate the processing–structure–property–performance relationships of SC cathodes, anodes, and solid-state electrolytes, with a focus on unique SC characteristics such as crystallographic anisotropy, size effects, and facet-dependent properties. Additionally, we identify limitations in commonly used modeling techniques and discuss strategies to address these challenges. By integrating high-fidelity simulations with experimental insights, this review aims to outline a clear path for the rational design and optimization of SC battery components, paving the way for accelerated advancements in energy storage technologies.

Materials science↗
DOE OSTI2018

Constructing High-Dimensional Neural Network Potential Energy Surfaces for Gas–Surface Scattering and Reactions

While the ab initio molecular dynamics (AIMD) approach to gas–surface interaction has been instrumental in exploring important issues such as energy transfer and reactivity, it is only amenable to short-time events and a limited number of trajectories because of the on-the-fly nature of the density functional theory (DFT) calculations. In this work, we report a high-dimensional global reactive potential energy surface (PES) constructed with high fidelity from judiciously placed DFT points, using a machine learning method; and it is orders-of-magnitude more efficient than AIMD in dynamical calculations and can be employed in various simulations without performing additional electronic structure calculations. Importantly, the surface atoms are included in such a PES, which provides a unique platform for studying energy transfer and scattering/reaction of the impinging molecule on the solid surface on an equal footing.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗