Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “generative machine learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Utilizing Machine Learning to Improve Neutralization Potency of an HIV-1 Antibody Targeting the gp41 N-Heptad Repeat

The N-heptad repeat (NHR) of the HIV-1 gp41 prehairpin intermediate (PHI) is an attractive potential vaccine target with high sequence conservation across diverse strains. However, despite the potency of NHR-targeting peptides and clinical efficacy of the NHR-targeting entry inhibitor enfuvirtide, no potently neutralizing NHR-directed monoclonal antibodies (mAbs) nor antisera have been identified or elicited to date. The lack of potent NHR-binding mAbs both dampens enthusiasm for vaccine development efforts at this target and presents a barrier to performing passive immunization experiments with NHR-targeting antibodies. To address this challenge, we previously developed an improved variant of the NHR-directed mAb D5, called D5_AR, which is capable of neutralizing diverse tier-2 viruses. Building on that work, here we present the 2.7Å-crystal structure of D5_AR bound to NHR mimetic peptide IQN17. We then utilize protein language models and supervised machine learning to generate small (n < 100) libraries of D5_AR variants that are subsequently screened for improved neutralization potency. We identify a variant with 5-fold improved neutralization potency, D5_FI, which is the most potent NHR-directed monoclonal antibody characterized to date and exhibits broad neutralization of tier-2 and −3 pseudoviruses as well as replicating R5 and X4 challenge strains. Additionally, our work highlights the ability of protein language models to efficiently identify improved mAb variants from relatively small libraries.

Biopolymers↗
DOE OSTI2013

Multimodel Predictive System for Carbon Dioxide Solubility in Saline Formation Waters

The prediction of carbon dioxide solubility in brine at conditions relevant to carbon sequestration (i.e., high temperature, pressure, and salt concentration (T-P-X)) is crucial when this technology is applied. Eleven mathematical models for predicting CO{sub 2} solubility in brine are compared and considered for inclusion in a multimodel predictive system. Model goodness of fit is evaluated over the temperature range 304–433 K, pressure range 74–500 bar, and salt concentration range 0–7 m (NaCl equivalent), using 173 published CO{sub 2} solubility measurements, particularly selected for those conditions. The performance of each model is assessed using various statistical methods, including the Akaike Information Criterion (AIC) and the Bayesian Information Criterion (BIC). Different models emerge as best fits for different subranges of the input conditions. A classification tree is generated using machine learning methods to predict the best-performing model under different T-P-X subranges, allowing development of a multimodel predictive system (MMoPS) that selects and applies the model expected to yield the most accurate CO{sub 2} solubility prediction. Statistical analysis of the MMoPS predictions, including a stratified 5-fold cross validation, shows that MMoPS outperforms each individual model and increases the overall accuracy of CO{sub 2} solubility prediction across the range of T-P-X conditions likely to be encountered in carbon sequestration applications.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Anthropogenic influence on extreme precipitation over global land areas seen in multiple observational datasets

The intensification of extreme precipitation under anthropogenic forcing is robustly projected by global climate models, but highly challenging to detect in the observational record. Large internal variability distorts this anthropogenic signal. Models produce diverse magnitudes of precipitation response to anthropogenic forcing, largely due to differing schemes for parameterizing subgrid-scale processes. Meanwhile, multiple global observational datasets of daily precipitation exist, developed using varying techniques and inhomogeneously sampled data in space and time. Previous attempts to detect human influence on extreme precipitation have not incorporated model uncertainty, and have been limited to specific regions and observational datasets. Using machine learning methods that can account for these uncertainties and capable of identifying the time evolution of the spatial patterns, we find a physically interpretable anthropogenic signal that is detectable in all global observational datasets. Machine learning efficiently generates multiple lines of evidence supporting detection of an anthropogenic signal in global extreme precipitation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Gray matter volume drives the brain age gap in schizophrenia: a SHAP study

Neuroimaging-based brain age is a biomarker that is generated by machine learning (ML) predictions. The brain age gap (BAG) is typically defined as the difference between the predicted brain age and chronological age. Studies have consistently reported a positive BAG in individuals with schizophrenia (SCZ). However, there is little understanding of which specific factors drive the ML-based brain age predictions, leading to limited biological interpretations of the BAG. We gathered data from three publicly available databases - COBRE, MCIC, and UCLA - and an additional dataset (TOPSY) of early-stage schizophrenia (82.5% untreated first-episode sample) and calculated brain age with pre-trained gradient-boosted trees. Then, we applied SHapley Additive Explanations (SHAP) to identify which brain features influence brain age predictions. We investigated the interaction between the SHAP score for each feature and group as a function of the BAG. These analyses identified total gray matter volume (group × SHAP interaction term β = 1.71 [0.53; 3.23]; p corr < 0.03) as the feature that influences the BAG observed in SCZ among the brain features that are most predictive of brain age. Other brain features also presented differences in SHAP values between SCZ and HC, but they were not significantly associated with the BAG. We compared the findings with a non-psychotic depression dataset (CAN-BIND), where the interaction was not significant. This study has important implications for the understanding of brain age prediction models and the BAG in SCZ and, potentially, in other psychiatric disorders.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

QM7-X, a comprehensive dataset of quantum-mechanical properties spanning the chemical space of small organic molecules

We introduce QM7-X, a comprehensive dataset of 42 physicochemical properties for ≈4.2 million equilibrium and non-equilibrium structures of small organic molecules with up to seven non-hydrogen (C, N, O, S, Cl) atoms. To span this fundamentally important region of chemical compound space (CCS), QM7-X includes an exhaustive sampling of (meta-)stable equilibrium structures—comprised of constitutional/structural isomers and stereoisomers, e.g., enantiomers and diastereomers (including cis-/trans- and conformational isomers)—as well as 100 non-equilibrium structural variations thereof to reach a total of ≈4.2 million molecular structures. Computed at the tightly converged quantum-mechanical PBE0+MBD level of theory, QM7-X contains global (molecular) and local (atom-in-a-molecule) properties ranging from ground state quantities (such as atomization energies and dipole moments) to response quantities (such as polarizability tensors and dispersion coefficients). By providing a systematic, extensive, and tightly-converged dataset of quantum-mechanically computed physicochemical properties, we expect that QM7-X will play a critical role in the development of next-generation machine-learning based models for exploring greater swaths of CCS and performing in silico design of molecules with targeted properties.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Insights into coordination and ligand trends of lanthanide complexes from the Cambridge Structural Database

Abstract Understanding lanthanide coordination chemistry can help develop new ligands for more efficient separation of lanthanides for critical materials needs. The Cambridge Structural Database (CSD) contains tens of thousands of single crystal structures of lanthanide complexes that can serve as a training ground for both fundamental chemical insights and future machine learning and generative artificial intelligence models. This work aims to understand the currently available structures of lanthanide complexes in CSD by analyzing the coordination shell, donor types, and ligand types, from the perspective of rare-earth element (REE) separations. We obtain four sets of lanthanide complexes from CSD: Subset 1, all Ln-containing complexes (49472 structures); Subset 2, mononuclear Ln complexes (27858 structures); Subset 3, mononuclear Ln complexes without cyclopentadienyl ligands (Cp) (26156 structures); Subset 4, Ln complexes with at least one 1,10-phenanthroline (phen) or its derivative as a coordinating ligand (2226 structures). The subsequent analysis of lanthanide complexes in these subsets examines the trends in coordination numbers and first shell distances as well as identifies and characterizes the ligands and donor groups. In addition, examples of Ln-complexes with commercially available complexants and phen-based ligands are interrogated in detail. This systematic investigation lays the groundwork for future data-driven ligand designs for REE separations based on the structural insights into the lanthanide coordination chemistry.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Conditional guided generative diffusion for particle accelerator beam diagnostics

Abstract Advanced accelerator-based light sources such as free electron lasers (FEL) accelerate highly relativistic electron beams to generate incredibly short (10s of femtoseconds) coherent flashes of light for dynamic imaging, whose brightness exceeds that of traditional synchrotron-based light sources by orders of magnitude. FEL operation requires precise control of the shape and energy of the extremely short electron bunches whose characteristics directly translate into the properties of the produced light. Control of short intense beams is difficult due to beam characteristics drifting with time and complex collective effects such as space charge and coherent synchrotron radiation. Detailed diagnostics of beam properties are therefore essential for precise beam control. Such measurements typically rely on a destructive approach based on a combination of a transverse deflecting resonant cavity followed by a dipole magnet in order to measure a beam’s 2D time vs energy longitudinal phase-space distribution. In this paper, we develop a non-invasive virtual diagnostic of an electron beam’s longitudinal phase space at megapixel resolution (1024 × 1024) based on a generative conditional diffusion model. We demonstrate the model’s generative ability on experimental data from the European X-ray FEL.

43 PARTICLE ACCELERATORS↗
DOE OSTI2022

A nearsighted force-training approach to systematically generate training data for the machine learning of large atomic structures

A challenge of atomistic machine-learning (ML) methods is ensuring that the training data are suitable for the system being simulated, which is particularly challenging for systems with large numbers of atoms. Most atomistic ML approaches rely on the nearsightedness principle (“all chemistry is local”), using information about the position of an atom’s neighbors to predict a per-atom energy. Here, in this work, we develop a framework that exploits the nearsighted nature of ML models to systematically produce an appropriate training set for large structures. We use a per-atom uncertainty estimate to identify the most uncertain atoms and extract chunks centered around these atoms. It is crucial that these small chunks are both large enough to satisfy the ML’s nearsighted principle (that is, filling the cutoff radius) and are large enough to be converged with respect to the electronic structure calculation. We present data indicating when the electronic structure calculations are converged with respect to the structure size, which fundamentally limits the accuracy of any nearsighted ML calculator. These new atomic chunks are calculated in electronic structures, and crucially, only a single force—that of the central atom—is added to the growing training set, preventing the noisy and irrelevant information from the piece’s boundary from interfering with ML training. The resulting ML potentials are robust, despite requiring single-point calculations on only small reference structures and never seeing large training structures. We demonstrated our approach via structure optimization of a 260-atom structure and extended the approach to clusters with up to 1415 atoms.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Exploring dielectric properties in atomistic models of amorphous boron nitride

Abstract We report a theoretical study of dielectric properties of models of amorphous Boron Nitride, using interatomic potentials generated by machine learning. We first perform first-principles simulations on small (about 100 atoms in the periodic cell) sample sizes to explore the emergence of mid-gap states and its correlation with structural features. Next, by using a simplified tight-binding electronic model, we analyse the dielectric functions for complex three dimensional models (containing about 10.000 atoms) embedding varying concentrations of sp 1 , sp 2 and sp 3 bonds between B and N atoms. Within the limits of these methodologies, the resulting value of the zero-frequency dielectric constant is shown to be influenced by the population density of such mid-gap states and their localization characteristics. We observe nontrivial correlations between the structure-induced electronic fluctuations and the resulting dielectric constant values. Our findings are however just a first step in the quest of accessing fully accurate dielectric properties of as-grown amorphous BN of relevance for interconnect technologies and beyond.

Materials Science↗
DOE OSTI2021

Cosmology requirements on supernova photometric redshift systematics for the Rubin LSST and Roman Space Telescope

Some million type Ia supernovae (SN) will be discovered and monitored during upcoming wide area time domain surveys such as the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST). For cosmological use, accurate redshifts are needed among other characteristics; however the vast majority of the SN will not have spectroscopic redshifts, even for their host galaxies, only photometric redshifts. We assess the redshift systematic control necessary for robust cosmology. Based on the photometric vs true redshift relation generated by machine learning applied to a simulation of 500,000 galaxies as observed with LSST quality, we quantify requirements on systematics in the mean relation and in the outlier fraction and deviance so as not to bias dark energy cosmological inference. Certain redshift ranges are particularly sensitive, motivating spectroscopic followup of SN at z ≲ 0.2 and around z ≈ 0.5–0.6 . Including Nancy Grace Roman Space Telescope near infrared bands in the simulation, we reanalyze the constraints, finding improvements at high redshift but little at the low redshifts where systematics lead to strong cosmology bias. We identify a complete spectroscopic survey of SN host galaxies for z≲0.2 as a highly favored element for robust SN cosmology.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2015

Synergistic Chem-Bio Detection/Classification Combining UV LIF and IR LIDAR (SV)

The objective of this project was to determine if adding data products from Sandia’s Ares laser-induced fluorescence (LIF) system to those from Lockheed Martin Coherent Technologies’ Prototype WANDER Laser Radar (PROWLR) system produces an overall system with an improved ability to discriminate between aerosol-dispersed surrogates of chemical and biological agents and aerosol-dispersed background materials such as dust and smoke from burning wood, diesel fuel, and other common materials. The results of this work demonstrate that the addition of LIF information to PROWLR information significantly improves discrimination performance with respect to either LIF-only or PROWLR-only performance. The primary improvement is a dramatic improvement in false positive, where the best-performing combination of LIF/PROWLR data products improved false positive performance to 6.4% from 20.6% (PROWLR-only) and 11% (LIF-only). It is important to note that the improvement in false positive performance does not come at the expense of true positive performance which remains high at 93%. Sandia, DOE, and the government have benefitted from this project by building capabilities generating supervised machine learning and also in working closely and building professional relationships with private industry partners. Sandia’s CRADA partner benefitted by utilizing Sandia’s expertise to help accomplish work that will be beneficial to their business prospects in the future by allowing the knowledge gained by the CRADA interaction to provide them with a differentiating capability from potential competitors. The public and taxpayers will ultimately benefit from the knowledge has been gained that can be applied for public safety purposes in terms of producing systems with improved capabilities to detect threats to the public from the deployment of chemical and/or biological weapons.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Bioprospecting Trichoderma: A Systematic Roadmap to Screen Genomes and Natural Products for Biocontrol Applications

Natural products derived from microbes are crucial innovations that would help in reaching sustainability development goals worldwide while achieving bioeconomic growth. Trichoderma species are well-studied model fungal organisms used for their biocontrol properties with great potential to alleviate the use of agrochemicals in agriculture. However, identifying and characterizing effective natural products in novel species or strains as biological control products remains a meticulous process with many known challenges to be navigated. Integration of recent advancements in various “omics” technologies, next generation biodesign, machine learning, and artificial intelligence approaches could greatly advance bioprospecting goals. Herein, we propose a roadmap for assessing the potential impact of already known or newly discovered Trichoderma species for biocontrol applications. By screening publicly available Trichoderma genome sequences, we first highlight the prevalence of putative biosynthetic gene clusters and antimicrobial peptides among genomes as an initial step toward predicting which organisms could increase the diversity of natural products. Next, we discuss high-throughput methods for screening organisms to discover and characterize natural products and how these findings impact both fundamental and applied research fields.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRSDate not supplied

A Method for Validating Causal Diagrams of Human Health Risk in Space Flight

The complexity of cause-and-effect relationships between spaceflight hazards and resulting health conditions clouds understanding of the totality of human system risk in space. In response, NASA has introduced Directed Acyclic Graphs (causal diagrams) into the human systems risk management process. These diagrams allow for a common understanding of the mechanisms that lead from unique hazards of spaceflight to the health outcomes important to agencies and astronauts. However, the paucity of available biomedical data from spaceflight creates a need for methods of validating causal models that can accommodate data from spaceflight model analogs. Here we outline one approach utilizing open-access rodent bone datasets from the Ames Life Sciences Data Archive. The properties of directed acyclic graphs themselves can provide an epistemological and statistical framework for validation of a priori causal representations of human system risk in space flight. The assumed causal connections on the graph creates sets of logical implications: variables that – if the causal diagram is correct – should be correlated, as well as sets that should be conditionally independent. By testing these implied correlations and conditional independencies both statistically and heuristically, we can provide evidence for or against specific causal pathways on the causal diagram. In addition to validation of expert-generated causal diagrams, machine learning techniques can learn the most likely structure of a causal diagram from a given dataset. Comparison with and reconciliation between machine-learned causal diagrams and expert-generated diagrams is another technique for challenging assumptions and improving our understanding of causal mechanisms. Accurately representing complex causation is essential to systemic understanding of human health risks in space travel. Having a robust system of validating causal diagrams helps us arrive at more accurate representations of causal systems. This process will be integral to developing the countermeasures necessary for extended exploration of the moon and Mars.

Robert Reynolds↗
NASA NTRSDate not supplied

Combining Data with Physical Knowledge for Uncertainty Quantification in Certification and Reliability Analysis

Unifying empirical data with predictive models can enable engineering cost-savings through certification by analysis and reliability-based design. Both concepts require rigorous uncertainty quantification (UQ) and robust understanding and treatment of relevant physics. Combining sampling-based UQ algorithms with high-fidelity simulations creates a computational bottleneck that is often alleviated through the use of machine learning (ML). ML can be used to create computationally efficient surrogates for simulations of complex or high-dimensional physical interactions (e.g., multi-phase interactions associated with melt pools in laser powder bed fusion or spatially-dependent material properties in functionally graded materials). However, negative side effects of ML may include a lack of interpretability and negative correlation between event rarity and simulation accuracy due to a lack of training data. As such, it is important to infuse ML algorithms with physics-based guardrails to provide confidence in their predictions. This talk will provide a brief review of recent NASA research at this intersection of physics-based simulation, ML, and UQ with a focus on certification and reliability analysis.

uncertainty quantification↗
DOE OSTI2020

AI-Science for Performance Optimization and Diagnosis of Science Instrument Federations

Next generation of science workflows are expected to be executed over complex federations composed of supercomputers, science instruments, storage systems and networks, with new additions of the edge and cloud systems and services. The sheer complexity of these multi-domain federations makes it hard to manage them and optimize their performance, as small impedance mismatches (that can dynamically develop between systems) could drastically degrade the entire federation performance. Recent proliferation of Software Defined Everything (SDX) technologies combined with containerization frameworks provide custom instruments that can monitor and collect critical measurements at various levels to support diagnoses and performance optimization; but their data too enormous for human operators and analysts to process and generate decisions. Machine Learning (ML) methods that extract critical parameters, relationships and trends from the data offer general solutions. Artificial Intelligence (AI) and ML methods must be custom-developed for these problems based on solid, rigorous foundations, since black-box approaches are often ineffective and unsound.We propose to develop comprehensive AI-Science for the performance of science federations to (i) monitor and control storage, networks, experiments, and computing systems across multiple domains via softwarization layers, at speeds and scales orders of magnitude superior to current practice, (ii) optimally realize and orchestrate complex workflows with high performance by using dynamic state and performance estimation methods, and (iii) aggregate measurements across sites and time to develop infrastructure-level profiles, optimizations and diagnoses using AI-Science based on foundational principles from ML, game theory, and information fusion areas.

Rao, Nageswara↗
DOE OSTI2022

Deep Generative Models for Materials Discovery and Machine Learning-Accelerated Innovation

Machine learning and artificial intelligence (AI/ML) methods are beginning to have significant impact in chemistry and condensed matter physics. For example, deep learning methods have demonstrated new capabilities for high-throughput virtual screening, and global optimization approaches for inverse design of materials. Recently, a relatively new branch of AI/ML, deep generative models (GMs), provide additional promise as they encode material structure and/or properties into a latent space, and through exploration and manipulation of the latent space can generate new materials. These approaches learn representations of a material structure and its corresponding chemistry or physics to accelerate materials discovery, which differs from traditional AI/ML methods that use statistical and combinatorial screening of existing materials via distinct structure-property relationships. However, application of GMs to inorganic materials has been notably harder than organic molecules because inorganic structure is often more complex to encode. In this work we review recent innovations that have enabled GMs to accelerate inorganic materials discovery. We focus on different representations of material structure, their impact on inverse design strategies using variational autoencoders or generative adversarial networks, and highlight the potential of these approaches for discovering materials with targeted properties needed for technological innovation.

36 MATERIALS SCIENCE↗