Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “structured machine learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

Development of neural network force fields for corrosion studies

To fully understand the chemistry and physics of corrosion, novel methods of simulation must be developed. One approach is designing machine learning (ML) algorithms integrated with density functional theory to develop adaptive force fields to gain insight into corrosion behavior namely at the surface of metal oxides. Current methods of modeling corrosion are slow due to the computational cost of resolving both reaction mechanics and mass transport processes. Machine learning methods can be implemented to obtain structure-activity relationships at both the molecular and bulk scale while still retaining the accuracy of density functional theory (DFT) and significantly decreasing the time needed for simulations of complex chemical processes in the various environments of corrosion. Multiscale models are needed for corrosion studies to fully understand its processes not only at the atomic length scale (chemical bonding, energies, and forces), but also at the nano and meso length scales (solid-state physics and material science processes). Current methods of study include DFT, molecular dynamics, and Monte Carlo. The limitation of DFT is that only a small number of atoms or molecules can be simulated at that level of theory. Density functional theory is used to study the electronic structure of atoms and molecules, and calculate the force component of each atom. However, these calculations are limited to about 1000 atoms. Custom periodic boundary conditions (PBC) can be used to describe the various environments and defects that affect the atomic forces to produce a large data set from which a training set can be derived. Machine learning can be utilized to overcome the barrier of modeling macroscopic and multi-scale processes from ab initio calculations through the development of adaptive force fields. Local environments determine the atomic forces of a given system, therefore adaptive force fields must be created to produce reliable quantum mechanical calculations. This can be achieved by developing a learning algorithm that uses the mapped atomic forces or fingerprint as an input to produce energies and magnetic moments as output. A systematic approach was used to begin to build a data set in order to accurately describe the atomic forces in various environments. In Figure 4 below, a simple PBC cell of Fe{sub 2}O{sub 3} was first optimized. A surface optimization was performed next, followed by a hydroxylated surface optimization. Once this calculation has converged, the adsorption of halide species to the hydroxylated surface will be investigated. TensorFlow is an open source platform for machine learning developed by Google. Using a high level application program interface (API) such as Keras allows for building and training ML models easily in a number of different environments and languages. For this project, a neural network was developed within Anaconda in Python. Future Work: Further development of reference data set; Refining neural network and learning algorithm; Fingerprinting atomic environment to enable mapping of atomic force components; Choosing appropriate training set from reference data; Learning from training set and enabling non-linear mapping of training set fingerprints and the atomic forces; Estimation of uncertainty to identify ranges of outside applicability; Testing and analysis of molecular dynamic simulations.

36 MATERIALS SCIENCE↗

Virtual Growth of SRF Materials

Niobium's native surface oxide affects SRF cavity and superconducting qubit performance, motivating interest in controlling its crystalline structure. We combine a literature-derived machine-learning analysis with temperature-dependent XRD to study crystalline ordering in Nb2O5. Random Forest models, trained on 74 processing conditions from 17 papers and validated by leave-one-group-out cross-validation, predicted broad crystallinity outcomes well (balanced accuracy 0.809), but struggled with specific polymorph identity (0.577). Annealing temperature was the dominant predictor across all targets; oxygen partial pressure showed negligible importance, reflecting narrow literature coverage rather than physical irrelevance. Temperature-dependent XRD on anodized and H2O2-treated Niobium showed structural evolution consistent with the machine learning predictions. Our model and overall approach provide a data-driven framework for identifying and optimizing conditions that promote crystallization in initially amorphous oxides. This framework can guide the selection of growth and post-annealing conditions for Nb surfaces by narrowing the experimental parameter space, thereby reducing trial-and-error efforts in developing oxide structures relevant to SRF applications.

Tilkin, Anthony [Fermilab]↗

Machine learning for interpreting coherent X-ray speckle patterns

Speckle patterns produced by coherent X-ray have a close relationship with the internal structure of materials but quantitative inversion of the relationship to determine structure from speckle patterns is challenging. Here, in this work, we investigate the link between coherent X-ray speckle patterns and sample structures using a model 2D disk system and explore the ability of machine learning to learn aspects of the relationship. Specifically, we train a deep neural network to classify the coherent X-ray speckle patterns according to the disk number density in the corresponding structure. It is demonstrated that the classification system is accurate for both non-disperse and disperse size distributions.

36 MATERIALS SCIENCE↗

Application of multidimensional structural characterization to detect and describe moderate forest disturbance

The study of vegetation community and structural change has been central to ecology for over a century, yet the ways in which disturbances reshape the physical structure of forest canopies remain relatively unknown. Moderate severity disturbances affect different canopy strata and plant species, resulting in variable structural outcomes and ecological consequences. Terrestrial lidar (light detection and ranging) offers an unprecedented view of the interior arrangement and distribution of canopy elements, permitting the derivation of multidimensional measures of canopy structure that describe several canopy structural traits (CSTs) with known links to ecosystem function. We used lidar-derived CSTs within a machine learning framework to detect and describe the structural changes that result from various disturbance agents, including moderate severity fire, ice storm damage, age-related senescence, hemlock woolly adelgid, beech bark disease, and chronic acidification. We found that fire and ice storms primarily affected the amount and position of vegetation within canopies, while acidification, senescence, pathogen, and insect infestation altered canopy arrangement and complexity. Only two of the six disturbance agents significantly reduced leaf area, counter to common assumptions regarding many moderate severity disturbances. While findings are limited in their generalizability due to lack of replication among disturbances, they do suggest that the current limitations of standard disturbance detection methods—such as optical-based remote sensing platforms, which are often above-canopy perspectives—limit our ability to understand the full ecological and structural impacts of disturbance, and to evaluate the consistency of structural patterns within and among disturbance agents. A more broadly inclusive definition of ecological disturbance that incorporates multiple aspects of canopy structural change may potentially improve the modeling, detection, and prediction of functional implications of moderate severity disturbance as well as broaden our understanding of the ecological impacts of disturbance.

54 ENVIRONMENTAL SCIENCES↗

Opportunities for human factors in machine learning

Introduction The field of machine learning and its subfield of deep learning have grown rapidly in recent years. With the speed of advancement, it is nearly impossible for data scientists to maintain expert knowledge of cutting-edge techniques. This study applies human factors methods to the field of machine learning to address these difficulties. Methods Using semi-structured interviews with data scientists at a National Laboratory, we sought to understand the process used when working with machine learning models, the challenges encountered, and the ways that human factors might contribute to addressing those challenges. Results Results of the interviews were analyzed to create a generalization of the process of working with machine learning models. Issues encountered during each process step are described. Discussion Recommendations and areas for collaboration between data scientists and human factors experts are provided, with the goal of creating better tools, knowledge, and guidance for machine learning scientists.

97 MATHEMATICS AND COMPUTING↗

Membrane Filtration with Liquids: A Global Approach with Prior Successes, New Developments and Unresolved Challenges

After 70 years, modern pressure-driven polymer membrane processes with liquids are mature and accepted in many industries due to their good performance, ease of scale-up, low energy consumption, modular compact construction, and low operating costs compared with thermal systems. Successful isothermal operation of synthetic membranes with liquids requires consideration of three critical aspects or “legs” in order of relevance: selectivity, capacity (i.e. permeation flow rate per unit area) and transport of mass and momentum comprising concentration polarization (CP) and fouling (F). Major challenges remain with respect to increasing selectivity and controlling mass transport in, to and away from membranes. Thus, prediction and control of membrane morphology and a deep understanding of the mechanism of dissolved and suspended solute transport near and in the membrane (i.e. diffusional and convective mass transport) is essential. Here, we focus on materials development to address the relatively poor selectivity of liquid membrane filtration with polymers and discuss the critical aspects of transport limitations. Machine learning could help optimize membrane structure design and transport conditions for improved membrane filtration performance.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Dynamics-Based Peptide–MHC Binding Optimization by a Convolutional Variational Autoencoder: A Use-Case Model for CASTELO

An unsolved challenge in the development of antigen-specific immunotherapies is determining the optimal antigens to target. Comprehension of antigen–major histocompatibility complex (MHC) binding is paramount toward achieving this goal. Here, we apply CASTELO, a combined machine learning-molecular dynamics (ML-MD) approach, to identify per-residue antigen binding contributions and then design novel antigens of increased MHC-II binding affinity for a type 1 diabetes-implicated system. We build upon a small-molecule lead optimization algorithm by training a convolutional variational autoencoder (CVAE) on MD trajectories of 48 different systems across four antigens and four HLA serotypes. We develop several new machine learning metrics including a structure-based anchor residue classification model as well as cluster comparison scores. ML-MD predictions agree well with experimental binding results and free energy perturbation-predicted binding affinities. Moreover, ML-MD metrics are independent of traditional MD stability metrics such as contact area and root-mean-square fluctuations (RMSF), which do not reflect binding affinity data. Finally, our work supports the role of structure-based deep learning techniques in antigen-specific immunotherapy design.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Atomistic Origin of Microsecond Carrier Lifetimes at Perovskite Grain Boundaries: Machine Learning-Assisted Nonadiabatic Molecular Dynamics

The polycrystalline nature of perovskites, stemming from their facile solution-based fabrication, leads to a high density of grain boundaries (GBs) and point defects. However, the impact of GBs on perovskite performance remains uncertain, with contradictory statements found in the literature. We developed a machine learning force field, sampled GB structures on a nanosecond time scale, and performed nonadiabatic (NA) molecular dynamics simulations of charge carrier trapping and recombination in stoichiometric and doped GBs. The simulations reveal long, microsecond carrier lifetimes, approaching experimental data, stemming from charge separation at the GBs and small NA coupling, 0.01–0.1 meV. Stoichiometric GBs exhibit transient trap states, which, however, are not particularly detrimental to the carrier lifetime. Halide dopants form interstitial defects in the bulk, but have a stabilizing influence on the GB structure by passivating undersaturated Pb atoms and reducing the transient trap state formation. On the contrary, excess Pb destabilizes GBs, allowing formation of persistent midgap states that trap charges. Still, the charge carrier lifetime reduces relatively little, because the midgap states decouple from the bands, and charges are more likely to escape back into bands upon a GB structural fluctuation. The atomistic study into the structural dynamics of perovskite GBs and its influence on charge carrier trapping and recombination provides valuable insights into the complex properties of perovskites and the intricate role of GBs in the material performance.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Uncovering the True Active Sites in Ni–N–C Catalysts for CO 2 Electroreduction

Understanding and designing active sites in single-atom catalysts (SACs) requires going beyond static models to capture their dynamic evolution under realistic electrochemical conditions. Here, in this work, we develop an integrated theoretical framework that accounts for operational conditions, by combining grand canonical density functional theory (GC-DFT) with machine-learning-accelerated sampling, to uncover structure–activity–stability relationships in Ni–N–C SACs for the CO 2 reduction reaction (CO 2 RR). A library of NiN x C 4–x (x = 0–4) motifs─representing coordination defects likely formed during high-temperature synthesis─was systematically evaluated. Under working conditions, these sites were found to undergo hydrogenation, and NiN 3 C 1_ H 1 was identified as the most probable active site. At reducing potentials, hydrogen adsorbs spontaneously at C–Ni bridge sites rather than Ni top sites, while subsurface hydrogen facilitates bent CO 2 adsorption crucial for activation. High CO 2 RR selectivity toward CO arises from site separation: Ni centers drive CO2RR, while the hydrogen evolution reaction (HER) occurs at the C–Ni bridge or N sites and from thermodynamic suppression of HER at moderate hydrogen coverage. At more negative potentials, a shift in the CO 2 RR rate-determining process (RDP) and Ni out-of-surface displacement induced by coadsorption of H and H 2 O jointly reduce activity and selectivity. Thus, both the high CO2RR selectivity of Ni–N–C catalysts and its reversal with more negative potentials can be rationalized by accounting for hydrogenated surfaces. This highlights the necessity of modeling realistic; in situ conditions. This framework provides generalizable insights into the dynamic behavior of active sites in SACs, offering guidance for the rational design of active and robust catalysts for a wide range of electrochemical reactions.

25 ENERGY STORAGE↗

Identification of driver genes for critical forms of COVID-19 in a deeply phenotyped young patient cohort

The drivers of critical coronavirus disease 2019 (COVID-19) remain unknown. Given major confounding factors such as age and comorbidities, true mediators of this condition have remained elusive. We used a multi-omics analysis combined with artificial intelligence in a young patient cohort where major comorbidities were excluded at the onset. The cohort included 47 “critical” (in the intensive care unit under mechanical ventilation) and 25 “non-critical” (in a non-critical care ward) patients with COVID-19 and 22 healthy individuals. The analyses included whole-genome sequencing, whole-blood RNA sequencing, plasma and blood mononuclear cell proteomics, cytokine profiling, and high-throughput immunophenotyping. An ensemble of machine learning, deep learning, quantum annealing, and structural causal modeling were used. Patients with critical COVID-19 were characterized by exacerbated inflammation, perturbed lymphoid and myeloid compartments, increased coagulation, and viral cell biology. Among differentially expressed genes, we observed up-regulation of the metalloprotease ADAM9. This gene signature was validated in a second independent cohort of 81 critical and 73 recovered patients with COVID-19 and was further confirmed at the transcriptional and protein level and by proteolytic activity. Ex vivo ADAM9 inhibition decreased severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) uptake and replication in human lung epithelial cells. In conclusion, within a young, otherwise healthy, cohort of individuals with COVID-19, we provide the landscape of biological perturbations in vivo where a unique gene signature differentiated critical from non-critical patients. We further identified ADAM9 as a driver of disease severity and a candidate therapeutic target.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Neuromorphic Graph Algorithms: Extracting Longest Shortest Paths and Minimum Spanning Trees

Neuromorphic computing is poised to become a promising computing paradigm in the post Moore's law era due to its extremely low power usage and inherent parallelism. Traditionally speaking, a majority of the use cases for neuromorphic systems have been in the field of machine learning. In order to expand their usability, it is imperative that neuromorphic systems be used for non-machine learning tasks as well. The structural aspects of neuromorphic systems (i.e., neurons and synapses) are similar to those of graphs (i.e., nodes and edges), However, it is not obvious how graph algorithms would translate to their neuromorphic counterparts. In this work, we propose a preprocessing technique that introduces fractional offsets on the synaptic delays of neuromorphic graphs in order to break ties. This technique, in turn, enables two graph algorithms: longest shortest path extraction and minimum spanning trees.

Kay, Bill↗

HyMARC Seedling: Optimized Hydrogen Adsorbents via Machine Learning and Crystal Engineering

This final report is presented in two parts: In Part 1, the H 2 capacities of a diverse set of 918,734 metal-organic frameworks (MOFs) sourced from 19 databases is predicted via machine learning (ML). Using only 7 structural features as input, ML identifies 8,282 MOFs with the potential to exceed the capacities of state-of-the-art materials. The identified MOFs are predominantly hypothetical compounds having low densities (<0.31 g/cm3) in combination with high surface areas (>5,300 m2/g), void fractions ($0.90), and pore volumes (>3.3 cm3/g). The relative importance of the input features are characterized, and dependencies on the ML algorithm and training set size are quantified. The most important features for predicting H 2 uptake are pore volume (for gravimetric capacity) and void fraction (for volumetric capacity). The ML models are available on the web, allowing for rapid and accurate predictions of the hydrogen capacities of MOFs from limited structural data; the simplest models require only a single crystallographic feature. In part 2, ways to improve the poor powder packing density of MOFs is discussed. More specifically, a strategy that improves packing efficiency and volumetric hydrogen gas storage density dramatically through engineered morphologies and controlled-crystal size distributions is presented that holds promise for maximizing storage capacity for a given MOF. The packing density improvement, demonstrated for the benchmark sorbent MOF-5, leads to a significant enhancement of volumetric hydrogen storage performance relative to commercial MOF-5. System model projections demonstrate that engineering of crystal morphology/size or use of a bimodal distribution of cubic crystal sizes in tandem with system optimization can surpass the 25 g/L volumetric capacity of a typical 700 bar compressed storage system and exceed the DOE targets 2020 volumetric capacity (30 g/L). Finally, a critical link between improved powder packing density and reduced damage upon compaction is revealed leading to sorbents with both high surface area and high density.

08 HYDROGEN↗

Abstract for CRADA between NETL and Louisiana State University

The National Energy Technology Laboratory (NETL) and Louisiana State University (PARTICIPANT) will collaborate in developing and testing distributed optical fiber CO 2 sensors for CO 2 storage site monitoring. Safe and reliable monitoring of CO 2 storage sites and transport infrastructure is critical for ensuring the long-term effectiveness and integrity of carbon capture and storage (CCS). In this project, the objective is to develop a novel optical fiber-based distributed CO 2 sensor for long-term monitoring of CCS sites and CO 2 pipelines and also implement machine learning to automate leak and structural anomaly detection. This effort aligns with NETL’s mission in reliable and sustainable energy and decarbonization.

47 OTHER INSTRUMENTATION↗

BOXKIT

SF-23-067 BoxKit is a library that provides building blocks to parallelize and scale data science, high performance computing, and machine learning applications for block-structured datasets. Spatial data from simulations and experiments can be accessed and managed using tools available in this library when working with more data analysis oriented packages like SciKit (https://github.com/scikit-learn/scikit-learn) and FlowNet (https://github.com/NVIDIA/flownet2-pytorch)

DHRUV, AKASH↗

A Multifidelity and Multimodal Machine Learning Approach for Extracting Bonding Environments of Impurities and Dopants from X-ray Spectroscopies

Extended X-ray absorption fine structure (EXAFS) spectroscopy is crucial for determining the coordination environment of impurities and dopants; however, it requires difficult measurements. X-ray absorption near edge structure (XANES) spectroscopy and X-ray emission spectroscopy (XES) can be obtained easily but cannot be converted to determine structures. In this work we develop tools to map measured XANES to the EXAFS signal through machine learning, thereby facilitating the use of EXAFS structural-determination analyses on XANES data. Through the use of Deep Operator Networks (DeepONets), we are able to accurately predict the EXAFS spectrum between 6 and 14 Å -1 from the first 6 Å -1 (~100 eV) of the absorption spectrum of Cu 2+ substitutional defects in the Fe 3+ mineral hematite (a-Fe 2 O 3 ). This surprising finding implies that theoretical analyses of X-ray absorption spectra could be implemented that extract the same conclusions as high-quality EXAFS studies from spectra collected over a much smaller range of photon energies. To encourage similar efforts, the simulated x-ray spectra, machine learning, and fitting code is made publicly available.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Machine learning sheds light on microbial dark proteins

In this article, metagenomics projects have revealed more than 8 billion non-redundant microbial protein sequences from across the Earth’s biosphere. Of these, 1.17 billion proteins do not have recognizable homologues in any of the more than 100,000 reference genomes available1. Understanding the function of these microbial proteins is a daunting task. Fortunately, machine learning has recently achieved unprecedented accuracy in modelling complex biological data and making predictions. At the forefront of these advancements are machine learning-based approaches that can confidently predict atomic-level protein structures for many (but not all) amino acid sequences.

59 BASIC BIOLOGICAL SCIENCES↗

Highly Drug-Resistant HIV-1 Protease Mutant PRS17 Shows Enhanced Binding to Substrate Analogues

We report the structural analysis of highly drug-resistant human immunodeficiency virus protease (PR) variant PR S17 , rationally selected by machine learning, in complex with substrate analogues. Crystal structures were solved of inhibitor-free inactive PR S17 -D25N, wild-type PR/CA-p2 complex, and PR S17 in complex with substrate analogues, CA-p2 and p2-NC. Peptide analogues p2-NC and CA-p2 exhibit inhibition constants of 514 and 22 nM, respectively, for PR S17 or approximately 3-fold better than for PR. CA-p2 is a better inhibitor of PR S17 than are clinical inhibitors ( K i = 50–8390 nM) except for amprenavir ( K i = 11 nM). G48V resistance mutation induces curled flap tips in PR S17 -D25N structure. The inner P2–P2' residues of substrate analogues in PR S17 complexes maintain similar conformations to those of wild-type complex, while significant conformational changes are observed in the peripheral residues P3, P4' of CA-p2 and P3, P4, and P3' of p2-NC. The loss of β-branched side chain by V82S mutation initiates a shift in 80’s loop and reshapes the S3/S3' subsite, which enhances substrate binding with new hydrogen bonds and van der Waals interactions that are absent in the wild-type structures. The steric hindrance caused by G48V mutation in the flap of PR S17 contributes to altered binding interactions of P3 Arg, P4' norleucine of CA-p2, and P4 and P3' of p2-NC with the addition of new hydrogen bonds and van der Waals contacts. The enhanced interaction of PR S17 with substrate analogues agrees with their relative inhibition, suggesting that this mutant improves substrate binding while decreasing affinity for clinical inhibitors.

59 BASIC BIOLOGICAL SCIENCES↗