Training Data Selection for Transferable Machine Learned Potentials [Slides]
Abstract not provided.
36 MATERIALS SCIENCE↗
SEARCH · Engineering Papers
Results for “machine learning for science”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Leveraging Machine Learning Algorithms for Efficient Optimization
Explore the source record for details and available documents.
Engineering - Aeronautics, Mathematics and Computi↗
Prediction of Specificity of α-Conotoxins to Subtypes of Human Nicotinic Acetylcholine Receptors with Semi-supervised Machine Learning
Conotoxins are a family of highly toxic neurotoxins composed of cysteine-rich peptides produced by marine cone snails. The most lethal cone snail species to humans is Conus geographus, with fatality rates of up to ∼65% from a single sting, which is caused mostly by the activity of α-conotoxins against human nicotinic acetylcholine receptors (nAChRs). While sequence-based machine learning (ML) classifiers have been trained to identify targets of conotoxins binding voltage-gated ion channels, no ML model has been built to predict the subtype-specific nAChR targets of α-conotoxins. Here, we trained an ML model in a semi-supervised manner to predict the specificity of α-conotoxin binding toward different human nAChR subtypes to overcome the challenge of limited data in subtype-specific nAChR targets of α-conotoxins and the issue that one α-conotoxin can bind multiple nAChR subtypes with high selectivity. We considered additional features of sequences of α-conotoxins in training our ML model, including the secondary structure propensities and electrostatic properties, which resulted in better prediction capability for the ML model. Notably, we identify that most α-conotoxins bind to α3β2, α1γδ, and α7 subtypes of human nAChRs. Our findings from this study provide a framework for predicting targets of various kinds of toxins.
59 BASIC BIOLOGICAL SCIENCES↗
Feature engineering descriptors, transforms, and machine learning for grain boundaries and variable-sized atom clusters
Abstract Obtaining microscopic structure-property relationships for grain boundaries is challenging due to their complex atomic structures. Recent efforts use machine learning to derive these relationships, but the way the atomic grain boundary structure is represented can have a significant impact on the predictions. Key steps for property prediction common to grain boundaries and other variable-sized atom clustered structures include: (1) describing the atomic structure as a feature matrix, (2) transforming the variable-sized feature matrix to a fixed length common to all structures, and (3) applying a machine learning algorithm to predict properties from the transformed matrices. We examine how these steps and different combinations of engineered features impact the accuracy of grain boundary energy predictions using a database of over 7000 grain boundaries. Additionally, we assess how different engineered features support interpretability, offering insights into the physics of the structure-property relationships.
36 MATERIALS SCIENCE↗
Framework development for a SAVY-4000 nuclear material storage container structural integrity surveillance tool
Here, this work presents the preliminary design of an automated surveillance tool to assess the health of SAVY-4000 nuclear material storage containers. This tool is designed by training several machine learning (ML) regression models to predict maximum residual stress in plain dents on the container sidewall. The model is trained on an experimentally validated Finite Element Analysis (FEA) model built in Abaqus FEA. The accuracy of each ML model is compared. The potential for application as well as model shortcomings are assessed. Necessary FEA model improvements are outlined and the various ML models are proposed.
36 MATERIALS SCIENCE↗
Science & Technology Review (April/May 2023)
NASA’s Double Asteroid Redirection Test (DART), featured beginning on p.4, has been a testament to Lawrence Livermore’s multidisciplinary expertise. For DART, the Laboratory developed planetary defense strategies, modeled materials and impacts, and utilized advanced machine learning to create and evaluate multitudes of impact scenarios—informing prediction and analysis of the intercept of a small spacecraft with a much larger asteroid of unknown properties. The success of the project heralds a bright future for space science and security work at the Laboratory.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Machine Learning Framework for Conotoxin Class and Molecular Target Prediction
Conotoxins are small and highly potent neurotoxic peptides derived from the venom of marine cone snails which have captured the interest of the scientific community due to their pharmacological potential. These toxins display significant sequence and structure diversity, which results in a wide range of specificities for several different ion channels and receptors. Despite the recognized importance of these compounds, our ability to determine their binding targets and toxicities remains a significant challenge. Predicting the target receptors of conotoxins, based solely on their amino acid sequence, remains a challenge due to the intricate relationships between structure, function, target specificity, and the significant conformational heterogeneity observed in conotoxins with the same primary sequence. We have previously demonstrated that the inclusion of post-translational modifications, collisional cross sections values, and other structural features, when added to the standard primary sequence features, improves the prediction accuracy of conotoxins against non-toxic and other toxic peptides across varied datasets and several different commonly used machine learning classifiers. Here, we present the effects of these features on conotoxin class and molecular target predictions, in particular, predicting conotoxins that bind to nicotinic acetylcholine receptors (nAChRs). We also demonstrate the use of the Synthetic Minority Oversampling Technique (SMOTE)-Tomek in balancing the datasets while simultaneously making the different classes more distinct by reducing the number of ambiguous samples which nearly overlap between the classes. In predicting the alpha, mu, and omega conotoxin classes, the SMOTE-Tomek PCA PLR model, using the combination of the SS and P feature sets establishes the best performance with an overall accuracy (OA) of 95.95%, with an average accuracy (AA) of 93.04%, and an f1 score of 0.959. Using this model, we obtained sensitivities of 98.98%, 89.66%, and 90.48% when predicting alpha, mu, and omega conotoxin classes, respectively. Similarly, in predicting conotoxins that bind to nAChRs, the SMOTE-Tomek PCA SVM model, which used the collisional cross sections (CCSs) and the P feature sets, demonstrated the highest performance with 91.3% OA, 91.32% AA, and an f1 score of 0.9131. The sensitivity when predicting conotoxins that bind to nAChRs is 91.46% with a 91.18% sensitivity when predicting conotoxins that do not bind to nAChRs.
59 BASIC BIOLOGICAL SCIENCES↗
Harnessing graph convolutional neural networks for identification of glassy states in metallic glasses
Graph Convolutional Neural Networks (GCNNs) have emerged as powerful tools for analyzing materials. In this study, we employ GCNNs to examine structural characteristics of CuZr metallic glasses (MGs) and identify their states. We use molecular dynamics to simulate the quenching process of CuZr, using cooling rates ranging from 10 9 to 10 15 K/s, to produce six unique glassy states. For each state, we create a dataset comprising 1,800 distinct samples. We evaluate the effectiveness of various GCNNs, including Graph Attention Neural Network (GANN), Graph Sample and AggreGatE (GraphSAGE), Graph Isomorphism Network (GIN), and Relational Graph Convolutional Neural Network (RGCN). GANN and GraphSAGE demonstrate comparable performance, achieving an overall accuracy of 81% in classifying the MG states. Furthermore, these results underscore the potential of GCNNs to detect subtle structural variances in disordered materials and point to broader application of deep learning in the analysis of MGs and other amorphous substances.
36 MATERIALS SCIENCE↗
Mucin 4 is a cellular biomarker of necrotizing bronchiolitis in influenza A virus infection
Influenza A virus (IAV) in the human and swine host infects epithelial cells lining the respiratory tract causing a necrotizing bronchitis and bronchiolitis. These epithelial surfaces are protected by large glycoproteins called mucins. Mucin 4 (MUC4) is a transmembrane mucin that consists of an alpha subunit responsible for surface protection and intracellular beta subunit involved in signal transduction which repress apoptosis and stimulate epithelial proliferation. This study was designed to determine the expression and potential role of MUC4 during IAV infection. We used immunohistochemistry in combination with machine learning image analysis to quantify differential protein expression of MUC4 subunits in IAV-infected and uninfected lung in a porcine model. MUC4 protein basal expression in control animals varied significantly by litter. MUC4 protein expression was significantly increased in bronchioles with necrotizing bronchiolitis compared to histologically normal bronchioles, likely representing a regenerative response to restore mucosal integrity of conducting airways. Understanding the impact of differential MUC4 expression among healthy individuals and during IAV infection will facilitate control strategies by elucidating mechanisms associated with susceptibility to IAV that can be therapeutically or genetically regulated and may be extended to other respiratory diseases.
60 APPLIED LIFE SCIENCES↗
Explosively driven Richtmyer–Meshkov instability jet suppression and enhancement via coupling machine learning and additive manufacturing
The ability to control the behavior of fluid instabilities at material interfaces, such as the shock-driven Richtmyer–Meshkov instability, is a grand technological challenge with a broad number of applications ranging from inertial confinement fusion experiments to explosively driven shaped charges. In this work, we use a linear-geometry shaped charge as a means of studying methods for controlling material jetting that results from the Richtmyer–Meshkov instability. A shaped charge produces a high-velocity jet by focusing the energy from the detonation of high explosives. The interaction of the resulting detonation wave with a hollowed cavity lined with a thin metal layer produces the unstable jetting effect. By modifying the characteristics of the detonation wave prior to striking the lined cavity, the kinetic energy of the jet can be enhanced or reduced. Modifying the geometry of the liner material can also be used to alter jetting properties. We apply optimization methods to investigate several design parameterizations for both enhancing or suppressing the shaped-charge jet. This is accomplished using 2D and 3D hydrodynamic simulations to investigate the design space that we consider. We also apply new additive manufacturing methods for producing the shaped-charge assemblies, which allow for the experimental testing of complicated design geometries obtained through computational optimization. We present a direct comparison of our optimized designs with experimental results carried out at the High Explosives Application Facility at Lawrence Livermore National Laboratory.
36 MATERIALS SCIENCE↗
Microscopic and Macroscopic Characterization of Grain Boundary Energy and Strength in Silicon Carbide via Machine-Learning Techniques
Predicting the properties of grain boundaries poses a challenge because of the complex relationships between structural and chemical attributes both at the atomic and continuum scales. Grain boundary systems are typically characterized by parameters used to classify local atomic arrangements in order to extract features such as grain boundary energy or grain boundary strength. The present work utilizes a combination of high-throughput atomistic simulations, macroscopic and microscopic descriptors, and machine-learning techniques to characterize the energy and strength of silicon carbide grain boundaries. Additionally, a diverse data set of symmetric tilt and twist grain boundaries are described using macroscopic metrics such as misorientation, the alignment of critical low-index planes, and the Schmid factor, but also in terms of microscopic metrics, by quantifying the local atomic structure and chemistry at the interface. These descriptors are used to create random-forest regression models, allowing for their relative importance to the grain boundary energy and decohesion stress to be better understood. Results show that while the energetics of the grain boundary were best described using the microscopic descriptors, the ability of the macroscopic descriptors to reasonably predict grain boundaries with low energy suggests a link between the crystallographic orientation and the resultant atomic structure that forms at the grain boundary within this regime. For grain boundary strength, neither microscopic nor macroscopic descriptors were able to fully capture the response individually. However, when both descriptor sets were utilized, the decohesion stress of the grain boundary could be accurately predicted. These results highlight the importance of considering both macroscopic and microscopic factors when constructing constitutive models for grain boundary systems, which has significant implications for both understanding the fundamental mechanisms at work and the ability to bridge length scales.
36 MATERIALS SCIENCE↗
A Machine Learning Bias Correction on Large–Scale Environment of High–Impact Weather Systems in E3SM Atmosphere Model
Large–scale dynamical and thermodynamical processes are common environmental drivers of high–impact weather systems causing extreme weather events. However, such large–scale environmental conditions often display systematic biases in climate simulations, posing challenges to evaluating high–impact weather systems and extreme weather events. In this paper, a machine learning (ML) approach was employed to bias correct the large–scale wind, temperature, and humidity simulated by the atmospheric component of the Energy Exascale Earth System Model (E3SM) at ~1° resolution. The usefulness of the ML approach for extreme weather analysis was demonstrated with a focus on three high–impact weather systems, including tropical cyclones (TCs), extratropical cyclones (ETCs), and atmospheric rivers (ARs). We show that the ML model can effectively reduce climate bias in large–scale wind, temperature, and humidity while preserving their responses to imposed climate change perturbations. The bias correction is found to directly improve water vapor transport associated with ARs, and representations of thermodynamical flows associated with ETCs. When the bias–corrected large–scale winds are used to drive a synthetic TC track forecast model over the Atlantic basin, the resulting TC track density agrees better with that of the TC track model driven by observed winds. In addition, the ML model insignificantly interferes with the mean climate change signals of large–scale storm environments as well as the occurrence and intensity of three weather systems. This study suggests that the proposed ML approach can be used to improve the downscaling of extreme weather events by providing more realistic large–scale storm environments simulated by low–resolution climate models.
54 ENVIRONMENTAL SCIENCES↗
Bayesian Calibration of Stochastic Agent Based Model via Random Forest
Agent-based models (ABM) provide an excellent framework for modeling outbreaks and interventions in epidemiology by explicitly accounting for diverse individual interactions and environments. However, these models are usually stochastic and highly parametrized, requiring precise calibration for predictive performance. When considering realistic numbers of agents and properly accounting for stochasticity, this high-dimensional calibration can be computationally prohibitive. This paper presents a random forest-based surrogate modeling technique to accelerate the evaluation of ABMs and demonstrates its use to calibrate an epidemiological ABM named CityCOVID via Markov chain Monte Carlo (MCMC). The technique is first outlined in the context of CityCOVID's quantities of interest, namely hospitalizations and deaths, by exploring dimensionality reduction via temporal decomposition with principal component analysis (PCA) and via sensitivity analysis. The calibration problem is then presented, and samples are generated to best match COVID-19 hospitalization and death numbers in Chicago from March to June in 2020. Further, these results are compared with previous approximate Bayesian calibration (IMABC) results, and their predictive performance is analyzed, showing improved performance with a reduction in computation.
60 APPLIED LIFE SCIENCES↗
Prediction of Creep-Induced Strain Using a Symbolic Regression-Based Model
Material creep under high-temperature conditions limits the lifetime and safety of structural systems such as advanced nuclear reactors. Conventional creep testing is slow and often produces inconsistent results across nominally identical experiments, making lifetime prediction uncertain. Here, to address these challenges, this work develops a data-driven symbolic regression (SR) model that consolidates results from duplicate creep tests and predicts the remaining strain-time curve of an ongoing experiment. The method uses piece-wise multi-objective SR with physical constraints to generate analytic, interpretable functions describing transient creep strain. Applied to Inconel Alloy 617 data, the approach achieved relative mean absolute errors of 1.0–9.5%, providing closed-form predictions of strain evolution. These results demonstrate a first step toward reducing the duration and cost of long-term creep testing while retaining physically interpretable model forms.
11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
Multi-modal characterization and simulation of human epileptic circuitry
Temporal lobe epilepsy is the fourth most common neurological disorder, with about 40% of patients not responding to pharmacological treatment. Increased cellular loss is linked to disease severity and pathological phenotypes such as heightened seizure propensity. While the hippocampus is the target of therapeutic interventions, the impact of the disease at the cellular level remains unclear. Here, we show that hippocampal granule cells change with disease progression as measured in living, resected hippocampal tissue excised from patients with epilepsy. We show that granule cells increase excitability and shorten response latency while also enlarging in cellular volume and spine density. Single-nucleus RNA sequencing combined with simulations ascribes the changes to three conductances: BK, Cav2.2, and Kir2.1. In a network model, we show that these changes related to disease progression bring the circuit into a more excitable state, while reversing them produces a less excitable, “early-disease-like” state.
60 APPLIED LIFE SCIENCES↗
Analysis of antibodies from HCV elite neutralizers identifies genetic determinants of broad neutralization
The high genetic diversity of hepatitis C virus (HCV) complicates effective vaccine development. We screened a cohort of 435 HCV-infected individuals and found that 2%–5% demonstrated outstanding HCV-neutralizing activity. From four of these patients, we isolated 310 HCV antibodies, including neutralizing antibodies with exceptional breadth and potency. High neutralizing activity was enabled by the use of the VH1-69 heavy-chain gene segment, somatic mutations within CDRH1, and CDRH2 hydrophobicity. Structural and mutational analyses revealed an important role for mutations replacing the serines at positions 30 and 31, as well as the presence of neutral and hydrophobic residues at the tip of the CDRH3. Based on these characteristics, we computationally created a de novo antibody with a fully synthetic VH1-69 heavy chain that efficiently neutralized multiple HCV genotypes. Finally, our findings provide a deep understanding of the generation of broadly HCV-neutralizing antibodies that can guide the design of effective vaccine candidates.
60 APPLIED LIFE SCIENCES↗
Two-dimensional materials for bio-realistic neuronal computing networks
Two-dimensional (2D) van der Waals materials have found broad utility in a diverse range of applications including electronics, optoelectronics, renewable energy, and quantum information technologies. Meanwhile, exponentially growing digital data coupled with the ubiquity of artificial intelligence algorithms have generated significant interest in edge neuromorphic computing as an alternative to centralized cloud computing. The drive to incorporate neuroscience principles into computing hardware is motivated by the low power consumption, parallel processing, and reconfigurability of the human brain. The diverse library of 2D materials with atomic-level thicknesses, exceptional electrostatic tunability, and integration versatility is particularly well-suited for realizing bio-realistic synaptic and neuronal functionality. Here, we summarize past and present work in this field and outline the frontier challenges that have not yet been overcome. Here we also delineate potential solutions and suggest that the neuroscience principles of criticality and synchrony have the potential to inspire breakthrough applications of 2D materials in neuronal computing networks.
36 MATERIALS SCIENCE↗
In-pixel AI for lossy data compression at source for X-ray detectors
Integrating neural networks for data compression directly in the Read-Out Integrated Circuits (ROICs), i.e. the pixelated front-end, would result in a significant reduction in off-chip data transfer, overcoming the I/O bottleneck. Our ROIC test chip (AI-In-Pixel-65) is designed in a 65 nm Low Power CMOS process for the readout of pixelated X-ray detectors. Each pixel consists of an analog front-end for signal processing and a 10b analog-to-digital converter operating at 100KSPS. Here, we compare two non-reconfigurable techniques, Principal Component Analysis (PCA) and an AutoEncoder (AE) as lossy data compression engines implemented within the pixelated area. The PCA algorithm achieves 50$×$ compression, adds one clock cycle latency, and results in a 21% increase in the pixel area. The AE achieves 70$×$ compression, adds 30 clock cycle latency, and results in a similar area increase.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗