Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “performance prediction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,207 records · Page 67
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Deep neural network uncertainty quantification for LArTPC reconstruction

We evaluate uncertainty quantification (UQ) methods for deep learning applied to liquid argon time projection chamber (LArTPC) physics analysis tasks. As deep learning applications enter widespread usage among physics data analysis, neural networks with reliable estimates of prediction uncertainty and robust performance against overconfidence and out-of-distribution (OOD) samples are critical for their full deployment in analyzing experimental data. While numerous UQ methods have been tested on simple datasets, performance evaluations for more complex tasks and datasets are scarce. Here we assess the application of selected deep learning UQ methods on the task of particle classification using the PiLArNet monte carlo 3D LArTPC point cloud dataset. We observe that UQ methods not only allow for better rejection of prediction mistakes and OOD detection, but also generally achieve higher overall accuracy across different task settings. We assess the precision of uncertainty quantification using different evaluation metrics, such as distributional separation of prediction entropy across correctly and incorrectly identified samples, receiver operating characteristic curves (ROCs), and expected calibration error from observed empirical accuracy. We conclude that ensembling methods can obtain well calibrated classification probabilities and generally perform better than other existing methods in deep learning UQ literature.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Sensitivities of time-dependent temperature profile predictions for NSTX with the multi-mode model

The Multi-Mode Model (MMM) for turbulent transport was applied to a large set of well-analyzed discharges from the National Spherical Torus Experiment (NSTX) in order to evaluate its sensitivities to a wide range of plasma conditions. MMM calculations were performed for hundreds of milliseconds in each discharge by performing time-dependent predictive simulations with the 1.5D tokamak integrated modeling code TRANSP. A closely related study (Lestz et al 2025 Plasma Phys. Control. Fusion 67 105029) concluded that MMM predicted electron and ion temperature profiles that were in reasonable agreement with NSTX observations, generally outperforming a different reduced transport model, TGLF. This finding motivates the more thorough investigation of the characteristics of the MMM predictions conducted in this work. The simulations with MMM have electron energy transport dominated by electron temperature gradient modes in the examined discharges with relatively low plasma β (ratio of kinetic plasma pressure to magnetic field pressure) and high collisionality, transitioning to a mixture of different modes for higher β and lower collisionality. The thermal ion diffusivity predicted by MMM is much smaller than the neoclassical contribution, in line with previous experimental analysis of NSTX. Nonetheless, the electron and ion temperature profiles are coupled via collisional energy exchange and thus sensitive to which transport channels are predicted. The time-dependent simulations with MMM are robust to the simulation start time, converging to remarkably similar temperature profiles later during the discharge. MMM typically overpredicts confinement relative to NSTX observations, leading to the prediction of overly steep temperature profiles. Plasmas with spatially broader temperature profiles, higher plasma β, and longer energy confinement times tend to be predicted by MMM with better agreement with the experiment. As a result, these findings provide useful context for understanding the regime-dependent tendencies of MMM in anticipation of self-consistent, time-dependent predictive simulations of NSTX-U discharges with these same modeling tools.

MMM↗
DOE OSTI2023

Identification of novel organic polar materials: A machine learning study with importance sampling

Recent advances in the synthesis of polar molecular materials have produced practical alternatives to ferroelectric ceramics, opening up exciting new avenues for their incorporation into modern electronic devices. However, in order to realize the full potential of polar polymer and molecular crystals for modern technological applications, it is paramount to assemble and evaluate all the available data for such compounds, identifying descriptors that could be associated with an emergence of ferroelectricity. In this paper, we utilized data-driven approaches to judiciously shortlist candidate materials from a wide chemical space that could possess ferroelectric functionalities. A machine learning study with importance sampling was employed to address the challenge of having a limited amount of available data on already-known organic ferroelectrics. Sets of molecular- and crystal-level descriptors were combined with a Random Forest Regression algorithm in order to predict the spontaneous polarization of the shortlisted compounds. First-principles simulations were performed to further validate the predictions obtained from the machine learning model.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Molten‐Salt‐Mediated Chemical Looping Oxidative Dehydrogenation of Ethane with In‐Situ Carbon Capture and Utilization

Abstract The molten‐salt‐mediated oxidative dehydrogenation (MM‐ODH) of ethane (C 2 H 6 ) via a chemical looping scheme represents an effective carbon capture and utilization (CCU) method for the valorization of ethane‐rich shale gas and concurrent mitigation of carbon dioxide (CO 2 ) emissions. Here, stepwise experimentation with Li 2 CO 3 ‐Na 2 CO 3 ‐K 2 CO 3 (LNK) ternary salts (i) assessed how each component of the LNK mixture impacted ethane MM‐ODH performance and (ii) explored physicochemical and thermodynamic mechanisms behind melt‐induced changes to ethylene (C 2 H 4 ) and carbon monoxide (CO) yields. Of fifteen screened LNK compositions, nine exhibited ethylene yields greater than 50 % at 800 °C while maintaining C 2 H 4 selectivities of 85 % or higher. LNK salts rich in Li 2 CO 3 content yielded more ethylene and CO on average than their counterparts, and net CO 2 capture per cycle reached a maximum of ~75 %. Extended MM‐ODH cycling also demonstrated long‐term stability of a high‐performing LNK medium. Density functional theory (DFT) calculations andab initiomolecular dynamics (AIMD) simulations suggested that the molten salt does not directly activate C 2 H 6 . Meanwhile, an empirical model informed by experimental data and reaction thermodynamics adequately predicted overall MM‐ODH performance from LNK composition and provided insights into the system′s primary drivers.

Chemistry↗
DOE OSTI2024

Exploring 2D X-ray diffraction phase fraction analysis with convolutional neural networks: Insights from kinematic-diffraction simulations

Abstract Deep-learning models are effective for analyzing the complex information in 2D X-ray diffraction (XRD) patterns. Accurately collecting parameters of the material sample is crucial during model training, significantly impacting model performance. In this study, we employ a kinematic-diffraction simulator to generate simulated 2D XRD patterns for Ti–6Al–4V alloy, allowing precise control of sample parameters. These simulated patterns are used to train convolutional neural networks, predicting $$\upbeta$$ β -phase volume fractions. The training data set consists exclusively of 2D XRD patterns with pure $$\upalpha$$ α - or pure $$\upbeta$$ β -phase, while the testing set incorporates patterns with intermediate phase volume fraction. In particular, we investigate how the architectures of the model influence prediction reliability and computational performance. Experimental results reveal that, with appropriate training, the convolutional neural network accurately detects intermediate phase volume fractions even trained with only pure-phase patterns, achieving a mean square error accuracy of $$9.4 \times 10^{-4}$$ 9.4 × 10 - 4 . Graphical abstract

Yue, Weiqi↗
DOE OSTI2024

Improving Low‐Cloud Fraction Prediction Through Machine Learning

Abstract In this study, we evaluated the performance of machine learning (ML) models (XGBoost) in predicting low‐cloud fraction (LCF), compared to two generations of the community atmospheric model (CAM5 and CAM6) and ERA5 reanalysis data, each having a different cloud scheme. ML models show a substantial enhancement in predicting LCF regarding root mean squared errors and correlation coefficients. The good performance is consistent across the full spectrums of atmospheric stability and large‐scale vertical velocity. Employing an explainable ML approach, we revealed the importance of including the amount of available moisture in ML models for representing spatiotemporal variations in LCF in the midlatitudes. Also, ML models demonstrated marked improvement in capturing the LCF variations during the stratocumulus‐to‐cumulus transition (SCT). This study suggests ML models' great potential to address the longstanding issues of “too few” low clouds and “too rapid” SCT in global climate models.

Geology↗
DOE OSTI2025

Data-driven modeling of dynamic occupant thermostat override behavior for demand response applications

Buildings consume nearly 40% of global energy and produce similar emissions. Whiletechnological advances address efficiency, occupant behavior causes energy use variations up to 300% between identical buildings. This gap between predicted and actual building performance impacts building design, operations, and grid demand management programs. Through analyses of smart thermostat data from 1,400 single-occupant homes, the researchdemonstrates that occupants respond to 8°F thermostat setpoint changes within a median of 15 minutes, while 2°F changes trigger responses within a median of 30 minutes. This highlights an understudied temporal relationship between thermostat setbacks and response time of occupant behaviors. Models of such behavior dynamics are required to incorporate occupant impacts into building performance simulation. A key contribution of this dissertation is the Thermal Frustration Theory (TFT), which positsthat thermal discomfort driven behaviors are caused by the time-accumulation of discomfort, not simply a temperature deviation threshold or a delay from an initiating event. Using a dataset of 634 thermostats, each with 25+ manual setpoint changes, a comparative analysis of TFT and comfort zone and a delayed response theories demonstrated that personalized TFT models better predict when manual setpoint change occur. This was measured by the area under the curve statistical measure (AUC); all three models perform similarly by a Matthews Correlation Coefficient measure. Higher AUC performance is especially important for modeling occupant behavior in demand response programs where false negatives of rare occupant interactions could adversely affect grid stability. EnergyPlus based simulations were conducted with TFT-derived occupant models, demonstrating the ability to identify parameters of known TFT models from only data observable with smart thermostats, even under the presence of noise from routine overrides. Overall, the dissertation highlights that thermostat interactions are neither static,instantaneous, nor driven solely by the environment. Instead, temporal accumulation of discomfort and routine-based behavior play important roles. The methodology and results offer a pathway towards more accurate modeling of human-building interactions for policy assessment, building design, and demand response programs.

Sharma, Kunind [Northeastern University] (ORCID:00↗
DOE OSTI2025

Effect of particle size and moisture on flow performance of loblolly pine anatomical fractions: Experimental findings and model predictions

The rising energy demand has highlighted biomass as a promising next-generation energy source. However, commercializing biomass-derived energy faces challenges, particularly in handling biomass feedstock. Factors like particle size, shape, moisture content, and surface roughness significantly impact biomass flowability. This study addresses a crucial knowledge gap by examining the effects of particle size and moisture content on the flow behavior and shear properties of different anatomical fractions of loblolly pine (Pinus taeda). The bulk shear behavior was examined using a Schulze ring shear tester, while flow performance was tested through gravity-driven flow experiments in a variable wedge-shape hopper. Results were incorporated into empirical and machine learning-based flow prediction models to evaluate their accuracy and limitations. The study found that samples with higher moisture content show higher unconfined yield strength. The critical arching distance increased with particle size, e.g., from approximately 13 and 33 mm for 2- and 6-mm whole chips, respectively at a 32-degree inclination angle. Conversely, the flow rate decreased for a given hopper opening as particle size increased. For instance, at a 60-mm hopper opening and a 32-degree inclination angle, the mass flow rates for 2- and 6-mm whole chips were 7.83 and 6.42 tonne/h, respectively. The empirical model consistently overpredicted the mass flow rate for all anatomical fractions, while the machine learning model more accurately predicted the central tendency of flow rate but was insensitive to varying tissue proportions. These novel findings provide comprehensive characterization of anatomical fractions, reveal significant combined effects of particle size and moisture content on biomass flow behavior, and demonstrate a better predictive accuracy of a machine learning model, all of which are useful for optimizing material handling strategies and biomass utilization technologies in the industry.

09 - BIOMASS FUELS↗
DOE OSTI2019

Validation of RELAP-7 for Forced Convective and Natural Circulation Reactor Flows

New reactor designs such as small modular reactors and newly proposed passive safety systems rely on natural circulation two-phase flow cooling of the reactor core under accident conditions. Without a pump to drive the flow, the circulation rate is a strong function of void fraction. Under these conditions where the flow rate, pressure drop, and heat transfer are all closely coupled through the mixture density, the accurate prediction of void fraction is pivotal. Furthermore, while these passive systems boast a more reliable cooling option, the sensitivity of the system to two-phase flow instabilities is more likely than in forced convective cooling and can result in dangerous density wave or flow excursion conditions. Improvement of one-dimensional system codes and further development of three-dimensional code capability are all important efforts in addressing these issues. The proposed work is a critical step towards providing confidence through validation of the capability of thermal-hydraulic tools to meet the emerging challenges in reactor simulation. Historically, system analysis codes develop a stiffness over time due to fine-tuning of adjustable code parameters that result in a reluctance or inability to adopt improved models. Therefore, a rigorous effort should be invested in preparation for RELAP-7 to identify required modeling improvements of constitutive relations and validation of the code applicability to the wide range of possible reactor flow conditions. Part of this validation involves the uncertainty quantification which is a critical step in the Code Scaling, Applicability, and Uncertainty (CSAU) methodology and Best-Estimate Plus Uncertainty (BEPU) licensing method. BEPU allows recovery of safety margins and potentially optimizing plant performance, resulting in economic benefit for the reactor operators. Beginning with the collection of past experimental data covering prototypic LWR conditions, this document reviews three critical datasets available for the validation of system codes. The experimental methods, procedures, facilities, instrumentation, and supplementary information are consolidated to aid the validation efforts of this work and future projects. These three datasets (824 conditions) are chosen due to their wide acceptance and demonstrated application for code validation. Two experimental datasets from the Nuclear Power Engineering Corporation (NUPEC) span prototypic conditions of Boiling Water Reactors (BWR) and Pressurized Water Reactors (PWR). These datasets are labeled as the BFBT (BWR Full-size Fine-mesh Bundle Test) and the PSBT (PWR Subchannel and Bundle Test) datasets respectively. The third dataset is taken in an internally heated annulus that is scaled based on a BWR subassembly and includes two-phase flows important to post-blowdown analysis. Together, the datasets consider the full range of pressure and mass flux expected in LWR forced convective flows from steady-state to long term cooling conditions. Recognizing the deficiency of available data under low-pressure, low-flow, a new natural circulation dataset consisting of 107 conditions is obtained. With system pressures ranging between 145 and 950 kPa, natural circulation is driven by a heat flux up to 275 kW/m2 in a 3 m long heated region of the annulus test section which is followed by a 2 m long unheated region before entering a condenser. Stable natural circulation flow rates in this facility were measured to be between 182 and 590 kg/m2-s. Pressure and temperature are measured at ten locations in the facility. In addition, measurements of void fraction, interfacial area concentration, and gas velocity are obtained at five axial locations in the annulus test section. The RELAP5-3D code demonstrates good accuracy for void fraction predictions in BFBT and PSBT benchmarks, but shows relatively large discrepancy in the annulus experiments at lower pressures. In two-phase natural circulation, large oscillations are observed in many system parameters during the simulation of 19 experiment cases which were conducted at low pressures, and the model shows good predictive performance with the remaining 88 experiment cases. However, some discrepancies in void fraction and temperature predictions are found which may require improved constitutive modeling under these low-pressure, low-flow condition. The quantified uncertainty in void fraction predictions in three forced convection benchmarks due to uncertainties in boundary conditions and geometries are relatively small, except for a few cases in the annulus experiment. The output uncertainty of the natural circulation model is quantified by considering the measurement error in boundary conditions, and it is shown that the output uncertainty ranges are relatively small for the range of conditions considered. Through this work, a clear pathway is provided for validation of RELAP7 once the code is available.

42 ENGINEERING↗
DOE OSTI2025

Toward Verification of RANS Simulations of the T-Tube Modular Divertor Using Large Eddy Simulations of Impinging Turbulent Plane Jets

Turbulent impinging jets have been proposed to cool high heat flux plasma-facing components such as the solid tungsten target plates of the divertor in long-pulse magnetic fusion energy reactors. In particular, the T-tube modular divertor, originally developed by the ARIES Team, consists of two concentric cylindrical tubes where helium flows through a slot in the inner tube, forming an approximately planar jet that impinges upon and cools the inner surface of the pressure boundary (namely, the outer tube) and the ~15-cm 2 plasma-facing W target. The objective of this work is to demonstrate that large eddy simulations (LESs) accurately simulate the thermal transport in canonical flows that comprise the cooling flow in the T-tube, as well as validate temperatures from LES with experimental measurements in a simplified T-tube geometry. Wall‑resolved LESs, validated by experimental data and verified by direct numerical simulations (DNSs), provide benchmark data for two canonical flows in the T‑tube, namely, planar impinging and wall jets, for Reynolds numbers Re B = 4 × 10 3 to 2 × 10 4 . Our LES results are within 4% to 12% root-mean-square error (RMSE) of surface Nusselt number distributions (Nu) from experiments and DNSs. The validated LES results are then used as the ground truth to evaluate four Reynolds‑averaged Navier-Stokes (RANS) turbulence closures, namely, the k‑ω SST, realizable k‑ε, GEKO, and γ‑SST models. The k‑ω SST model has the best overall performance in terms of heat transfer, giving surface Nu within 12% RMSE of the LES results for high‑ReB impinging jets and reduced overprediction in the wall‑jet region. The GEKO model with default constants has the next best performance, providing slightly better Nu predictions for low ReB impinging jets (versus k-ω SST) but worse overall performance over the full range of ReB studied here. The realizable k‑ε turbulence model significantly overestimates turbulence near the stagnation point, while the γ‑SST model suppresses near‑wall production, biasing the simulations toward simulating laminar surface heat transfer. Simulations of the simplified T‑tube show that LES and RANS simulations with the k‑ω SST model give nearly identical average heat transfer coefficients (HTCs) over the impingement surface. The realizable k‑ε model predicts significantly lower wall temperatures due to overestimation of HTC in the outlet flow.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Phase-field modeling for restructuring in the dark zone of high burnup UO 2

This report summarizes the mesoscale modeling work performed in fiscal year 2024 under the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program to capture the microstructural evolution and restructuring observed in the dark regions of high burnup UO 2 nuclear fuel. This is the first attempt to realistically simulate the restructuring behavior observed in different region of a high burnup fuel. We employ a grand-potential based phase-field model to concurrently evaluate the formation of subgrains and growth of fission bubbles within the fuel. A energy-based subgrain formation criteria is introduced to simulate the restructuring process. Effect of different initial conditions and different modeling parameters are studies systematically to capture how each of these parameters influence the characteristics of the restructured fuel. It is observed that the subgrain formation begins around existing fission gas bubbles and then proceeds towards triple junctions, grain boundaries and grain interiors. It is demonstrated that restructuring is influenced by a combination of initial dislocation densities, subgrain formation rate, and temperature. Rate of restructuring increases with increase in fuel temperature. A restructuring bias is observed within the microstructure due to variation in defect accumulation among different grains. Furthermore, bubble sizes and distribution does not have a significant effect on rate of restructuring. The predicted microstructures resembles the characteristics of the restructured regions as observed in experiments. Finally, a correlation is presented that demonstrates the evolution of the restructuring volume fraction as a function of local effective burnup. This work provides a first of its kind restructuring model for darkzone that can be used by BISON for performance prediction of high burnup UO 2 fuel.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Modeling and Scaling up of Membrane Modules Leveraging Dimensional Analysis

In the current analysis, we study the separation performance using membrane modules through dimensional analysis (DA). We formulate the main process equations to identify relevant dimensionless numbers inherent in the physics. In particular, we identify that the critical step in the separation process is mass transfer through the selective layer. Remarkably, the dimensionless feed flow (DFfeed) emerges as a crucial factor in describing this process. Not only does DFfeed directly appear in the governing equations, but it also holds a physical significance associated with the time scales for the mass transfer across the feed side and through the selective layer. Regarding the output performance variables, we consider the recovery, stage cut, productivity and purity. In this context, we profit from experimental data and CFD simulations to evaluate the separation performance of the modules when varying the input flowrate, the scale of the module, and the CO2 permeance. These datasets enable us to establish correlations between performance metrics and the dimensionless feed flow. Using simple power functions of DFfeed, we obtain R2 coefficients exceeding 0.99, indicating the accuracy of the correlations built in the present work. In the future, we wish to use DA to understand key transport mechanisms, predict and control module performance, and challenge the universality of these findings by testing various gas separations across different membrane modules beyond our case study.

Pedrozo, Hector A.↗
DOE OSTI2024

Carbon Capture through Membranes - Leveraging Multiphysics Modeling, Dimensional Analysis and Machine Learning to Scale up and Optimize Devices and Processes for Decarbonization

We study the separation performance using membrane modules through dimensional analysis (DA). We formulate the main process equations to identify relevant dimensionless numbers inherent in the physics. In particular, we identify that the critical step in the separation process is mass transfer through the selective layer. Remarkably, the dimensionless feed flow (DFfeed) emerges as a crucial factor in describing this process. Not only does DFfeed directly appear in the governing equations, but it also holds a physical significance associated with the time scales for the mass transfer across the feed side and through the selective layer. Regarding the output performance variables, we consider the recovery, stage cut, productivity and purity. In this context, we profit from experimental data and CFD simulations to evaluate the separation performance of the modules when varying the input flowrate, the scale of the module, and the CO2 permeance. These datasets enable us to establish correlations between performance metrics and the dimensionless feed flow (DFfeed). Using simple power functions of DFfeed, we obtain R2 coefficients exceeding 0.99, indicating the accuracy of the correlations built in the present work. In the future, we wish to use DA to understand key transport mechanisms, predict and control module performance, and challenge the universality of these findings by testing various gas separations across different membrane modules beyond our case study.

Pedrozo, Hector A.↗
DOE OSTI2025

Graph-Based Prediction of Spatio-Temporal Vaccine Hesitancy From Insurance Claims Data

Growing vaccine hesitancy is contributing to the decline in immunization rates for highly contagious, vaccine-preventable childhood diseases. Therefore, there has been a significant interest in understanding how hesitancy is spreading at higher spatio-temporal resolutions, enabling more targeted interventions. Motivated by this, we study the problem of prediction of vaccine hesitancy at the ZIP Code level, referred to as the VaxHesitancy problem. A significant challenge for this problem is the lack of high-resolution data that indicates hesitancy. Here, we develop a hybrid VaxHesSTL framework that combines a Graph Neural Network (GNN) and a Recurrent Neural Network (RNN) to address the VaxHesitancy problem. The GNN uses a ZIP Code-level network to capture spatial signals from neighboring areas, while the RNN models the temporal dynamics present in the data. We train and evaluate VaxHesSTL using a large dataset, namely the All-Payer Claims Databases (APCD), for Virginia, consisting of insurance claims from over five million individuals for six years. We find that an aggregated contact network or graph, developed from a detailed activity-based population network, plays an important role in the performance of VaxHesSTL, compared to graph models based solely on spatial proximity. Experiments demonstrate that VaxHesSTL outperforms a range of state-of-the-art baselines, which rely solely on historical time series data without accounting for spatial relationships. Since hesitancy data at higher spatial resolution is often unavailable or hard to get, we incorporate an active learning approach with our VaxHesSTL framework to optimize the training set without compromising the prediction performance. We find that hesitancy data for only 18% of ZIP Codes selected by active learning allows us to forecast hesitancy for all the ZIP Codes in the Virginia.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2026

Direct Ab Initio Simulation of the Synthesis of BaZrO 3 and the Microstructure Impacts on Proton Transport

Controlling and predicting the processing-structure-performance relationship in functional materials is a grand challenge in materials science, with important implications for a wide range of emerging applications; a high fidelity understanding of the performance impact of microstructures formed under synthesis conditions is required to develop advanced materials, such as solid-state fuel cells and electrolyzers. Using the ceramic BaZrO 3 as a case study, we directly simulate the synthesis and investigate how proton transport is dictated by microstructures. We develop a framework that couples density functional theory (DFT), machine-learning interatomic potential (MLIP) driven molecular dynamics, and grand canonical Monte Carlo to perform large-scale, microstructure-resolved, atomistic simulations of proton transport in experimentally representative polycrystalline structures. Our fully ab initio approach, using a MLIP as a proxy for DFT, allows us to quantify the competition between two distinct diffusion mechanisms: one associated with grain-boundary regions and another within grains. When the impacts of grain boundaries are taken into account, proton transport exhibits substantial deviation from the bulk oxide limit. This addresses long-standing discrepancies between theory and experiments. Our integrated approach provides atomistic insight into microstructure-dependent proton pathways in BaZrO 3 and establishes a general protocol for predicting processing-structure-performance relationships.

organic↗
DOE OSTI2021

Accurate and scalable graph neural network force field and molecular dynamics with direct force architecture

Abstract Recently, machine learning (ML) has been used to address the computational cost that has been limiting ab initio molecular dynamics (AIMD). Here, we present GNNFF, a graph neural network framework to directly predict atomic forces from automatically extracted features of the local atomic environment that are translationally-invariant, but rotationally-covariant to the coordinate of the atoms. We demonstrate that GNNFF not only achieves high performance in terms of force prediction accuracy and computational speed on various materials systems, but also accurately predicts the forces of a large MD system after being trained on forces obtained from a smaller system. Finally, we use our framework to perform an MD simulation of Li 7 P 3 S 11 , a superionic conductor, and show that resulting Li diffusion coefficient is within 14% of that obtained directly from AIMD. The high performance exhibited by GNNFF can be easily generalized to study atomistic level dynamics of other material systems.

Chemistry↗
DOE OSTI2022

Prescreening-Based Subset Selection for Improving Predictions of Earth System Models With Application to Regional Prediction of Red Tide

We present the ensemble method of prescreening-based subset selection to improve ensemble predictions of Earth system models (ESMs). In the prescreening step, the independent ensemble members are categorized based on their ability to reproduce physically-interpretable features of interest that are regional and problem-specific. The ensemble size is then updated by selecting the subsets that improve the performance of the ensemble prediction using decision relevant metrics. We apply the method to improve the prediction of red tide along the West Florida Shelf in the Gulf of Mexico, which affects coastal water quality and has substantial environmental and socioeconomic impacts on the State of Florida. Red tide is a common name for harmful algal blooms that occur worldwide, which result from large concentrations of aquatic microorganisms, such as dinoflagellate Karenia brevis, a toxic single celled protist. We present ensemble method for improving red tide prediction using the high resolution ESMs of the Coupled Model Intercomparison Project Phase 6 (CMIP6) and reanalysis data. The study results highlight the importance of prescreening-based subset selection with decision relevant metrics in identifying non-representative models, understanding their impact on ensemble prediction, and improving the ensemble prediction. These findings are pertinent to other regional environmental management applications and climate services. Additionally, our analysis follows the FAIR Guiding Principles for scientific data management and stewardship such that data and analysis tools are findable, accessible, interoperable, and reusable. As such, the interactive Colab notebooks developed for data analysis are annotated in the paper. This allows for efficient and transparent testing of the results’ sensitivity to different modeling assumptions. Moreover, this research serves as a starting point to build upon for red tide management, using the publicly available CMIP, Coordinated Regional Downscaling Experiment (CORDEX), and reanalysis data.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Uncertainty quantification in machine learning for engineering design and health prognostics: A tutorial

On top of machine learning (ML) models, uncertainty quantification (UQ) functions as an essential layer of safety assurance that could lead to more principled decision making by enabling sound risk assessment and management. The safety and reliability improvement of ML models empowered by UQ has the potential to significantly facilitate the broad adoption of ML solutions in high-stakes decision settings, such as healthcare, manufacturing, and aviation, to name a few. In this tutorial, we aim to provide a holistic lens on emerging UQ methods for ML models with a particular focus on neural networks and the applications of these UQ methods in tackling engineering design as well as prognostics and health management problems. Towards this goal, we start with a comprehensive classification of uncertainty types, sources, and causes pertaining to UQ of ML models. Next, we provide a tutorial-style description of several state-of-the-art UQ methods: Gaussian process regression, Bayesian neural network, neural network ensemble, and deterministic UQ methods focusing on spectral-normalized neural Gaussian process. Established upon the mathematical formulations, we subsequently examine the soundness of these UQ methods quantitatively and qualitatively (by a toy regression example) to examine their strengths and shortcomings from different dimensions. Then, we review quantitative metrics commonly used to assess the quality of predictive uncertainty in classification and regression problems. Afterward, we discuss the increasingly important role of UQ of ML models in solving challenging problems in engineering design and health prognostics. In conclusion, two case studies with source codes available on GitHub are used to demonstrate these UQ methods and compare their performance in the life prediction of lithium-ion batteries at the early stage (case study 1) and the remaining useful life prediction of turbofan engines (case study 2).

97 MATHEMATICS AND COMPUTING↗