Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “predictability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,117 records · Page 62

Empirical thermophotovoltaic performance predictions and limits

Significant progress has been made in the field of thermophotovoltaics, with efficiency recently rising to over 40% due to improvements in cell design and material quality, higher emitter temperatures, and better spectral management. However, inconsistencies in trends for efficiency with semiconductor bandgap energy across various temperatures pose challenges in predicting optimal bandgaps or expected performance for different applications. To address these issues, here we present realistic performance predictions for various types of single-junction cells over a broad range of emitter temperatures using an empirical model based on past cell measurements. Our model is validated using data from different authors with various bandgaps and emitter temperatures, and an excellent agreement is seen between the model and the experimental data. Using our model, we show that in addition to spectral losses, it is important to consider practical electrical losses associated with series resistance and cell quality to avoid overestimation of system efficiency. Here, we also show the effect of modifying various system parameters such as bandgap, above and below-bandgap reflectance, saturation current, and series resistance on the efficiency and power density of thermophotovoltaics at different temperatures. Finally, we predict the bandgap energies for best performance over a range of emitter temperatures for different cell material qualities.

14 SOLAR ENERGY↗

Predicting Local Material Thickness from Steady-State Ultrasonic Wavefield Measurements Using a Convolutional Neural Network

Acoustic steady-state excitation spatial spectroscopy (ASSESS) is a full-field, ultrasonic non-destructive evaluation (NDE) technique used to locate and characterize defects in plate-like structures. ASSESS generates a steady-state, single-tone ultrasonic excitation in a structure and a scanning laser Doppler Vibrometer (LDV) measures the resulting full-field surface velocity response. Traditional processing techniques for ASSESS data rely on wavenumber domain analysis. This paper presents the alternative use of a convolutional neural network (CNN), trained using simulated ASSESS data, to predict the local plate thickness at every pixel in the wavefield measurement directly. The defect detection accuracy of CNN-based thickness predictions are shown to improve for defects of greater size, and for defects with higher thickness reductions. The CNN demonstrates the ability to predict thickness accurately in regions where Lamb wave dispersion relations are complex or unknown, such as near the boundaries of a test specimen, so long as the CNN is trained on data that accounts for these regions. The CNN also shows generalizability to ASSESS experimental data, despite an entirely simulated training dataset.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Early calendar life and health prediction of silicon batteries via machine learning with uncertainty quantification

Lithium-ion batteries with silicon anodes promise high energy density but are limited by calendar lifetime. Reducing the long iteration time to obtain experimental results requires predicting calendar lifetime early in a cell's life. In this study, we demonstrate that lightweight machine learning models with feature engineering can provide calendar lifetime estimates from early electrochemical signals. After 1 month of electrochemical aging, the best models achieve 10% error in calendar-life prediction and can separate "bad" from "good" lifetime cells with a mean F1 score of 0.857. As battery systems exhibit inherent variability, four methods for uncertainty quantification are compared, and confidence intervals are demonstrated with an uncertainty of +-3.6 months in lifetime prediction. A feature importance analysis indicates that early patterns in voltage decay are the strongest indicators of calendar lifetime. Finally, this modeling approach has high error when generalizing to new electrode chemistries or testing conditions but with appropriately low confidence.

25 ENERGY STORAGE↗

Building predictive signaling models by perturbing yeast cells with time-varying stimulations resulting in distinct signaling responses

This protocol provides a step-by-step approach to perturb single cells with time-varying stimulation profiles, collect distinct signaling responses, and use these to infer a system of ordinary differential equations to capture and predict dynamics of protein-protein regulation in signal transduction pathways. The models are validated by predicting the signaling activation upon new cell stimulation conditions. In comparison to using standard step-like stimulations, application of diverse time-varying cell stimulations results in better inference of model parameters and substantially improves model predictions. For complete details on the use and results of this protocol, please refer to Jashnsaz et al. (2020).

59 BASIC BIOLOGICAL SCIENCES↗

A structure-preserving machine learning framework for accurate prediction of structural dynamics for systems with isolated nonlinearities

The nonlinearities present in structural systems are often found in isolated regions within the structure, such as those containing joints or interfaces. However, despite the localized nature of these nonlinearities their presence serves to couple together the modes of the underlying linear system and significantly complicate the development of appropriate reduced-order models; the localized nonlinearities have a global effect on the dynamics of the system. Further, in the presence of evolving structural health the nonlinearities can arise from accumulating damage, with dynamics distinct from those observed in the healthy state. The present work develops a data-driven formulation to identify and include the contributions of the isolated nonlinearities on the dynamics of the underlying linear structure. A novel coordinate separation is developed that decomposes those nonlinearities restricted to the isolated subdomain from the known linear system defined over the entire domain, and the influence of the isolated nonlinearities is reintroduced as an appropriately identified traction at the boundary of the isolated subdomain, referred to as the deviatoric force. In the region exterior to the nonlinear subdomain the response of the ideal linear system recovers that of the original nonlinear system. In this work, the deviatoric force component is predicted using a structure-preserving multilayer perceptron, based only on measured responses at the boundary of the isolated subdomain. Therefore introduction of the perceptron is able to bypass the direct numerical simulation of the nonlinearities within the isolated subdomain. This approach is illustrated through a simple structural system in which an interior region contains cubic nonlinearities and hysteretic damping. Once trained, the machine learning system is able to accurately predict the deviatoric force so that the ideal system recovers the response of the original system in the region outside the isolated nonlinear subdomain. Moreover, the data-driven approach is able to accurately predict the response when the system is subject to differing initial conditions and external excitation without the need for retraining, so that the proposed approach provides a robust description of the structural dynamics of the overall system.

Machine learning↗

Amundsen Sea Embayment ice-sheet mass-loss predictions to 2050 calibrated using observations of velocity and elevation change

Mass loss from the Amundsen Sea Embayment of the West Antarctic Ice Sheet is a major contributor to global sea-level rise (SLR) and has been increasing over recent decades. Predictions of future SLR are increasingly modelled using ensembles of simulations within which model parameters and external forcings are varied within credible ranges. Accurately reporting the uncertainty associated with these predictions is crucial in enabling effective planning for, and construction of defences against, rising sea levels. Calibrating model simulations against current observations of ice-sheet behaviour enables the uncertainty to be reduced. Here we calibrate an ensemble of BISICLES ice-sheet model simulations of ice loss from the Amundsen Sea Embayment using remotely sensed observations of surface elevation and ice speed. Each calibration type is shown to be capable of reducing the 90% credibility bounds of predicted contributions to SLR by 34 and 43% respectively.

54 ENVIRONMENTAL SCIENCES↗

Predictions of core plasma performance for the SPARC tokamak

SPARC is designed to be a high-field, medium-size tokamak aimed at achieving net energy gain with ion cyclotron range-of-frequencies (ICRF) as its primary auxiliary heating mechanism. Empirical predictions with conservative physics indicate that SPARC baseline plasmas would reach $\textit{Q}$ ≈ 11, which is well above its mission objective of $\textit{Q}$ > 2. To build confidence that SPARC will be successful, physics-based integrated modelling has also been performed. The TRANSP code coupled with the theory-based trapped gyro-Landau fluid (TGLF) turbulence model and EPED predictions for pedestal stability find that $\textit{Q}$ ≈ 9 is attainable in standard H-mode operation and confirms $\textit{Q}$ > 2 operation is feasible even with adverse assumptions. In this analysis, ion cyclotron waves are simulated with the full wave TORIC code and alpha heating is modelled with the Monte–Carlo fast ion NUBEAM module. Detailed analysis of expected turbulence regimes with linear and nonlinear CGYRO simulations is also presented, demonstrating that profile predictions with the TGLF reduced model are in reasonable agreement.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Predicting the Phase Stability of Multicomponent High-Entropy Compounds

A generic method to estimate the relative feasibility of formation of high-entropy compounds in a single phase, directly from first principles, is developed. As a first step, the relative formation abilities of 56 multicomponent, AO, oxides were evaluated. These were constructed from five cation combinations chosen from A = {Ca, Co, Cu, Fe, Mg, Mn, Ni, Zn}. Candidates for multicomponent oxides are predicted from descriptors related to the enthalpy and configurational entropy obtained from the mixing enthalpies of two-component oxides. The utility of this approach is evaluated by comparing the predicted combinations with the experimentally realized entropy-stabilized oxide, (MgCoCuNiZn)O. In the second step, Monte Carlo simulations are utilized to investigate the phase composition and local ionic segregation as a function of temperature. This approach allows for the evaluation of potential secondary phases, thereby making realistic predictions of novel multicomponent compounds that can be synthesized.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Machine Learning Prediction of the Critical Cooling Rate for Metallic Glasses from Expanded Datasets and Elemental Features

In this study, we use a random forest (RF) model to predict the critical cooling rate (R C ) for glass formation of various alloys from features of their constituent elements. The RF model was trained on a database that integrates multiple sources of direct and indirect R C data for metallic glasses to expand the directly measured R C database of less than 100 values to a training set of over 2000 values. The model error on 5-fold cross-validation (CV) is 0.66 orders of magnitude in K/s. The error on leave-out-one-group CV on alloy system groups is 0.59 log units in K/s when the target alloy constituents appear more than 500 times in training data. Using this model, we make predictions for the set of compositions with melt-spun glasses in the database and for the full set of quaternary alloys that have constituents which appear more than 500 times in training data. These predictions identify a number of potential new bulk metallic glass systems for future study, but the model is most useful for the identification of alloy systems likely to contain good glass formers rather than detailed discovery of bulk glass composition regions within known glassy systems.

36 MATERIALS SCIENCE↗

Improving Enzyme Optimum Temperature Prediction with Resampling Strategies and Ensemble Learning

Accurate prediction of the optimal catalytic temperature ( T opt ) of enzymes is vital in biotechnology, as enzymes with high T opt values are desired for enhanced reaction rates. Recently, a machine learning method (temperature optima for microorganisms and enzymes, TOME) for predicting T opt was developed. TOME was trained on a normally distributed data set with a median T opt of 37 °C and less than 5% of T opt values above 85 °C, limiting the method’s predictive capabilities for thermostable enzymes. Due to the distribution of the training data, the mean squared error on T opt values greater than 85 °C is nearly an order of magnitude higher than the error on values between 30 and 50 °C. Here, we apply ensemble learning and resampling strategies that tackle the data imbalance to significantly decrease the error on high T opt values (>85 °C) by 60% and increase the overall R 2 value from 0.527 to 0.632. The revised method, temperature optima for enzymes with resampling (TOMER), and the resampling strategies applied in this work are freely available to other researchers as Python packages on GitHub.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Multifidelity Neural Network Formulations for Prediction of Reactive Molecular Potential Energy Surfaces

Here, this paper focuses on the development of multifidelity modeling approaches using neural network surrogates, where training data arising from multiple model forms and resolutions are integrated to predict high-fidelity response quantities of interest at lower cost. We focus on the context of quantum chemistry and the integration of information from multiple levels of theory. Important foundations include the use of symmetry function-based atomic energy vector constructions as feature vectors for representing structures across families of molecules and single-fidelity neural network training capabilities that learn the relationships needed to map feature vectors to potential energy predictions. These foundations are embedded within several multifidelity topologies that decompose the high-fidelity mapping into model-based components, including sequential formulations that admit a general nonlinear mapping across fidelities and discrepancy-based formulations that presume an additive decomposition. Methodologies are first explored and demonstrated on a pair of simple analytical test problems and then deployed for potential energy prediction for C 5 H 5 using B2PLYP-D3/6-311++G(d,p) for high-fidelity simulation data and Hartree–Fock 6-31G for low-fidelity data. For the common case of limited access to high-fidelity data, our computational results demonstrate that multifidelity neural network potential energy surface constructions achieve roughly an order of magnitude improvement, either in terms of test error reduction for equivalent total simulation cost or reduction in total cost for equivalent error.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Acceleration of Graph Neural Network-Based Prediction Models in Chemistry via Co-Design Optimization on Intelligence Processing Units

Atomic structure prediction and associated property calculations are the bedrock of chemical physics. Since high-fidelity ab initio modeling techniques for computing the structure and properties can be prohibitively expensive, this motivates the development of machine-learning (ML) models that make these predictions more efficiently. Training graph neural networks over large atomistic databases introduces unique computational challenges such as the need to process millions of small graphs with variable size and support communication patterns that are distinct from learning over large graphs such as social networks. We demonstrate a novel hardware-software co-design approach to scale up the training of atomistic graph neural networks (GNN) for structure and property prediction. First, to eliminate redundant computation and memory associated with alternative padding techniques and to improve throughput via minimizing communication, we formulate the effective coalescing of the batches of variable-size atomistic graphs as the bin packing problem and introduce a hardware-agnostic algorithm to pack these batches. In addition, we propose hardware-specific optimizations including a planner and vectorization for the gather-scatter operations targeted for Graphcore’s Intelligence Processing Unit (IPU), as well as model-specific optimizations such as merged communication collectives and optimized softplus. Putting these all together, we demonstrate the effectiveness of the proposed co-design approach by providing an implementation of a well-established atomistic GNN on the Graphcore IPUs. We evaluate the training performance on multiple atomistic graph databases with varying degrees of graph counts, sizes and sparsity. Here, we demonstrate that such a co-design approach can reduce the training time of atomistic GNNs and can improve the performance by up to 1.5× compared to the baseline implementation of the model on the IPUs. Additionally, we compare our IPU implementation with a Nvidia GPU-based implementation and show that our atomistic GNN implementation on the IPUs can run 1.8× faster on average compared to the execution time on the GPUs.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

HEPOM: Using Graph Neural Networks for the Accelerated Predictions of Hydrolysis Free Energies in Different pH Conditions

Hydrolysis is a fundamental family of chemical reactions where water facilitates the cleavage of bonds. The process is ubiquitous in biological and chemical systems, owing to water’s remarkable versatility as a solvent. However, accurately predicting the feasibility of hydrolysis through computational techniques is a difficult task, as subtle changes in reactant structure like heteroatom substitutions or neighboring functional groups can influence the reaction outcome. Furthermore, hydrolysis is sensitive to the pH of the aqueous medium, and the same reaction can have different reaction properties at different pH conditions. In this work, we have combined reaction templates and high-throughput ab initio calculations to construct a diverse data set of hydrolysis free energies. The developed framework automatically identifies reaction centers, generates hydrolysis products, and utilizes a trained graph neural network (GNN) model to predict ΔG values for all potential hydrolysis reactions in a given molecule. The long-term goal of the work is to develop a data-driven, computational tool for high-throughput screening of pH-specific hydrolytic stability and the rapid prediction of reaction products, which can then be applied in a wide array of applications including chemical recycling of polymers and ion-conducting membranes for clean energy generation and storage.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

CAML: Commutative Algebra Machine Learning─A Case Study on Protein–Ligand Binding Affinity Prediction

Recently, Suwayyid and Wei introduced commutative algebra as an emerging paradigm for machine learning and data science. In this work, we propose commutative algebra machine learning (CAML) for the prediction of protein−ligand binding affinities. Specifically, we apply persistent Stanley−Reisner theory, a key concept in combinatorial commutative algebra, to the affinity predictions of protein−ligand binding and metalloprotein−ligand binding. We present three new algorithms, i.e., element-specific commutative algebra, category-specific commutative algebra, and commutative algebra on bipartite complexes, to tackle the complexity of data involved in (metallo) protein−ligand complexes. We show that the proposed CAML outperforms other state-of-theart methods in (metallo) protein−ligand binding affinity predictions, indicating the great potential of commutative algebra learning.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Method for accurately predicting solvation structure

Accurately predicting the molecular structure of solutions is a fundamental scientific challenge. Using quantum mechanical density functional theory (DFT) to make these predictions is hindered by significant variation depending on which DFT functional is used. Here, we present a simple metric that can determine the reliability of a DFT functional for predicting solvation structure. We then show that including a simple interaction term to correct this metric leads to quantitative agreement with experimental measurements of liquid structure. We demonstrate the utility of this method by using it to accurately describe the hydration structure around the Na+ a

basis sets, molecular structure, cluster chemistry↗

Two-Dimensional Energy Histograms as Features for Machine Learning to Predict Adsorption in Diverse Nanoporous Materials

A major obstacle for machine learning (ML) in chemical science is the lack of physically informed feature representations that provide both accurate prediction and easy interpretability of the ML model. In this work, we describe adsorption systems using novel two-dimensional energy histogram (2D-EH) features, which are obtained from the probe-adsorbent energies and energy gradients at grid points located throughout the adsorbent. The 2D-EH features encode both energetic and structural information of the material and lead to highly accurate ML models (coefficient of determination R2 ~ 0.94–0.99) for predicting single-component adsorption capacity in metal–organic frameworks (MOFs). Here, we consider the adsorption of spherical molecules (Kr and Xe), linear alkanes with a wide range of aspect ratios (ethane, propane, n-butane, and n-hexane), and a branched alkane (2,2-dimethylbutane) over a wide range of temperatures and pressures. The interpretable 2D-EH features enable the ML model to learn the basic physics of adsorption in pores from the training data. We show that these MOF-data-trained ML models are transferrable to different families of amorphous nanoporous materials. We also identify several adsorption systems where capillary condensation occurs, and ML predictions are more challenging. Nevertheless, our 2D-EH features still outperform structural features including those derived from persistent homology. The novel 2D-EH features may help accelerate the discovery and design of advanced nanoporous materials using ML for gas storage and separation in the future.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Understanding and Predicting the Spatially Resolved Adsorption Properties of Nanoporous Materials

Using knowledge from statistical thermodynamics and crystallography, we develop an image–image translation model, called SorbIIT, that uses three-dimensional grids of adsorbate–adsorbent interaction energies as input to predict the spatially resolved loading surface of nanoporous materials over a broad range of temperatures and pressures. SorbIIT consists of a closed-form differential model for loading-surface prediction and a U-Net to generate spatial differential distributions from the energy grids. SorbIIT is trained using the energy grids and adsorbate distributions (obtained from high-throughput simulations) of 50 synthesized and 70 hypothetical zeolites and applied for predicting the adsorption of carbon dioxide, hydrogen sulfide, n-butane, 2-methylpropane, krypton, and xenon in other zeolites from 256 to 400 K. In conclusion, employing a quadratic isotherm model for the local differentiation, SorbIIT yields mean R 2 values of 0.998 for total adsorption and 0.6904 for local adsorption with a resolution of 0.2 Å, and a value of 0.721 for the structural similarity of the local loading distribution.

Sun, Yangzesheng↗

Systematic Improvement of Quantum Monte Carlo Calculations in Transition Metal Oxides: sCI-Driven Wavefunction Optimization for Reliable Band Gap Prediction

Accurate determination of the electronic properties of correlated oxides remains a significant challenge for computational theory. Traditional Hubbard-corrected density functional theory (DFT+U) frequently encounters limitations in precisely capturing electron correlation, particularly in predicting band gaps. We introduce a systematic methodology to enhance the accuracy of diffusion Monte Carlo (DMC) simulations for both ground and excited states, focusing on LiCoO 2 as a case study. By employing a selected configuration interaction (sCI) approach, we demonstrate the capability to optimize wavefunctions beyond the constraints of single-reference DFT+U trial wavefunctions. Here, we show that the sCI framework enables accurate prediction of band gaps in LiCoO 2 , closely aligning with experimental values and substantially improving traditional computational methods. The study uncovers a nuanced mixed state of t 2g and e g orbitals at the band edges that is not captured by conventional single-reference methods, further elucidating the limitations of PBE+U in describing d-d excitations. Our findings advocate for the adoption of beyond-DFT methodologies, such as sCI, to capture the essential physics of excited-state wavefunctions in strongly correlated materials. The improved accuracy in band gap predictions and the ability to generate more reliable trial wavefunctions for DMC calculations underscore the potential of this approach for broader applications in the study of correlated oxides. This work not only provides a pathway for more accurate simulations of electronic structures in complex materials but also suggests a framework for future investigations of the excited states of other challenging systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗