Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “predictive”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Predicting Drug Effects from High-dimensional Asymmetric Drug Data Sets using Graph Neural Networks: A Comprehensive Analysis of Multi-target Drug Effect Prediction

Graph neural networks (GNNs) have emerged as one of the most effective Machine learning (ML) techniques for drug effect prediction from drug molecular graphs. Despite having immense potential, GNN models lack performance when using data sets that contain high dimensional asymmetrically co-occurrent drug effects as targets with complex correlations between them. Training individual learning models for each drug effect and incorporating every prediction result for a wide spectrum of drug effects is beyond practicality. Such an implication provides a testbed to address this challenge as multi-target prediction problems, aiming to predict all drug effects at a time. We develop standard and hybrid graph neural networks (GNNs)to perform two separate tasks that are multi-regression for continuous values and multi-label classification for categorical values contained in our data sets. Since this step makes the target data even more sparse and introduces asymmetric label co-occurrence, the learning of multi-label classification models becomes difficult and heavily impacts the GNN's performance. To address these challenges, we propose a new data oversampling technique to improve multi-label classification performances on all the given imbalanced molecular graph data sets. Using the technique, we improve the data imbalance ratio of the drug effects better than before while protecting the data set's integrity. Finally, we evaluate multi-label classification performance using the best-performant hybrid GNN model on all the oversampled data sets obtained from the proposed oversampling technique. These results outperform those of other ML models including GNN models when they are trained on the original data sets or oversampled data sets using MLSMOTE (a well-known oversampling technique) in all evaluation metrics precision, recall, and F1 score by a significant margin.

Bose, Avishek [ORNL]↗

AI-Enabled Operations at Fermi Complex: Multivariate Time Series Prediction for Outage Prediction and Diagnosis

The Main Control Room of the Fermilab accelerator complex continuously gathers extensive time-series data from thousands of sensors monitoring the beam. However, unplanned events such as trips or voltage fluctuations often result in beam outages, causing operational downtime. This downtime not only consumes operator effort in diagnosing and addressing the issue but also leads to unnecessary energy consumption by idle machines awaiting beam restoration. The current threshold-based alarm system is reactive and faces challenges including frequent false alarms and inconsistent outage-cause labeling. To address these limitations, we propose an AI-enabled framework that leverages predictive analytics and automated labeling. Using data from $2,703$ Linac devices and $80$ operator-labeled outages, we evaluate state-of-the-art deep learning architectures, including recurrent, attention-based, and linear models, for beam outage prediction. Additionally, we assess a Random Forest-based labeling system for providing consistent, confidence-scored outage annotations. Our findings highlight the strengths and weaknesses of these architectures for beam outage prediction and identify critical gaps that must be addressed to fully harness AI for transitioning downtime handling from reactive to predictive, ultimately reducing downtime and improving decision-making in accelerator management.

Jain, Milan [PNL, Richland] (ORCID:000000021676111↗

A probabilistic inverse prediction method for predicting plutonium processing conditions

In the past decade, nuclear chemists and physicists have been conducting studies to investigate the signatures associated with the production of special nuclear material (SNM). In particular, these studies aim to determine how various processing parameters impact the physical, chemical, and morphological properties of the resulting special nuclear material. By better understanding how these properties relate to the processing parameters, scientists can better contribute to nuclear forensics investigations by quantifying their results and ultimately shortening the forensic timeline. This paper aims to statistically analyze and quantify the relationships that exist between the processing conditions used in these experiments and the various properties of the nuclear end-product by invoking inverse methods. In particular, these methods make use of Bayesian Adaptive Spline Surface models in conjunction with Bayesian model calibration techniques to probabilistically determine processing conditions as an inverse function of morphological characteristics. Not only does the model presented in this paper allow for providing point estimates of a sample of special nuclear material, but it also incorporates uncertainty into these predictions. This model proves sufficient for predicting processing conditions within a standard deviation of the observed processing conditions, on average, provides a solid foundation for future work in predicting processing conditions of particles of special nuclear material using only their observed morphological characteristics, and is generalizable to the field of chemometrics for applicability across different materials.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Conotoxin Prediction: New Features to Increase Prediction Accuracy

Conotoxins are toxic, disulfide-bond-rich peptides from cone snail venom that target a wide range of receptors and ion channels with multiple pathophysiological effects. Conotoxins have extraordinary potential for medical therapeutics that include cancer, microbial infections, epilepsy, autoimmune diseases, neurological conditions, and cardiovascular disorders. Despite the potential for these compounds in novel therapeutic treatment development, the process of identifying and characterizing the toxicities of conotoxins is difficult, costly, and time-consuming. This challenge requires a series of diverse, complex, and labor-intensive biological, toxicological, and analytical techniques for effective characterization. While recent attempts, using machine learning based solely on primary amino acid sequences to predict biological toxins (e.g., conotoxins and animal venoms), have improved toxin identification, these methods are limited due to peptide conformational flexibility and the high frequency of cysteines present in toxin sequences. This results in an enumerable set of disulfide-bridged foldamers with different conformations of the same primary amino acid sequence that affect function and toxicity levels. Consequently, a given peptide may be toxic when its cysteine residues form a particular disulfide-bond pattern, while alternative bonding patterns (isoforms) or its reduced form (free cysteines with no disulfide bridges) may have little or no toxicological effects. Similarly, the same disulfide-bond pattern may be possible for other peptide sequences and result in different conformations that all exhibit varying toxicities to the same receptor or to different receptors. We present here new features, when combined with primary sequence features to train machine learning algorithms to predict conotoxins, that significantly increase prediction accuracy.

collisional cross section↗

Improving Prediction of Surface Solar Irradiance Variability by Integrating Observed Cloud Characteristics and Machine Learning

A 5-year, 1-minute resolution observational dataset of clouds and solar radiation was produced that includes two metrics of the variability in surface solar irradiance due to cloud type and fractional sky cover. Multiple regression models were trained to fit observations of surface solar irradiance variability from those two cloud property predictors. We found that ensemble tree-based methods, Random Forest and Gradient Boosting Machine, have the least overfitting issues and showed the best performance with an R2 of 0.42. While the observational data trained in this study was only from one site, the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) site in Oklahoma, initial comparisons of the seasonality of the statistics suggest that these results are relatively weather regime independent; the generality of such a finding across sites will be tested in future work. The observational data and developed machine learning model are being used to create a numerical weather prediction model parameterization to enable day-ahead solar variability prediction in a computationally efficient way. This is a first step towards creating a new paradigm of predicting day-ahead variability with the potential to provide a new tool to improve grid operation, planning, and resilience.

Riihimaki, Laura↗

Machine Learning Self-Diffusion Prediction for Lennard-Jones Fluids in Pores

Predicting the diffusion coefficient of fluids under nanoconfinement is important for many applications including the extraction of shale gas from kerogen and product turnover in porous catalysts. Due to the large number of important variables, including pore shape and size, fluid temperature and density, and the fluid–wall interaction strength, simulating diffusion coefficients using molecular dynamics (MD) in a systematic study could prove to be prohibitively expensive. Here, we use machine learning models trained on a subset of MD data to predict the self-diffusion coefficients of Lennard-Jones fluids in pores. Our MD data set contains 2280 simulations of ideal slit pore, cylindrical pore, and hexagonal pore geometries. We use the forward feature selection method to determine the most useful features (i.e., descriptors) for developing an artificial neutral network (ANN) model with an emphasis on easily acquired features. Our model shows good predictive ability with a coefficient of determination (i.e., R 2 ) of ~0.99 and a mean squared error of ~2.9 × 10 –5 . Finally, we propose an alteration to our feature set that will allow the ANN model to be applied to nonideal pore geometries.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Predicting images for the dynamics of stellar clusters ( π-DOC ): a deep learning framework to predict mass, distance, and age of globular clusters

ABSTRACT Dynamical mass estimates of simple systems such as globular clusters (GCs) still suffer from up to a factor of 2 uncertainty. This is primarily due to the oversimplifications of standard dynamical models that often neglect the effects of the long-term evolution of GCs. Here, we introduce a new approach to measure the dynamical properties of GCs, based on the combination of a deep-learning framework and the large amount of data from direct N-body simulations. Our algorithm, π-DOC (Predicting Images for the Dynamics Of stellar Clusters) is composed of two convolutional networks, trained to learn the non-trivial transformation between an observed GC luminosity map and its associated mass distribution, age, and distance. The training set is made of V-band luminosity and mass maps constructed as mock observations from N-body simulations. The tests on π-DOC demonstrate that we can predict the mass distribution with a mean error per pixel of 27 per cent, and the age and distance with an accuracy of 1.5 Gyr and 6 kpc, respectively. In turn, we recover the shape of the mass-to-light profile and its global value with a mean error of 12 per cent, which implies that we efficiently trace mass segregation. A preliminary comparison with observations indicates that our algorithm is able to predict the dynamical properties of GCs within the limits of the training set. These encouraging results demonstrate that our deep-learning framework and its forward modelling approach can offer a rapid and adaptable tool competitive with standard dynamical models.

Chardin, Jonathan↗

Predicting the Dissolution Rate of Borosilicate Glasses using QSPR analysis based on molecular dynamics simulations

Quantitative Structure Property Relationship (QSPR) analysis based on molecular dynamics (MD) simulations is a promising approach for establishing the composition-property relationships of glass and other materials with complex structures. A series of 20 borosilicate and boroaluminosilicate glasses have been modeled by using MD simulations with recently developed effective potentials. Short- and medium-range structures of these glasses were analyzed and, based on these structural information, QSPR analysis of the initial dissolution rate (r0) was made and compared with measured r0 at 90°C and pH 9 using various structural descriptors such as percentage of bridging oxygen species, network connectivity and average ring size. The structural descriptors, Fnet, containing energetic information such as single bond strength and other structural information were also used. It was found that overall network connectivity, average ring size and Fnet give reasonable predictions of the r0 of studied glasses, given the conditions that the glasses are homogeneous and dissolve congruently. Modifying glass compositions to account preferential release of modifiers gives a better prediction for incongruently dissolving glasses. The results were compared with our recent work of predicting glass dissolution behavior from compositions using the topological-constraints-based models.

Du, Jincheng↗

A Modular System for Increasing Predictiveness for Extreme Climate Predictions

We know that climate change is poised to reshape our world, but we lack clear enough predictions about precisely how. The preponderance of these changes is associated with human activity, specifically the emission of CO 2 and other greenhouse gases. Problematically, projections of climate change continue to be marred by unacceptably large uncertainties which hamper informed decision-making and cost society a chance to adapt proactively and effectively. These uncertainties stem from deficiencies in predictions of future greenhouse gas emissions, but also from inaccuracies in the representation of the physical models used to predict the climate response to such emissions. The uncertainties in projections associated with the inaccurate representation of climate physics, chemistry and biology are similar to those that plagued the first global climate models developed fifty years ago, despite more than a factor 10 8 increase in computer performance. Our transformational question is then, how can the accuracy of climate projections be dramatically improved by applying recent advances in the computational and data sciences to train the models with the wealth of data being constantly collected about the ongoing changes in the climate system?

54 ENVIRONMENTAL SCIENCES↗

Hybrid AI-ML and FE-based Digital Twin Predictive Modeling Framework for a PWR Coolant System Components: Updates on Multi-Time-Series-3D-Location Dependent Usages Factor Prediction

The long-term operation (LTO) of nuclear power plants (NPP) beyond their original design life of 40 years can lead to more material damage associated with cyclic fatigue under thermal-mechanical loading cycles and associated long-term exposure of reactor material to the deleterious reactor-coolant environments. However, under this LTO condition, the reactor components can still safely operate but may require more frequent Nondestructive Evaluation (NDE) of reactor components. Requiring frequent NDE inspections may lead to frequent NPP shutdowns which can lead to power outages and additional NDE inspection cost-related economic loss. The economic loss can be minimized by reducing uncertainty in life estimation of safety-critical pressure boundary components and by implementing a more digital approach such as using upcoming digital-twin (DT) technology for predicting the structural states (e.g., time and location dependent inside/outside thickness temperature, stress, strain, plastic deformation, etc.) and associated fatigue life of a component in real time. The DT framework is based on limited experimental data, Artificial-intelligence (AI)-Machine-Learning (ML) and multiphysics-computationalmechanics such as finite element- (FE) based models. Given the real-time thermal-hydraulic process measurements from several existing plant sensors, the overall goal of the DT framework is to predict the cumulative usages factors or equivalent fatigue lives in real time and at any random 3D location of the components. This includes inaccessible locations such as inside the thickness or location of a component. This prediction can be at thousands to millions of 3D point clouds or locations like conventional FE-based models, but without running an FE model in real time.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Uncertainty Quantification Framework for Predicting Material Response with Large Number of Parameters: Application to Creep Prediction in Ferritic-Martensitic Steels Using Combined Crystal Plasticity and Grain Boundary Models

This paper presents an uncertainty quantification (UQ) framework for the physics-based model prediction of material response with a large number of parameters. The application problem presented in this work is that of predicting creep in Grade 91 steel at 600°C. The material response is defined with a physically based microstructural model with constitutive equations emulating several observed phenomena in Grade 91 and embodied into an explicit geometry mesoscale finite element model for prior austenite grains and grain boundaries. Creep within the grains and in grain boundaries are represented by crystal plasticity for dislocation motion and a physics-based model for cavity growth and nucleation, respectively. The creep behavior of this material is influenced by several parameters, some of which have a wide range of variation based on experimental data. UQ combined with microstructural modeling can discover the core microstructural causes of experimental variability, leading to improved materials with lower variability in critical long-term material properties. In this study, we investigate the model's uncertainty to identify material properties that may be modified during production to increase creep life and analyze different components of the crystal plasticity model for improvements. For this purpose, a quantity of interest is defined as time to minimum creep rate, which correlates well to the creep failure of the material. A deep neural network model was trained and validated to be used as a surrogate for the finite element model. Then, a variance-based sensitivity analysis is performed on the surrogate model to find the Sobol indices of the input parameters in respect to the output quantity of interest. The Sobol indices are used to reduce the dimensionality of the model. Generalized polynomial chaos expansion is used on the reduced basis models to propagate the uncertainty from the input parameters to the quantity of interest using the deep neural network surrogate model. These results are benchmarked against uncertainty propagation using Monte Carlo simulations. In conclusion, the UQ performed through the reduced basis model captures almost all the uncertainty in the model with significantly fewer simulations, making it possible to perform the UQ directly via simulations with the finite element model rather than surrogate machine-learned models.

36 MATERIALS SCIENCE↗

Model Predictive Control for Urban Traffic Signals with Stability Guarantees

Traditional traffic signal control focuses more on the optimization aspects whereas the stability and robustness of the closed-loop system are less studied. This paper aims to establish the stability properties of traffic signal control systems through the analysis of a practical model predictive control (MPC) scheme, which models the traffic network with the conservation of vehicles based on a store-and forward model and attempts to balance the traffic densities. More precisely, this scheme guarantees the exponential stability of the closed-loop system under state and input constraints when the inflow is feasible and traffic demand can be fully accessed. Practical exponential stability is achieved in case of small uncertain traffic demand by a modification of the previous scheme. Simulation results of a small-scale traffic network validate the theoretical analysis.

ADVANCED PROPULSION SYSTEMS,MATHEMATICS AND COMPUT↗

Predicting CaO-(MgO)-Al2O3-SiO2 glass reactivity in alkaline environments from force field molecular dynamics simulations

In this investigation, force field-based molecular dynamics (MD) simulations have been employed to generate detailed structural representations for a range of amorphous quaternary CaO-MgO-Al{sub 2}O{sub 3}-SiO{sub 2} (CMAS) and ternary CaO-Al{sub 2}O{sub 3}-SiO{sub 2} (CAS) glasses. Comparison of the simulation results with select experimental X-ray and neutron total scattering and literature data reveals that the MD-generated structures have captured the key structural features of these CMAS and CAS glasses. Based on the MD-generated structural representations, we have developed two structural descriptors, specifically (i) average metal oxide dissociation energy (AMODE) and (ii) average self-diffusion coefficient (ASDC) of all the atoms at melting. Both structural descriptors are seen to more accurately predict the relative glass reactivity than the commonly used degree of depolymerization parameter, especially for the eight synthetic CAS glasses that span a wide compositional range. Hence these descriptors hold great promise for predicting CMAS and CAS glass reactivity in alkaline environments from compositional information.

36 MATERIALS SCIENCE↗

Predicting zeolites’ stability during the corrosion of nuclear waste immobilization glasses: Comparison with glass corrosion experiments

During the long-term corrosion of nuclear waste glasses under nuclear waste disposal conditions, the precipitation of zeolitic phases has been linked to a delayed acceleration in glass corrosion (known as “Stage III”). Hence, predicting the thermodynamic propensity for zeolites to form upon the dissolution of nuclear waste glasses is key to ensure their long-term performance. Here, we compile a unified, internally-consistent thermodynamic database “clay20” to estimate the stability of clay and feldspar phases relevant to nuclear waste immobilization glasses, including beidellite(Mg, Ca, Na, K), kaolinite, montmorillonite(Mg, Ca, Na, K), nontronite(Mg, Ca, Na, K), saponite(Ca, Na, K), and albite. Based on this, we report a geochemical modeling method allowing us to predict the stability of secondary phases (including zeolites, calcium–silicate–hydrate gels, and clays) upon the dissolution of nuclear waste immobilization glasses. We show that this approach offers a realistic description of the stability of the secondary phases forming during the dissolution of two archetypical model nuclear glasses (namely, the International Simple Glass, ISG, and WVUTh-203) under conditions relevant to nuclear waste disposal (T = 90°C, p = 1 bar) as a function of pH. We find that the formation of silica and clay secondary phases is thermodynamically favored at low pH (pH < 10), whereas, in contrast, zeolite (analcime) and calcium–silicate–hydrate phases are favored at high pH (pH > 10.5). This suggests that thermodynamics (i.e., not solely kinetics) plays a key role in determining the range of solution pH wherein stage III corrosion may occur, i.e., when zeolite formation is favored.

Zhen-Wu, Bi Yun↗

Prediction of the Thermal Runaway Limit and Optimal Operation of Heat Transfer-Limited, Fixed-Bed Reactor Systems

Here, we derive a new prediction for thermal runaway starting from the alpha model for fixed-bed reactor systems. This method accounts for thermal resistance internal to the reactor tube and the radial temperature gradients that result. To showcase our method, we compare its predictions to other common criteria for thermal runaway using o-xylene oxidation as the example chemistry. Even in systems where internal heat transfer is negligible, the empirical practical design criterion for thermal runaway is inaccurate. For cases where internal heat transfer is relevant, our runaway limit is more stringent than limits derived from simpler 1-D models. To augment our work, we optimize the product yield with the thermal runaway constraint using orthogonal collocation. Using the alpha model, the results illustrate that the thermal runaway limit can be accurately determined using either numerical or analytical methods.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗