Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Prediction Accuracy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

AlphaFold predictions are valuable hypotheses and accelerate but do not replace experimental structure determination

Abstract Artificial intelligence-based protein structure prediction methods such as AlphaFold have revolutionized structural biology. The accuracies of these predictions vary, however, and they do not take into account ligands, covalent modifications or other environmental factors. Here, we evaluate how well AlphaFold predictions can be expected to describe the structure of a protein by comparing predictions directly with experimental crystallographic maps. In many cases, AlphaFold predictions matched experimental maps remarkably closely. In other cases, even very high-confidence predictions differed from experimental maps on a global scale through distortion and domain orientation, and on a local scale in backbone and side-chain conformation. We suggest considering AlphaFold predictions as exceptionally useful hypotheses. We further suggest that it is important to consider the confidence in prediction when interpreting AlphaFold predictions and to carry out experimental structure determination to verify structural details, particularly those that involve interactions not included in the prediction.

59 BASIC BIOLOGICAL SCIENCES↗

Best of both worlds: Enforcing detailed balance in machine learning models of transition rates

The slow microstructural evolution of materials often plays a key role in determining material properties. When the unit steps of the evolution process are slow, direct simulation approaches such as molecular dynamics become prohibitive and Kinetic Monte-Carlo (kMC) algorithms, where the state-to-state evolution of the system is represented in terms of a continuous-time Markov chain, are instead frequently relied upon to efficiently predict long-time evolution. The accuracy of kMC simulations however relies on the complete and accurate knowledge of reaction pathways and corresponding kinetics. This requirement becomes extremely stringent in complex systems such as concentrated alloys where the astronomical number of local atomic configurations makes the a priori tabulation of all possible transitions impractical. Machine learning models of transition kinetics have been used to mitigate this problem by enabling the efficient on-the-fly prediction of kinetic parameters. While conventional KMC methods based on transition state theory naturally yield reversible dynamics that exactly obey the detailed balance criterion, providing strong guarantees on the properties of the stationary distribution, many recently-proposed ML-based approaches to barrier predictions provide no such guarantees. In this study, we derive conditions under which physics-informed ML architectures exactly enforce the detailed balance condition by construction, even when relying on non-extensive descriptions of states in terms of local environments around mobile defects. In conclusion, using the diffusion of a vacancy in a concentrated alloy as an example, we show that such ML architectures also exhibit superior performance in terms of prediction accuracy, demonstrating that the imposition of physical constraints can facilitate the accurate learning of barriers at no increase in computational cost.

36 MATERIALS SCIENCE↗

Toward ultra-efficient high-fidelity predictions of wind turbine wakes: Augmenting the accuracy of engineering models with machine learning

This study proposes a novel machine learning (ML) methodology for the efficient and cost-effective prediction of high-fidelity three-dimensional velocity fields in the wake of utility-scale turbines. The model consists of an autoencoder convolutional neural network with U-Net skipped connections, fine-tuned using high-fidelity data from large-eddy simulations (LES). The trained model takes the low-fidelity velocity field cost-effectively generated from the analytical engineering wake model as input and produces the high-fidelity velocity fields. The accuracy of the proposed ML model is demonstrated in a utility-scale wind farm for which datasets of wake flow fields were previously generated using LES under various wind speeds, wind directions, and yaw angles. Comparing the ML model results with those of LES, the ML model was shown to reduce the error in the prediction from 20% obtained from the Gauss Curl hybrid (GCH) model to less than 5%. In addition, the ML model captured the non-symmetric wake deflection observed for opposing yaw angles for wake steering cases, demonstrating a greater accuracy than the GCH model. The computational cost of the ML model is on par with that of the analytical wake model while generating numerical outcomes nearly as accurate as those of the high-fidelity LES.

Mechanics↗

FY22 Progress on Computational Modeling of the Water-Based NSTF

This report summarizes the system-level modeling effort by Argonne National Laboratory (Argonne) of the Natural convection Shutdown heat removal Test Facility (NSTF) in FY22. As an extension of the effort from FY21, this year’s work focuses primarily on the two-phase modeling of the NSTF using RELAP5-3D, particularly with the inclusion of the cavity model. The results from simulations were used to compare against experimental data for benchmarking purposes of the RELAP5 deck. Additionally, RELAP5 was used as a predictive tool to guide planned test operations and identify expected system behaviors. In the first part of this report, details are provided of the cavity omitted model where heat flux is applied directly as a boundary condition to the risers. The general trend predicted by the RELAP5 model matches that from the experimental data when a single-phase natural circulation flow is first established, followed by an oscillatory two-phase period and finally a stable two-phase flow. However, the onset of oscillations is predicted early by the model due to the smaller thermal mixing region in the tank. However, by expanding the simulated thermal mixing region in the tank, the onset of oscillations predicted by the model is able to match that from the experiment. These oscillations where studied in depth and are deduced to be flashing-induced instability. The model was then modified to simulate an accident scenario case where a representative heat load based on the full-scale Framatome’s 625 MW t SC-HTGR was applied directly to the riser channels. The simulated initial and boundary conditions were identical to those performed experimentally, facilitating direct comparisons between the predicted and experimental results. It was determined that the results showed some discrepancies remain, likely due to the overprediction of vapor generation rate by the computer model. In the second part of this report, the cavity model is re-introduced where it is observed that the RELAP5 prediction is now able to capture the major trends of the observed flow commonly observed during two-phase conditions. However, the onset of oscillations is once again predicted early by the model, possibly caused by the underprediction of heat loss from the heater and cavity. This is likely due to the omission of support structures in the cavity that can act as additional pathways for heat to escape to the environment. To overcome the underprediction of heat loss, part of the insulation surrounding the cavity side panels and the back of the heaters are removed to allow heat to escape directly to the environment, which then improves the RELAP5 prediction. Parametric studies are also performed to investigate the effects of heater power, tank inventory level, and tank gas space pressure on flow behaviors, also in direct comparison to conditions tested experimentally. User option-61 in the RELAP5-3D input deck, which changes the heat transfer coefficient correlations used for calculating the vapor generation, is also investigated where it is found that by enabling the option, the overall duration of oscillations is increased and matches that from the experiment better. The RELAP5 model is further benchmarked with a header inlet- throttling case where it is observed that the prediction from the model fails to capture some major features observed in the experiment. By using a modified loss coefficient curve for the valve, the accuracy of the prediction is improved where most of the major features observed in the experiment are predicted by the model. Lastly, the model is benchmarked with an inventory depletion scenario where it is observed that despite the modeling limitation of RELAP5, the prediction shows good agreement with the experimental data where major trends and features are captured by the model. Future work will see continued development of the current RELAP5-3D input deck of the NSTF to both improve the accuracy of the model’s predictive capability and continuing serving the experimental program. The mutually beneficial relationship between analysis and experimental efforts has become integral to the parent NSTF program, and the greater objective to fully understand and accurately predict the heat removal performance of a full scale RCCS concept.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Multimodal sensor fusion for real-time standoff estimation in directed energy deposition

In Laser Powder-based Direct Energy Deposition (LP-DED) systems, achieving consistency, precision and quality of produced parts requires tight control over printing parameters. One of the critical parameters is the standoff distance. Maintaining an optimal standoff height is crucial for achieving correct laser power density and powder catchment efficiency, as both laser and powder streams are focused at this distance. Here, this study introduces a novel approach using multimodal sensor fusion to predict standoff height in real-time. The proposed system integrates two low-profile, cost-effective sensors: an RGB coaxial camera and a high frequency and high dynamic range microphone. By utilizing a simple fully connected neural network, trained on a limited dataset, data fusion of these sensors allowed for the real-time prediction of the standoff height. The results demonstrate high resolution and accuracy of the predictions across multiple geometries and a wide range of standoff heights. This approach offers a simple, and cost-effective solution for real-time standoff height monitoring and lays the groundwork for future integration into commercial LP-DED systems.

42 ENGINEERING↗

Spatiotemporal Learning in Power Modules: Wavelet-Enhanced Forecasting of Thermomechanical Degradation

Detecting internal defects in power electronics packages is critical for their performance and reliability, especially under extreme operating conditions, as these defects can lead to catastrophic failure if not properly addressed. Confocal scanning acoustic microscopy (C-SAM) plays a key role in the nondestructive evaluation of bond layer degradation within a power electronics package by detecting defects such as delamination, voids, and cracks. However, accurately quantifying and predicting these defects from C-SAM images remains a significant challenge due to the low noise-to-signal ratio, which typically arises from both imaging process and bond patterns itself. In this paper, we explore machine learning strategies for processing C-SAM images and providing predictive models of defect growth. We use C-SAM images of sintered copper and sintered silver samples, which are obtained under accelerated thermal experiments, as the representative dataset for our study. We investigate the effect of Fourier transforms and wavelet transforms on these datasets to remove high-frequency noise and address noise across multiple scales with histogram equalization to enhance the contrast and improve the visibility of defects. As a result, defect boundaries can be clearly distinguished, enabling more accurate tracking of their growth over time. We then employ different time-series forecasting algorithms on the denoised images to formulate an image-based lifetime prediction model. Statistical models and deep-learning techniques are trained on images obtained in the early stages of thermal shock, and defect growth in the later stages is predicted. Our work serves as a preliminary attempt to improve the accuracy of lifetime prediction models of power electronics packages, which is critical under extreme operating environments.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Sierra/SD – Verification Test Manual – 5.22

Verification and validation (V&V) of scientific computing programs are important at Sandia National Labs due to the expanding role of computational simulation in managing the United States nuclear stockpile. The complexities of structural response calculations used to analyze physical problems, the varieties of codes applied to the calculations, and the importance of accurate predictions when assessing field conditions demand confidence in the consistency and accuracy of computer codes. Confidence in the accuracy of the predictions arising from computer simulations must ultimately be gained through verification and validation. The Sierra salinas structural dynamics analysis code, Sierra/SD, is used at the DOE Laboratories, and in several DOD projects. The roles of Sierra/SD in the qualification of weapon systems and components for normal and hostile environments throughout the Stockpile-to-Target Sequence include to, • Redesign weapon components. • Certify weapon components and systems for target environments such as hypersonic vehicles. • Certify that components will survive the thermal mechanical shock loads associated with hostile environments. • Evaluate current stockpile issues, including issues associated with uncertainty quantification. • Address many other problems that are encountered in stockpile management. The Sierra/SD verification plan is described, and an evolving set of key verification tests are described in detail. The verification tests ensure the correctness of the mathematics and numerical algorithms associated with functionality describing engineering phenomena. Development is in accordance with a set of tailored Software Quality Engineering (SQE) practices. SQE practices guide the overall verification and validation effort.

97 MATHEMATICS AND COMPUTING↗

A comparison of computational models for predicting yield sooting index

Sooting propensity, a measurement of how much particulate matter is produced when a fuel is burned, is a property of significant interest among researchers who are striving to discover the next generation of cleaner, more efficient fuels and fuel additives. Many compounds are not viable as fuels and/or fuel additives, and as a result, designing cleaner-burning biofuels using only experimental techniques is inefficient. Predictive models have been instrumental in reducing this inherent difficulty, providing researchers with a tool to preemptively screen compounds before production and testing. The present work compares the accuracies and interpretabilities of existing models used to predict a particular measure of sooting propensity, Yield Sooting Index (YSI). These models include artificial neural networks, graph neural networks, and multivariate equations. A novel equation for predicting YSI based on atom path count and bond order is proposed, which can highlight key structural components that contribute to YSI. It was found that artificial neural networks slightly outperform graph neural networks and greatly outperform multivariate equations in blind (test set) prediction accuracy; however, graph neural networks and multivariate equations provide significantly more interpretability as to how compound structure relates to YSI. Predictions of YSI are compared to experimental measurements for previously un-tested compounds with cetane numbers comparable to diesel fuel (50-60) (butyl decanoate, ethyl decanoate, 1,4-bis(ethenoxymethyl)cyclohexane, and 5-heptyloxolan-2-one), and it was found that these compounds produce significantly less soot compared to diesel fuel.

09 BIOMASS FUELS↗

$\mathrm{Z}$ero-jettiness resummation for top-quark pair production at the $\mathrm{LHC}$

We study the resummation of the 0-jettiness resolution variable $\mathcal{T}_o$ for the top-quark pair production process in hadronic collisions. Starting from an effective theory framework we derive a factorisation formula for this observable which allows its resummation at any logarithmic order in the $\mathcal{T}_o$→ o limit. We then calculate the $\mathcal{O}(a_s)$ corrections to the soft function matrices and, by employing renormalisation group equation methods, we obtain the ingredients for the resummation formula up to next-to-next-to-leading logarithmic (NNLL) accuracy. We study the impact of these corrections to the 0-jettiness distribution by comparing predictions at different accuracy orders: NLL, NLL', NNLL and Approximate NNLL' (NNLL$^{'}_{a}$). We match these results to the corresponding fixed order calculations both at leading order and next-to-leading order for the $t\bar{t}$+jet production process, obtaining the most accurate prediction of the 0-jettiness distribution for the top-quark pair production process at NNLL$^{'}_{a}$+NLO accuracy.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Predicting Biomass Yields of Advanced Switchgrass Cultivars for Bioenergy and Ecosystem Services Using Machine Learning

The production of advanced perennial bioenergy crops within marginal areas of the agricultural landscape is gaining interest due to its potential to sustainably produce feedstocks for biofuels and bioproducts while also improving the sustainability and resilience of commodity crop production. However, predicting the biomass yields of this production system is challenging because marginal areas are often relatively small and spread around agricultural fields and are typically associated with various abiotic conditions that limit crop production. Machine learning (ML) offers a viable solution as a biomass yield prediction tool because it is suited to predicting relationships with complex functional associations. The objectives of this study were to (1) evaluate the accuracy of commonly applied ML algorithms in agricultural applications for predicting the biomass yields of advanced switchgrass cultivars for bioenergy and ecosystem services and (2) determine the most important biomass yield predictors. Datasets on biomass yield, weather, land marginality, soil properties, and agronomic management were generated from three field study sites in two U.S. Midwest states (Illinois and Iowa) over three growing seasons. The ML algorithms evaluated in the study included random forests (RFs), gradient boosting machines (GBMs), artificial neural networks (ANNs), K-neighbors regressor (KNR), AdaBoost regressor (ABR), and partial least squares regression (PLSR). Coefficient of determination (R 2 ) and mean absolute error (MAE) were used to evaluate the predictive accuracy of the tested algorithms. Results showed that the ensemble methods, RF (R 2 = 0.86, MAE = 0.62 Mg/ha), GBM (R 2 = 0.88, MAE = 0.57 Mg/ha), and GBM (R 2 = 0.78, MAE = 0.66 Mg/ha), were the most accurate in predicting biomass yields of the Independence, Liberty, and Shawnee switchgrass cultivars, respectively. This is in agreement with similar studies that apply ML to multi-feature problems where traditional statistical methods are less applicable and datasets used were considered to be relatively small for ANNs. Consistent with previous studies on switchgrass, the most important predictors of biomass yield included average annual temperature, average growing season temperature, sum of the growing season precipitation, field slope, and elevation. This study helps pave the way for applying ML as a management tool for alternative bioenergy landscapes where understanding agronomic and environmental performance of a multifunctional cropping system seasonally and interannually at the sub-field scale is critical.

09 BIOMASS FUELS↗

Predicting Device Parameters for Dye-Sensitized Solar Cells from Electronic Structure Calculations to Reproduce Experiment.

Given that improvements to the power-conversion efficiency (PCE) of dye-sensitized solar cells (DSSCs) have slowed in recent years, a means to accurately predict the device parameters yielded by trial dyes in silico, without having to synthesize them, would be extremely valuable to speed up the design process. Currently, the best-performing methods of calculating device parameters rely on a set of experimentally determined kinetic coefficients. In practice, it is very difficult to measure these kinetic parameters accurately, limiting the overall accuracy of such predictive methods. This work proposes a model to obtain key parameters such as J(SC), V-OC, and PCE using only the results from density functional theory (DFT) and time-dependent DFT calculations, noting that rates of electron-transfer steps are ultimately linked to the electronic structure of the dye center dot center dot center dot TiO2 working electrode. Six organic DSSC dyes from dissimilar chemical classes (L0, L1, L2, WS-2, WS-92, and C281) were chosen to demonstrate the power of this approach. Their a priori known experimentally determined device performance metrics served to validate our predictions. The greatest absolute error in our predicted PCE values was 0.36% relative to the experiment, while the greatest fractional error was 0.042. This indicates that the proposed model offers a dramatic improvement on previous predictive methods for DSSC device parameters, both in accuracy and in consistency. Moreover, such a predictive model has great potential to be applied to other photovoltaic applications, further enabling the design of novel, highly efficient photoactive materials.

density functional theory↗

Brain‐age prediction: Systematic evaluation of site effects, and sample age range and size

Abstract Structural neuroimaging data have been used to compute an estimate of the biological age of the brain (brain‐age) which has been associated with other biologically and behaviorally meaningful measures of brain development and aging. The ongoing research interest in brain‐age has highlighted the need for robust and publicly available brain‐age models pre‐trained on data from large samples of healthy individuals. To address this need we have previously released a developmental brain‐age model. Here we expand this work to develop, empirically validate, and disseminate a pre‐trained brain‐age model to cover most of the human lifespan. To achieve this, we selected the best‐performing model after systematically examining the impact of seven site harmonization strategies, age range, and sample size on brain‐age prediction in a discovery sample of brain morphometric measures from 35,683 healthy individuals (age range: 5–90 years; 53.59% female). The pre‐trained models were tested for cross‐dataset generalizability in an independent sample comprising 2101 healthy individuals (age range: 8–80 years; 55.35% female) and for longitudinal consistency in a further sample comprising 377 healthy individuals (age range: 9–25 years; 49.87% female). This empirical examination yielded the following findings: (1) the accuracy of age prediction from morphometry data was higher when no site harmonization was applied; (2) dividing the discovery sample into two age‐bins (5–40 and 40–90 years) provided a better balance between model accuracy and explained age variance than other alternatives; (3) model accuracy for brain‐age prediction plateaued at a sample size exceeding 1600 participants. These findings have been incorporated into CentileBrain ( https://centilebrain.org/#/brainAGE2 ), an open‐science, web‐based platform for individualized neuroimaging metrics.

60 APPLIED LIFE SCIENCES↗

Assessment of Machine Learning Wall Modeling Approaches for Large Eddy Simulation of Gas Turbine Film Cooling Flows: An a Priori Study

Here, in this work, a priori analysis of machine learning (ML) strategies is carried out with the goal of data-driven wall modeling for large eddy simulation (LES) of gas turbine film cooling flows. High-fidelity flow datasets are extracted from wall-resolved LES (WRLES) of flow over a flat plate interacting with the coolant flow supplied by a single row of 7-7-7 shaped cooling holes inclined at 30 degrees with the flat plate at different blowing ratios (BR). The WRLES are performed using the high-order Nek5000 spectral element computational fluid dynamics (CFD) solver. Light gradient boosting machine (LightGBM) is employed as the ML algorithm for the data-driven wall model. Parametric tests are conducted to systematically assess the influence of a wide range of input flow features (velocity components, velocity gradients, pressure gradients, and fluid properties) on the accuracy of ML wall model with respect to prediction of wall shear stress. In addition, the use of spatial stencil and time delay is also explored within the ML wall modeling framework. It is shown that features associated with gradients of the streamwise and spanwise velocity components have a major impact on the prediction fidelity of wall model, while the effect of gradients of wall-normal velocity component is found to be negligible. Moreover, adding flow feature information from an x-y-z spatial stencil significantly improves the ML model accuracy and generalizability compared to just using local flow features from the matching location. Overall, highest prediction accuracy is achieved when both spatial stencil and time delay features are incorporated within the data-driven wall modeling paradigm.

33 ADVANCED PROPULSION SYSTEMS↗

Data-Enabled Predictive Control for Building HVAC Systems

Model predictive control is widely used as a control technology for the computation of optimal control inputs of building heating, ventilating, and air conditioning (HVAC) systems. However, both the benefits and widespread adoption of model predictive control (MPC) are hindered by the effort of model creation, calibration, and accuracy of the predictions. In this paper, we apply the data-enabled predictive control (DeePC) algorithm for designing controls for building HVAC systems. The algorithm solely depends on input/output data from the system to predict future state trajectories without the need for system identification. The algorithm relies on the idea that a vector space of all input–output trajectories of a discrete-time linear time-invariant (LTI) system is spanned by time-shifts of a single measured trajectory, given the input signal is persistently exciting. Closed-loop simulations using EnergyPlus are performed to demonstrate the approach. The simulated building modeled in EnergyPlus is a modified commercial large office prototype building served by an air handling unit-variable air volume HVAC system. Temperature setpoints of zones are used as control variables to minimize the HVAC energy cost of the building considering a time-of-use electricity rate structure. Furthermore, sensitivity analysis is conducted to gain insights into the effect of parameter tuning on DeePC performance. Simulation results are used to illustrate the performance of the algorithm and compare the algorithm with model-based MPC and occupancy-based setpoint controller. Overall, DeePC achieves similar performance compared to MPC for lower engineering effort.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Diverse signatures of convergent evolution in cactus-associated yeasts

Many distantly related organisms have convergently evolved traits and lifestyles that enable them to live in similar ecological environments. However, the extent of phenotypic convergence evolving through the same or distinct genetic trajectories remains an open question. Here, we leverage a comprehensive dataset of genomic and phenotypic data from 1,049 yeast species in the subphylum Saccharomycotina (Kingdom Fungi, Phylum Ascomycota) to explore signatures of convergent evolution in cactophilic yeasts, ecological specialists associated with cacti. We inferred that the ecological association of yeasts with cacti arose independently approximately 17 times. Using a machine learning–based approach, we further found that cactophily can be predicted with 76% accuracy from both functional genomic and phenotypic data. The most informative feature for predicting cactophily was thermotolerance, which we found to be likely associated with altered evolutionary rates of genes impacting the cell envelope in several cactophilic lineages. We also identified horizontal gene transfer and duplication events of plant cell wall–degrading enzymes in distantly related cactophilic clades, suggesting that putatively adaptive traits evolved independently through disparate molecular mechanisms. Notably, we found that multiple cactophilic species and their close relatives have been reported as emerging human opportunistic pathogens, suggesting that the cactophilic lifestyle—and perhaps more generally lifestyles favoring thermotolerance—might preadapt yeasts to cause human disease. This work underscores the potential of a multifaceted approach involving high-throughput genomic and phenotypic data to shed light onto ecological adaptation and highlights how convergent evolution to wild environments could facilitate the transition to human pathogenicity.

59 BASIC BIOLOGICAL SCIENCES↗

Design and analysis of a wake model for spatially heterogeneous flow

Abstract. Methods of turbine wake modeling are being developed to more accurately account for spatially variant atmospheric conditions within wind farms. Most current wake modeling utilities are designed to apply a uniform flow field to the entire domain of a wind farm. When this method is used, the accuracy of power prediction and wind farm controls can be compromised depending on the flow-field characteristics of a particular area. In an effort to improve strategies of wind farm wake modeling and power prediction, FLOw Redirection and Induction in Steady State (FLORIS) was developed to implement sophisticated methods of atmospheric characterization and power output calculation. In this paper, we describe an adapted FLORIS model that features spatial heterogeneity in flow-field characterization. This model approximates an observed flow field by interpolating from a set of atmospheric measurements that represent local weather conditions. The objective of this method is to capture heterogeneous atmospheric effects caused by site-specific terrain features, without explicitly modeling the geometry of the wind farm terrain. The implemented adaptations were validated by comparing the simulated power predictions generated from FLORIS to the actual recorded wind farm output from the supervisory control and data acquisition (SCADA) recordings and large eddy simulations (LESs). When comparing the performance of the proposed heterogeneous model to homogeneous FLORIS simulations, the results show a 14.6 % decrease for mean absolute error (MAE) in wind farm power output predictions for cases using wind farm SCADA data and a 18.9 % decrease in LES case studies. The results of these studies also indicate that the efficacy of the proposed modeling techniques may vary with differing site-specific operational conditions. This work quantifies the accuracy of wind plant power predictions under heterogeneous flow conditions and establishes best practices for atmospheric surveying for wake modeling.

17 WIND ENERGY↗

Prediction of Silicon Content in a Blast Furnace via Machine Learning: A Comprehensive Processing and Modeling Pipeline

Silicon content plays an important role in determining the operational efficiency of blast furnaces (BFs) and their downstream processes in integrated steelmaking; however, existing sampling methods and first-principles models are somewhat limited in their capability and flexibility. Current data-based prediction models primarily rely on a limited set of manually selected furnace parameters. Additionally, different BFs present a diverse set of operating parameters and state variables that are known to directly influence the hot metal’s silicon content, such as fuel injection, blast temperature, and raw material charge composition, among other process variables that have their own impacts. The expansiveness of the parameter set adds complexity to parameter selection and processing. This highlights the need for a comprehensive methodology to integrate and select from all relevant parameters for accurate silicon content prediction. Providing accurate silicon content predictions would enable operators to adjust furnace conditions dynamically, improving safety and reducing economic risk. To address these issues, a two-stage approach is proposed. First, a generalized data processing scheme is proposed to accommodate diverse furnace parameters. Second, a robust modeling pipeline is used to establish a machine learning (ML) model capable of predicting hot metal silicon content with reasonable accuracy. The method employed herein predicted the average Si content of the upcoming furnace cast with an accuracy of 91% among 200 target predictions for a specific furnace provisioned by the XGBoost model. This prediction is achieved using only the past shift’s operating conditions, which should be available in real time. This performance provides a strong baseline for the modeling approach with potential for further improvement through provision of real-time features.

Chemistry↗

Multi-task graph neural networks for simultaneous prediction of global and atomic properties in ferromagnetic systems *

Abstract We introduce a multi-tasking graph convolutional neural network, HydraGNN, to simultaneously predict both global and atomic physical properties and demonstrate with ferromagnetic materials. We train HydraGNN on an open-source ab initio density functional theory (DFT) dataset for iron-platinum with a fixed body centered tetragonal lattice structure and fixed volume to simultaneously predict the mixing enthalpy (a global feature of the system), the atomic charge transfer, and the atomic magnetic moment across configurations that span the entire compositional range. By taking advantage of underlying physical correlations between material properties, multi-task learning (MTL) with HydraGNN provides effective training even with modest amounts of data. Moreover, this is achieved with just one architecture instead of three, as required by single-task learning (STL). The first convolutional layers of the HydraGNN architecture are shared by all learning tasks and extract features common to all material properties. The following layers discriminate the features of the different properties, the results of which are fed to the separate heads of the final layer to produce predictions. Numerical results show that HydraGNN effectively captures the relation between the configurational entropy and the material properties over the entire compositional range. Overall, the accuracy of simultaneous MTL predictions is comparable to the accuracy of the STL predictions. In addition, the computational cost of training HydraGNN for MTL is much lower than the original DFT calculations and also lower than training separate STL models for each property.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗