Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model prediction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

LA17-V-InverseRadTransportProblem-PD2Kb. Final Project Report

In the inverse radiation transport problem, a radiation signal emanating from an unknown object is used to reconstruct geometric and material parameters of the object , e.g., the mass of special nuclear material (SNM), the isotopic composition of the SNM (e.g., the enrichment of 235U), the thickness of shielding, etc. The inverse radiation transport problem is one of the most fundamental and important in the emergency response mission, and has been addressed in previous NA-22 and NA-42/84 investments by using derivative-free optimization methods. Our project was aimed at (i) consolidating previous work by applying polynomial chaos expansion (PCE) for reducing significantly the number of forward model simulations required by derivative-free optimization methods; (ii) developing a general-purpose framework and stand-alone software for solving the inverse radiation transport problem by applying a new “predictive modeling” methodology (predictive modeling of coupled multi-physics systems, PM_CMPS) which enables the fusing of experimental and computational information; and (iii) developing several benchmarks (for unscattered gamma rays) for demonstrating the quantification of non-Gaussian features (e.g., skewness and kurtosis, which characterize asymmetries and long tails) of response distributions by deterministically and efficiently propagating parameter uncertainties (covariances and higher-order moments, where available) using high-order sensitivities computed by the recently developed comprehensive adjoint sensitivity analysis methodology (C-ASAM). With regard to (i), application of PCE, the most significant accomplishment of this project was an implementation of PCE into INVERSE that significantly reduced computation time for the DiffeRential Evolution Adaptive Metropolis (DREAM) and Differential Evolution (DE) methods. For inverse transport problems with measurements of neutron leakage, neutron multiplication, and neutron-induced gamma-rays, the solution times for the DREAM and DE methods were reduced by factors of 30-300, reducing run times from hours to minutes while maintaining the same accuracy as the standard (non-PCE) DREAM and DE. Speedups were further improved by exploring sparse grid quadrature sets using the Toolkit for Adaptive Stochastic Modeling and Non-Intrusive ApproximatioN (Tasmanian) toolset. An initial exploration of sparse grids indicated that further speedups factors of 5-10 are obtainable. The implementation of PCE in INVERSE is not in a form that users can easily access. With regard to (ii), solving the inverse problem using a predictive modeling paradigm, the most significant accomplishment of this project were the derivation and implementation of adjoint-based second derivatives in neutron and photon transport theory. There are two codes that compute these derivatives. SENSPG computes them for uncollided gamma rays and SENSMG computes them for neutron leakage. SENSMG is open-source code available on github. Other significant accomplishments included a stand-alone code, MULTI-PRED, that implements the predictive modeling paradigm, along with a detailed manual. The code was implemented in the existing INVERSE code for inverse problems, but a head-to-head comparison of inverse methods was not achieved. We also derived and implemented the capability to compute sensitivities for multiplicity measurements into the SENSMG code, and this capability was used in a data assimilation application, but it was not used for solving inverse problems. With regard to (iii), developing benchmarks to demonstrate the importance of high-order sensitivity and uncertainty analysis, the most significant accomplishment of this project were two test problems that showed how important second-order sensitivities are.

07 ISOTOPE AND RADIATION SOURCES↗

Machine learning models inaccurately predict current and future high-latitude C balances

The high-latitude carbon (C) cycle is a key feedback to the global climate system, yet because of system complexity and data limitations, there is currently disagreement over whether the region is a source or sink of C. Recent advances in big data analytics and computing power have popularized the use of machine learning (ML) algorithms to upscale site measurements of ecosystem processes, and in some cases forecast the response of these processes to climate change. Due to data limitations, however, ML model predictions of these processes are almost never validated with independent datasets. To better understand and characterize the limitations of these methods, we develop an approach to independently evaluate ML upscaling and forecasting. We mimic data-driven upscaling and forecasting efforts by applying ML algorithms to different subsets of regional process-model simulation gridcells, and then test ML performance using the remaining gridcells. In this study, we simulate C fluxes and environmental data across Alaska using ecosys, a process-rich terrestrial ecosystem model, and then apply boosted regression tree ML algorithms to training data configurations that mirror and expand upon existing AmeriFLUX eddy-covariance data availability. We first show that a ML model trained using ecosys outputs from currently-available Alaska AmeriFLUX sites incorrectly predicts that Alaska is presently a modeled net C source. Increased spatial coverage of the training dataset improves ML predictions, halving the bias when 240 modeled sites are used instead of 15. However, even this more accurate ML model incorrectly predicts Alaska C fluxes under 21st century climate change because of changes in atmospheric CO 2 , litter inputs, and vegetation composition that have impacts on C fluxes which cannot be inferred from the training data. Our results provide key insights to future C flux upscaling efforts and expose the potential for inaccurate ML upscaling and forecasting of high-latitude C cycle dynamics.

54 ENVIRONMENTAL SCIENCES↗

Chemical composition based machine learning model to predict defect formation in additive manufacturing

With a goal of exploiting additive manufacturing to improve the manufacturing of existing reactor materials, we developed a chemical composition-based machine learning model to predict the printability of any given alloy in laser powder bed fusion (L-PBF) using experimental data from peer-reviewed literature. We defined printability as the ability to avoid defects like cracking, balling, porosity, and lack of fusion, that are caused by thermal stresses (during solidification or liquation), molten pool disintegration into disconnected small beads or lack of heat input respectively. Our models predict the tendency of balling defect formation and porosity percentage for a given composition, under a given set of processing conditions. To predict the likelihood of balling defect, three models: a random forest classifier, a gradient boost regressor and a neural network were trained on a dataset containing both traditional alloys and high entropy alloys. The neural network model showed the highest accuracy of 92.3 % in predicting the balling defect formation. A random forest regressor, gradient boost regressor and neural network were trained and tested on a dataset of various alloys to predict porosity. The random forest regressor showed the best predictions with an R 2 score of 0.97. The models also revealed the relative importance of the input descriptors on defect-formation tendency. Of particular significance was the identification of carbon as an important element in determining the occurrence of balling and percent porosity in alloys like steel, as well as being moderately important to the percentage porosity in other alloys as well as steel. Manganese was also identified as a key descriptor for the percentage of porosity in steel and other alloys. Manganese’s low thermal conductivity and consistent presence in the dataset is the likely cause for its contribution. Carbon’s role is attributable to its relatively high specific heat and high melting temperature. In conclusion, our model serves as a swift, chemistry-based tool to design experiments and find modified compositions better suited for additive manufacturing.

36 MATERIALS SCIENCE↗

Performance and power modeling and prediction using MuMMI and 10 machine learning methods

Energy-efficient scientific applications require insight into how high performance computing system features impact the applications' power and performance. This insight can result from the development of performance and power models. Here, in this article, we use the modeling and prediction tool MuMMI (Multiple Metrics Modeling Infrastructure) and 10 machine learning methods to model and predict performance and power consumption and compare their prediction error rates. We use an algorithm-based fault-tolerant linear algebra code and a multilevel checkpointing fault-tolerant heat distribution code to conduct our modeling and prediction study on the Cray XC40 Theta and IBM BG/Q Mira at Argonne National Laboratory and the Intel Haswell cluster Shepard at Sandia National Laboratories. Our experimental results show that the prediction error rates in performance and power using MuMMI are less than 10% for most cases. By utilizing the models for runtime, node power, CPU power, and memory power, we identify the most significant performance counters for potential application optimizations, and we predict theoretical outcomes of the optimizations. Based on two collected datasets, we analyze and compare the prediction accuracy in performance and power consumption using MuMMI and 10 machine learning methods.

97 MATHEMATICS AND COMPUTING↗

Co-Evolving Climate Models under Uncertainty to Improve Predictive Skill

Focal Area: Predictive modeling through the use of AI techniques and AI-derived model components; the use of AI and other tools to design a prediction system comprising of a hierarchy of models Science Challenge: Advances in modeling of climate and improved observational capabilities have led to great improvements in understanding large-scale historical climate effects. It however remains a challenge to reliably predict the risk of fine-scale regional climate events on human systems even as such risks are on the rise because warmer and wetter climates are more prone to hydrometeorological extremes,

54 ENVIRONMENTAL SCIENCES↗

Forward and inverse predictive transient models of TREAT using surrogate reactivity models

In this work, we present two novel approaches for predicting the power evolution and control rod height of the Transient Reactor Test Facility (TREAT) to support experiment modeling; specifically, transient analysis of the NASA-sponsored Sirius series of experiments. These approaches utilize steady-state Monte Carlo model, point kinetics model, and surrogate models to predict power evolution and control rod axial position during transient experiments. Both approaches were tested and validated against several Sirius experiments that were performed in the TREAT facility at different power levels. The validation test results show very good agreement with the experimental data, and the models were able to accurately predict the power evolution and the axial control rod position with an average error within 3.0%. Finally, this indicates that these approaches will help the reactor engineering team of the TREAT facility in preparing and predicting the power and temperature of the experiment.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A newly proposed isotherm model to predict Cs exchange with crystalline silicotitanate in tank waste simulants

The Zheng Anthony Miller (ZAM) computer model, a multicomponent ion exchange model used to predict the exchange of Group I metals onto crystalline silicotitanate (CST), has historically been used to predict Cs distribution coefficients from Hanford and Savannah River Site (SRS) tank waste simulants. Comparison of experimentally determined Cs distribution coefficients from tank waste simulants with ZAM isotherm model predictions indicate overprediction of Cs and K distribution coefficients for simple and complex simulants with the engineered form of CST. Additionally, recent changes in chemical composition/manufacturing of IONSIV TM R9140-B have resulted in increased Cs capacity from high-salt, highly alkaline solutions. Here, this work served to assess different isotherm models and refine equilibrium parameters to develop a model that can be applied to Hanford and SRS tank waste Cs removal efforts. Toward this goal, the Campbell Westesen Peterson (CWP) model was developed. This model utilized the experimentally determined Cs capacity, and simplified ZAM equilibria expressions to include only the binary substitution of Cs + or K + on the Na + sites. Equilibrium constants for these equations were refined using experimentally determined distribution coefficients. Overall, the CWP model significantly improved our ability to predict both Cs and K loading capacity from complex matrices.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Data-Enabled Predictive Control for Building HVAC Systems

Model predictive control is widely used as a control technology for the computation of optimal control inputs of building heating, ventilating, and air conditioning (HVAC) systems. However, both the benefits and widespread adoption of model predictive control (MPC) are hindered by the effort of model creation, calibration, and accuracy of the predictions. In this paper, we apply the data-enabled predictive control (DeePC) algorithm for designing controls for building HVAC systems. The algorithm solely depends on input/output data from the system to predict future state trajectories without the need for system identification. The algorithm relies on the idea that a vector space of all input–output trajectories of a discrete-time linear time-invariant (LTI) system is spanned by time-shifts of a single measured trajectory, given the input signal is persistently exciting. Closed-loop simulations using EnergyPlus are performed to demonstrate the approach. The simulated building modeled in EnergyPlus is a modified commercial large office prototype building served by an air handling unit-variable air volume HVAC system. Temperature setpoints of zones are used as control variables to minimize the HVAC energy cost of the building considering a time-of-use electricity rate structure. Furthermore, sensitivity analysis is conducted to gain insights into the effect of parameter tuning on DeePC performance. Simulation results are used to illustrate the performance of the algorithm and compare the algorithm with model-based MPC and occupancy-based setpoint controller. Overall, DeePC achieves similar performance compared to MPC for lower engineering effort.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Zonal-Based Emission Source Term Model for Predicting Particulate Emission Factors in Wildfire Simulations

A physics/chemistry-based numerical model for predicting the emission of fine particles from wildfires is proposed. This model implements the fundamental mechanisms of soot formation in a combustion environment: soot nucleation, surface growth, agglomeration, oxidation, and particle fragmentation. These mechanisms occur on a scale too fine for the discretization of most wildfire models, which need to simulate landscape-scale dynamics. As a result this model implements a zonal approach, where the computed soot particle distribution is partitioned into process zones within a single resolved grid cell. These process zones include: an inception zone (for nucleation), a heating zone (for coagulation, surface growth, and fragmentation), a reaction zone (for oxidation), and a quenched zone (for atmospheric processes). Governing mechanisms are applied to the appropriate zones to predict total particle growth and emission. Additionally, the proposed model is implemented into HIGRAD/FIRETEC, a physics-based wildfire simulation code which couples interactions between fire, fuels, atmosphere, and topography on a landscape scale. Fire simulations among grasslands and conifer forests are performed and compared against experimental data for emission factors.

54 ENVIRONMENTAL SCIENCES↗

Dynamic pulse propagation modelling for predictive femtosecond-laser-microbonding of transparent materials

A dynamic pulse propagation modeling for femtosecond laser bonding of Borofloat glass is presented. The temperature evolution and internal modifications are predicted by incorporating the nonlinear electron dynamics along with temperature dependent thermal properties. The modelling predicts the spatial and temporal distribution of absorption coefficient and plasma density that gives quantitative estimations of the heat affected zone and weld geometry. The impact of focusing condition on heat affected zone and weld geometry is investigated, which for the first time to our knowledge allows to numerically determine the desired relative position between the geometrical focus of a femtosecond-laser-pulse and the interface of the two substrates to be welded. The prediction of the modelling on the offset distance is applied to weld Borofloat glass plates having optical contact and can be applied to other dielectric solids.

Sahoo, Pankaj K. (ORCID:0000000209437319)↗

Pressure-Gradient-Based RANS Model for Predicting Separation in Transitional and Turbulent Flows

Predicting flow separation poses a significant challenge for RANS models, particularly in transitional flows over airfoils. We propose a novel improvement to RANS models to predict incipient separation in both transitional and fully turbulent flows. Our approach modifies the eddy viscosity model in regions indicated by a pressure-gradient criterion that accounts for intermittency - determining whether the boundary layer is laminar or turbulent. This model demonstrates robust generalization across various airfoil shapes and Reynolds numbers. Applied to the NREL Phase VI wind turbine rotor, our model shows improved aerodynamic performance predictions compared to the baseline RANS model.

k-omega SST↗

A Fast, Accurate Prediction for System-Wide Damage Due to Dynamic Wind Loading

The complex relationship between photovoltaic (PV) hardware configurations, overall system dynamics, and turbulent aerodynamic phenomena generates highly unsteady, non-uniform loads that can lead to damaging instabilities. These effects may result in glass breakage, cell cracking, and structural failures in frames and mounting systems, even under moderate wind conditions. Addressing industry concerns about premature system failures in field conditions deemed survivable, our research aims to develop a fast and accurate predictive model for system damage. This model integrates configurable hardware choices with advanced simulation tools to represent the overall system-specific dynamics effectively. Using this model, we predict responses under varying weather conditions and hardware setups, translating these predictions into pre-trained surrogate models capable of accurately identifying failure risks and rapidly testing new system hardening measures. In this presentation, we will showcase preliminary results in capturing system dynamics through our customizable library of PV hardware configurations. Additionally, we will highlight how these new tools build upon PVade's established wind load modeling capabilities and foster the development of advanced AI/ML surrogates for improving system robustness.

97 MATHEMATICS AND COMPUTING↗

Mapping the proteogenomic landscape enables prediction of drug response in acute myeloid leukemia

Acute myeloid leukemia is a poor prognosis cancer commonly stratified by genetic aberrations, but these mutations are often heterogeneous and don’t always predict therapeutic response. Here we combine transcriptomic, proteomic, and phosphoproteomic datasets with ex vivo drug sensitivity data to help understand the underlying pathophysiology of AML beyond mutations. We measured the proteome and phosphoproteome of 210 patients and combined them with genomics and transcriptomic measurements to identify four proteogenomic subtypes that complemented existing genetic subtypes. We then built a predictor to classify samples into subtypes based on 147 molecular features and mapped them to a ‘landscape’. Each region of this landscape corresponded to specific drug response patterns. We then built a drug response prediction model to identify drugs that target distinct subtypes. We can ultimately use these models to predict drug treatment response and prioritize treatments. Finally, we extended our models and mapped a series of cell lines representing various stages of quizartinib resistance into our subtype landscape, predicting and experimentally validating a switch in sensitivity to venetoclax to panobinostat, two drugs with very different mechanisms than quizartinib. Our results show how multi-omics data together with drug sensitivity data can inform therapy stratification and drug combinations in AML.

59 BASIC BIOLOGICAL SCIENCES↗

A Comprehensive Investigation of Active Learning Strategies for Conducting Anti-Cancer Drug Screening

It is well-known that cancers of the same histology type can respond differently to a treatment. Thus, computational drug response prediction is of paramount importance for both preclinical drug screening studies and clinical treatment design. To build drug response prediction models, treatment response data need to be generated through screening experiments and used as input to train the prediction models. In this study, we investigate various active learning strategies of selecting experiments to generate response data for the purposes of (1) improving the performance of drug response prediction models built on the data and (2) identifying effective treatments. Here, we focus on constructing drug-specific response prediction models for cancer cell lines. Various approaches have been designed and applied to select cell lines for screening, including a random, greedy, uncertainty, diversity, combination of greedy and uncertainty, sampling-based hybrid, and iteration-based hybrid approach. All of these approaches are evaluated and compared using two criteria: (1) the number of identified hits that are selected experiments validated to be responsive, and (2) the performance of the response prediction model trained on the data of selected experiments. The analysis was conducted for 57 drugs and the results show a significant improvement on identifying hits using active learning approaches compared with the random and greedy sampling method. Active learning approaches also show an improvement on response prediction performance for some of the drugs and analysis runs compared with the greedy sampling method.

60 APPLIED LIFE SCIENCES↗

A physics-informed and hierarchically regularized data-driven model for predicting fluid flow through porous media

This paper presents a new deep learning data-driven model for predicting structure dependent pore-fluid velocity fields in rock. The model is based on a Convolutional Auto-Encoder (CAE) artificial neural network capable of learning from image data generated by direct numerical simulations of fluid flow through pore-structures, such as by Lattice Boltzmann or molecular dynamics methods. The main novelty of the model in comparison to previous CAE-based data-driven approaches consists of three parts. The first is a methodology for decomposing the full-domain of the porous media into sub-regions, or “sub-domains”, in order to reduce the overall size of the CAE, batch process the sub-domains in parallel, and enable the CAE to learn local and generalizable nonlinear mappings of pore-fluid velocities. The second consists of embedding the finite difference solutions of the incompressible Navier-Stokes and continuity equations into convolutional layers prior to the CAE in order to provide the CAE with knowledge of fluid dynamics physics (PhyFlow). The third main novelty is that the training of the CAE is regularized with a hierarchical loss function that encourages the learning of fluid flow patterns (in a way similar to ranked modes in principal component analysis), ranking from most to least important. This is shown to increase the stability in learning, reduce over-fitting, and promote interpretability of the CAE neural network layers (HierCAE). The comprehensive new data-driven model, which we call the PhyFlow-HierCAE model, is shown to exhibit improved accuracy and generalizability of flow field predictions over conventional CAE models, attributable to the embedded physical knowledge and the hierarchical regularization, as well as realize orders of magnitude speed-ups in computation times as a surrogate for the direct numerical simulations. Examples of training and forward predictions on unseen pore-structures are provided and evaluated for data from Lattice Boltzmann and molecular dynamics simulations of pore-fluid flow. The model is shown to be a fast and accurate emulator (or “surrogate”) for predicting effective permeability of unseen pore-structures based on learning from relatively small direct numerical simulation datasets.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Smart culture medium optimization for recombinant protein production: Experimental, modeling, and AI/ML-driven strategies

Recombinant protein production (RPP) is central to biotechnology, where recombinant proteins are used as either end products or catalysts in the synthesis of chemicals, fuels, and materials. Among the major cost drivers, culture medium plays a pivotal role in determining protein yield and quality. This review presents a comprehensive perspective on the critical stages of “smart” culture medium optimization: planning, screening, modeling, optimization, and validation. In the planning stage, we examine the nutritional and energetic roles of medium components, including carbon, nitrogen, amino acids, salts, and trace metals, and their impacts on culture parameters such as pH, oxidative state, and osmolality. We highlight the variability in trace metal content due to water sources, culture vessels, and raw materials, which can substantially influence RPP. The screening stage covers Design of Experiments (DoE) approaches, assessing their theoretical basis, implementation, and limitations. For modeling, we describe methods that integrate experimental data to develop predictive models for smart medium formulation. Model-based optimization strategies can then be employed to select optimal media compositions for a given application. The validation stage aims to evaluate model predictions and provide feedback for model training and refinement. Finally, we survey mechanistic and artificial intelligence/machine learning (AI/ML)-driven models as integrated, transformational tools for predictive modeling of bioprocess conditions, nutrient availability, cellular metabolism, and protein quality, with the goal of optimizing culture media to enhance protein yields while reducing costs and environmental impact. We conclude by addressing the challenges of translating laboratory-scale medium optimization to industrial-scale settings and exploring future AI/ML-driven approaches that may overcome current bottlenecks and accelerate medium design for RPP. Overall, this review provides a unified framework for advancing smart medium design in RPP.

Artificial Intelligence/Machine Learning (AI/ML)↗

Evaluating alternative ebullition models for predicting peatland methane emission and its pathways via data–model fusion

Abstract. Understanding the dynamics of peatland methane (CH4) emissions and quantifying sources of uncertainty in estimating peatland CH4 emissions are critical for mitigating climate change. The relative contributions of CH4 emission pathways through ebullition, plant-mediated transport, and diffusion, together with their different transport rates and vulnerability to oxidation, determine the quantity of CH4 to be oxidized before leaving the soil. Notwithstanding their importance, the relative contributions of the emission pathways are highly uncertain. In particular, the ebullition process is more uncertain and can lead to large uncertainties in modeled CH4 emissions. To improve model simulations of CH4 emission and its pathways, we evaluated two model structures: (1) the ebullition bubble growth volume threshold approach (EBG) and (2) the modified ebullition concentration threshold approach (ECT) using CH4 flux and concentration data collected in a peatland in northern Minnesota, USA. When model parameters were constrained using observed CH4 fluxes, the CH4 emissions simulated by the EBG approach (RMSE = 0.53) had a better agreement with observations than the ECT approach (RMSE = 0.61). Further, the EBG approach simulated a smaller contribution from ebullition but more frequent ebullition events than the ECT approach. The EBG approach yielded greatly improved simulations of pore water CH4 concentrations, especially in the deep soil layers, compared to the ECT approach. When constraining the EBG model with both CH4 flux and concentration data in model–data fusion, uncertainty of the modeled CH4 concentration profiles was reduced by 78 % to 86 % in comparison to constraints based on CH4 flux data alone. The improved model capability was attributed to the well-constrained parameters regulating the CH4 production and emission pathways. Our results suggest that the EBG modeling approach better characterizes CH4 emission and underlying mechanisms. Moreover, to achieve the best model results both CH4 flux and concentration data are required to constrain model parameterization.

59 BASIC BIOLOGICAL SCIENCES↗

REV-INR: Regularized Evidential Implicit Neural Representation for Uncertainty-Aware Volume Visualization

Applications of Implicit Neural Representations (INRs) have emerged as a promising deep learning approach for compactly representing large volumetric datasets. These models can act as surrogates for volume data, enabling efficient storage and on-demand reconstruction via model predictions. However, conventional deterministic INRs only provide value predictions without insights into the model’s prediction uncertainty or the impact of inherent noisiness in the data. This limitation can lead to unreliable data interpretation and visualization due to prediction inaccuracies in the reconstructed volume. Identifying erroneous results extracted from model-predicted data may be infeasible, as raw data may be unavailable due to its large size. To address this challenge, we introduce REV-INR, Regularized Evidential Implicit Neural Representation, which learns to predict data values accurately along with the associated coordinate-level data uncertainty and model uncertainty using only a single forward pass of the trained REV-INR during inference. By comprehensively comparing and contrasting REV-INR with existing well-established deep uncertainty estimation methods, we show that REV-INR achieves the best volume reconstruction quality with robust data (aleatoric) and model (epistemic) uncertainty estimates using the fastest inference time. Consequently, we demonstrate that REV-INR facilitates assessment of the reliability and trustworthiness of the extracted isosurfaces and volume visualization results, enabling analyses to be solely driven by model-predicted data.

Saklani, Shanu [Indian Institute of Technology, Ka↗