Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Model prediction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Fouling modeling and prediction approach for heat exchangers using deep learning

In this article, we develop a generalized and scalable statistical model for accurate prediction of fouling resistance using commonly measured parameters of industrial heat exchangers. This prediction model is based on deep learning where a scalable algorithmic architecture learns non-linear functional relationships between a set of target and predictor variables from large number of training samples. Here, the efficacy of this modeling approach is demonstrated for predicting fouling in an analytically modeled cross-flow heat exchanger, designed for waste heat recovery from flue-gas using room temperature water. The performance results of the trained models demonstrate that the mean absolute prediction errors are under 10 –4 KW –1 for flue-gas side, water side and overall fouling resistances. The coefficients of determination (R 2 ), which characterize the goodness of fit between the predictions and observed data, are over 99%. Even under varying levels of measurement noise in the inputs, we demonstrate that predictions over an ensemble of multiple neural networks achieves better accuracy and robustness to noise. We find that the proposed deep-learning fouling prediction framework learns to follow heat exchanger flow and heat transfer physics, which we confirm using locally interpretable model agnostic explanations around randomly selected operating points. Overall, we provide a robust algorithmic framework for fouling prediction that can be generalized and scaled to various types of industrial heat exchangers.

42 ENGINEERING↗
DOE OSTI2021

Developing an Automated Uncertainty Quantification Tool to Improve Watershed-Scale Predictions of Water and Nutrient Cycling

Managing the flow of water, nutrients, and contaminants in watersheds is vital to addressing pressing issues related to water scarcity, access to clean drinking water, energy production, resilience to natural and anthropogenic perturbations, and ecological restoration. Decisions about the management of watersheds critically depend on the accuracy with which the flow of water and chemicals through the watershed can be predicted by computer models. Prediction uncertainty can be reduced by matching the model to data, which are collected in the field at great expense. The contribution of watershed characterization data to reducing uncertainty of relevant model predictions can be evaluated in a so-called data-worth analysis, which provides transparent, quantitative metrics about a data set’s value for the support of relevant watershed management objectives. To achieve this goal, we developed a software package that implements the data-worth analysis approach for use with state-of-the-art watershed models. The purpose of the proposed data-worth analysis is to help decision-makers allocate resources for watershed characterization such that the uncertainty in model predictions can be significantly reduced, which leads to better, more effective management decisions. At the same time, watershed characterization costs can be reduced. The specific technical objectives of this SBIR/STTR Phase II project were to develop a framework and associated software toolsets that implement the uncertainty quantification and data-worth analysis approach for use with state-of-the-art watershed models. This goal was achieved by (A) developing a user-friendly, robust software package that is accessible to a wide audience, including watershed managers, policy-makers, and public stakeholders; (B) by demonstrating application of the prototype on several use cases that are representative of complex watershed management challenges spanning a range of scales and that consider different open-source, DOE-based codes and other modeling platforms; and (C) by gathering information about the needs and requirements from potential users to help guide future developments, ensuring that the final product will be commercially viable. The developed software consists of a graphical user interface that guides the user through a sequence of analysis steps, supported by toolsets that leverage state-of-the-art computational simulation-optimization capabilities. A prototype of the software runs on multiple platforms (PC, Mac, multi-processor Linux environment), is linked to diverse watershed simulators (e.g., ECOSYS, TOUGH2, TOUGHREACT, Amanzi-ATS), performs multiple analysis tasks (predictive simulations, sensitivity analysis, uncertainty analysis, automatic parameter estimation, and data-worth analysis, multicomponent geothermometry), and is readily extensible to include external simulators and analysis tools. The software is being commercialized and will be continually updated to address user needs.

58 GEOSCIENCES↗
DOE OSTI2021

The Cell Utilized Partitioning Model as a Predictive Tool for Optimizing Counter-Current Chromatography Processes

Counter-current chromatography (CCC) is capable of unique elution modes that isolate analytes using the movement of the stationary phase in addition to moving the mobile phase. These modes include elution-extrusion CCC (EECCC) and dual-mode CCC (DM CCC) that are not possible in traditional solid-liquid chromatography systems. Although EECCC and DM CCC are widely used to recover highly retained components, to our knowledge, optimizing the elution process in these modes with predictive models has not been reported. To address this gap, we developed a predictive model for CCC dubbed the Cell Utilized Partitioning (CUP) model. The CUP model accurately predicts the effluents of multicomponent separations in EECCC and DM CCC modes when compared to experimental data. Furthermore, CUP model simulations were extended to investigate the influence of operating and intrinsic parameters on the yield and productivity, and to compare the separation performances of EECCC and DM CCC in various conditions. The results demonstrate that low distribution constants, usually a KD less than 1, and a selectivity > 1.3, under specific flowrate ranges, increase both productivity and yield. From these results, generalized optimization and scaleup guidelines are proposed that can apply to research settings and to industrial processes to maximize preparative CCC performance.

BIOMASS FUELS,INORGANIC, ORGANIC, PHYSICAL, AND AN↗
DOE OSTI2020

Designing accurate emulators for scientific processes using calibration-driven deep models

Abstract Predictive models that accurately emulate complex scientific processes can achieve speed-ups over numerical simulators or experiments and at the same time provide surrogates for improving the subsequent analysis. Consequently, there is a recent surge in utilizing modern machine learning methods to build data-driven emulators. In this work, we study an often overlooked, yet important, problem of choosing loss functions while designing such emulators. Popular choices such as the mean squared error or the mean absolute error are based on a symmetric noise assumption and can be unsuitable for heterogeneous data or asymmetric noise distributions. We propose Learn-by-Calibrating, a novel deep learning approach based on interval calibration for designing emulators that can effectively recover the inherent noise structure without any explicit priors. Using a large suite of use-cases, we demonstrate the efficacy of our approach in providing high-quality emulators, when compared to widely-adopted loss function choices, even in small-data regimes.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Hybrid Recurrent Neural Network Modeling for Traffic Delay Prediction at Signalized Intersections Along an Urban Arterial

This paper studies the traffic delay prediction modeling for multiple signalized intersections along the Ala Moana Boulevard and Nimitz Highway in Hawaii. Several machine learning (ML) based approaches have been studied in the literature, and most of them focused on prediction accuracy rather than the end use of real-time control and implementation. These ML models tend to be very complex and non-linear in nature, making it challenging to achieve fast inferences and are computationally heavy for real-time signal control implementation. As such, in this paper, a simple yet accurate hybrid modeling method is proposed to predict traffic delay one-step ahead with the model made suitable for real-time implementation to control traffic flow. Since real-time road-side measurements are recorded in unstructured form, the paper also discusses other issues related to data extraction and the pre-processing process. Finally, a simple signal control loop is developed to demonstrate the proposed modeling approach, which has shown advantages in model accuracy and computation efficiency compared against several existing modeling methods.

42 ENGINEERING↗
DOE OSTI2023

Many but not all deep neural network audio models capture brain responses and exhibit correspondence between model stages and brain regions

Models that predict brain responses to stimuli provide one measure of understanding of a sensory system and have many potential applications in science and engineering. Deep artificial neural networks have emerged as the leading such predictive models of the visual system but are less explored in audition. Prior work provided examples of audio-trained neural networks that produced good predictions of auditory cortical fMRI responses and exhibited correspondence between model stages and brain regions, but left it unclear whether these results generalize to other neural network models and, thus, how to further improve models in this domain. We evaluated model-brain correspondence for publicly available audio neural network models along with in-house models trained on 4 different tasks. Most tested models outpredicted standard spectromporal filter-bank models of auditory cortex and exhibited systematic model-brain correspondence: Middle stages best predicted primary auditory cortex, while deep stages best predicted non-primary cortex. However, some state-of-the-art models produced substantially worse brain predictions. Models trained to recognize speech in background noise produced better brain predictions than models trained to recognize speech in quiet, potentially because hearing in noise imposes constraints on biological auditory representations. The training task influenced the prediction quality for specific cortical tuning properties, with best overall predictions resulting from models trained on multiple tasks. The results generally support the promise of deep neural networks as models of audition, though they also indicate that current models do not explain auditory cortical responses in their entirety.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

A Framework for Parametric and Predictive Uncertainty Quantification in the E3SM Land Model: Assessing Site and Observable Generalizability

Quantifying parametric uncertainty using observations from individual sites provides a critical foundation for Earth system modeling, serving as a necessary first step before scaling up to regional or global applications. This study introduces a novel computational framework designed to enhance model predictability by reducing parametric uncertainty and assessing site and observable generalizability using various observational constraints. The framework integrates five components: Model Simulation, Statistical Emulation, Global Sensitivity Analysis (GSA), Model Calibration, and Model Prediction. Using the E3SM land model, we simulated site-level land-atmosphere carbon and energy fluxes from 2003 to 2007 across five evergreen needleleaf FLUXNET sites, perturbing 26 vegetation-related model parameters. Gaussian process emulators were employed to expedite GSA and model calibration. Four critical parameters that strongly influence selected land-atmosphere fluxes were identified by GSA. Bayesian approaches were used to infer parameter probability distributions leveraging synthetic data and FLUXNET observations. The results reveal that posterior parameter distributions vary significantly across different sites and observables within the same plant functional type. Probabilistic predictions indicate that parameters calibrated at one site can enhance predictive accuracy at other sites, although site heterogeneity may sometimes outweigh parametric uncertainty. Additionally, the probabilistic predictions demonstrate that calibration for one variable can also improve predictability for other variables, thereby maximizing predictive capabilities with limited observations. This framework provides a powerful approach for reducing parametric uncertainty in Earth system models and deepening our understanding of carbon dynamics and energy cycles. Its adaptability makes it a valuable tool for broader applications in Earth system modeling.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Model-based predictive control of multi-zone commercial building with a lumped building modelling approach

Here this study investigates the applicability of a lumped building modeling approach to model-based predictive control (MPC) to alleviate the complex modeling process of the grey-box multi-zone building model. Based on experimental data, two building models were estimated in this study. The detailed model as a reference case and a lumped model were estimated with decentralized and conventional approaches, respectively. Then, simulations were performed with two boundary conditions, including the comfort bound and electricity cost structure. The performances of the MPC with the detailed and lumped models were analyzed compared to the feedback control. More savings was achieved with a larger comfort bound and more aggressive electricity cost structure. The savings potential of the proposed lumped model approach was not as high as that of the detailed model. However, the proposed method yields good control performance, whose savings was approximately 8.6% over that of feedback control. These results suggest that the proposed method can be used to facilitate MPC implementation in multi-zone building applications.

42 ENGINEERING↗
DOE OSTI2022

Integrating multimodal data through interpretable heterogeneous ensembles

Motivation: Integrating multimodal data represents an effective approach to predicting biomedical characteristics, such as protein functions and disease outcomes. However, existing data integration approaches do not sufficiently address the heterogeneous semantics of multimodal data. In particular, early and intermediate approaches that rely on a uniform integrated representation reinforce the consensus among the modalities but may lose exclusive local information. The alternative late integration approach that can address this challenge has not been systematically studied for biomedical problems. Results: We propose Ensemble Integration (EI) as a novel systematic implementation of the late integration approach. EI infers local predictive models from the individual data modalities using appropriate algorithms and uses heterogeneous ensemble algorithms to integrate these local models into a global predictive model. We also propose a novel interpretation method for EI models. We tested EI on the problems of predicting protein function from multimodal STRING data and mortality due to coronavirus disease 2019 (COVID-19) from multimodal data in electronic health records. We found that EI accomplished its goal of producing significantly more accurate predictions than each individual modality. It also performed better than several established early integration methods for each of these problems. The interpretation of a representative EI model for COVID-19 mortality prediction identified several disease-relevant features, such as laboratory test (blood urea nitrogen and calcium) and vital sign measurements (minimum oxygen saturation) and demographics (age). These results demonstrated the effectiveness of the EI framework for biomedical data integration and predictive modeling.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Physics-informed machine learning modeling for predictive control using noisy data

Due to the occurrence of over-fitting at the learning phase, the modeling of chemical processes via artificial neural networks (ANN) by using corrupted data (i.e., noisy data) is an ongoing challenge. Therefore, this work investigates the effect of both Gaussian and non-Gaussian noise on the performance of process-structure based recurrent neural networks (RNN) models, which take the form of partially-connected RNN models in this work, that are used to approximate a class of multi-input-multi-outputs nonlinear systems. Furthermore, two different techniques, specifically Monte Carlo dropout and co-teaching, are utilized in the development of partially-connected RNN models. Here, these two techniques are employed to reduce the over-fitting in ANNs when noisy data is used in the training process and, hence, to improve the open-loop accuracy as well as the closed-loop performance under a Lyapunov-based model predictive controller (MPC). Aspen Plus Dynamics, a well-known high-fidelity process simulator, is used to simulate a large-scale chemical process application in order to demonstrate the anticipated improvements in both open-loop approximation and closed-loop controller performance in the presence of Gaussian and non-Gaussian noise in the data set using physics-informed RNNs.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

A multiscale recurrent neural network model for predicting energy production from geothermal reservoirs

Optimization of energy production from geothermal reservoirs requires reliable prediction of energy production performance under alternative operation and development scenarios. Traditionally, reservoir simulation models are used for the evaluation and screening of alternative production and development plans. However, simulation models require extensive data collection and modeling efforts and are time-consuming to build, run, and update. Data-driven predictive models, on the other hand, can serve as efficient prediction tools that can be used for decision support and management of daily operations and surveillance activities. Data-driven models become particularly attractive when a reservoir simulation model for a field does not exist and/or is difficult to build. Machine learning (ML)-based data-driven models that have recently become popular in several fields exploit statistical patterns and relations in training data to generate predictions. As such, they tend to perform better in interpolation problems (that is, prediction within the training data range) than when they are used to extrapolate beyond the training data. Production data from geothermal reservoirs tend to exhibit short-term variabilities as well as long-term trends, such as monotonically declining production temperatures. Capturing both short-term features and long-term trends with ML-based models is not trivial. We evaluate the use of recurrent neural networks (RNN) for the prediction of energy production from geothermal reservoirs. RNN is a class of ML architectures that are used to represent and predict sequential/dynamic data. Thus, it can be challenging to apply RNN to problems where long-term trends must be captured and extrapolation beyond the training data range is needed. We introduce the multiscale RNN architecture to extend the application of RNN to detect and predict both short-term variabilities and long-term trends in geothermal data. The developed architecture consists of a long-term component to only capture low-frequency data patterns, and a short-term component to detect features with higher frequency and more nonlinearity. The final prediction is obtained by combining the long-term and short-term predictions. Both synthetic and field data are used to evaluate the presented multiscale RNN model. The prediction performance of the multiscale RNN is compared against those obtained from the regular RNN and the autoregressive (AR) model. The results suggest that the multiscale architecture improves the long-term prediction performance of the regular RNN and enhances its robustness against noise.

15 GEOTHERMAL ENERGY↗
DOE OSTI2022

Optimized Machine Learning Model for Predicting Groundwater Contamination

The use of physical models to predict groundwater contaminant movement remains technically challenging due to the complexity of the phenomena, the heterogeneity of key parameters in nature, and the presence of poorly defined interactive and feedback processes. New approaches to address these challenges are needed. In this study, we evaluate various Artificial Intelligence (AI)-based approaches to understand a hexavalent chromium (Cr(VI)) plumes located on the U.S. Department of Energy’s (DOE) Hanford Site in Richland, WA. The groundwater monitoring dataset used in this study included data from the 100 Area along the Columbia River and included data collected between 2010 to 2019. This study investigates the most prominent contaminant, Cr(VI), with the Extreme Gradient Boosting (XGBoost) machine learning model. The XGBoost models were compared with optimized versions using an Empirical Bayes Search Cross-Validation technique for better prediction. The optimized XGBoost model yielded an R^2 value of 0.99 on the training set and 0.85 on the testing set, whereas XGBoost without optimization yielded a value of 0.83 on the training set and 0.85 on the testing set. This paper provides an overview of a computational method for groundwater contamination modeling that shows promise for improving current remediation efforts.

Mazumdar, Hirak↗
DOE OSTI2020

Development and Evaluation of Occupancy-Aware HVAC Control for Residential Building Energy Efficiency and Occupant Comfort

Occupancy-aware heating, ventilation, and air conditioning (HVAC) control offers the opportunity to reduce energy use without sacrificing thermal comfort. Residential HVAC systems often use manually-adjusted or constant setpoint temperatures, which heat and cool the house regardless of whether it is needed. By incorporating occupancy-awareness into HVAC control, heating and cooling can be used for only those time periods it is needed. Yet, bringing this technology to fruition is dependent on accurately predicting occupancy. Non-probabilistic prediction models offer an opportunity to use collected occupancy data to predict future occupancy profiles. Smart devices, such as a connected thermostat, which already include occupancy sensors, can be used to provide a continually growing collection of data that can then be harnessed for short-term occupancy prediction by compiling and creating a binary occupancy prediction. Real occupancy data from six homes located in Colorado is analyzed and investigated using this occupancy prediction model. Results show that non-probabilistic occupancy models in combination with occupancy sensors can be combined to provide a hybrid HVAC control with savings on average of 5.0% and without degradation of thermal comfort. Model predictive control provides further opportunities, with the ability to adjust the relative importance between thermal comfort and energy savings to achieve savings between 1% and 13.3% depending on the relative weighting between thermal comfort and energy savings. In all cases, occupancy prediction allows the opportunity for a more intelligent and optimized strategy to residential HVAC control.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Liquid Core Detection and Strand Condition Monitoring in a Continuous Caster Using Optical Fiber

Real-time monitoring of the liquid core position during the continuous casting of steel has been demonstrated using low-cost distributed optical-fiber-based strain sensors. These sensors were installed on the containment roll support structures in the segments of a production continuous caster to detect the position of the solid–liquid interface and monitor the strand condition during the continuous casting. Distributed Fiber Bragg Grating sensors (FBGs) were used in this work to monitor strain at six roll positions in the caster. The sensor performance was first validated by comparing optical strain measurements with conventional strain gauge measurements in the lab. Next, optical strain measurements were performed on an isolated caster segment in a segment maintenance facility using hydraulic jacks to simulate the presence of a liquid core under the roll. Finally, the sensors were evaluated during caster operation. The sensors successfully detected the load increase associated with the presence of a liquid core under each instrumented roll location. Incidents of bulging and roll eccentricity were also detected using frequency analysis of the optical strain signal. The liquid core position measurements were compared using predictions from computer models (digital twins) in use at the production site. The measurements were in good agreement with the model predictions, with a few exceptions. Under certain transient caster operating conditions, such as spraying practice changes and SEN exchanges, the model predictions deviated slightly from the liquid core position determined from strain measurements.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

Mean Climate and Tropical Rainfall Variability in Aquaplanet Simulations Using the Model for Prediction Across Scales‐Atmosphere

Abstract Aquaplanet experiments are important tools for understanding and improving physical processes simulated by global models; yet, previous aquaplanet experiments largely differ in their representation of subseasonal tropical rainfall variability. This study presents results from aquaplanet experiments produced with the Model for Prediction Across Scales‐Atmosphere (MPAS‐A)—a community model specifically designed to study weather and climate in a common framework. The mean climate and tropical rainfall variability simulated by MPAS‐A with varying horizontal resolution were compared against results from a recent suite of aquaplanet experiments. This comparison shows that, regardless of horizontal resolution, MPAS‐A produces the expected mean climate of an aquaplanet framework with zonally symmetric but meridionally varying sea‐surface temperature. MPAS‐A, however, has a stronger signal of tropical rainfall variability driven by convectively coupled equatorial waves. Sensitivity experiments with different cumulus parameterizations, physics packages, and vertical grids consistently show the presence of those waves, especially equatorial Kelvin waves, in phase with lower‐tropospheric convergence. Other models do not capture such rainfall‐kinematics phasing. These results suggest that simulated tropical rainfall variability depends not only on the cumulus parameterization (as suggested by previous studies) but also on the coupling between physics and dynamics of climate and weather prediction models.

Rios‐Berrios, R.↗
DOE OSTI2022

Integrated Computational Materials and Mechanical Modeling for Additive Manufacturing of Alloys with Graded Structure Used in Fossil Fuel Power Plants

Wire-arc additive manufacturing (WAAM) has demonstrated its unique capability of producing large-size alloy components with a significantly reduced fabrication time and enhanced geometry design freedom. In this project, the team has developed an ICME (Integrated Computational Materials Engineering) modeling framework, which supports the WAAM of the AUSC (Advanced Ultra-Supercritical) power plant components. The manufacturing design has been applied to Inconel 740H, steel P91, as well as the dissimilar alloy components between steel P91 and Inconel 740H. The ICME model framework is developed by considering two types of modeling. First, mechanistic modeling has been applied to control the printing quality and understand the sequence of the dissimilar printing of the wall structure. The following models have been included in the developed ICME framework: finite element thermal model, grain structure model, residual stress simulation, crystal plasticity model, CALPHAD-based precipitation kinetic model, phase stability prediction, thermal expansion predictive model, and heuristic creep model. Secondary, a physics-based machine learning model has also been developed based on the ICME model structure. The machine learning model development is based on the ICME model prediction with calibration of the experiments. In addition, the WAAM has been utilized as a high-throughput experimental tool rapidly generating a gradient of alloy composition to facilitate experimental database generation for process-structure-property relationships. Such a database directly supported the ICME-enhanced machine learning, which further assisted in intermediate composition block design between P91 and 740H. A high-throughput screening study of the oxidation resistance has been performed based on such high-throughput experimentation. Based on the computational design, several dissimilar alloy manufacturing with post-heat treatment have been performed with a comprehensive evaluation of mechanical performance, including hardness mapping, yield strength, creep resistance. In this project, the single component of P91 and 740H processed by WAAM after heat treatment designed by ICME has demonstrated higher performance in yield strength and creep resistance than the wrought materials. The P91 sample prepared by WAAM with ICME-designed heat treatment performs better than P92 in creep resistance. The designed graded alloy printing with intermediate block shows a promising performance that exceeds the traditional welding. Moreover, the current research indicates the high need for location-specific design analysis with uncertainty quantification, an important topic that deserves more dedicated research. The achievement of this project demonstrated the promising future of WAAM in structural alloy manufacturing for energy power plant development. Successful printing requires synergetic efforts made by manufacturing, mechanical, and materials sciences.

20 FOSSIL-FUELED POWER PLANTS↗