Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “ensemble prediction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Coupled machine learning–ecosystem ensemble models substantially improve predictions of nitrous oxide (N 2 O) fluxes from US croplands

Nitrous oxide (N 2 O) is a potent and persistent greenhouse gas, with rising atmospheric concentrations driven in part by inefficient use of synthetic nitrogen (N) fertilizers in agriculture. Predicting soil N 2 O emissions is challenging due to high spatial and temporal variability arising from complex soil biogeochemical processes. Process-based ecosystem models and standalone machine learning (ML) approaches without extensive site-specific calibration often miss high-emission episodes. Here, we show how an Ensemble Modeling System (EMS) based on outputs from an ensemble of ecosystem models coupled to an ensemble of ML models can improve predictions and understanding of N 2 O fluxes from US cropland. Trained and validated on ~12,000 N 2 O chamber measurements at 17 US Midwest sites (six crops, 35 management practices), the EMS accurately predicted daily fluxes of N 2 O at both training (R 2 = 0.84, RMSE = 16.4 g N ha −1 d −1 ) and held-out testing sites (R 2 = 0.84, RMSE = 6.2 g N ha −1 d −1 ). Analyses identified six dominant N 2 O drivers: soil organic carbon (SOC), NH 4 + , NO 3 - , water-filled pore space, temperature, and aboveground biomass production. Wet, warm soils produced large N 2 O peaks only with sufficient SOC and mineral N; in low-SOC soils, fluxes remained low. Incorporating these drivers into process-based models might significantly improve their predictive capacity. The EMS demonstrates a strong potential to predict N 2 O fluxes at unseen sites, enabling more reliable regional inventories, improved gap-filling where measurements are sparse, and enhanced understanding of mechanisms to advance targeted mitigation strategies in food, feed, and bioenergy crops.

AI↗
DOE OSTI2024

Evidential Deep Learning: Enhancing Predictive Uncertainty Estimation for Earth System Science Applications

Abstract Robust quantification of predictive uncertainty is a critical addition needed for machine learning applied to weather and climate problems to improve the understanding of what is driving prediction sensitivity. Ensembles of machine learning models provide predictive uncertainty estimates in a conceptually simple way but require multiple models for training and prediction, increasing computational cost and latency. Parametric deep learning can estimate uncertainty with one model by predicting the parameters of a probability distribution but does not account for epistemic uncertainty. Evidential deep learning, a technique that extends parametric deep learning to higher-order distributions, can account for both aleatoric and epistemic uncertainties with one model. This study compares the uncertainty derived from evidential neural networks to that obtained from ensembles. Through applications of the classification of winter precipitation type and regression of surface-layer fluxes, we show evidential deep learning models attaining predictive accuracy rivaling standard methods while robustly quantifying both sources of uncertainty. We evaluate the uncertainty in terms of how well the predictions are calibrated and how well the uncertainty correlates with prediction error. Analyses of uncertainty in the context of the inputs reveal sensitivities to underlying meteorological processes, facilitating interpretation of the models. The conceptual simplicity, interpretability, and computational efficiency of evidential neural networks make them highly extensible, offering a promising approach for reliable and practical uncertainty quantification in Earth system science modeling. To encourage broader adoption of evidential deep learning, we have developed a new Python package, Machine Integration and Learning for Earth Systems (MILES) group Generalized Uncertainty for Earth System Science (GUESS) (MILES-GUESS) ( https://github.com/ai2es/miles-guess ), that enables users to train and evaluate both evidential and ensemble deep learning. Significance Statement This study demonstrates a new technique, evidential deep learning, for robust and computationally efficient uncertainty quantification in modeling the Earth system. The method integrates probabilistic principles into deep neural networks, enabling the estimation of both aleatoric uncertainty from noisy data and epistemic uncertainty from model limitations using a single model. Our analyses reveal how decomposing these uncertainties provides valuable insights into reliability, accuracy, and model shortcomings. We show that the approach can rival standard methods in classification and regression tasks within atmospheric science while offering practical advantages such as computational efficiency. With further advances, evidential networks have the potential to enhance risk assessment and decision-making across meteorology by improving uncertainty quantification, a longstanding challenge. This work establishes a strong foundation and motivation for the broader adoption of evidential learning, where properly quantifying uncertainties is critical yet lacking.

Schreck, John S.↗
DOE OSTI2023

Predictive performance of multi-model ensemble forecasts of COVID-19 across European nations

Background: Short-term forecasts of infectious disease burden can contribute to situational awareness and aid capacity planning. Based on best practice in other fields and recent insights in infectious disease epidemiology, one can maximise the predictive performance of such forecasts if multiple models are combined into an ensemble. Here, we report on the performance of ensembles in predicting COVID-19 cases and deaths across Europe between 08 March 2021 and 07 March 2022. Methods: We used open-source tools to develop a public European COVID-19 Forecast Hub. We invited groups globally to contribute weekly forecasts for COVID-19 cases and deaths reported by a standardised source for 32 countries over the next 1–4 weeks. Teams submitted forecasts from March 2021 using standardised quantiles of the predictive distribution. Each week we created an ensemble forecast, where each predictive quantile was calculated as the equally-weighted average (initially the mean and then from 26th July the median) of all individual models’ predictive quantiles. We measured the performance of each model using the relative Weighted Interval Score (WIS), comparing models’ forecast accuracy relative to all other models. We retrospectively explored alternative methods for ensemble forecasts, including weighted averages based on models’ past predictive performance. Results: Over 52 weeks, we collected forecasts from 48 unique models. We evaluated 29 models’ forecast scores in comparison to the ensemble model. We found a weekly ensemble had a consistently strong performance across countries over time. Across all horizons and locations, the ensemble performed better on relative WIS than 83% of participating models’ forecasts of incident cases (with a total N=886 predictions from 23 unique models), and 91% of participating models’ forecasts of deaths (N=763 predictions from 20 models). Across a 1–4 week time horizon, ensemble performance declined with longer forecast periods when forecasting cases, but remained stable over 4 weeks for incident death forecasts. In every forecast across 32 countries, the ensemble outperformed most contributing models when forecasting either cases or deaths, frequently outperforming all of its individual component models. Among several choices of ensemble methods we found that the most influential and best choice was to use a median average of models instead of using the mean, regardless of methods of weighting component forecast models. Conclusions: Our results support the use of combining forecasts from individual models into an ensemble in order to improve predictive performance across epidemiological targets and populations during infectious disease epidemics. Our findings further suggest that median ensemble methods yield better predictive performance more than ones based on means. Our findings also highlight that forecast consumers should place more weight on incident death forecasts than incident case forecasts at forecast horizons greater than 2 weeks. Funding: AA, BH, BL, LWa, MMa, PP, SV funded by National Institutes of Health (NIH) Grant 1R01GM109718, NSF BIG DATA Grant IIS-1633028, NSF Grant No.: OAC-1916805, NSF Expeditions in Computing Grant CCF-1918656, CCF-1917819, NSF RAPID CNS-2028004, NSF RAPID OAC-2027541, US Centers for Disease Control and Prevention 75D30119C05935, a grant from Google, University of Virginia Strategic Investment Fund award number SIF160, Defense Threat Reduction Agency (DTRA) under Contract No. HDTRA1-19-D-0007, and respectively Virginia Dept of Health Grant VDH-21-501-0141, VDH-21-501-0143, VDH-21-501-0147, VDH-21-501-0145, VDH-21-501-0146, VDH-21-501-0142, VDH-21-501-0148. AF, AMa, GL funded by SMIGE - Modelli statistici inferenziali per governare l'epidemia, FISR 2020-Covid-19 I Fase, FISR2020IP-00156, Codice Progetto: PRJ-0695. AM, BK, FD, FR, JK, JN, JZ, KN, MG, MR, MS, RB funded by Ministry of Science and Higher Education of Poland with grant 28/WFSN/2021 to the University of Warsaw. BRe, CPe, JLAz funded by Ministerio de Sanidad/ISCIII. BT, PG funded by PERISCOPE European H2020 project, contract number 101016233. CP, DL, EA, MC, SA funded by European Commission - Directorate-General for Communications Networks, Content and Technology through the contract LC-01485746, and Ministerio de Ciencia, Innovacion y Universidades and FEDER, with the project PGC2018-095456-B-I00. DE., MGu funded by Spanish Ministry of Health / REACT-UE (FEDER). DO, GF, IMi, LC funded by Laboratory Directed Research and Development program of Los Alamos National Laboratory (LANL) under project number 20200700ER. DS, ELR, GG, NGR, NW, YW funded by National Institutes of General Medical Sciences (R35GM119582; the content is solely the responsibility of the authors and does not necessarily represent the official views of NIGMS or the National Institutes of Health). FB, FP funded by InPresa, Lombardy Region, Italy. HG, KS funded by European Centre for Disease Prevention and Control. IV funded by Agencia de Qualitat i Avaluacio Sanitaries de Catalunya (AQuAS) through contract 2021-021OE. JDe, SMo, VP funded by Netzwerk Universitatsmedizin (NUM) project egePan (01KX2021). JPB, SH, TH funded by Federal Ministry of Education and Research (BMBF; grant 05M18SIA). KH, MSc, YKh funded by Project SaxoCOV, funded by the German Free State of Saxony. Presentation of data, model results and simulations also funded by the NFDI4Health Task Force COVID-19 ( https://www.nfdi4health.de/task-force-covid-19-2 ) within the framework of a DFG-project (LO-342/17-1). LP, VE funded by Mathematical and Statistical modelling project (MUNI/A/1615/2020), Online platform for real-time monitoring, analysis and management of epidemic situations (MUNI/11/02202001/2020); VE also supported by RECETOX research infrastructure (Ministry of Education, Youth and Sports of the Czech Republic: LM2018121), the CETOCOEN EXCELLENCE (CZ.02.1.01/0.0/0.0/17-043/0009632), RECETOX RI project (CZ.02.1.01/0.0/0.0/16-013/0001761). NIB funded by Health Protection Research Unit (grant code NIHR200908). SAb, SF funded by Wellcome Trust (210758/Z/18/Z).

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

An ensemble data assimilation modeling system for operational outdoor microalgae growth forecasting

Microalgae have received increasing attention as a potential feedstock for biofuel or biobased products. Forecasting the microalgae growth is beneficial for managers in planning pond operations and harvesting decisions. This study proposed a biomass forecasting system comprised of the Huesemann Algae Biomass Growth Model (BGM), the Modular Aquatic Simulation System in Two Dimensions (MASS2), ensemble data assimilation (DA), and numerical weather prediction Global Ensemble Forecast System (GEFS) ensemble meteorological forecasts. The novelty of this study is to seek the use of ensemble DA to improve both BGM and MASS2 model initial conditions with the assimilation of biomass and water temperature measurements and consequently improve short-term biomass forecasting skills. This study introduces the theory behind the proposed integrated biomass forecasting system, with an application undertaken in pseudo-real-time in three outdoor ponds cultured with Chlorella sorokiniana in Delhi, California, United States. Results from all three case studies demonstrate that the biomass forecasting system improved the short-term (i.e., 7-day) biomass forecasting skills by about 60% on average, comparing to forecasts without using the ensemble DA method. Given the satisfactory performances achieved in this study, it is probable that the integrated BGM-MASS2-DA forecasting system can be used operationally to inform managers in making pond operation and harvesting planning decisions.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Predicting concrete compressive strength using hybrid ensembling of surrogate machine learning models

This study aims to implement a hybrid ensemble surrogate machine learning technique in predicting the compressive strength (CS) of concrete, an important parameter used for durability design and service life prediction of concrete structures in civil engineering projects. For this purpose, an experimental database consisting of 1030 records has been compiled from the machine learning repository of the University of California, Irvine. The database was used to train and validate four conventional machine learning (CML) models, namely Artificial Neural Network (ANN), Linear and Non-Linear Multivariate Adaptive Regression Splines (MARS-L and MARS-C), Gaussian Process Regression (GPR), and Minimax Probability Machine Regression (MPMR). Subsequently, the predicted outputs of CML models were combined and trained using ANN to construct the Hybrid Ensemble Model (HENSM). It is observed that the proposed HENSM produces higher predictive accuracy compared to the CML models used in the present study. The predictive performance of all models for CS prediction was compared using the testing dataset and it is found that the HENSM model attained the highest predictive accuracy in both phases. Based on the experimental results, the newly constructed HENSM model is very potential to be a new alternative in handling the overfitting issues of CML models and hence, can be used to predict the concrete CS, including the design of less polluting and more sustainable concrete constructions.

36 MATERIALS SCIENCE↗
DOE OSTI2023

The Potential Benefits of Handling Mixture Statistics via a Bi-Gaussian EnKF: Tests With All-Sky Satellite Infrared Radiances

The meteorological characteristics of cloudy atmospheric columns can be very different from their clear counterparts. Thus, when a forecast ensemble is uncertain about the presence/absence of clouds at a specific atmospheric column (i.e., some members are clear while others are cloudy), that column's ensemble statistics will contain a mixture of clear and cloudy statistics. Such mixtures are inconsistent with the ensemble data assimilation algorithms currently used in numerical weather prediction. Hence, ensemble data assimilation algorithms that can handle such mixtures can potentially outperform currently used algorithms. In this study, we demonstrate the potential benefits of addressing such mixtures through a bi-Gaussian extension of the ensemble Kalman filter (BGEnKF). The BGEnKF is compared against the commonly used ensemble Kalman filter (EnKF) using perfect model observing system simulated experiments (OSSEs) with a realistic weather model (the Weather Research and Forecast model). Synthetic all-sky infrared radiance observations are assimilated in this study. In these OSSEs, the BGEnKF outperforms the EnKF in terms of the horizontal wind components, temperature, specific humidity, and simulated upper tropospheric water vapor channel infrared brightness temperatures. This study is one of the first to demonstrate the potential of a Gaussian mixture model EnKF with a realistic weather model. Our results thus motivate future research toward improving numerical Earth system predictions though explicitly handling mixture statistics.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Using High-Resolution NSRDB Data to Evaluate Cloud Mask Forecast from WRF-Solar EPS

Validating spatiotemporal distributions of cloud forecasts using numerical weather prediction (NWP) models is difficult as this requires high-quality cloud-property at significantly high spatial and temporal resolution over extended periods of time. Observations of cloud properties, such as cloud mask, cloud optical thickness, and cloud type, are vital for assessing the capability of NWP models to forecast various types of clouds. Using the National Solar Radiation Database (NSRDB), this research evaluates ensemble cloud-mask predictions from the WRF-Solar ensemble prediction system (WRF-Solar EPS). From the WRF-Solar EPS, day-ahead solar forecasts for the contiguous United States (CONUS) for 2018 are simulated. Given the NSRDB data is accessible at a resolution of 2 km, we can calculate the cloud fraction across the 9-km grid of WRF-Solar EPS. This allows us to spatially assess the cloud-mask forecasts using two methods against the high-resolution NSRDB: (a) considering all 2-km NSRDB clouds in the forecast domain (EMAll), and (b) using a minimum cloud fraction threshold of 50% to designate a pixel as cloudy (EMP50). The low-resolution cloud masks from WRF-Solar EPS are evaluated directly against the cloud-resolving scale gridded observations from NSRDB using EMAll. With EMP50, we presume that scenes with less than 50% cloud cover from the 2-km NSRDB are clear. Thus, this assessment approach allows for a fair comparison with WRF-Solar EPS resolved to a 9-km grid. A method of point-by-point verification is used to evaluate dichotomous (yes/no) cloud mask predictions against the NSRDB. For each pixel of model extent, cloud frequency and traditional metrics (e.g., probability of detection, false alarm rate, and hit rate, etc.) are computed and compared with satellite-derived data sets. Mismatched cloud frequency (MCF) is computed to measure the present capability of WRF-Solar EPS in representing various types of clouds, which are categorized using three levels of cloud top height (CTH) and cloud optical depth (COD) across entire CONUS. Preliminary results show that the WRF-Solar EPS provides MCF values ranging from 9% to 46%, 16% to 33%, and 8% to 27% for low-level, middle-level, and high-level clouds, respectively, for three CTHs. The model produces MCFs ranging from 27% to 46%, 13% to 34%, and 8% to 19% for thin, medium-thickness, and thick clouds, respectively, for three CODs. The presentation will include a detailed description of the current outcomes as well as potential future extensions. The evaluation approach established in this study is readily extensible to the evaluation of cloud predictions from different ensemble NWP models. In addition, the findings of the suggested evaluation technique aid in identifying model weaknesses and will ultimately lead to advances in WRF-Solar EPS's skill in predicting clouds and solar irradiance.

cloud mask forecast↗
DOE OSTI2021

Accounting for uncertainty in complex alluvial aquifer modeling by Bayesian multi-model approach

Alluvial aquifers by nature are complex caused by varied depositional environments. Developing a reliable groundwater model to represent an alluvial aquifer is non-trivial. Also, relying on a single best calibrated model may not be sufficient because of an inadequate choice of model parameter values. To better understand groundwater dynamics and improve model prediction reliability, this study presents a Bayesian multi-model uncertainty quantification (BMMUQ) framework to account for model parameter uncertainty in complex alluvial groundwater modeling. The methodology was applied to the agriculturally intensive Mississippi River alluvial aquifer (MRAA), Northeast Louisiana. An aquifer architecture was first constructed using 7,259 well logs in the MRAA area which covers three fluvial deposits (alluvium, braided-stream terrace, and braided-stream terrace-loess). A 12-layer MODFLOW model was then developed to address the alluvial aquifer complexity and well calibrated through a genetic algorithm. This study quantified model parameter uncertainty in hydraulic conductivity and specific storage of sand facies. Bayesian model averaging (BMA) with the Expectation Maximization (EM) algorithm was adopted to derive posterior model weights and head variances of 50 alternative conceptual groundwater flow models, and thereby obtains BMA ensemble model predictions instead of only relying on the best calibrated conceptual model. Overall, results show that an estimated around 950 million m3 of groundwater storage loss occurs in 2015 with respect to the beginning of 2004, due to high groundwater demand for irrigation in the MRAA area. Explicitly quantifying model uncertainty can produce more reliable groundwater level predictions from BMA ensemble model. The presented groundwater modeling framework improves our understanding of the MRAA and provides a valuable tool to assist agricultural water management.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Ensemble transfer learning for the prediction of anti-cancer drug response

Abstract Transfer learning, which transfers patterns learned on a source dataset to a related target dataset for constructing prediction models, has been shown effective in many applications. In this paper, we investigate whether transfer learning can be used to improve the performance of anti-cancer drug response prediction models. Previous transfer learning studies for drug response prediction focused on building models to predict the response of tumor cells to a specific drug treatment. We target the more challenging task of building general prediction models that can make predictions for both new tumor cells and new drugs. Uniquely, we investigate the power of transfer learning for three drug response prediction applications including drug repurposing, precision oncology, and new drug development, through different data partition schemes in cross-validation. We extend the classic transfer learning framework through ensemble and demonstrate its general utility with three representative prediction algorithms including a gradient boosting model and two deep neural networks. The ensemble transfer learning framework is tested on benchmark in vitro drug screening datasets. The results demonstrate that our framework broadly improves the prediction performance in all three drug response prediction applications with all three prediction algorithms.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Updating and Evaluating Anthropogenic Emissions for NOAA’s Global Ensemble Forecast Systems for Aerosols (GEFS-Aerosols): Application of an SO 2 Bias-Scaling Method

We updated the anthropogenic emissions inventory in NOAA’s operational Global Ensemble Forecast for Aerosols (GEFS-Aerosols) to improve the model’s prediction of aerosol optical depth (AOD). We used a methodology to quickly update the pivotal global anthropogenic sulfur dioxide (SO 2 ) emissions using a speciated AOD bias-scaling method. The AOD bias-scaling method is based on the latest model predictions compared to NASA’s Modern-Era Retrospective analysis for Research and Applications, version 2 (MERRA2). The model bias was subsequently applied to the CEDS 2019 SO 2 emissions for adjustment. The monthly mean GEFS-Aerosols AOD predictions were evaluated against a suite of satellite observations (e.g., MISR, VIIRS, and MODIS), ground-based AERONET observations, and the International Cooperative for Aerosol Prediction (ICAP) ensemble results. The results show that transitioning from CEDS 2014 to CEDS 2019 emissions data led to a significant improvement in the operational GEFS-Aerosols model performance, and applying the bias-scaled SO 2 emissions could further improve global AOD distributions. The biases of the simulated AODs against the observed AODs varied with observation type and seasons by a factor of 3~13 and 2~10, respectively. The global AOD distributions showed that the differences in the simulations against ICAP, MISR, VIIRS, and MODIS were the largest in March–May (MAM) and the smallest in December–February (DJF). When evaluating against the ground-truth AERONET data, the bias-scaling methods improved the global seasonal correlation (r), Index of Agreement (IOA), and mean biases, except for the MAM season, when the negative regional biases were exacerbated compared to the positive regional biases. The effect of bias-scaling had the most beneficial impact on model performance in the regions dominated by anthropogenic emissions, such as East Asia. However, it showed less improvement in other areas impacted by the greater relative transport of natural emissions sources, such as India. The accuracies of the reference observation or assimilation data for the adjusted inputs and the model physics for outputs, and the selection of regions with less seasonal emissions of natural aerosols determine the success of the bias-scaling methods. A companion study on emission scaling of anthropogenic absorbing aerosols needs further improved aerosol prediction.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Causes and evolution of winter polynyas north of Greenland

During the 42-year period (1979–2020) of satellite measurements, four major winter (December–March) polynyas have been observed north of Greenland: one in December 1986 and three in the last decade, i.e., February of 2011, 2017, and 2018. The 2018 polynya was unparalleled in its magnitude and duration compared to the three previous events. Given the apparent recent increase in the occurrence of these extreme events, this study aims to examine their evolution and causality, in terms of forced versus natural variability. The limited weather station and remotely sensed sea ice data are analyzed combining with output from the fully coupled Regional Arctic System Model (RASM), including one hindcast and two ensemble simulations. We found that neither the accompanying anomalous warm surface air intrusion nor the ocean below had an impact (i.e., no significant ice melting) on the evolution of the observed winter open-water episodes in the region. Instead, the extreme atmospheric wind forcing resulted in greater sea ice deformation and transport offshore, accounting for the majority of sea ice loss in all four polynyas. Our analysis suggests that strong southerly winds (i.e., northward wind with speeds greater than 10 m s –1 ) blowing persistently over the study region for at least 2 d or more were required over the study region to mechanically redistribute some of the thickest Arctic sea ice out of the region and thus to create open-water areas (i.e., a latent heat polynya). To assess the role of internal variability versus external forcing of such events, we carried out and examined results from the two RASM ensembles dynamically downscaled with output from the Community Earth System Model (CESM) Decadal Prediction Large Ensemble (DPLE) simulations. Out of 100 winters in each of the two ensembles (initialized 30 years apart: one in December 1985 and another in December 2015), 17 and 16 winter polynyas were produced north of Greenland, respectively. The frequency of polynya occurrence had no apparent sensitivity to the initial sea ice thickness in the study area pointing to internal variability of atmospheric forcing as a dominant cause of winter polynyas north of Greenland. We assert that dynamical downscaling using a high-resolution regional climate model offers a robust tool for process-level examination in space and time, synthesis with limited observations, and probabilistic forecasts of Arctic events, such as the ones being investigated here and elsewhere.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Neural network ensembles and uncertainty estimation for predictions of inelastic mechanical deformation using a finite element method-neural network approach

The finite element method (FEM) is widely used to simulate a variety of physics phenomena. Approaches that integrate FEM with neural networks (NNs) are typically leveraged as an alternative to conducting expensive FEM simulations in order to reduce the computational cost without significantly sacrificing accuracy. However, these methods can produce biased predictions that deviate from those obtained with FEM, since these hybrid FEM-NN approaches rely on approximations trained using physically relevant quantities. In this work, an uncertainty estimation framework is introduced that leverages ensembles of Bayesian neural networks to produce diverse sets of predictions using a hybrid FEM-NN approach that approximates internal forces on a deforming solid body. The uncertainty estimator developed herein reliably infers upper bounds of bias/variance in the predictions for a wide range of interpolation and extrapolation cases using a three-element FEM-NN model of a bar undergoing plastic deformation. This proposed framework offers a powerful tool for assessing the reliability of physics-based surrogate models by establishing uncertainty estimates for predictions spanning a wide range of possible load cases.

42 ENGINEERING↗
DOE OSTI2022

Prediction of grain structure after thermomechanical processing of U-10Mo alloy using sensitivity analysis and machine learning surrogate model

Abstract Hot rolling and annealing are critical intermediate steps for controlling microstructures and thickness variations when fabricating uranium alloyed with 10% molybdenum (U-10Mo), which is highly relevant to worldwide nuclear non-proliferation efforts. This work proposes a machine-learning surrogate model combined with sensitivity analysis to identify and predict U-10Mo microstructure development during thermomechanical processing. Over 200 simulations were collected using physics-based microstructure models covering a wide range of thermomechanical processing routes and initial alloy grain features. Based on the sensitivity analysis, we determined that an increase in rolling reduction percentage at each processing pass has the strongest effect in reducing the grain size. Multi-pass rolling and annealing can significantly improve recrystallization regardless of the reduction percentage. With a volume fraction below 2%, uranium carbide particles were found to have marginal effects on the average grain size and distribution. The proposed stratified stacking ensemble surrogate predicts the U-10Mo grain size with a mean square error four times smaller than a standard single deep neural network. At the same time, with a significant speedup (1000×) compared to the physics-based model, the machine learning surrogate shows good potential for U-10Mo fabrication process optimization.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Deep Learning Provides Substantial Improvements to County‐Level Fire Weather Forecasting Over the Western United States

Abstract The recent wildfires in the western United States during 2018 and 2020 caused record‐breaking fire damage and casualties. Despite remarkable advances in fire modeling and weather forecasting, it remains challenging to anticipate catastrophic wildfire events and associated damage. One key missing component is a fire weather prediction system with sufficiently long lead time capable of providing useful regional details. Here, we develop a hybrid prediction model of wildfire danger called CFS with super resolution (CFS‐SR) as a proof of concept to fill that void. The CFS‐SR model is constructed by integrating the Climate Forecast System version 2 with a deep learning (DL) technique from Single Image Super Resolution, a method widely used in enhancing image resolution. We show that for the 2018–2019 fire season, the CFS‐SR model significantly improves accuracy in forecasting fire weather at lead times of up to 7 days with an enhanced spatial resolution up to 4 km. This level of high resolution provides county‐level fire weather forecast, making it more practical for allocating resources to mitigate wildfire danger. Our study demonstrates that a proper combination of ensemble climate predictions with DL techniques can boost predictability at finer spatial scales, increasing the utility of fire weather forecasts for practical applications.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

The effects of bias, drift, and trends in calculating anomalies for evaluating skill of seasonal-to-decadal initialized climate predictions

In initialized seasonal to decadal (S2D) predictions, model hindcasts rapidly drift away from the initial observed state and converge toward a preferred state characterized by systematic error, or bias. Bias and drift are among the greatest challenges facing initialized prediction today. Differences in trends between initial states and drifted states, combined with bias and drift, introduce complexities in calculating anomalies to assess skill of initialized predictions. We examine several methods of calculating anomalies using the Decadal Prediction Large Ensemble (DPLE) using the Community Earth System Model (CESM) initialized hindcasts and focus on Pacific and Atlantic SSTs to illustrate issues with anomaly calculations. Three methods of computing anomalies, one as differences from a long term model climatology, another as bias-adjusted differences from the previous 15 year average from observations, and a third as differences from the previous 15 year average from the model, are contrasted and each is shown to have limitations. For the first, trends in bias and drift introduce higher skill estimates earlier and later in the hindcast period due to the trends that contribute to skill. For the second, higher skill can be introduced in situations where low frequency variability in the observations is large compared to the hindcasts on timescales greater than 15 years, while lower skill can result if the predicted signal is small and the bias-correction itself produces a transition of SST anomalies to the opposite sign of those that are observed. The third method has somewhat lower skill compared to each of the others, but has less difficulties with not only the long term trends in the model climatology, but also with the unrealistic situational skill from using observations as a reference. However, the first 15 years of the hindcast period cannot be evaluated due to having to wait to accumulate the previous 15 year model climatology before the method can be applied. Here, the IPO transition in the 2014–2016 time frame from negative to positive (predicted by Meehl et al. in in Nat Commun, 10.1038/NCOMMS11718, 2016) did indeed verify using all three methods, though each provides somewhat different skill values as a result of the respective limitations. There is no clear best method, as all are roughly comparable, and each has its own set of limitations and caveats. However, all three methods show generally higher overall skill in the AMO region compared to the IPO region.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

An efficient method to identify uncertainties of WRF-Solar variables in forecasting solar irradiance using a tangent linear sensitivity analysis

Uncertainty in predicting solar energy resources introduces major challenges in power system management and necessitates the development of reliable probabilistic solar forecasts. As the first part of the development of probabilistic forecasts based on the Weather Research and Forecasting model with solar extensions (WRF-Solar), this study presents a tangent linear approach to identify input variables responsible for the largest uncertainties in predicting surface solar irradiance and clouds. A tangent linear analysis is capable of efficiently investigating sensitivities of output variables with respect to various input variables of WRF-Solar because this approach avoids the computational burden of perturbing the initial conditions of individual input variables. We develop tangent linear models (TLMs) for six WRF-Solar physics packages that control the formation and dissipation of clouds and solar radiation, and we evaluate the validity of TLMs using a linearity test. The tangent linear sensitivity analysis is conducted under various scenarios based on satellite observations and model simulations to consider realistic input conditions. A simple method is used to quantify the impact of the uncertainty of input variables on the output variables from the TLMs. The results demonstrate that uncertainties in the output variables that are the focus of this study—including global horizontal irradiance, direct normal irradiance, cloud mixing ratio, cloud tendency, cloud fraction, and sensible and latent heat fluxes—are highly sensitive to uncertainties in 14 input variables. This study indicates that the tangent linear method can identify key variables of physics modules in WRF-Solar that can be stochastically perturbed to generate ensemble-based probabilistic forecasts.

14 SOLAR ENERGY↗
DOE OSTI2020

Improved Predictability of the Indian Ocean Dipole Using a Stochastic Dynamical Model Compared to the North American Multimodel Ensemble Forecast

This study assesses the predictive skill of eight North American Multimodel Ensemble (NMME) models in predicting the Indian Ocean dipole (IOD). We find that the forecasted ensemble-mean IOD–El Niño–Southern Oscillation (ENSO) relationship deteriorates away from the observed relationship with increasing lead time, which might be one reason that limits the IOD predictive skill in coupled models. We are able to improve the IOD predictive skill using a recently developed stochastic dynamical model (SDM) forced by forecasted ENSO conditions. The results are consistent with the previous result that operational IOD predictability beyond persistence at lead times beyond one season is mostly controlled by ENSO predictability and the signal-to-noise ratio of the Indo-Pacific climate system. The multimodel ensemble (MME) investigated here is found to be of superior skill compared to each individual model at most lead times. Importantly, the skill of the SDM IOD predictions forced with forecasted ENSO conditions were either similar or better than those of the MME IOD forecasts. Moreover, the SDM forced with observed ENSO conditions exhibits significantly higher IOD prediction skill than the MME at longer lead times, suggesting the large potential skill increase that could be achieved by improving operational ENSO forecasts. We find that both cold and warm biases of the predicted Niño-3.4 index may cause false alarms of negative and positive IOD events, respectively, in NMME models. Many false alarms for IOD forecasts at lead times longer than one season in the original forecasts disappear or are significantly reduced in the SDM forced by forecasted ENSO conditions.

54 ENVIRONMENTAL SCIENCES↗