Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “ensemble prediction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Ensemble transfer learning for the prediction of anti-cancer drug response

Abstract Transfer learning, which transfers patterns learned on a source dataset to a related target dataset for constructing prediction models, has been shown effective in many applications. In this paper, we investigate whether transfer learning can be used to improve the performance of anti-cancer drug response prediction models. Previous transfer learning studies for drug response prediction focused on building models to predict the response of tumor cells to a specific drug treatment. We target the more challenging task of building general prediction models that can make predictions for both new tumor cells and new drugs. Uniquely, we investigate the power of transfer learning for three drug response prediction applications including drug repurposing, precision oncology, and new drug development, through different data partition schemes in cross-validation. We extend the classic transfer learning framework through ensemble and demonstrate its general utility with three representative prediction algorithms including a gradient boosting model and two deep neural networks. The ensemble transfer learning framework is tested on benchmark in vitro drug screening datasets. The results demonstrate that our framework broadly improves the prediction performance in all three drug response prediction applications with all three prediction algorithms.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Updating and Evaluating Anthropogenic Emissions for NOAA’s Global Ensemble Forecast Systems for Aerosols (GEFS-Aerosols): Application of an SO 2 Bias-Scaling Method

We updated the anthropogenic emissions inventory in NOAA’s operational Global Ensemble Forecast for Aerosols (GEFS-Aerosols) to improve the model’s prediction of aerosol optical depth (AOD). We used a methodology to quickly update the pivotal global anthropogenic sulfur dioxide (SO 2 ) emissions using a speciated AOD bias-scaling method. The AOD bias-scaling method is based on the latest model predictions compared to NASA’s Modern-Era Retrospective analysis for Research and Applications, version 2 (MERRA2). The model bias was subsequently applied to the CEDS 2019 SO 2 emissions for adjustment. The monthly mean GEFS-Aerosols AOD predictions were evaluated against a suite of satellite observations (e.g., MISR, VIIRS, and MODIS), ground-based AERONET observations, and the International Cooperative for Aerosol Prediction (ICAP) ensemble results. The results show that transitioning from CEDS 2014 to CEDS 2019 emissions data led to a significant improvement in the operational GEFS-Aerosols model performance, and applying the bias-scaled SO 2 emissions could further improve global AOD distributions. The biases of the simulated AODs against the observed AODs varied with observation type and seasons by a factor of 3~13 and 2~10, respectively. The global AOD distributions showed that the differences in the simulations against ICAP, MISR, VIIRS, and MODIS were the largest in March–May (MAM) and the smallest in December–February (DJF). When evaluating against the ground-truth AERONET data, the bias-scaling methods improved the global seasonal correlation (r), Index of Agreement (IOA), and mean biases, except for the MAM season, when the negative regional biases were exacerbated compared to the positive regional biases. The effect of bias-scaling had the most beneficial impact on model performance in the regions dominated by anthropogenic emissions, such as East Asia. However, it showed less improvement in other areas impacted by the greater relative transport of natural emissions sources, such as India. The accuracies of the reference observation or assimilation data for the adjusted inputs and the model physics for outputs, and the selection of regions with less seasonal emissions of natural aerosols determine the success of the bias-scaling methods. A companion study on emission scaling of anthropogenic absorbing aerosols needs further improved aerosol prediction.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Causes and evolution of winter polynyas north of Greenland

During the 42-year period (1979–2020) of satellite measurements, four major winter (December–March) polynyas have been observed north of Greenland: one in December 1986 and three in the last decade, i.e., February of 2011, 2017, and 2018. The 2018 polynya was unparalleled in its magnitude and duration compared to the three previous events. Given the apparent recent increase in the occurrence of these extreme events, this study aims to examine their evolution and causality, in terms of forced versus natural variability. The limited weather station and remotely sensed sea ice data are analyzed combining with output from the fully coupled Regional Arctic System Model (RASM), including one hindcast and two ensemble simulations. We found that neither the accompanying anomalous warm surface air intrusion nor the ocean below had an impact (i.e., no significant ice melting) on the evolution of the observed winter open-water episodes in the region. Instead, the extreme atmospheric wind forcing resulted in greater sea ice deformation and transport offshore, accounting for the majority of sea ice loss in all four polynyas. Our analysis suggests that strong southerly winds (i.e., northward wind with speeds greater than 10 m s –1 ) blowing persistently over the study region for at least 2 d or more were required over the study region to mechanically redistribute some of the thickest Arctic sea ice out of the region and thus to create open-water areas (i.e., a latent heat polynya). To assess the role of internal variability versus external forcing of such events, we carried out and examined results from the two RASM ensembles dynamically downscaled with output from the Community Earth System Model (CESM) Decadal Prediction Large Ensemble (DPLE) simulations. Out of 100 winters in each of the two ensembles (initialized 30 years apart: one in December 1985 and another in December 2015), 17 and 16 winter polynyas were produced north of Greenland, respectively. The frequency of polynya occurrence had no apparent sensitivity to the initial sea ice thickness in the study area pointing to internal variability of atmospheric forcing as a dominant cause of winter polynyas north of Greenland. We assert that dynamical downscaling using a high-resolution regional climate model offers a robust tool for process-level examination in space and time, synthesis with limited observations, and probabilistic forecasts of Arctic events, such as the ones being investigated here and elsewhere.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1985

Temporal variations in predictability

Those characteristics which most significantly contribute to temporal variations in error growth are presently examined in light of a large ensemble of predictability runs conducted in the course of a long equilibrium run in a two-level, nonlinear, quasi-geostrophic model which incorporates orography. In the error spectrum thus developed, all scales grow with a similar doubling time until saturation is first reached at the smallest scales. Due to a lag relationship between equilibrium kinetic energy and available potential energy, it is possible to marginally predict times of small and large error growth.

Roads, J. O.↗
DOE OSTI2023

Neural network ensembles and uncertainty estimation for predictions of inelastic mechanical deformation using a finite element method-neural network approach

The finite element method (FEM) is widely used to simulate a variety of physics phenomena. Approaches that integrate FEM with neural networks (NNs) are typically leveraged as an alternative to conducting expensive FEM simulations in order to reduce the computational cost without significantly sacrificing accuracy. However, these methods can produce biased predictions that deviate from those obtained with FEM, since these hybrid FEM-NN approaches rely on approximations trained using physically relevant quantities. In this work, an uncertainty estimation framework is introduced that leverages ensembles of Bayesian neural networks to produce diverse sets of predictions using a hybrid FEM-NN approach that approximates internal forces on a deforming solid body. The uncertainty estimator developed herein reliably infers upper bounds of bias/variance in the predictions for a wide range of interpolation and extrapolation cases using a three-element FEM-NN model of a bar undergoing plastic deformation. This proposed framework offers a powerful tool for assessing the reliability of physics-based surrogate models by establishing uncertainty estimates for predictions spanning a wide range of possible load cases.

42 ENGINEERING↗
NASA NTRS2001

Interannual Variability, Global Teleconnection, and Potential Predictability Associated with the Asian Summer Monsoon

In this Chapter, aspects of global teleconnections associated with the interannual variability of the Asian summer monsoon (ASM) are discussed. The basic differences in the basic dynamics of the South Asian Monsoon and the East Asian monsoon, and their implications on global linkages are discussed. Two teleconnection modes linking ASM variability to summertime precipitation over the continental North America were identified. These modes link regional circulation and precipitation anomalies over East Asia and continental North America, via coupled atmosphere-ocean variations over the North Pacific. The first mode has a large zonally symmetrical component and appears to be associated with subtropical jetstream variability and the second mode with Rossby wave dispersion. Both modes possess strong sea surface temperature (SST) expressions in the North Pacific. Results show that the two teleconnection modes may have its origin in intrinsic modes of sea surface temperature variability in the extratropical oceans, which are forced in part by atmospheric variability and in part by air-sea interaction. The potential predictability of the ASM associated with SST variability in different ocean basins is explored using a new canonical ensemble correlation prediction scheme. It is found that SST anomalies in tropical Pacific, i.e., El Nino, is the most dominant forcing for the ASM, especially over the maritime continent and eastern Australia. SST anomalies in the India Ocean may trump the influence from El Nino in western Australia and western maritime continent. Both El Nino, and North Pacific SSTs contribute to monsoon precipitation anomalies over Japan, southern Korea, northern and central China. By optimizing SST variability signals from the world ocean basins using CEC, the overall predictability of ASM can be substantially improved.

Lau, K. M.↗
NASA NTRS2013

The North American Multi-Model Ensemble (NMME): Phase-1 Seasonal to Interannual Prediction, Phase-2 Toward Developing Intra-Seasonal Prediction

The recent US National Academies report "Assessment of Intraseasonal to Interannual Climate Prediction and Predictability" was unequivocal in recommending the need for the development of a North American Multi-Model Ensemble (NMME) operational predictive capability. Indeed, this effort is required to meet the specific tailored regional prediction and decision support needs of a large community of climate information users. The multi-model ensemble approach has proven extremely effective at quantifying prediction uncertainty due to uncertainty in model formulation, and has proven to produce better prediction quality (on average) then any single model ensemble. This multi-model approach is the basis for several international collaborative prediction research efforts, an operational European system and there are numerous examples of how this multi-model ensemble approach yields superior forecasts compared to any single model. Based on two NOAA Climate Test Bed (CTB) NMME workshops (February 18, and April 8, 2011) a collaborative and coordinated implementation strategy for a NMME prediction system has been developed and is currently delivering real-time seasonal-to-interannual predictions on the NOAA Climate Prediction Center (CPC) operational schedule. The hindcast and real-time prediction data is readily available (e.g., http://iridl.ldeo.columbia.edu/SOURCES/.Models/.NMME/) and in graphical format from CPC (http://origin.cpc.ncep.noaa.gov/products/people/wd51yf/NMME/index.html). Moreover, the NMME forecast are already currently being used as guidance for operational forecasters. This paper describes the new NMME effort, presents an overview of the multi-model forecast quality, and the complementary skill associated with individual models.

NOAA CPC↗
NASA NTRS2016

Fast and Slow Precipitation Responses to Individual Climate Forcers: A PDRMIP Multimodel Study

Precipitation is expected to respond differently to various drivers of anthropogenic climate change. We present the first results from the Precipitation Driver and Response Model Intercomparison Project (PDRMIP), where nine global climate models have perturbed CO2, CH4, black carbon, sulfate, and solar insolation. We divide the resulting changes to global mean and regional precipitation into fast responses that scale with changes in atmospheric absorption and slow responses scaling with surface temperature change. While the overall features are broadly similar between models, we find significant regional intermodel variability, especially over land. Black carbon stands out as a component that may cause significant model diversity in predicted precipitation change. Processes linked to atmospheric absorption are less consistently modeled than those linked to top-of-atmosphere radiative forcing. We identify a number of land regions where the model ensemble consistently predicts that fast precipitation responses to climate perturbations dominate over the slow, temperature-driven responses.

environment effects↗
DOE OSTI2022

Prediction of grain structure after thermomechanical processing of U-10Mo alloy using sensitivity analysis and machine learning surrogate model

Abstract Hot rolling and annealing are critical intermediate steps for controlling microstructures and thickness variations when fabricating uranium alloyed with 10% molybdenum (U-10Mo), which is highly relevant to worldwide nuclear non-proliferation efforts. This work proposes a machine-learning surrogate model combined with sensitivity analysis to identify and predict U-10Mo microstructure development during thermomechanical processing. Over 200 simulations were collected using physics-based microstructure models covering a wide range of thermomechanical processing routes and initial alloy grain features. Based on the sensitivity analysis, we determined that an increase in rolling reduction percentage at each processing pass has the strongest effect in reducing the grain size. Multi-pass rolling and annealing can significantly improve recrystallization regardless of the reduction percentage. With a volume fraction below 2%, uranium carbide particles were found to have marginal effects on the average grain size and distribution. The proposed stratified stacking ensemble surrogate predicts the U-10Mo grain size with a mean square error four times smaller than a standard single deep neural network. At the same time, with a significant speedup (1000×) compared to the physics-based model, the machine learning surrogate shows good potential for U-10Mo fabrication process optimization.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Deep Learning Provides Substantial Improvements to County‐Level Fire Weather Forecasting Over the Western United States

Abstract The recent wildfires in the western United States during 2018 and 2020 caused record‐breaking fire damage and casualties. Despite remarkable advances in fire modeling and weather forecasting, it remains challenging to anticipate catastrophic wildfire events and associated damage. One key missing component is a fire weather prediction system with sufficiently long lead time capable of providing useful regional details. Here, we develop a hybrid prediction model of wildfire danger called CFS with super resolution (CFS‐SR) as a proof of concept to fill that void. The CFS‐SR model is constructed by integrating the Climate Forecast System version 2 with a deep learning (DL) technique from Single Image Super Resolution, a method widely used in enhancing image resolution. We show that for the 2018–2019 fire season, the CFS‐SR model significantly improves accuracy in forecasting fire weather at lead times of up to 7 days with an enhanced spatial resolution up to 4 km. This level of high resolution provides county‐level fire weather forecast, making it more practical for allocating resources to mitigate wildfire danger. Our study demonstrates that a proper combination of ensemble climate predictions with DL techniques can boost predictability at finer spatial scales, increasing the utility of fire weather forecasts for practical applications.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

The effects of bias, drift, and trends in calculating anomalies for evaluating skill of seasonal-to-decadal initialized climate predictions

In initialized seasonal to decadal (S2D) predictions, model hindcasts rapidly drift away from the initial observed state and converge toward a preferred state characterized by systematic error, or bias. Bias and drift are among the greatest challenges facing initialized prediction today. Differences in trends between initial states and drifted states, combined with bias and drift, introduce complexities in calculating anomalies to assess skill of initialized predictions. We examine several methods of calculating anomalies using the Decadal Prediction Large Ensemble (DPLE) using the Community Earth System Model (CESM) initialized hindcasts and focus on Pacific and Atlantic SSTs to illustrate issues with anomaly calculations. Three methods of computing anomalies, one as differences from a long term model climatology, another as bias-adjusted differences from the previous 15 year average from observations, and a third as differences from the previous 15 year average from the model, are contrasted and each is shown to have limitations. For the first, trends in bias and drift introduce higher skill estimates earlier and later in the hindcast period due to the trends that contribute to skill. For the second, higher skill can be introduced in situations where low frequency variability in the observations is large compared to the hindcasts on timescales greater than 15 years, while lower skill can result if the predicted signal is small and the bias-correction itself produces a transition of SST anomalies to the opposite sign of those that are observed. The third method has somewhat lower skill compared to each of the others, but has less difficulties with not only the long term trends in the model climatology, but also with the unrealistic situational skill from using observations as a reference. However, the first 15 years of the hindcast period cannot be evaluated due to having to wait to accumulate the previous 15 year model climatology before the method can be applied. Here, the IPO transition in the 2014–2016 time frame from negative to positive (predicted by Meehl et al. in in Nat Commun, 10.1038/NCOMMS11718, 2016) did indeed verify using all three methods, though each provides somewhat different skill values as a result of the respective limitations. There is no clear best method, as all are roughly comparable, and each has its own set of limitations and caveats. However, all three methods show generally higher overall skill in the AMO region compared to the IPO region.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

An efficient method to identify uncertainties of WRF-Solar variables in forecasting solar irradiance using a tangent linear sensitivity analysis

Uncertainty in predicting solar energy resources introduces major challenges in power system management and necessitates the development of reliable probabilistic solar forecasts. As the first part of the development of probabilistic forecasts based on the Weather Research and Forecasting model with solar extensions (WRF-Solar), this study presents a tangent linear approach to identify input variables responsible for the largest uncertainties in predicting surface solar irradiance and clouds. A tangent linear analysis is capable of efficiently investigating sensitivities of output variables with respect to various input variables of WRF-Solar because this approach avoids the computational burden of perturbing the initial conditions of individual input variables. We develop tangent linear models (TLMs) for six WRF-Solar physics packages that control the formation and dissipation of clouds and solar radiation, and we evaluate the validity of TLMs using a linearity test. The tangent linear sensitivity analysis is conducted under various scenarios based on satellite observations and model simulations to consider realistic input conditions. A simple method is used to quantify the impact of the uncertainty of input variables on the output variables from the TLMs. The results demonstrate that uncertainties in the output variables that are the focus of this study—including global horizontal irradiance, direct normal irradiance, cloud mixing ratio, cloud tendency, cloud fraction, and sensible and latent heat fluxes—are highly sensitive to uncertainties in 14 input variables. This study indicates that the tangent linear method can identify key variables of physics modules in WRF-Solar that can be stochastically perturbed to generate ensemble-based probabilistic forecasts.

14 SOLAR ENERGY↗
DOE OSTI2025

Enhancing Biomass Productivity by Forecast‐Informed Pond Operations

ABSTRACT Microalgal cultivation for biofuels and proteins holds significant promise but faces challenges in achieving economically viable biomass productivity under variable environmental conditions. This study introduces a forecast‐informed pond operation (FIPO) system that uses numerical weather prediction (NWP) ensemble forecasts and the biomass assessment tool (BAT) to optimize daily dilution rates for enhanced biomass production. In contrast to the current practice, where fixed dilution rates are based on operator experience, the FIPO system determines the optimal dilution rate based on future weather forecasts and biomass growth conditions. Our experiments validate the effectiveness of FIPO in both short‐ and long‐term growth scenarios. In short‐term experiments, FIPO increased biomass production by 21.3% compared to batch growth and 7.4% over fixed dilution (60% every 3 days) operations. The NWP forecast‐informed operations achieved biomass production nearly identical to that using perfect weather forecasts, highlighting the accuracy of current NWP forecasts for guiding pond operations. In long‐term experiments, FIPO resulted in biomass production increases of 13.3% and 17.8% compared to two fixed dilution rates (60% every 3 days and 20% daily). These findings underscore the viability of using NWP forecasts to optimize microalgal cultivation systems. By adjusting daily dilution rates in response to forecasted weather, operators can achieve higher biomass yields and mitigate risks associated with environmental variability. This study provides a foundation for future research and practical applications in commercial‐scale microalgal production.

Yan, Hongxiang [Energy and Environment Directorate↗
DOE OSTI2022

Accurate predictions from small boxes: variance suppression via the Zel'dovich approximation

Simulations have become an indispensable tool for accurate modelling of observables measured in galaxy surveys, but can be expensive if very large dynamic range in scale is required. We describe how to combine Lagrangian perturbation theory models with N-body simulations to reduce the effects of finite computational volume in the prediction of ensemble average properties in the simulations within the context of control variates. In particular we use the fact that Zel'dovich displacements, computed during initial condition generation for any simulation, correlate strongly with the final density field. Since all the correlators of biased tracers can be computed with arbitrary precision for these displacements, pairing the Zel'dovich `simulation' with the N-body realization allows hundredfold reductions in sample variance for power spectrum or correlation function estimation. Additionally, Zel'dovich control variates can accurately extend matter or tracer field emulators to larger scales than previously possible, as well as improving measurements of statistics in simulations which are inherently limited to small volumes, such as hydrodynamical simulations of galaxy formation and reionization.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Comment on “Hermitian stochastic methodology for x-ray superfluorescence”

This comment critically examines the paper “Hermitian stochastic methodology for x-ray superfluorescence” by Chuchurka, Sukharnikov, and Rohringer [Phys. Rev. A 109, 063705 (2024)]. Here, the paper proposes a Hermitian framework based on the positive-𝑃 stochastic equations (PPSEs), claimed to be derived “from first principles,” through a redefinition of physical variables without a clear rationale. However, because the original PPSEs cannot satisfy Hermiticity under any stochastic-diffusion-gauge transformation, the framework necessarily employs representations beyond this gauge freedom, thereby contradicting the original PPSEs and their ensemble-average predictions. The resulting equations have close structural similarities with the previously established Hermitian formalism of stochastic Maxwell-Bloch equations [arXiv:2305.04653 and Phys. Rev. A 110, 023724 (2024)].

Park, Jeong-Wan [Argonne National Laboratory (ANL)↗
DOE OSTI2025

Dark Matter Velocity Distributions for Direct Detection: Astrophysical Uncertainties Are Smaller Than They Appear

The sensitivity of direct detection experiments depends on the phase-space distribution of dark matter near the Sun, which can be modeled theoretically using cosmological hydrodynamical simulations of Milky Way–like galaxies. However, capturing the halo-to-halo variation in the local dark matter speeds—a necessary step for quantifying the astrophysical uncertainties that feed into experimental results—requires a sufficiently large sample of simulated galaxies, which has been a challenge. In this Letter, we quantify this variation with nearly 100 Milky Way–like galaxies from the tng50 simulation, the largest sample to date at this resolution. Moreover, we introduce a novel phase-space scaling procedure that endows every system with a reference frame that accurately reproduces the local standard-of-rest speed of our Galaxy, providing a principled way of extrapolating the simulation results to real-world data. The ensemble of predicted speed distributions is well characterized by the standard halo model, a Maxwell-Boltzmann distribution truncated at the escape speed, though the individual distributions can deviate from it, especially at high speeds. The dark matter–nucleon cross section limits placed by these speed distributions vary by ∼ 60% about the median. This places the 1⁢𝜎 astrophysical uncertainty at or below the level of the systematic uncertainty of current ton-scale detectors, even down to the energy threshold. The predicted uncertainty remains unchanged when subselecting on those TNG 50 galaxies with merger histories similar to the Milky Way. Tabulated speed distributions, as well as Maxwell-Boltzmann fits, are provided for use in computing direct detection bounds or projecting sensitivities.

Milky Way↗
DOE OSTI2020

Probabilistic Solar Power Forecasting Using Bayesian Model Averaging

There is rising interest in probabilistic forecasting to mitigate risks from solar power uncertainty, but the numerical weather prediction (NWP) ensembles readily available to system operators are often biased and underdispersed. We propose a Bayesian model averaging (BMA) post-processing method suitable for forecasting power from utility-scale photovoltaic (PV) plants at multiple time horizons up to at least the day-ahead timescale. BMA is a kernel dressing technique for NWP ensembles in which the forecast is a weighted sum of member-specific probability density functions. We tailor BMA for utility-scale PV forecasting by modeling power clipping at the AC inverter rating and advance the theory of BMA with a new beta kernel parameterization that accommodates theoretical constraints not previously addressed. BMA is demonstrated for a case study of 11 utility-scale PV plants in Texas, forecasting at hourly resolution for the complete year 2018. BMA's mixture-model approach mitigates underdispersion of the raw ensemble to significantly improve forecast calibration, while consistently outperforming an ensemble model output statistics (EMOS) parametric approach from the literature. At 4-hour lead time, the BMA post-processing achieves continuous ranked probability skill scores of 2--36% over the raw ensemble, with consistent performance at multiple lead times suitable for power system operations.

14 SOLAR ENERGY↗