Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “ensemble forecast”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Value of Information and Data Management Platform Promoting Modern Data Analysis Utilization. STTR Phase I, Final Technical Report

The immense growth in weather and river sensor data availability along with increases in computational power and algorithmic sophistication have enabled the widespread application of physical, machine learning, and artificial intelligence algorithms to river forecasting. The forecasts produced by widely varying model approaches are inherently limited in different ways, such as by the number and quality of training observations, producing biased predictions that achieve optimal skill only over specific ranges of weather and river conditions. Thus, despite the growing availability and new sources of forecasts, hydropower owners cannot fully leverage the information because they lack an effective mechanism to determine the “best” forecast for given conditions or objectives. Tools are needed to consolidate forecast information, demonstrate skill, and extract optimal forecast guidance from the range of possibilities. Such tools will increase uptake and beneficial use of the growing wealth of forecast information, and lead to improved operating decisions, optimal power generation, and enhanced system value. This research proposes to improve the value of forecasts by developing a broadly accessible verification framework and applying machine learning techniques to identify the ‘best’ forecast from an ensemble of sources given the current weather, river, and operating conditions.

13 HYDRO ENERGY↗
DOE OSTI2023

Ecological forecasts for marine resource management during climate extremes

Forecasting weather has become commonplace, but as society faces novel and uncertain environmental conditions there is a critical need to forecast ecology. Forewarning of ecosystem conditions during climate extremes can support proactive decision-making, yet applications of ecological forecasts are still limited. We showcase the capacity for existing marine management tools to transition to a forecasting configuration and provide skilful ecological forecasts up to 12 months in advance. The management tools use ocean temperature anomalies to help mitigate whale entanglements and sea turtle bycatch, and we show that forecasts can forewarn of human-wildlife interactions caused by unprecedented climate extremes. We further show that regionally downscaled forecasts are not a necessity for ecological forecasting and can be less skilful than global forecasts if they have fewer ensemble members. Our results highlight capacity for ecological forecasts to be explored for regions without the infrastructure or capacity to regionally downscale, ultimately helping to improve marine resource management and climate adaptation globally.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Improving seasonal precipitation forecasts in the Western United States through statistical downscaling

Abstract Seasonal precipitation forecasts in the western United States are critical resources for water resource management, especially during winter. While current seasonal forecasting systems provide monthly precipitation forecasts operationally, their coarse resolution limits their effectiveness in capturing the localized precipitation patterns and snowpack conditions essential for water resource managers in the mountainous regions. Here, analog statistical downscaling is demonstrated as an effective approach to enhance the spatial resolution of operational seasonal forecasts provided by the North American Multi-Model Ensemble. Downscaling was performed by building an analog ‘library’, in which corresponding model forecasts and observed values during the training period were stored. In the testing period, unseen model forecasts referenced the closest historical forecast from the analog library and applied the corresponding observational value for each point. This analysis indicates that downscaled products can capture localized features more accurately than the original coarse resolution forecasts, reducing forecast error across the western United States. Moreover, downscaling individual ensemble members—rather than downscaling the ensemble mean—further reduces forecasting error for their multi-model ensemble mean products. The greatest error reductions in the downscaled product, measured by root mean squared error (RMSE), were observed at low to mid-elevations (500–2000 meters), with 50%–70% improvement relative to the original forecasts. In the higher elevations (2000 meters and above), changes in RMSE relative to the original forecast were limited to 10%–30% improvements. The improvement is more substantial for forecast systems with 10 ensemble members compared to that with 4 members, but this relationship does not hold for the system with 24 ensemble members. These findings show that analog statistical downscaling can effectively address the spatial limitations of seasonal precipitation forecasts with minimal computational cost, providing a valuable framework for enhancing coarse resolution forecasting products while providing insights into the timing of ensemble mean calculations during the downscaling process.

Vernon, B. (ORCID:0009000891670689)↗
DOE OSTI2025

Huge ensembles – Part 2: Properties of a huge ensemble of hindcasts generated with spherical Fourier neural operators

Abstract. In Part 1, we created an ensemble based on spherical Fourier neural operators. As initial condition perturbations, we used bred vectors, and as model perturbations, we used multiple checkpoints trained independently from scratch. Based on diagnostics that assess the ensemble's physical fidelity, our ensemble has comparable performance to operational weather forecasting systems. However, it requires orders-of-magnitude fewer computational resources. Here in Part 2, we generate a huge ensemble (HENS), with 7424 members initialized each day of summer 2023. We enumerate the technical requirements for running huge ensembles at this scale. HENS precisely samples the tails of the forecast distribution and presents a detailed sampling of internal variability. HENS has two primary applications: (1) as a large dataset with which to study the statistics and drivers of extreme weather and (2) as a weather forecasting system. For extreme climate statistics, HENS samples events 4σ away from the ensemble mean. At each grid cell, HENS increases the skill of the most accurate ensemble member and enhances coverage of possible future trajectories. As a weather forecasting model, HENS issues extreme weather forecasts with better uncertainty quantification. It also reduces the probability of outlier events, in which the verification value lies outside the ensemble forecast distribution.

Mahesh, Ankur↗
DOE OSTI2022

Evaluating wind speed and power forecasts for wind energy applications using an open-source and systematic validation framework

Building on the verification and validation work developed under the Second Wind Forecast Improvement Project, this work exhibits the value of a consistent procedure to evaluate wind power forecasts. We established an open-source Python code base tailored for wind speed and wind power forecast validation, WE-Validate. The code base can evaluate model forecasts with observations in a coherent manner. To demonstrate the systematic validation framework of WE-Validate, we designed and hosted a forecast evaluation benchmark exercise. We invited forecast providers in industry and academia to participate and submit forecasts for two case studies. We then evaluated the submissions with WE-Validate. Our findings suggest that ensemble means have reasonable skills in time series forecasting, whereas they are often inferior to single ensemble members in wind ramp forecasting. Adopting a voting scheme in ramp forecasting that allows ensemble members to detect ramps independently leads to satisfactory skill scores. Throughout this document, we also emphasize the importance of using statistically robust and resistant metrics as well as equitable skill scores in forecast evaluation.

17 WIND ENERGY↗
DOE OSTI2023

Large Ensemble Particle Filter for Spatial Climate Reconstructions Using a Linear Inverse Model

Proxy records that document the last 2000 years of climate provide evidence for the wide range of the natural climate variability from inter-annual to secular timescales not captured by the short window of recent direct observations. Assessing climate models ability to reproduce such natural variations is crucial to understand climate sensitivity and impacts of future climate change. Paleoclimate data assimilation (PDA) offers a powerful way to extend the short instrumental period by optimally combining the physics described by General Circulation Climate Models (GCMs) with information from available proxy records while taking into account their uncertainties. Here we present a new PDA approach based on a sequential importance resampling (SIR) Particle filter (PF) that uses Linear Inverse Modeling (LIM) as an emulator of several CMIP-class GCMs. We examine in a perfect-model framework the skill of the various LIMs to forecast the dynamics of the surface temperatures and provide spatial field reconstructions over the last millennium in a SIR PF. Our results show that the LIMs allow for skillful ensemble forecasts at 1-year lead-time based on GCMs dynamical knowledge with best prediction in the tropics and the North Atlantic. The PDA further provides a set of physically consistent spatial fields allowing robust uncertainty quantification related to climate models biases and proxy spatial sampling. Our results indicate that the LIM yields dynamical memory improving climate variability reconstructions and support the use of the LIM as a GCM-emulator in real reconstruction to propagate large ensembles of particles at low cost in SIR PF.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

A deep learning-accelerated data assimilation and forecasting workflow for commercial-scale geologic carbon storage

Fast assimilation of monitoring data to update forecasts of pressure buildup and carbon dioxide (CO 2 ) plume migration under geologic uncertainties is a challenging problem in geologic carbon storage. The high computational cost of data assimilation with a high-dimensional parameter space impedes fast decision-making for commercial-scale reservoir management. We propose to leverage physical understandings of porous medium flow behavior with deep learning techniques to develop a fast data assimilation-reservoir response forecasting workflow. Applying an Ensemble Smoother Multiple Data Assimilation (ES-MDA) framework, the workflow updates geologic properties and predicts reservoir performance with quantified uncertainty from pressure history and CO 2 plumes interpreted through seismic inversion. As the most computationally expensive component in such a workflow is reservoir simulation, we developed surrogate models to predict dynamic pressure and CO 2 plume extents under multi-well injection. The surrogate models employ deep convolutional neural networks, specifically, a wide residual network and a residual U-Net. The workflow is validated against a flat threedimensional reservoir model representative of a clastic shelf depositional environment. Intelligent treatments are applied to bridge between quantities in a true-3D reservoir model and those in a single-layer reservoir model. The workflow can complete history matching and reservoir forecasting with uncertainty quantification in less than one hour on a mainstream personal workstation.

25 ENERGY STORAGE↗
DOE OSTI2021

Assimilation of a Coordinated Fleet of Uncrewed Aircraft System Observations in Complex Terrain: EnKF System Design and Preliminary Assessment

Abstract Uncrewed aircraft system (UAS) observations collected during the 2018 Lower Atmospheric Process Studies at Elevation—a Remotely Piloted Aircraft Team Experiment (LAPSE-RATE) field campaign were assimilated into a high-resolution configuration of the Weather Research and Forecasting Model using an ensemble Kalman filter. The benefit of UAS observations was assessed for a terrain-driven (drainage and upvalley) flow event that occurred within Colorado’s San Luis Valley (SLV) using independent observations. The analysis and prediction of the strength, depth, and horizontal extent of drainage flow from the Saguache Canyon and the subsequent transition to upvalley and up-canyon flow were improved relative to that obtained both without data assimilation (benchmark) and when only surface observations were assimilated. Assimilation of UAS observations greatly improved the analyses of vertical variations in temperature, relative humidity, and winds at multiple locations in the northern portion of the SLV, with reductions in both bias and the root-mean-square error of roughly 40% for each variable relative to the benchmark run. Despite these noted improvements, some biases remain that were tied to measurement error and/or the impact of the boundary layer parameterization on vertically spreading the observations, both of which require further exploration. The results presented here highlight how observations obtained with a fleet of profiling UAS improve limited-area, high-resolution analyses and short-term forecasts in complex terrain.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Augmentation of WRF-Hydro to simulate overland-flow- and streamflow-generated debris flow susceptibility in burn scars

In steep wildfire-burned terrains, intense rainfall can produce large runoff that can trigger highly destructive debris flows. However, the ability to accurately characterize and forecast debris flow susceptibility in burned terrains using physics-based tools remains limited. Here, we augment the Weather Research and Forecasting Hydrological modeling system (WRF-Hydro) to simulate both overland and channelized flows and assess postfire debris flow susceptibility over a regional domain. We perform hindcast simulations using high-resolution weather-radar-derived precipitation and reanalysis data to drive non-burned baseline and burn scar sensitivity experiments. Our simulations focus on January 2021 when an atmospheric river triggered numerous debris flows within a wildfire burn scar in Big Sur – one of which destroyed California's famous Highway 1. Compared to the baseline, our burn scar simulation yields dramatic increases in total and peak discharge and shorter lags between rainfall onset and peak discharge, consistent with streamflow observations at nearby US Geological Survey (USGS) streamflow gage sites. For the 404 catchments located in the simulated burn scar area, median catchment-area-normalized peak discharge increases by ~ 450 % compared to the baseline. Catchments with anomalously high catchment-area-normalized peak discharge correspond well with post-event field-based and remotely sensed debris flow observations. We suggest that our regional postfire debris flow susceptibility analysis demonstrates WRF-Hydro as a compelling new physics-based tool whose utility could be further extended via coupling to sediment erosion and transport models and/or ensemble-based operational weather forecasts. Given the high-fidelity performance of our augmented version of WRF-Hydro, as well as its potential usage in probabilistic hazard forecasts, we argue for its continued development and application in postfire hydrologic and natural hazard assessments.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Future projections and uncertainty assessment of precipitation extremes in the Korean peninsula from the CMIP5 ensemble

Abstract Projections of changes in extreme climate are sometimes predicted by multimodel ensemble methods that combine forecasts from individual simulation models using weighted averaging. One method to assign weight to each model is the Bayesian model averaging (BMA) in which posterior probability is used. For the cases of extreme climate, the generalized extreme value distribution (GEVD) is typically used. We applied the approach of GEV‐embedded BMA to a series of 35 years of the annual maximum daily precipitation data (both historical data and data gathered from simulation experiments for future periods) over the Korean peninsula as simulated by the models in the Coupled Model Intercomparison Project Phase 5 (CMIP5). Simulation data under two Representative Concentration Pathway (RCP) scenarios, namely RCP4.5 and RCP8.5, were used. Observed data and 17 CMIP5 models for 12 gird cells in Korea have been examined to predict future changes in precipitation extremes. A simple regional frequency analysis of pooling observations from three stations in each cell was employed to reduce the estimation variance and local fluctuations. A bias correction technique using the regression‐type transfer function was applied to these simulation data. Return levels spanning over 20 and 50 years, as well as the return periods relative to the reference years (1971–2005), were estimated for two future periods, namely Period 1 (2021–2050) and Period 2 (2066–2095). From these analyses, relative increase observed in the spatially averaged 20‐year (50‐year) return level was approximately 23% (16%) and 45% (36%) in the RCP4.5 and RCP8.5 experiments, respectively, by the end of the 21st century. We concluded that extreme rainfalls will likely occur two times and four times more frequently in the RCP4.5 and RCP8.5 scenarios, respectively, as compared to in the reference years by the end of the 21st century.

Lee, Youngsaeng↗
DOE OSTI2023

Extreme windstorms in the Northeastern USA in the contemporary and future climate

Cold-season windstorms represent an important, and potentially changing, geophysical hazard in the Northeastern United States. Here we employ an integrated research methodology including both a storyline approach, where three intense windstorms from the current climate are subjected to pseudo-global warming (PGW) experiments, and a long-term transient simulation using the Weather Research and Forecasting (WRF) model. An ensemble of WRF simulations is built for each windstorm using different planetary boundary layer and microphysical parameterizations. The fidelity assessment suggests all ensemble members capture the windstorm evolution in contemporary climate. The configuration with highest fidelity is used in the PGW experiments performed with perturbed temperature fields, constant relative humidity, and deiced Great Lakes. These perturbation simulations indicate some evidence for a reduction of sea level pressure and increases in wind speed over and downwind of the Great Lakes and over the Atlantic Ocean plus an increase in precipitation accumulation but a reduction in snow coverage. These changes are spatially inhomogeneous in terms of magnitude and sign but are consistent with changes in potential vorticity. Alberta Clippers and Colorado Lows dominate the cyclones responsible for historical windstorms and thus are sampled in the PGW simulations. However, the transient simulation suggests an increasing role for tropical cyclones that undergo transition to extratropical cyclones. Furthermore, this reinforces the value of combining information from both PGW perturbation experiments within a storyline context and transient simulations when seeking to quantify the future risk associated with cold-season windstorms under changing climate.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Using High-Resolution NSRDB Data to Evaluate Cloud Mask Forecast from WRF-Solar EPS

Validating spatiotemporal distributions of cloud forecasts using numerical weather prediction (NWP) models is difficult as this requires high-quality cloud-property at significantly high spatial and temporal resolution over extended periods of time. Observations of cloud properties, such as cloud mask, cloud optical thickness, and cloud type, are vital for assessing the capability of NWP models to forecast various types of clouds. Using the National Solar Radiation Database (NSRDB), this research evaluates ensemble cloud-mask predictions from the WRF-Solar ensemble prediction system (WRF-Solar EPS). From the WRF-Solar EPS, day-ahead solar forecasts for the contiguous United States (CONUS) for 2018 are simulated. Given the NSRDB data is accessible at a resolution of 2 km, we can calculate the cloud fraction across the 9-km grid of WRF-Solar EPS. This allows us to spatially assess the cloud-mask forecasts using two methods against the high-resolution NSRDB: (a) considering all 2-km NSRDB clouds in the forecast domain (EMAll), and (b) using a minimum cloud fraction threshold of 50% to designate a pixel as cloudy (EMP50). The low-resolution cloud masks from WRF-Solar EPS are evaluated directly against the cloud-resolving scale gridded observations from NSRDB using EMAll. With EMP50, we presume that scenes with less than 50% cloud cover from the 2-km NSRDB are clear. Thus, this assessment approach allows for a fair comparison with WRF-Solar EPS resolved to a 9-km grid. A method of point-by-point verification is used to evaluate dichotomous (yes/no) cloud mask predictions against the NSRDB. For each pixel of model extent, cloud frequency and traditional metrics (e.g., probability of detection, false alarm rate, and hit rate, etc.) are computed and compared with satellite-derived data sets. Mismatched cloud frequency (MCF) is computed to measure the present capability of WRF-Solar EPS in representing various types of clouds, which are categorized using three levels of cloud top height (CTH) and cloud optical depth (COD) across entire CONUS. Preliminary results show that the WRF-Solar EPS provides MCF values ranging from 9% to 46%, 16% to 33%, and 8% to 27% for low-level, middle-level, and high-level clouds, respectively, for three CTHs. The model produces MCFs ranging from 27% to 46%, 13% to 34%, and 8% to 19% for thin, medium-thickness, and thick clouds, respectively, for three CODs. The presentation will include a detailed description of the current outcomes as well as potential future extensions. The evaluation approach established in this study is readily extensible to the evaluation of cloud predictions from different ensemble NWP models. In addition, the findings of the suggested evaluation technique aid in identifying model weaknesses and will ultimately lead to advances in WRF-Solar EPS's skill in predicting clouds and solar irradiance.

cloud mask forecast↗
DOE OSTI2021

Quantifying sensitivity in numerical weather prediction-modeled offshore wind speeds through an ensemble modeling approach

A decade of research has shown that numerical weather prediction (NWP)-modeled wind speeds can be highly sensitive to the inputs and setups within the NWP model. For wind resource characterization applications, this sensitivity is often addressed by constructing a range of setups and selecting the one that best validates against observations. However, this approach is not possible in areas that lack high-quality hub height observations, especially offshore wind areas. In such cases, techniques to quantify and disseminate confidence in NWP-modeled wind speeds in the absence of observations are needed. We address this need in the present study and propose best practices for quantifying the spread in NWP-modeled wind speeds. We implement an ensemble approach in which we consider 24 different setups to the Weather Research and Forecasting (WRF) model. We construct the ensemble by considering variations in WRF version, WRF namelist, atmospheric forcing, and sea surface temperature (SST) forcing. Our analysis finds that the standard deviation produces more consistent estimates compared to the interquartile range and tends to be the more conservative estimator for ensemble variability. We further find that model spread increases closer to the surface and on shorter time scales. In conclusion, we explore methods to attribute total ensemble variability to the different ensemble components (e.g., atmospheric forcing and SST product) and find that contributions by components also vary depending on time scale. We anticipate that the methods and results presented in this paper will provide a reasonable foundation for further research into ensemble-based wind resource data sets.

17 WIND ENERGY↗
DOE OSTI2024

How well are hazards associated with derechos reproduced in regional climate simulations?

Abstract. A 15-member ensemble of convection-permitting regional simulations of the fast-moving and destructive derecho of 29–30 June 2012 that impacted the northeastern urban corridor of the USA is presented. This event generated 1100 reports of damaging winds, generated significant wind gusts over an extensive area of up to 500 000 km2, caused several fatalities, and resulted in widespread loss of electrical power. Extreme events such as this are increasingly being used within pseudo-global-warming experiments to examine the sensitivity of historical, societally important events to global climate non-stationarity and how they may evolve as a result of changing thermodynamic and dynamic contexts. As such it is important to examine the fidelity with which such events are described in hindcast experiments. The regional simulations presented herein are performed using the Weather Research and Forecasting (WRF) model. The resulting ensemble is used to explore simulation fidelity relative to observations for wind gust magnitudes, spatial scales of convection (as is manifest in high composite reflectivity, cREF), and both rainfall and hail production as a function of model configuration (microphysics parameterization, lateral boundary conditions (LBCs), start date, use of nudging, compiler choice, damping, and number of vertical levels). We also examine the degree to which each ensemble member differs with respect to key mesoscale drivers of convective systems (e.g., convective available potential energy and vertical wind shear) and critical manifestations of deep convection, e.g., vertical velocities, cold-pool generation, and how those properties relate to the correct characterization of the associated atmospheric hazards (wind gusts and hail). Use of a double-moment, seven-class scheme with number concentrations for all species (including hail and graupel) results in the greatest fidelity of model-simulated wind gusts and convective structure to the observations of this event. All ensemble members, however, fail to capture the intensity of the event in terms of the spatial extent of convection and the production of high near-surface wind gusts. We further show very high sensitivity to the LBCs employed and specifically that simulation fidelity is higher for simulations nested within ERA-Interim compared to ERA5. Excess convective available potential energy (CAPE) in all ensemble members after the derecho passage leads to excess production of convective cells, wind gusts, cREF > 40 dBZ, and precipitation during a frontal passage on the subsequent day. This event proved very challenging to forecast in real time and to reproduce in the 15-member hindcast simulation ensemble presented here. Future work could examine if simulations with other initial and lateral boundary conditions can achieve greater fidelity.

Shepherd, Tristan (ORCID:0000000186276419)↗
DOE OSTI2020

Probabilistic Solar Power Forecasting Using Bayesian Model Averaging

There is rising interest in probabilistic forecasting to mitigate risks from solar power uncertainty, but the numerical weather prediction (NWP) ensembles readily available to system operators are often biased and underdispersed. We propose a Bayesian model averaging (BMA) post-processing method suitable for forecasting power from utility-scale photovoltaic (PV) plants at multiple time horizons up to at least the day-ahead timescale. BMA is a kernel dressing technique for NWP ensembles in which the forecast is a weighted sum of member-specific probability density functions. We tailor BMA for utility-scale PV forecasting by modeling power clipping at the AC inverter rating and advance the theory of BMA with a new beta kernel parameterization that accommodates theoretical constraints not previously addressed. BMA is demonstrated for a case study of 11 utility-scale PV plants in Texas, forecasting at hourly resolution for the complete year 2018. BMA's mixture-model approach mitigates underdispersion of the raw ensemble to significantly improve forecast calibration, while consistently outperforming an ensemble model output statistics (EMOS) parametric approach from the literature. At 4-hour lead time, the BMA post-processing achieves continuous ranked probability skill scores of 2--36% over the raw ensemble, with consistent performance at multiple lead times suitable for power system operations.

14 SOLAR ENERGY↗