Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Forecasts”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Towards Improved Understanding of the Applicability of Uncertainty Forecasts in the Electric Power Industry

Around the world wind energy is starting to become a major energy provider in electricity markets, as well as participating in ancillary services markets to help maintain grid stability. The reliability of system operations and smooth integration of wind energy into electricity markets has been strongly supported by years of improvement in weather and wind power forecasting systems. Deterministic forecasts are still predominant in utility practice although truly optimal decisions and risk hedging are only possible with the adoption of uncertainty forecasts. One of the main barriers for the industrial adoption of uncertainty forecasts is the lack of understanding of its information content (e.g., its physical and statistical modeling) and standardization of uncertainty forecast products, which frequently leads to mistrust towards uncertainty forecasts and their applicability in practice. Our paper aims at improving this understanding by establishing a common terminology and reviewing the methods to determine, estimate, and communicate the uncertainty in weather and wind power forecasts. This conceptual analysis of the state of the art highlights that: (i) end-users should start to look at the forecast's properties in order to map different uncertainty representations to specific wind energy-related user requirements; (ii) a multidisciplinary team is required to foster the integration of stochastic methods in the industry sector. Furthermore, a set of recommendations for standardization and improved training of operators are provided along with examples of best practices.

24 POWER TRANSMISSION AND DISTRIBUTION↗

On the Dominant Factor Controlling Seasonal Hydrological Forecast Skill in China

Initial conditions (ICs) and climate forecasts (CFs) are the two primary sources of seasonal hydrological forecast skill. However, their relative contribution to predictive skill remains unclear in China. In this study, we investigate the relative roles of ICs and CFs in cumulative runoff (CR) and soil moisture (SM) forecasts using 31-year (1980–2010) ensemble streamflow prediction (ESP) and reverse-ESP (revESP) simulations with the Variable Capacity Infiltration (VIC) hydrologic model. The results show that the relative importance of ICs and CFs largely depends on climate regimes. The influence of ICs is stronger in a dry or wet-to-dry climate regime that covers the northern and western interior regions during the late fall to early summer. In particular, ICs may dominate the forecast skill for up to three months or even six months during late fall and winter months, probably due to the low precipitation value and variability in the dry period. In contrast, CFs become more important for most of southern China or during summer months. The impact of ICs on SM forecasts tends to cover larger domains than on CR forecasts. These findings will greatly benefit future work that will target efforts towards improving current forecast levels for the particular regions and forecast periods.

54 ENVIRONMENTAL SCIENCES↗

Uncertainty Reduction in Power Generation Forecast Using Coupled Wavelet-ARIMA

In this paper, we introduce a new approach without implying normal distributions and stationarity of power generation forecast errors. In addition, it is desired to more accurately quantify the forecast uncertainty by reducing prediction intervals of forecasts. We use automatically coupled wavelet transform and autoregressive integrated moving-average (ARIMA) forecasting to reflect multi-scale variability of forecast errors. The proposed analysis reveals slow-changing “quasi-deterministic” components of forecast errors. This helps improve forecasts produced by other means, e.g., using weather-based models, and reduce forecast errors prediction intervals.

Power system planning, uncertainty reduction, fore↗

Probabilistic Short-Term Wind Forecasting Based on Pinball Loss Optimization: Preprint

Probabilistic wind power forecasts that quantify the uncertainty in wind output have the potential to aid in the economic grid integration of wind power at large penetration levels. In this paper, a novel probabilistic wind forecasting approach based on pinball loss optimization is proposed, in conjunction with a multi-model machine learning based ensemble deterministic forecasting framework. By assuming the pointforecasted value as the mean at each point, one unknown parameter (i.e., standard deviation) of a predictive distribution at each forecasting point is determined by minimizing the pinball loss. A surrogate model is developed to represent the unknown distribution parameter as a function of deterministic forecasts. This surrogate model can be used together with deterministic forecasts to predict the unknown distribution parameter and thereby generate probabilistic forecasts. Numerical results of case studies show that the proposed method has improved the pinball loss by up to 35% compared to a baseline quantile regression forecasting model.

17 WIND ENERGY↗

RAVIS: Resource Forecast and Ramp Visualization for Situational Awareness of Variable Renewable Generation: Preprint

The Resource Forecast and Ramp Visualization for Situational Awareness (RAVIS) is an innovative, open-source tool for visualizing variable renewable resource forecasts and alerts for significant up- and down-ramps in renewable generation and the consequent system net load. The modular dashboard of RAVIS contains configurable panes for viewing probabilistic time-series forecasts, ramp event alerts on the look-ahead timeline, and spatially resolved resource sites, and forecasts. For comprehensive situational awareness, the tool can add additional data layers from simulation and independent system operator (ISO) market clearing data—including electric line utilization, nodal price, and available generation flexibility—in response to continuously updated renewable forecasts. This paper introduces the RAVIS technology suite employed to provide optimum visualization and flexible design characteristics. The paper also illustrates some use cases of the tool using site-specific solar power forecast data obtained from the IBM Watt-Sun forecasting platform for the California ISO and Midcontinent ISO footprints. The source code for RAVIS is public (https://github.com/ravis-nrel/ravis), and the intended users are forecasters, utility planners, ISO operators, and researchers.

41 EE - Solar Energy Technologies Office (EE-4S)↗

Occlusion-Perturbed Deep Learning for Probabilistic Solar Forecasting via Sky Images: Preprint

Solar forecasting is shifting to the probabilistic paradigm due to the inherent uncertainty within the solar resource. Input uncertainty quantification is one of the widely used and best-performing ways to model solar uncertainty. However, compared to other sources of inputs, such as numerical weather prediction models, pure sky image-based probabilistic solar forecasting lags behind. In this research, an occlusion-perturbed convolutional neural network, named the PSolarNet, is developed. The PSolarNet provides very short-term deterministic forecasts, forecast scenarios, and probabilistic forecasts of the global horizontal irradiance from sky image sequences. Case studies based on 6 years of open-source data show that the developed PSolarNet is able to generate accurate 10-minute ahead deterministic forecasts with a 5.62% normalized root mean square error, realistic and diverse forecast scenarios with a 0.966 average correlation with the actual time series, and reliable and sharp probabilistic forecasts with a 2.77% normalized continuous ranked probability score.

Bayesian model averaging↗

An Optimized Autoregressive Forecast Error Generator for Wind and Load Uncertainty Study

This paper presents a first-order autoregressive algorithm to generate real-time (RT), hour-ahead (HA), and day-ahead (DA) wind and load forecast errors. The methodology aims at producing random wind and load forecast time series reflecting the autocorrelation and cross-correlation of historical forecast data sets. Five statistical characteristics are considered: the means, standard deviations, autocorrelations, and cross-correlations. A stochastic optimization routine is developed to minimize the differences between the statistical characteristics of the generated time series and the targeted ones. An optimal set of parameters are obtained and used to produce the RT, HA, and DA forecasts in due order of succession. This method, although implemented as the first-order regressive random forecast error generator, can be extended to higher-order. Results show that the methodology produces random series with desired statistics derived from real data sets provided by the California Independent System Operator (CAISO). The wind and load forecast error generator is currently used in wind integration studies to generate wind and load inputs for stochastic planning processes. Our future studies will focus on reflecting the diurnal and seasonal differences of the wind and load statistics and implementing them in the random forecast generator.

17 WIND ENERGY↗

Wind Forecasting Improvement Project In Complex Terrain Near the Columbia River Gorge

In 2014 a multi-institution team led by Vaisala, Inc. was selected by the Department of Energy (DOE) to partner with multiple DOE and National Oceanic and Atmospheric Administration (NOAA) laboratories on a project designed to improve the quality of wind power forecasts in areas of complex terrain. This was the second Wind Forecast Improvement Project (WFIP2) funded by DOE and it extended from late 2014 through the middle of 2018. It encompassed an 18-month observational field campaign, numerical weather prediction (NWP) model development, extensive analysis of data and NWP output, and the creation of decision support tool algorithms to convey forecast information to end users in the wind industry. WFIP2 focused on improvements to the representation of near-surface and boundary-layer physics in NOAA’s High-Resolution Rapid Refresh (HRRR) model. Improvements to HRRR, which is run operationally over the continental United States, benefit the wind industry in multiple ways. Forecasts from the operational HRRR are used directly by wind power forecast vendors and the operators of wind plants. In addition, because HRRR is built using the widely-used Weather Research and Forecasting (WRF) model, improvements to its parameterizations become available to commercial and research institutions using WRF for a myriad of purposes. The geographic area studied by WFIP2 was a region of the Columbia River basin located to the east of the Cascade Mountains between Oregon and Washington. Home to over 6 GW of installed capacity for wind energy production, this area also hosts a variety of atmospheric phenomena either unique to or augmented by complex topography. This makes it an attractive test-bed for the analysis of wind forecast in complex terrain, though results found are should be applicable in any area of topographic complexity. WFIP2 succeeded as a collaborative effort, and while this report focuses on the activities of the team led by Vaisala, the work described here is part of a larger whole. The Vaisala team accomplished a number of specific tasks as described in this report, while also contributing to this larger effort.

17 WIND ENERGY↗

Enhancing Biomass Productivity by Forecast‐Informed Pond Operations

ABSTRACT Microalgal cultivation for biofuels and proteins holds significant promise but faces challenges in achieving economically viable biomass productivity under variable environmental conditions. This study introduces a forecast‐informed pond operation (FIPO) system that uses numerical weather prediction (NWP) ensemble forecasts and the biomass assessment tool (BAT) to optimize daily dilution rates for enhanced biomass production. In contrast to the current practice, where fixed dilution rates are based on operator experience, the FIPO system determines the optimal dilution rate based on future weather forecasts and biomass growth conditions. Our experiments validate the effectiveness of FIPO in both short‐ and long‐term growth scenarios. In short‐term experiments, FIPO increased biomass production by 21.3% compared to batch growth and 7.4% over fixed dilution (60% every 3 days) operations. The NWP forecast‐informed operations achieved biomass production nearly identical to that using perfect weather forecasts, highlighting the accuracy of current NWP forecasts for guiding pond operations. In long‐term experiments, FIPO resulted in biomass production increases of 13.3% and 17.8% compared to two fixed dilution rates (60% every 3 days and 20% daily). These findings underscore the viability of using NWP forecasts to optimize microalgal cultivation systems. By adjusting daily dilution rates in response to forecasted weather, operators can achieve higher biomass yields and mitigate risks associated with environmental variability. This study provides a foundation for future research and practical applications in commercial‐scale microalgal production.

Yan, Hongxiang [Energy and Environment Directorate↗

A Physics-based Smart Persistence model for Intra-hour forecasting of solar radiation (PSPI) using GHI measurements and a cloud retrieval technique

Short-term solar forecasting models based solely on global horizontal irradiance (GHI) measurements are often unable to discriminate the forecasting of the factors affecting GHI from those that can be precisely computed by atmospheric models. Here, we introduce a Physics-based Smart Persistence model for Intra-hour forecasting of solar radiation (PSPI) that decomposes the forecasting of GHI into the computation of extraterrestrial solar radiation and solar zenith angle and the forecasting of cloud albedo and cloud fraction. The extraterrestrial solar radiation and solar zenith angle are accurately computed by the Solar Position Algorithm (SPA) developed at the National Renewable Energy Laboratory (NREL). A cloud retrieval technique is used to estimate cloud albedo and cloud fraction from surface-based observations of GHI. With the assumption of persistent cloud structures, the cloud albedo and cloud fraction are predicted for future time steps using a two-stream approximation and a 5-min exponential weighted moving average, respectively. Our model evaluation using the long-term observations of GHI at NREL's Solar Radiation Research Laboratory (SRRL) shows that the PSPI has a better performance than the persistence and smart persistence models in all forecast time horizons between 5 and 60 min, which is more significant in cloudy-sky conditions. Finally, compared to the persistence and smart persistence models, the PSPI does not require additional observations of various atmospheric parameters but is customizable in that additional observations, if available, can be ingested to further improve the GHI forecast. An advanced technology of cloud forecast is also expected to improve the future performance of the PSPI.

14 SOLAR ENERGY↗

The United States COVID-19 Forecast Hub dataset

Academic researchers, government agencies, industry groups, and individuals have produced forecasts at an unprecedented scale during the COVID-19 pandemic. To leverage these forecasts, the United States Centers for Disease Control and Prevention (CDC) partnered with an academic research lab at the University of Massachusetts Amherst to create the US COVID-19 Forecast Hub. Launched in April 2020, the Forecast Hub is a dataset with point and probabilistic forecasts of incident cases, incident hospitalizations, incident deaths, and cumulative deaths due to COVID-19 at county, state, and national, levels in the United States. Included forecasts represent a variety of modeling approaches, data sources, and assumptions regarding the spread of COVID-19. The goal of this dataset is to establish a standardized and comparable set of short-term forecasts from modeling teams. These data can be used to develop ensemble models, communicate forecasts to the public, create visualizations, compare models, and inform policies regarding COVID-19 mitigation. These open-source data are available via download from GitHub, through an online API, and through R packages.

60 APPLIED LIFE SCIENCES↗

Electrical Load Forecasting Over Multihop Smart Metering Networks With Federated Learning

Electric load forecasting is essential for power management and stability in smart grids. This is mainly achieved via advanced metering infrastructure, where smart meters (SMs) record household energy data. Traditional machine learning (ML) methods are often employed for load forecasting, but require data sharing, which raises data privacy concerns. Federated learning (FL) can address this issue by running distributed ML models at local SMs without data exchange. However, current FL-based approaches struggle to achieve efficient load forecasting due to imbalanced data distribution across heterogeneous SMs. Here, this article presents a novel personalized FL (PFL) method for high-quality load forecasting in metering networks. A meta-learning-based strategy is developed to address data heterogeneity at local SMs in the collaborative training of local load forecasting models. Moreover, to minimize the load forecasting delays in our PFL model, we study a new latency optimization problem based on optimal resource allocation at SMs. A theoretical convergence analysis is also conducted to provide insights into FL design for federated load forecasting. Extensive simulations from real-world datasets show that our method outperforms existing approaches regarding better load forecasting and reduced operational latency costs.

Rahman, Ratun [Univ. of Alabama, Huntsville, AL (U↗

Call Center Arrivals: When to Jointly Forecast Multiple Streams?

We consider call centers that have multiple (potentially inter‐dependent) demand arrival streams. Workforce management of such labor intensive service systems starts with forecasting future arrival demand. We investigate the question of whether and when to jointly forecast future arrivals of the multiple streams. We first develop a general statistical model to simultaneously forecast multi‐stream arrival rates. The model takes into account three types of inter‐stream dependence. We then show with analytical and simulation studies how the forecasting benefits of the multi‐stream forecasting model vary by the type, direction, and strength of inter‐stream dependence. In particular, we find that it is beneficial to simultaneously forecast multi‐stream arrivals (instead of separately forecasting each stream), when there exists inter‐stream lag dependence among daily arrival rates. Empirical studies, using two real call center datasets further demonstrate our findings, and provide operational insights into how one chooses forecasting models for multi‐stream arrivals.

Ye, Han↗

Load Forecasting in Electric Utility Integrated Resource Planning

Integrated resource planning (IRP) is a process used by many vertically-integrated U.S. electric utilities to determine least-cost/risk supply and demand-side resources that meet government policy objectives and future obligations to customers and, in many cases, shareholders. Forecasts of energy and peak demand are a critical component of the IRP process. There have been few, if any, quantitative studies of IRP long-run (planning horizons of two decades) load forecast performance and its relationship to resource planning and actual procurement decisions. In this paper, we evaluate load forecasting methods, assumptions, and outcomes for 12 Western U.S. utilities by examining and comparing plans filed in the early 2000s against recent plans, up to year 2014. We find a convergence in the methods and data sources used. We also find that forecasts in more recent IRPs generally took account of new information, but that there continued to be a systematic over-estimation of load growth rates during the period studied. We compare planned and procured resource expansion against customer load and year-to-year load growth rates, but do not find a direct relationship. Load sensitivities performed in resource plans do not appear to be related to later procurement strategies even in the presence of large forecast errors. These findings suggest that resource procurement decisions may be driven by other factors than customer load growth. Our results have important implications for the integrated resource planning process, namely that load forecast accuracy may not be as important for resource procurement as is generally believed, that load forecast sensitivities could be used to improve the procurement process, and that management of load uncertainty should be prioritized over more complex forecasting techniques.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Towards physics-inspired data-driven weather forecasting: integrating data assimilation with a deep spatial-transformer-based U-NET in a case study with ERA5

Abstract. There is growing interest in data-driven weather prediction (DDWP), e.g., using convolutional neural networks such as U-NET that are trained on data from models or reanalysis. Here, we propose three components, inspired by physics, to integrate with commonly used DDWP models in order to improve their forecast accuracy. These components are (1) a deep spatial transformer added to the latent space of U-NET to capture rotation and scaling transformation in the latent space for spatiotemporal data, (2) a data-assimilation (DA) algorithm to ingest noisy observations and improve the initial conditions for next forecasts, and (3) a multi-time-step algorithm, which combines forecasts from DDWP models with different time steps through DA, improving the accuracy of forecasts at short intervals. To show the benefit and feasibility of each component, we use geopotential height at 500 hPa (Z500) from ERA5 reanalysis and examine the short-term forecast accuracy of specific setups of the DDWP framework. Results show that the spatial-transformer-based U-NET (U-STN) clearly outperforms the U-NET, e.g., improving the forecast skill by 45 %. Using a sigma-point ensemble Kalman (SPEnKF) algorithm for DA and U-STN as the forward model, we show that stable, accurate DA cycles are achieved even with high observation noise. This DDWP+DA framework substantially benefits from large (O(1000)) ensembles that are inexpensively generated with the data-driven forward model in each DA cycle. The multi-time-step DDWP+DA framework also shows promise; for example, it reduces the average error by factors of 2–3. These results show the benefits and feasibility of these three components, which are flexible and can be used in a variety of DDWP setups. Furthermore, while here we focus on weather forecasting, the three components can be readily adopted for other parts of the Earth system, such as ocean and land, for which there is a rapid growth of data and need for forecast and assimilation.

54 ENVIRONMENTAL SCIENCES↗

Huge ensembles – Part 1: Design of ensemble weather forecasts using spherical Fourier neural operators

Abstract. Simulating low-likelihood high-impact extreme weather events in a warming world is a significant and challenging task for current ensemble forecasting systems. While these systems presently use up to 100 members, larger ensembles could enrich the sampling of internal variability. They may capture the long tails associated with climate hazards better than traditional ensemble sizes. Due to computational constraints, it is infeasible to generate huge ensembles (comprised of 1000–10 000 members) with traditional, physics-based numerical models. In this two-part paper, we replace traditional numerical simulations with machine learning (ML) to generate hindcasts of huge ensembles. In Part 1, we construct an ensemble weather forecasting system based on spherical Fourier neural operators (SFNOs), and we discuss important design decisions for constructing such an ensemble. The ensemble represents model uncertainty through perturbed-parameter techniques, and it represents initial condition uncertainty through bred vectors, which sample the fastest-growing modes of the forecast. Using the European Centre for Medium-Range Weather Forecasts Integrated Forecasting System (IFS) as a baseline, we develop an evaluation pipeline composed of mean, spectral, and extreme diagnostics. With large-scale, distributed SFNOs with 1.1 billion learned parameters, we achieve calibrated probabilistic forecasts. As the trajectories of the individual members diverge, the ML ensemble mean spectra degrade with lead time, consistent with physical expectations. However, the individual ensemble members' spectra stay constant with lead time. Therefore, these members simulate realistic weather states during the rollout, and the ML ensemble passes a crucial spectral test in the literature. The IFS and ML ensembles have similar extreme forecast indices, and we show that the ML extreme weather forecasts are reliable and discriminating. These diagnostics ensure that the ensemble can reliably simulate the time evolution of the atmosphere, including low-likelihood high-impact extremes. In Part 2, we generate a huge ensemble initialized each day in summer 2023, and we characterize the simulations of extremes.

Mahesh, Ankur↗

Short-term apartment-level load forecasting using a modified neural network with selected auto-regressive features

Residential electricity load profiles and their diversity have become increasingly important to realize the benefits of Smart or Transactive Energy Networks (TENs). An important element of TENs will be practical, accurate, and implementable residential load forecasting techniques. While there have been many approaches to short-term load forecasting, few have included forecasting for individual households, partly because the high volatility and idiosyncrasies present in individual household load data can pose significant challenges. In this study, we develop a Convolutional Long Short-Term Memory-based neural network with Selected Autoregressive Features (termed a CLSAF model) to improve short-term household electricity load forecasting accuracy by employing three strategies: autoregressive features selection, exogenous features selection, and a “default” state to avoid overfitting at times of high load volatility. We include aggregations of apartments to floor and building level, because utilities may favor transactive approaches that rely on aggregator models, e.g., a cluster of consumers as opposed to an individual. We demonstrate that the CLSAF model, by virtue of its enhanced feature representation and modest computational resources, can accomplish load forecasting in a multi-family residential building across three spatial granularities (individual apartment/household, floor, and building levels), with an accuracy improvement of up to 25% compared to a persistence model. We propose a data screening technique to characterize time-series electricity-load data. This technique is suitable for integration into a TEN ecosystem and allows one to estimate confidence levels of the load forecasts to optimize computational resources and the risks associated with uncertain forecasts.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A real-time probabilistic channel flood-forecasting model based on the Bayesian particle filter approach

Reliable real-time probabilistic flood forecasting is critical for effective water management and flood protection all over the world. In this study, we develop a real-time probabilistic channel flood-forecasting model by combining a channel hydraulic model with the Bayesian particle filter approach. The new model is tested in the upstream river reach of Three Gorges Dam (TGD) on the Yangtze River, China. Stage observations at seven hydrological stations are used simultaneously to adjust the Manning's roughness coefficients and to update discharges and stages along the river reach to attain reliable probabilistic flood forecasting. The synthetic experiments are applied to demonstrate the new model's correction and forecasting performances. The real-world experiments show that the new model can make accurate flood forecasting as well as derive reliable intervals for different confidence levels. The new probabilistic flood forecasting model not only outperforms the existing deterministic channel flood-forecasting models in accuracy, but also provides a more robust tool with which to incorporate uncertainty into flood-control efforts.

54 ENVIRONMENTAL SCIENCES↗