Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “forecasting”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Wind ramp events validation in NWP forecast models during the second Wind Forecast Improvement Project (WFIP2) using the Ramp Tool and Metric (RT&M)

The second Wind Forecast Improvement Project (WFIP2) is a multi-agency field campaign held in the Columbia Gorge area (October 2015 - March 2017). The main goal of the project is to understand and improve the forecast skill of numerical weather prediction (NWP) models in complex terrain, particularly beneficial for the wind energy industry. This region is well-known for its excellent wind resource. One of the biggest challenges for wind power production is the accurate forecasting of wind ramp events (large changes of generated power over short periods of time). Poor forecasting of the ramps requires large and sudden adjustments in conventional power generation, ultimately increasing the costs of power. A Ramp Tool and Metric (RT&M) was developed during the first WFIP experiment, held in the U.S. Great Plains (September 2011 - August 2012). The RT&M was designed to explicitly measure the skill of NWP models at forecasting wind ramp events. Here we apply the RT&M to 80-m (turbine hub-height) wind speeds measured by 19 sodars and 3 lidars, and to forecasts from the High Resolution Rapid Refresh (HRRR), 3-km, and from the High Resolution Rapid Refresh Nest (HRRRNEST), 750-m horizontal grid spacing, models. The diurnal and seasonal distribution of ramp events are analyzed, finding a noticeable diurnal variability for spring and summer but less for fall and especially winter. Also, winter has fewer ramps compared to the other seasons. The model skill at forecasting ramp events, including the impact of the modification to the model physical parameterizations, was finally investigated.

Djalalova, Irina V.↗
DOE OSTI2016

Epidemic forecasting is messier than weather forecasting: The role of human behavior and internet data streams in epidemic forecast

Mathematical models, such as those that forecast the spread of epidemics or predict the weather, must overcome the challenges of integrating incomplete and inaccurate data in computer simulations, estimating the probability of multiple possible scenarios, incorporating changes in human behavior and/or the pathogen, and environmental factors. In the past 3 decades, the weather forecasting community has made significant advances in data collection, assimilating heterogeneous data steams into models and communicating the uncertainty of their predictions to the general public. Epidemic modelers are struggling with these same issues in forecasting the spread of emerging diseases, such as Zika virus infection and Ebola virus disease. While weather models rely on physical systems, data from satellites, and weather stations, epidemic models rely on human interactions, multiple data sources such as clinical surveillance and Internet data, and environmental or biological factors that can change the pathogen dynamics. We describe some of similarities and differences between these 2 fields and how the epidemic modeling community is rising to the challenges posed by forecasting to help anticipate and guide the mitigation of epidemics. Here, we conclude that some of the fundamental differences between these 2 fields, such as human behavior, make disease forecasting more challenging than weather forecasting.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Getting brighter: Impacts of improved day-ahead solar forecasts in high-solar, high-storage electricity systems

This paper analyzes the impacts of improved day-ahead solar forecasts on costs and dispatch in the solar-rich Southeast U.S. It uses an optimized high-solar, high-storage resource portfolio in which solar generation capacity accounts for 45 % of total installed capacity (34 %–36 % of generation) and energy storage capacity (43 GW) is equivalent to 33 % of peak demand. In a base scenario, improved day-ahead solar forecasts reduce production costs by $\$87$ million per year ($\$0.13$ per MWh load, $2023$$). This level of savings is within the range or lower than earlier studies of solar forecast improvements at lower levels of solar generation (<25 % of total generation). In this study, solar expansion was accompanied by two important sources of flexibility for managing solar forecast error: energy storage and day-ahead solar curtailment. Furthermore, the analysis finds that regional coordination complements day-ahead solar forecast improvements while natural gas commitment flexibility is a substitute for forecast improvements, as the improved solar forecast leads to sub-optimal commitment of thermal units. Day-ahead solar forecast improvements reduce reserves required to manage forecast error by 30 %. Fewer reserves to manage large, infrequent solar forecast errors could be an important benefit of improved solar forecasts.

14 SOLAR ENERGY↗
DOE OSTI2024

Short-Term Load Forecasting Considering EV Charging Loads with Prediction Interval Evaluation

Short-term load forecasting plays a critical role in power system planning and operation. Along with the electrification of various loads, electricity demands are becoming increasingly hard to predict. Notably, the recent rise in electric vehicles (EVs) has further contributed to this unpredictability. To address this issue, this paper proposes a probabilistic load forecasting strategy utilizing Gaussian process regression, structured in a day-ahead manner. While many works focus on deterministic prediction, probabilistic forecasting offers additional insights into variability and uncertainty, enabling more flexible and reliable operation for power systems. To enhance the accuracy of the load forecasting model, the inputs include features related to EV charging habits as well as commonly used weather information. The load forecasting results are evaluated using various metrics, including conventional ones that assess the accuracy of point forecasts, as well as additional metrics that test the reliability of prediction intervals. The proposed load forecasting method is finally tested on real residential power consumption data and EV charging data sampled from real-world sources. The results prove that the new features can greatly improve the performance of the load forecasting method.

electrical vehicle↗
DOE OSTI2020

Cross-Market Price Difference Forecast Using Deep Learning for Electricity Markets

Price forecasting is in the center of decision making in electricity markets. Many researches have been done in forecasting energy prices while little research has been reported on forecasting price difference between day-ahead and realtime markets due to its high volatility, which however plays a critical role in virtual trading. To this end, this paper takes the first attempt to employ novel deep learning architecture with Bidirectional Long-Short Term Memory (LSTM) units to forecast the price difference between day-ahead and real-time markets for the same node. The raw data is collected from PJM market, processed and fed into the proposed network. The Root Mean Squared Error (RMSE) and customized performance metric are used to evaluate the performance of the proposed method. Case studies show that it outperforms the traditional statistical models like ARIMA, and machine learning models like XGBoost and SVR methods in both RMSE and the capability of forecasting the sign of price difference. Additionally, to cross-market price difference forecast, the proposed approach has the potential to be applied to solve other forecasting problems such as price spread forecast in DA market for Financial Transmission Right (FTR) trading purpose.

DA/RT price difference↗
DOE OSTI2018

Evaluation of regression and neural network models for solar forecasting over different short-term horizons

Forecasting solar irradiation has acquired immense importance in view of the exponential increase in the number of solar pho- tovoltaic (PV) system installations. In this article, analyses results involving statistical and machine-learning techniques to predict solar irradiation for di?erent forecasting horizons are reported. Yearlong typical meteorological year 3 (TMY3) datasets from three cities in the United States with di?erent climatic conditions have been used in this analysis. A simple forecast approach that assumes consecutive days to be identical serves as a baseline model to compare forecasting alternatives. To account for seasonal variability and to capture short-term ?uctuations, di?erent variants of the lagged moving average (LMX) model with cloud cover as the input variable are evaluated. Finally, the proposed LMX model is evaluated against an arti?cial neural network (ANN) model. How the one-hour and 24-hour models can be used in conjunction to predict di?erent short-term rolling horizons is discussed, and this joint application is illustrated for a four-hour rolling horizon forecast scheme. Finally, the e?ect of using predicted cloud cover values, instead of measured ones, on the accuracy of the models is assessed. Results show that LMX models do not degrade in forecast accuracy if models are trained with the forecast cloud cover data.

Inanlouganji, Alireza↗
DOE OSTI2016

An experimental seasonal hydrological forecasting system over the Yellow River basin &ndash; Part 2: The added value from climate forecast models

This is the second paper of a two-part series on introducing an experimental seasonal hydrological forecasting system over the Yellow River basin in northern China. While the natural hydrological predictability in terms of initial hydrological conditions (ICs) is investigated in a companion paper, the added value from eight North American Multimodel Ensemble (NMME) climate forecast models with a grand ensemble of 99 members is assessed in this paper, with an implicit consideration of human-induced uncertainty in the hydrological models through a post-processing procedure. The forecast skill in terms of anomaly correlation (AC) for 2 m air temperature and precipitation does not necessarily decrease over leads but is dependent on the target month due to a strong seasonality for the climate over the Yellow River basin. As there is more diversity in the model performance for the temperature forecasts than the precipitation forecasts, the grand NMME ensemble mean forecast has consistently higher skill than the best single model up to 6 months for the temperature but up to 2 months for the precipitation. The NMME climate predictions are downscaled to drive the variable infiltration capacity (VIC) land surface hydrological model and a global routing model regionalized over the Yellow River basin to produce forecasts of soil moisture, runoff and streamflow. And the NMME/VIC forecasts are compared with the Ensemble Streamflow Prediction method (ESP/VIC) through 6-month hindcast experiments for each calendar month during 1982&ndash;2010. As verified by the VIC offline simulations, the NMME/VIC is comparable to the ESP/VIC for the soil moisture forecasts, and the former has higher skill than the latter only for the forecasts at long leads and for those initialized in the rainy season. The forecast skill for runoff is lower for both forecast approaches, but the added value from NMME/VIC is more obvious, with an increase of the average AC by 0.08&ndash;0.2. To compare with the observed streamflow, both the hindcasts from NMME/VIC and ESP/VIC are post-processed through a linear regression model fitted by using VIC offline-simulated streamflow. The post-processed NMME/VIC reduces the root mean squared error (RMSE) from the post-processed ESP/VIC by 5&ndash;15 %. And the reduction occurs mostly during the transition from wet to dry seasons. As a result, with the consideration of the uncertainty in the hydrological models, the added value from climate forecast models is decreased especially at short leads, suggesting the necessity of improving the large-scale hydrological models in human-intervened river basins.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2018

Short-Term Load Forecasting Based Automatic Distribution Network Reconfiguration

In a traditional dynamic network reconfiguration study, the optimal topology is determined at every scheduled time point by using the real load data measured at that time. The development of the load forecasting technique can provide an accurate prediction of the load power that will happen in a future time and provide more information about load changes. With the inclusion of load forecasting, the optimal topology can be determined based on the predicted load conditions during a longer time period instead of using a snapshot of the load at the time when the reconfiguration happens; thus, the distribution system operator can use this information to better operate the system reconfiguration and achieve optimal solutions. This paper proposes a short-term load forecasting approach to automatically reconfigure distribution systems in a dynamic and pre-event manner. Specifically, a short-term and high-resolution distribution system load forecasting approach is proposed with a forecaster based on support vector regression and parallel parameters optimization. The network reconfiguration problem is solved by using the forecasted load continuously to determine the optimal network topology with the minimum amount of loss at the future time. The simulation results validate and evaluate the proposed approach.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2019

The Second Wind Forecast Improvement Project (WFIP 2): General Overview

In 2015 the U.S. Department of Energy initiated a four-year study, the second Wind Forecast Improvement Project (WFIP 2), to improve the representation of boundary-layer physics and related processes in mesoscale models for better wind and wind power forecasts. This goal challenges numerical weather prediction models in complex terrain due to inherent assumptions underlying their boundary-layer parameterizations. The WFIP 2 effort involved the wind industry, universities, NOAA, and DOE's national laboratories in an integrated observational and modeling study. Observations spanned 18-months to assure a full annual cycle of continuously recorded observations from remote-sensing and in situ measurement systems. The study area comprised the Columbia Basin of eastern Washington and Oregon, containing more than 4 GW of installed wind capacity; nests of observational systems captured important atmospheric scales from mesoscale to NWP sub-grid scale. Model improvements targeted NOAA's High-Resolution Rapid Refresh (HRRR) model to facilitate transfer of improvements to NWS operational forecast models. This paper describes the general WFIP 2 scope and objectives, the particular scientific challenges of improving wind forecasts in complex terrain, early successes of the project, and an integrated approach to archiving observations and model output. It provides an introduction for a set of more detailed BAMS papers addressing WFIP 2 observational science, modeling challenges and solutions, practical transfer of boundary layer advances to industry use, and advances in coupling improved mesoscale models to microscale models that can represent interactions between wind plants and the atmosphere.

WFIP2, boundary layer, complex terrain, forecastin↗
DOE OSTI2017

A Short-Term and High-Resolution System Load Forecasting Approach Using Support Vector Regression with Hybrid Parameters Optimization

This work proposes an approach for distribution system load forecasting, which aims to provide highly accurate short-term load forecasting with high resolution utilizing a support vector regression (SVR) based forecaster and a two-step hybrid parameters optimization method. Specifically, because the load profiles in distribution systems contain abrupt deviations, a data normalization is designed as the pretreatment for the collected historical load data. Then an SVR model is trained by the load data to forecast the future load. For better performance of SVR, a two-step hybrid optimization algorithm is proposed to determine the best parameters. In the first step of the hybrid optimization algorithm, a designed grid traverse algorithm (GTA) is used to narrow the parameters searching area from a global to local space. In the second step, based on the result of the GTA, particle swarm optimization (PSO) is used to determine the best parameters in the local parameter space. After the best parameters are determined, the SVR model is used to forecast the short-term load deviation in the distribution system.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Forecasting for ESCAPE: A Multi-Institution Hybrid Forecasting and Nowcasting Operation for Sea-Breeze Convection Supporting a Ground-Based and Airborne Field Campaign

The Experiment of Sea-Breeze Convection, Aerosols, Precipitation and Environment (ESCAPE) field project deployed two aircraft and ground-based assets in the vicinity of Houston, Texas, between 27 May and 2 July 2022, examining how meteorological conditions, dynamics, and aerosols control the initiation, early growth stage, and evolution of coastal convective clouds. To ensure that airborne- and ground-based assets were deployed appropriately, a forecasting and nowcasting team was formed. Daily forecasts guided real-time decision-making by assessing synoptic weather conditions, environmental aerosol, and a variety of atmospheric modeling data to assign a probability for meeting specific ESCAPE campaign objectives. During the research flights, a small team of forecasters provided “nowcasting” support by analyzing radar, satellite, and new model data in real time. The nowcasting team proved invaluable to the campaign operation, as sometimes changing environmental conditions affected, for example, the timing of convective initiation. In addition to the success of the forecasting and nowcasting teams, the ESCAPE campaign offered a unique “testbed” opportunity where in-person and virtual support both contributed to campaign objectives. The forecasting and nowcasting teams were each composed of new and experienced forecasters alike, where new forecasters were given invaluable experience that would otherwise be difficult to attain. Both teams received training on forecast models, map analysis, Hybrid Single-Particle Lagrangian Integrated Trajectory model (HYSPLIT), and thermodynamic sounding analysis before the beginning of the campaign. In this article, the ESCAPE forecasting and nowcasting teams reflect on these experiences, providing potentially useful advice for future field campaigns requiring forecasting and nowcasting support in a hybrid virtual/in-person framework.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2013

Ensemble Statistical Post-Processing of the National Air Quality Forecast Capability: Enhancing Ozone Forecasts in Baltimore, Maryland

An ensemble statistical post-processor (ESP) is developed for the National Air Quality Forecast Capability (NAQFC) to address the unique challenges of forecasting surface ozone in Baltimore, MD. Air quality and meteorological data were collected from the eight monitors that constitute the Baltimore forecast region. These data were used to build the ESP using a moving-block bootstrap, regression tree models, and extreme-value theory. The ESP was evaluated using a 10-fold cross-validation to avoid evaluation with the same data used in the development process. Results indicate that the ESP is conditionally biased, likely due to slight overfitting while training the regression tree models. When viewed from the perspective of a decision-maker, the ESP provides a wealth of additional information previously not available through the NAQFC alone. The user is provided the freedom to tailor the forecast to the decision at hand by using decision-specific probability thresholds that define a forecast for an ozone exceedance. Taking advantage of the ESP, the user not only receives an increase in value over the NAQFC, but also receives value for An ensemble statistical post-processor (ESP) is developed for the National Air Quality Forecast Capability (NAQFC) to address the unique challenges of forecasting surface ozone in Baltimore, MD. Air quality and meteorological data were collected from the eight monitors that constitute the Baltimore forecast region. These data were used to build the ESP using a moving-block bootstrap, regression tree models, and extreme-value theory. The ESP was evaluated using a 10-fold cross-validation to avoid evaluation with the same data used in the development process. Results indicate that the ESP is conditionally biased, likely due to slight overfitting while training the regression tree models. When viewed from the perspective of a decision-maker, the ESP provides a wealth of additional information previously not available through the NAQFC alone. The user is provided the freedom to tailor the forecast to the decision at hand by using decision-specific probability thresholds that define a forecast for an ozone exceedance. Taking advantage of the ESP, the user not only receives an increase in value over the NAQFC, but also receives value for

ozone↗
DOE OSTI2021

Use of Physics to Improve Solar Forecast: Physics-Informed Persistence Models for Simultaneously Forecasting GHI, DNI, and DHI

Observation-based statistical models have been widely used in forecasting solar energy; however, existing models often lack a clear relation to physics and are limited largely to global horizontal irradiance (GHI) forecasts over relatively short time horizons (< 1 hour). Incorporating physics into observation-based models, increasing forecast time horizons and developing a model system for forecasting not only GHI but also direct normal irradiance (DNI) and diffuse horizontal irradiance (DHI) remain challenging, especially under cloudy conditions because of complex cloud-radiation interactions. This work attempts to address these challenges by developing a hierarchy of four new physics-informed persistence models that can be used to simultaneously forecast GHI, DNI and DHI. The decade-long measurements (1998 to 2014) at the U.S. Department of Energy's Atmospheric Radiation Measurement (ARM)'s Southern Great Plains (SGP) Central Facility site are used to evaluate the performance of the new models. Overall, the results show that the new physics-informed forecast models generally outperform the simple and smart persistence models, and improve the forecast accuracy at lead times from 1.25 hours up to 6 hours. Further analysis reveals that the forecast error is highly related to the error and temporal variability of the assumed cloud predictor. The best model for forecasting different radiative components can be explained by the relationship between solar irradiances and cloud properties.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Use of Physics to Improve Solar Forecast: Part II, Machine Learning and Model Interpretability

Machine learning (ML) models have been applied to forecast solar energy; however, they often lack clarity of interpretability and underlying physics. This work addresses such challenges by developing a hierarchy of ML models that gradually introduce predictors to improve the forecast accuracy based on a physics-based framework. Three ML models (ARIMA, LSTM, and XGBoost) are examined and compared with four physics-informed persistence models reported in Part I and the simple persistence model to assess the improvement of different models. The 7-year measurements at the U.S. Department of Energy's Atmospheric Radiation Measurement's Southern Great Plains Central Facility site are used for forecasts and evaluations. The results reveal that the step-by-step introduction of predictors leads to different improvements for models at different hierarchical levels. Comparison of the ML models with persistence models shows that LSTM and XGBoost outperform all the persistence models, with LSTM having the overall best performance; however, ARIMA underperforms the four physics-informed persistence models. This study demonstrates the importance and utility of incorporating physics into ML models in improving forecast accuracy by introducing a hierarchy of physics-based predictors, distinguishing predictor contributions, and enhancing the ML interpretability. The combined use of Global Horizontal Irradiance (GHI) and Direct Normal Irradiance (DNI) significantly improves the forecast accuracy compared to using individual irradiances alone because the pair contains more information on cloud-radiation interactions.

interpretability↗
DOE OSTI2026

The Value of Forecasters‐in‐the‐Loop in Real‐Time Flood Forecasting in the Age of Machine Learning

Machine learning (ML) applications in hydrological forecasting are increasingly prevalent and show great potential. However, many previous studies have only evaluated performance through reanalysis or retrospective simulations compared to simplified baselines. This study provides the first assessment of ML performance against actual operational forecasting systems operated by the California Nevada River Forecast Center (CNRFC), which combines the Community Hydrologic Prediction System (CHPS) with forecasters-in-the-loop. Results demonstrate that forecasters-in-the-loop systems consistently outperform ML models in both general forecasts and flood alerting across lead times up to 96 hr, even when ML models use observed forcings, while CNRFC operational process relies on biased weather forecasts. Our analysis reveals that forecaster expertise maintains forecast reliability despite inaccurate precipitation inputs, with human-guided systems showing superior performance degradation characteristics at extended lead times. These findings highlight the irreplaceable value of human expertise in operational forecasting and caution against overstating current ML capabilities in real-world applications.

Tran, Vinh Ngoc [Univ. of Michigan, Ann Arbor, MI ↗