Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “FORECASTING”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Wind ramp events validation in NWP forecast models during the second Wind Forecast Improvement Project (WFIP2) using the Ramp Tool and Metric (RT&M)

The second Wind Forecast Improvement Project (WFIP2) is a multi-agency field campaign held in the Columbia Gorge area (October 2015 - March 2017). The main goal of the project is to understand and improve the forecast skill of numerical weather prediction (NWP) models in complex terrain, particularly beneficial for the wind energy industry. This region is well-known for its excellent wind resource. One of the biggest challenges for wind power production is the accurate forecasting of wind ramp events (large changes of generated power over short periods of time). Poor forecasting of the ramps requires large and sudden adjustments in conventional power generation, ultimately increasing the costs of power. A Ramp Tool and Metric (RT&M) was developed during the first WFIP experiment, held in the U.S. Great Plains (September 2011 - August 2012). The RT&M was designed to explicitly measure the skill of NWP models at forecasting wind ramp events. Here we apply the RT&M to 80-m (turbine hub-height) wind speeds measured by 19 sodars and 3 lidars, and to forecasts from the High Resolution Rapid Refresh (HRRR), 3-km, and from the High Resolution Rapid Refresh Nest (HRRRNEST), 750-m horizontal grid spacing, models. The diurnal and seasonal distribution of ramp events are analyzed, finding a noticeable diurnal variability for spring and summer but less for fall and especially winter. Also, winter has fewer ramps compared to the other seasons. The model skill at forecasting ramp events, including the impact of the modification to the model physical parameterizations, was finally investigated.

Djalalova, Irina V.↗

Getting brighter: Impacts of improved day-ahead solar forecasts in high-solar, high-storage electricity systems

This paper analyzes the impacts of improved day-ahead solar forecasts on costs and dispatch in the solar-rich Southeast U.S. It uses an optimized high-solar, high-storage resource portfolio in which solar generation capacity accounts for 45 % of total installed capacity (34 %–36 % of generation) and energy storage capacity (43 GW) is equivalent to 33 % of peak demand. In a base scenario, improved day-ahead solar forecasts reduce production costs by $\$87$ million per year ($\$0.13$ per MWh load, $2023$$). This level of savings is within the range or lower than earlier studies of solar forecast improvements at lower levels of solar generation (<25 % of total generation). In this study, solar expansion was accompanied by two important sources of flexibility for managing solar forecast error: energy storage and day-ahead solar curtailment. Furthermore, the analysis finds that regional coordination complements day-ahead solar forecast improvements while natural gas commitment flexibility is a substitute for forecast improvements, as the improved solar forecast leads to sub-optimal commitment of thermal units. Day-ahead solar forecast improvements reduce reserves required to manage forecast error by 30 %. Fewer reserves to manage large, infrequent solar forecast errors could be an important benefit of improved solar forecasts.

14 SOLAR ENERGY↗

Short-Term Load Forecasting Considering EV Charging Loads with Prediction Interval Evaluation

Short-term load forecasting plays a critical role in power system planning and operation. Along with the electrification of various loads, electricity demands are becoming increasingly hard to predict. Notably, the recent rise in electric vehicles (EVs) has further contributed to this unpredictability. To address this issue, this paper proposes a probabilistic load forecasting strategy utilizing Gaussian process regression, structured in a day-ahead manner. While many works focus on deterministic prediction, probabilistic forecasting offers additional insights into variability and uncertainty, enabling more flexible and reliable operation for power systems. To enhance the accuracy of the load forecasting model, the inputs include features related to EV charging habits as well as commonly used weather information. The load forecasting results are evaluated using various metrics, including conventional ones that assess the accuracy of point forecasts, as well as additional metrics that test the reliability of prediction intervals. The proposed load forecasting method is finally tested on real residential power consumption data and EV charging data sampled from real-world sources. The results prove that the new features can greatly improve the performance of the load forecasting method.

electrical vehicle↗

Cross-Market Price Difference Forecast Using Deep Learning for Electricity Markets

Price forecasting is in the center of decision making in electricity markets. Many researches have been done in forecasting energy prices while little research has been reported on forecasting price difference between day-ahead and realtime markets due to its high volatility, which however plays a critical role in virtual trading. To this end, this paper takes the first attempt to employ novel deep learning architecture with Bidirectional Long-Short Term Memory (LSTM) units to forecast the price difference between day-ahead and real-time markets for the same node. The raw data is collected from PJM market, processed and fed into the proposed network. The Root Mean Squared Error (RMSE) and customized performance metric are used to evaluate the performance of the proposed method. Case studies show that it outperforms the traditional statistical models like ARIMA, and machine learning models like XGBoost and SVR methods in both RMSE and the capability of forecasting the sign of price difference. Additionally, to cross-market price difference forecast, the proposed approach has the potential to be applied to solve other forecasting problems such as price spread forecast in DA market for Financial Transmission Right (FTR) trading purpose.

DA/RT price difference↗

Forecasting for ESCAPE: A Multi-Institution Hybrid Forecasting and Nowcasting Operation for Sea-Breeze Convection Supporting a Ground-Based and Airborne Field Campaign

The Experiment of Sea-Breeze Convection, Aerosols, Precipitation and Environment (ESCAPE) field project deployed two aircraft and ground-based assets in the vicinity of Houston, Texas, between 27 May and 2 July 2022, examining how meteorological conditions, dynamics, and aerosols control the initiation, early growth stage, and evolution of coastal convective clouds. To ensure that airborne- and ground-based assets were deployed appropriately, a forecasting and nowcasting team was formed. Daily forecasts guided real-time decision-making by assessing synoptic weather conditions, environmental aerosol, and a variety of atmospheric modeling data to assign a probability for meeting specific ESCAPE campaign objectives. During the research flights, a small team of forecasters provided “nowcasting” support by analyzing radar, satellite, and new model data in real time. The nowcasting team proved invaluable to the campaign operation, as sometimes changing environmental conditions affected, for example, the timing of convective initiation. In addition to the success of the forecasting and nowcasting teams, the ESCAPE campaign offered a unique “testbed” opportunity where in-person and virtual support both contributed to campaign objectives. The forecasting and nowcasting teams were each composed of new and experienced forecasters alike, where new forecasters were given invaluable experience that would otherwise be difficult to attain. Both teams received training on forecast models, map analysis, Hybrid Single-Particle Lagrangian Integrated Trajectory model (HYSPLIT), and thermodynamic sounding analysis before the beginning of the campaign. In this article, the ESCAPE forecasting and nowcasting teams reflect on these experiences, providing potentially useful advice for future field campaigns requiring forecasting and nowcasting support in a hybrid virtual/in-person framework.

54 ENVIRONMENTAL SCIENCES↗

Ensemble Statistical Post-Processing of the National Air Quality Forecast Capability: Enhancing Ozone Forecasts in Baltimore, Maryland

An ensemble statistical post-processor (ESP) is developed for the National Air Quality Forecast Capability (NAQFC) to address the unique challenges of forecasting surface ozone in Baltimore, MD. Air quality and meteorological data were collected from the eight monitors that constitute the Baltimore forecast region. These data were used to build the ESP using a moving-block bootstrap, regression tree models, and extreme-value theory. The ESP was evaluated using a 10-fold cross-validation to avoid evaluation with the same data used in the development process. Results indicate that the ESP is conditionally biased, likely due to slight overfitting while training the regression tree models. When viewed from the perspective of a decision-maker, the ESP provides a wealth of additional information previously not available through the NAQFC alone. The user is provided the freedom to tailor the forecast to the decision at hand by using decision-specific probability thresholds that define a forecast for an ozone exceedance. Taking advantage of the ESP, the user not only receives an increase in value over the NAQFC, but also receives value for An ensemble statistical post-processor (ESP) is developed for the National Air Quality Forecast Capability (NAQFC) to address the unique challenges of forecasting surface ozone in Baltimore, MD. Air quality and meteorological data were collected from the eight monitors that constitute the Baltimore forecast region. These data were used to build the ESP using a moving-block bootstrap, regression tree models, and extreme-value theory. The ESP was evaluated using a 10-fold cross-validation to avoid evaluation with the same data used in the development process. Results indicate that the ESP is conditionally biased, likely due to slight overfitting while training the regression tree models. When viewed from the perspective of a decision-maker, the ESP provides a wealth of additional information previously not available through the NAQFC alone. The user is provided the freedom to tailor the forecast to the decision at hand by using decision-specific probability thresholds that define a forecast for an ozone exceedance. Taking advantage of the ESP, the user not only receives an increase in value over the NAQFC, but also receives value for

ozone↗

Use of Physics to Improve Solar Forecast: Physics-Informed Persistence Models for Simultaneously Forecasting GHI, DNI, and DHI

Observation-based statistical models have been widely used in forecasting solar energy; however, existing models often lack a clear relation to physics and are limited largely to global horizontal irradiance (GHI) forecasts over relatively short time horizons (< 1 hour). Incorporating physics into observation-based models, increasing forecast time horizons and developing a model system for forecasting not only GHI but also direct normal irradiance (DNI) and diffuse horizontal irradiance (DHI) remain challenging, especially under cloudy conditions because of complex cloud-radiation interactions. This work attempts to address these challenges by developing a hierarchy of four new physics-informed persistence models that can be used to simultaneously forecast GHI, DNI and DHI. The decade-long measurements (1998 to 2014) at the U.S. Department of Energy's Atmospheric Radiation Measurement (ARM)'s Southern Great Plains (SGP) Central Facility site are used to evaluate the performance of the new models. Overall, the results show that the new physics-informed forecast models generally outperform the simple and smart persistence models, and improve the forecast accuracy at lead times from 1.25 hours up to 6 hours. Further analysis reveals that the forecast error is highly related to the error and temporal variability of the assumed cloud predictor. The best model for forecasting different radiative components can be explained by the relationship between solar irradiances and cloud properties.

54 ENVIRONMENTAL SCIENCES↗

Use of Physics to Improve Solar Forecast: Part II, Machine Learning and Model Interpretability

Machine learning (ML) models have been applied to forecast solar energy; however, they often lack clarity of interpretability and underlying physics. This work addresses such challenges by developing a hierarchy of ML models that gradually introduce predictors to improve the forecast accuracy based on a physics-based framework. Three ML models (ARIMA, LSTM, and XGBoost) are examined and compared with four physics-informed persistence models reported in Part I and the simple persistence model to assess the improvement of different models. The 7-year measurements at the U.S. Department of Energy's Atmospheric Radiation Measurement's Southern Great Plains Central Facility site are used for forecasts and evaluations. The results reveal that the step-by-step introduction of predictors leads to different improvements for models at different hierarchical levels. Comparison of the ML models with persistence models shows that LSTM and XGBoost outperform all the persistence models, with LSTM having the overall best performance; however, ARIMA underperforms the four physics-informed persistence models. This study demonstrates the importance and utility of incorporating physics into ML models in improving forecast accuracy by introducing a hierarchy of physics-based predictors, distinguishing predictor contributions, and enhancing the ML interpretability. The combined use of Global Horizontal Irradiance (GHI) and Direct Normal Irradiance (DNI) significantly improves the forecast accuracy compared to using individual irradiances alone because the pair contains more information on cloud-radiation interactions.

interpretability↗

The Value of Forecasters‐in‐the‐Loop in Real‐Time Flood Forecasting in the Age of Machine Learning

Machine learning (ML) applications in hydrological forecasting are increasingly prevalent and show great potential. However, many previous studies have only evaluated performance through reanalysis or retrospective simulations compared to simplified baselines. This study provides the first assessment of ML performance against actual operational forecasting systems operated by the California Nevada River Forecast Center (CNRFC), which combines the Community Hydrologic Prediction System (CHPS) with forecasters-in-the-loop. Results demonstrate that forecasters-in-the-loop systems consistently outperform ML models in both general forecasts and flood alerting across lead times up to 96 hr, even when ML models use observed forcings, while CNRFC operational process relies on biased weather forecasts. Our analysis reveals that forecaster expertise maintains forecast reliability despite inaccurate precipitation inputs, with human-guided systems showing superior performance degradation characteristics at extended lead times. These findings highlight the irreplaceable value of human expertise in operational forecasting and caution against overstating current ML capabilities in real-world applications.

Tran, Vinh Ngoc [Univ. of Michigan, Ann Arbor, MI ↗

Application of lagged averaged forecasting to medium range forecasting

The lagged average forecast (LAF) method for predicting and compensating for forecast error growth is applied to two 100 day samples of 10 day forecasts at the 500 mb altitude for winter-summer 1980-81. The LAF parameterizes the forecast error growth in order to weight the forecast with regression calculations. A 5 day LAF forecast was generated for a 10 day forecast made with a 1681 d.o.f. model which produced predictions using a truncated spherical harmonic expansion. A 100 day data set was employed, with the first 90 days serving for LAF forecasts for the model forecast. Significant improvements were obtained in the model forecast when the LAF weightings were introduced into the model variables.

Dalcher, A.↗

A TCN-Based Hybrid Forecasting Framework for Hours-Ahead Utility-Scale PV Forecasting

This paper presents a Temporal Convolutional Network (TCN) based hybrid PV forecasting framework for enhancing hours-ahead utility-scale PV forecasting. The hybrid framework consists of two forecasting models: a physics-based trend forecasting (TF) model and a data-driven fluctuation forecasting (FF) model. Three TCNs are integrated in the framework for: i) blending the inputs from different Numerical Weather Prediction sources for the TF model to achieve superior performance on forecasting hourly PV profiles, ii) capturing spatial-temporal correlations between detector sites and the target site in the FF model to achieve more accurate forecast of intra- hour PV power drops, and iii) reconciling TF and FF results to obtain coherent hours-ahead PV forecast with both hourly trends and intra-hour fluctuations well preserved. To automatically identify the most contributive neighboring sites for forming a detector network, a scenario-based correlation analysis method is developed, which significantly improves the capability of the FF model on capturing large power fluctuations caused by cloud movements. Here, the framework is developed, tested, and validated using actual PV data collected from 95 PV farms in North Carolina. Simulation results show that the performance of 6 hours ahead PV power forecasting is improved by 20% - 30% compared with state-of-the-art methods.

42 ENGINEERING↗

The Experimental Regional Ensemble Forecast System (ExREF): Its Use in NWS Forecast Operations and Preliminary Verification

The Experimental Regional Ensemble Forecast (ExREF) system is a tool for the development and testing of new Numerical Weather Prediction (NWP) methodologies. ExREF is run in near‐realtime by the Global Systems Division (GSD) of the NOAA Earth System Research Laboratory (ESRL) and its products are made available through a website, an ftp site, and via the Unidata Local Data Manager (LDM). The ExREF domain covers most of North America and has 9‐km horizontal grid spacing. The ensemble has eight members, all employing WRF‐ARW. The ensemble uses a variety of initial conditions from LAPS and the Global Forecasting System (GFS) and multiple boundary conditions from the GFS ensemble. Additionally, a diversity of physical parameterizations is used to increase ensemble spread and to account for the uncertainty in forecasting extreme precipitation events. ExREF has been a component of the Hydrometeorology Testbed (HMT) NWP suite in the 2012‐2013 and 2013‐2014 winters. A smaller domain covering just the West Coast was created to minimize band‐width consumption for the NWS. This smaller domain has and is being distributed to the National Weather Service (NWS) Weather Forecast Office and California Nevada River Forecast Center in Sacramento, California, where it is ingested into the Advanced Weather Interactive Processing System (AWIPS I and II) to provide guidance on the forecasting of extreme precipitation events. This paper will review the cooperative effort employed by NOAA ESRL, NASA SPoRT (Short‐term Prediction Research and Transition Center), and the NWS to facilitate the ingest and display of ExREF data utilizing the AWIPS I and II D2D and GFE (Graphical Software Editor) software. Within GFE is a very useful verification software package called BoiVer that allows the NWS to utilize the River Forecast Center's 4 km gridded QPE to compare with all operational NWP models 6‐hr QPF along with the ExREF mean 6‐hr QPF so the forecasters can build confidence in the use of the ExREF in preparing their rainfall forecasts. Preliminary results will be presented.

Reynolds, David↗

Dynamical Forecasts of Tropical Terrestrial Carbon Fluxes with the NASA S2S Retrospective Forecast System

Recent advances in the ability to predict climate anomalies at sub-seasonal to seasonal (S2S) timescales allow us to explore the possibility of forecasting carbon flux anomalies. Although carbon flux forecasting is a relatively new concept, it is potentially beneficial as it can help us better understand global and regional land-atmosphere carbon feedbacks associated with climate variations and can provide guidance for future field mission design. Here we evaluate the skill of forecasted terrestrial carbon anomalies generated from meteorological anomalies produced with the NASA Global Modeling and Assimilation Office (GMAO) S2S forecast system. We focus here on three representative time periods (the most recent 2015-2016 El Nino, 2011 La Nina, and 2014 as a neutral year), with each corresponding 9-month forecast comprising four ensemble members initialized in the preceding December. The meteorological variables produced by the GMAO forecast system were bias-corrected using a climatology derived from the Modern Era Retrospective analysis for Research and Applications, version 2 (MERRA-2) before being used to drive a suite of offline simulations with the NASA Catchment-CN terrestrial biosphere model, a model that computes water-energy-carbon dynamics. Forecasts are evaluated by comparing against satellite-driven estimates of gross primary production (GPP) and inverse model estimates of net carbon flux that incorporate satellite carbon dioxide measurements. We find that the restrospectively predicted carbon fluxes in the tropics reasonably reproduce the signs and magnitudes of the observed anomalies between the 2015-2016 El Nino and the 2011 La Nina for both net flux and GPP. For instance, for the El Nino period, the magnitude of the forecasted negative GPP anomaly in the South American tropics (which undergoes anomalously warm and dry conditions) agrees with the observed GPP anomaly at leads of up to three or four months. Overall, this study demonstrates potential skill in the forecast of biospheric carbon fluxes a few months in advance, a capability that could contribute to attribution studies focusing on carbon flux variations and support innovative observation strategies in the future.

Lee, Eunjee↗

Application of the Global Precipitation Forecast dataset for Global Landslide Forecasting System

Landslides are extremely damaging, pervasive and cause fatalities and economic impacts. Extreme rainfall events, coupled with inopportune surface conditions, are the primary triggers of landslides around the world. Forecasting landslide events represent an area of open research. A global Landslide Hazard Assessment for Situational Awareness (LHASA) model has been created that provides near real-time dynamic landslide characterization using Integrated Multi-Satellite Retrievals for Global Precipitation Mission (IMERG). However, it does not provide information on prediction of landslides into future. This study considers how global precipitation forecast data compares to satellite rainfall at different spatiotemporal scales and outlines the potential for its use in landslide hazard prediction/forecasting system. NASA Goddard Earth Observing System (GEOS)-Forecast model assimilates new observations every 6 hours, at 00, 06, 12, and 18 UTC. The GEOS-Forecast model is initialized at 00 UTC and is evaluated with IMERG Early, using Multi-Radar Multi-Sensor gauge corrected (MRMS-GC) precipitation product as a reference over contiguous United States (CONUS). Categorical and continuous statistics along with probability density functions and cumulative distribution functions are considered to assess the performance of the precipitation products, with a focus on landslide hotspots. Seasonality appears to influence the performance of both the GEOS-Forecast and IMERG Early product. Moreover, the global comparison between the GEOS-Forecast and IMERG Early is carried out in terms of percentile difference, correlation, and bias maps. For extreme rainfall events in regions such as Mekong, Colombia, and Tajikistan, GEOS-Forecast appears to resolve high rainfall relative to IMERG Early more frequently. Validation over landslide points reveal that for 24hr rainfall accumulations > 100mm, GEOS-Forecast and IMERG coincide. GEOS-Forecast and IMERG Early precipitation matches more closely for tropical cyclones than other types of storms. Overall, the performance varies with respect to location, rainfall intensities, and type of precipitation events.

Sana Khan↗

Comparison of Probabilistic Forecasts for Predictive Voltage Control

This paper explores predictive cooperative voltage control in distribution systems with highly variable sources such as photovoltaics (PV). The goal is to maintain the voltage profile within the limits despite the fluctuations due to sudden changes in solar power generation. The predictive voltage control method relies on probabilistic solar power and load forecasts to select the optimum Voltage Regulator (VR) taps appropriately. VR taps are selected to minimize the risk of voltage violation. A modified version of the IEEE 123 system is used as the case study. A 100% penetration of solar power is assumed for the distribution system with profiles for solar generation and loads added to the system. Three different probabilistic forecast models (Quantile Regression (QR), Gaussian distribution and volatility forecasting using Generalized Autoregressive Conditional Heteroskedasticity (GARCH)) are explored in this study. The results for the VR taps and Voltage Deviation Index (VDI) are compared to find the most effective forecast model.

Panamtash, Hossein↗

Lagged average forecasting, an alternative to Monte Carlo forecasting

A 'lagged average forecast' (LAF) model is developed for stochastic dynamic weather forecasting and used for predictions in comparison with the results of a Monte Carlo forecast (MCF). The technique involves the calculation of sample statistics from an ensemble of forecasts, with each ensemble member being an ordinary dynamical forecast (ODF). Initial conditions at a time lagging the start of the forecast period are used, with varying amounts of time for the lags. Forcing by asymmetric Newtonian heating of the lower layer is used in a two-layer, f-plane, highly truncated spectral model in a test forecasting run. Both the LAF and MCF are found to be more accurate than the ODF due to ensemble averaging with the MCF and the LAF. When a regression filter is introduced, all models become more accurate, with the LAF model giving the best results. The possibility of generating monthly or seasonal forecasts with the LAF is discussed.

Hoffman, R. N.↗

Interactive Forecasting with the National Weather Service River Forecast System

The National Weather Service River Forecast System (NWSRFS) consists of several major hydrometeorologic subcomponents to model the physics of the flow of water through the hydrologic cycle. The entire NWSRFS currently runs in both mainframe and minicomputer environments, using command oriented text input to control the system computations. As computationally powerful and graphically sophisticated scientific workstations became available, the National Weather Service (NWS) recognized that a graphically based, interactive environment would enhance the accuracy and timeliness of NWS river and flood forecasts. Consequently, the operational forecasting portion of the NWSRFS has been ported to run under a UNIX operating system, with X windows as the display environment on a system of networked scientific workstations. In addition, the NWSRFS Interactive Forecast Program was developed to provide a graphical user interface to allow the forecaster to control NWSRFS program flow and to make adjustments to forecasts as necessary. The potential market for water resources forecasting is immense and largely untapped. Any private company able to market the river forecasting technologies currently developed by the NWS Office of Hydrology could provide benefits to many information users and profit from providing these services.

Smith, George F.↗

Magnetogram Forecast: An All-Clear Space Weather Forecasting System

Solar flares and coronal mass ejections (CMEs) are the drivers of severe space weather. Forecasting the probability of their occurrence is critical in improving space weather forecasts. The National Oceanic and Atmospheric Administration (NOAA) currently uses the McIntosh active region category system, in which each active region on the disk is assigned to one of 60 categories, and uses the historical flare rates of that category to make an initial forecast that can then be adjusted by the NOAA forecaster. Flares and CMEs are caused by the sudden release of energy from the coronal magnetic field by magnetic reconnection. It is believed that the rate of flare and CME occurrence in an active region is correlated with the free energy of an active region. While the free energy cannot be measured directly with present observations, proxies of the free energy can instead be used to characterize the relative free energy of an active region. The Magnetogram Forecast (MAG4) (output is available at the Community Coordinated Modeling Center) was conceived and designed to be a databased, all-clear forecasting system to support the operational goals of NASA's Space Radiation Analysis Group. The MAG4 system automatically downloads nearreal- time line-of-sight Helioseismic and Magnetic Imager (HMI) magnetograms on the Solar Dynamics Observatory (SDO) satellite, identifies active regions on the solar disk, measures a free-energy proxy, and then applies forecasting curves to convert the free-energy proxy into predicted event rates for X-class flares, M- and X-class flares, CMEs, fast CMEs, and solar energetic particle events (SPEs). The forecast curves themselves are derived from a sample of 40,000 magnetograms from 1,300 active region samples, observed by the Solar and Heliospheric Observatory Michelson Doppler Imager. Figure 1 is an example of MAG4 visual output

Barghouty, Nasser↗