Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “day-ahead forecast”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Forecasting Day-Ahead Solar Irradiance for Puerto Rico Using the WRF Model and NSRDB

Accurately predicting solar energy resources is a major challenge in integrating photovoltaics generation on the electric grid. Numerical weather prediction has been recognized by the solar energy community as a major approach to provide solar resource forecasts at various locations and for a variety of timescales. In this study, as a part of the Puerto Rico Grid Resilience and Transitions to 100% Renewable Energy Study (PR100), we develop day-head solar irradiance forecast data using the Weather Research and Forecasting (WRF) model at 3 km and hourly/5-minute. The global horizontal irradiance (GHI) and direct normal irradiance (DNI) forecasts simulated from the WRF model are postprocessed by a simple optimization method using satellite-derived gridded observations from the National Solar Radiation Data Base (NSRDB) to reduce error and bias of the solar irradiance forecasts covering 2018-2020. The NSRDB contributes to improving the GHI and DNI forecasts and also offers the opportunity for an in-depth analysis to evaluate their accuracy over a wide range of Puerto Rico regions. Preliminary results show overall improvements of GHI forecasts up to 37% (DNI: 15%) for mean absolute error and 97% (DNI: 76%) for mean bias error by applying a postprocessing technique to WRF model output.

data models↗
DOE OSTI2025

Day-Ahead Forecasting with Federated LSTM to Plan Energy Sharing in a Community Microgrid

Energy balancing in microgrids is a key enabler of resilience. Community microgrids located close to each other have the added benefit of networking and sharing surplus energy, if available. Such complex decision-making runs on optimization that requires reliable short-term (up to very-short-term) forecasts of energy generation and consumption for scheduling or trading. Each microgrid may also opt to not expose their sensitive data such as consumption patterns of individual businesses or residences. This paper investigates a federated approach to dayahead forecasting that trains naive long short-term memory (LSTM) at each business in a microgrid and aggregates weights at the microgrid controller using proximal regularization. This approach ensures that the controller has access only to energy surplus/deficit and not the actual generation or consumption values, avoiding unwanted exposure of sensitive data. A community microgrid in Adjuntas, Puerto Rico with 3 businesses is selected as a case study with a laboratory-scale computing setup. A central LSTM forecaster, where sensitive data from businesses are aggregated at the controller, is implemented as a baseline for qualifying the results. This work serves as a proof-of-concept for scaling the approach to networked and nested microgrids with more complex control options.

Sundararajan, Aditya [ORNL] (ORCID:000000033577854↗
DOE OSTI2025

Getting brighter: Impacts of improved day-ahead solar forecasts in high-solar, high-storage electricity systems

This paper analyzes the impacts of improved day-ahead solar forecasts on costs and dispatch in the solar-rich Southeast U.S. It uses an optimized high-solar, high-storage resource portfolio in which solar generation capacity accounts for 45 % of total installed capacity (34 %–36 % of generation) and energy storage capacity (43 GW) is equivalent to 33 % of peak demand. In a base scenario, improved day-ahead solar forecasts reduce production costs by $\$87$ million per year ($\$0.13$ per MWh load, $2023$$). This level of savings is within the range or lower than earlier studies of solar forecast improvements at lower levels of solar generation (<25 % of total generation). In this study, solar expansion was accompanied by two important sources of flexibility for managing solar forecast error: energy storage and day-ahead solar curtailment. Furthermore, the analysis finds that regional coordination complements day-ahead solar forecast improvements while natural gas commitment flexibility is a substitute for forecast improvements, as the improved solar forecast leads to sub-optimal commitment of thermal units. Day-ahead solar forecast improvements reduce reserves required to manage forecast error by 30 %. Fewer reserves to manage large, infrequent solar forecast errors could be an important benefit of improved solar forecasts.

14 SOLAR ENERGY↗
DOE OSTI2026

LAF-Net: A Deep Residual and Cross-Attention Framework for Day-Ahead Load Forecasting: Preprint

Accurate day-ahead load forecasting is essential for reliable power system operations and market efficiency. System operators such as the Midcontinent Independent System Operator (MISO) rely on forecasts from multiple vendors, yet combining them effectively remains a persistent challenge due to vendor-specific biases. This paper presents a novel LSTM-Attention Fusion Network with Error Representation (LAF-Net) that enhances day-ahead hourly load forecasting through deep residual learning and multi-modal cross-attention. The proposed model builds a historical error memory from past vendor performance and dynamically queries it with future hour context to generate adaptive, hour-specific trust weights for each vendor. A bounded residual correction further refines forecasts by mitigating systematic and temporally localized errors. Tested on real MISO LBA data with multi-vendor forecasts, LAF-Net consistently outperforms the best vendor baseline across all 38 LBAs, achieving more than a 40% reduction in system-level mean absolute error (MAE) during peak load hours relative to the best vendor baseline.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Day-Ahead Probabilistic Forecasting of Net-Load and Demand Response Potentials with High Penetration of Behind-the-Meter Solar-plus-Storage

The goal of this project is to develop advanced methods for day-ahead net-load forecasting, by leveraging the state-of-the-art machine learning techniques. The developed models produce both point and probabilistic forecasts for a variety of use cases, and are versatile to work with different types of data sets. The innovation lies in the novel design of the architectures, leveraging the most recent advances in machine learning that have not been explored in power systems, accompanied by techniques in the broader artificial intelligence fields such as fuzzy systems. This project has achieved the following accomplishments: (1) preprocessing of over 10 data sets covering varying geographical regions, time horizons, and system levels, which form a robust foundation for training and evaluating forecasting models across a wide range of realistic grid scenarios; (2) development of an interactive web app that enables exploratory analysis of load and generation data, and supports better understanding of data trends, anomalies, and correlations, facilitating model development and stakeholder engagement; (3) implementation of over 10 benchmark models for point and probabilistic forecasting, which include a mix of conventional machine learning methods and state-of-the-art deep learning approaches, providing a comprehensive baseline for performance comparison and validation of the proposed models; (4) development of a fuzzy system based gradient boosting model, tailored for small (less than 3 years) data sets, which achieves a mean absolute percentage error (MAPE) of 4% for point forecasting and a 20% improvement in average pinball loss for probabilistic forecasting; (5) development of a Transformer (a state-of-the-art deep learning architecture) based neural network model, tailored for large (3 years or more) data sets, which achieves a MAPE of 2% for point forecasting and a 20% improvement in average pinball loss for probabilistic forecasting; (6) development of a methodology for quantifying DR potential, and extensions of the previous models for multi-target forecasting of net load and DR potential, which achieve a MAPE of 10% for DR potential.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Solar and Wind Forecast Error Reserve Sharing in a Multi-Utility Region

As electricity systems transition to higher levels of solar and wind generation, electric system operators will likely need to hold additional reserves to manage solar and wind forecast error. Because solar and wind forecast errors tend to be weakly correlated across space, system operators can reduce their reserve requirements by sharing reserves. This paper examines the benefits of forecast error reserve sharing among balancing areas in the Southeastern United States, in scenarios in which solar and wind generation ranges from 34% to 65% of total generation. It finds that day-ahead forecast error reserve requirements increase linearly with growth in solar and wind generation capacity (6%-10% of total capacity), but that reserve sharing can significantly reduce these requirements (by 6%-29%). It finds that, in economic terms, the value of forecast error reserve sharing ($\$$0.09-$\$$1.24 billion per year, $\$$0.12-$\$$1.68/MWh of load across scenarios) tends to decline with higher levels of solar and wind generation, due to lower reserve and energy prices. Even with declines in reserve prices, forecast error reserve sharing can still provide substantial value, though with higher levels of solar, wind, and electricity storage this value is increasingly tied to avoiding scarcity prices.

14 SOLAR ENERGY↗
DOE OSTI2026

VRN3P: Variational Recurrent Neural Network Based Net-Load Prediction under High Solar Penetration

This is the final technical report for the SETO-funded VRN3P project (PNNL# 76914). The goal of this project, led by Pacific Northwest National Laboratory (PNNL), in collaboration with Lawrence Livermore National Laboratory (LLNL) and Portland General Electric (PGE), was to develop and validate a deep variational recurrent neural network-based net-load prediction (VRN3P) framework for probabilistic time-series forecasting of day-ahead net-load under high solar penetration scenarios. The project team reports successful design of a novel probabilistic net-load forecasting architecture, comprising of a variational autoencoder and a recurrent neural network, which demonstrates 30% improvement in forecast performance, 60% improvement in training time, and consumes 44% less memory, when compared with conventional baseline models. The team tested the VRN3P model performance on GridLAB-D test-cases representing varying BTM solar penetration levels of 20%, 30%, and 50%, with integrated time-series net-load profiles provided by the utility partner (PGE). The VRN3P model demonstrate <2% hourly MAPE (averaged over the year) for day- ahead net-load forecast on the test scenario with 20% BTM solar. Transfer learning extension of the VRN3P model has demonstrated 8.33× speed-up in training, while still achieving acceptable forecast performance of 2.24% hourly MAPE on the 30% BTM solar penetration test-scenario. A preliminary version of the VRN3P GridAPPS-D™has been developed, along with a web-based interactive user-interface (named ‘Forte’) which has made available on GitHub for public use.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Electric Grid Simulator For Human Factor Research

The developed code simulates real-time monitor and control for west area of IEEE 118-bus system. The 24-hour load profile for each bus is derived by scaling the system’s rated load in the PSSE sav file according to the California Independent System Operator’s Day-ahead load forecast for May 1, 2024. This simulator performs several critical functions: (1) Calculating time-series power flow every 4 seconds; (2) Updating and dispatching AGC signals every minute; (3) Conducting N-1 contingency analysis every 5 minutes. Additionally, the simulator can trip lines and subsequently update and dispatch AGC signals, running power flow analysis after each tripping event.

Huang, Jianqiao [Idaho National Laboratory (INL), ↗
DOE OSTI2025

Assessment of Climate Change Impacts on Renewable Energy Resources in Western North America

We examine a 25 km resolution climate model dataset to evaluate how regional climate change impacts solar and wind energy under a high-emission scenario. Our study considers the Western Electricity Coordinating Council (WECC) region, which covers the western United States and southwestern Canada, focusing specifically on locations with existing solar and wind infrastructure. First, we conduct a historical model comparison of solar and wind energy capacity factors to highlight model uncertainties across the study area. Using future climate projections, we then assess the seasonal patterns of solar and wind capacity factors for three timeframes: historical, mid-century, and end of century. Additionally, we estimate the frequency of solar and wind resource droughts during these periods for the entire WECC and its five operational subregions, finding that certain subregions are more susceptible to energy droughts due to limited renewable resources. Finally, we present day-ahead capacity factor forecasts to support energy storage planning and provide estimates of offshore wind energy capacity within the WECC. Our results indicate that offshore wind capacity factors are nearly twice as high as onshore values, with less seasonal variation, which suggests that offshore wind could offer a more consistent renewable energy supply in the future.

climate change↗
DOE OSTI2024

Short-Term Load Forecasting Considering EV Charging Loads with Prediction Interval Evaluation

Short-term load forecasting plays a critical role in power system planning and operation. Along with the electrification of various loads, electricity demands are becoming increasingly hard to predict. Notably, the recent rise in electric vehicles (EVs) has further contributed to this unpredictability. To address this issue, this paper proposes a probabilistic load forecasting strategy utilizing Gaussian process regression, structured in a day-ahead manner. While many works focus on deterministic prediction, probabilistic forecasting offers additional insights into variability and uncertainty, enabling more flexible and reliable operation for power systems. To enhance the accuracy of the load forecasting model, the inputs include features related to EV charging habits as well as commonly used weather information. The load forecasting results are evaluated using various metrics, including conventional ones that assess the accuracy of point forecasts, as well as additional metrics that test the reliability of prediction intervals. The proposed load forecasting method is finally tested on real residential power consumption data and EV charging data sampled from real-world sources. The results prove that the new features can greatly improve the performance of the load forecasting method.

electrical vehicle↗
DOE OSTI2025

Transfer Learning Trained LSTM Models for Household Load Profile Forecasting

Grid edge renewable energy resources, such as rooftop solar photovoltaics, closely interact with consumer load profiles. Therefore, forecasting future electricity demand, ideally at the individual household level, is indispensable. In this paper, we present a transfer learning enhanced household load profile forecasting method. First, we tune a long short-term memory forecasting model to perform day-ahead prediction of household electricity load profiles. Then we improve these individualized models using transfer learning, and we use k-means clustering to create optimal source data sets. We find average improvements of 4.38% (largest improvement of 10.71%) when the entire data set was used to train the source model and 2.45% (largest improvement of 11.57%) in the mean absolute error when households were first clustered and used to train separate source models for each cluster. We find that transfer learning with clustered data can effectively boost the forecasting performance of the LSTM models. We use realistic household power measurements for 148 real residential households in Austin, Texas.

deep learning↗
DOE OSTI2024

Improving the National Solar Radiation Database (NSRDB) Using a Physics-Based Direct Normal Irradiance (DNI) Model

The National Solar Radiation Database (NSRDB) is a widely used resource providing satellite-derived solar data across the United States and globally. While the NSRDB employs a physical model for computing global horizontal irradiance (GHI), its current method for estimating cloudy-sky direct normal irradiance (DNI) relies on surface observations and empirical models. Recently, a novel physics-based approach, the Fast All-Sky Radiation Model for Solar applications with DNI (FARMS-DNI), was developed to enhance the DNI forecasting. FARMS-DNI incorporates both direct and scattered solar radiation within the circumsolar region, resulting in improved day-ahead DNI predictions when integrated into the Weather Research and Forecasting model with Solar extensions (WRF-Solar). This study integrates FARMS-DNI into the NSRDB algorithm to generate high-resolution DNI data from satellite resources. Our findings reveal that FARMS-DNI effectively mitigates the substantial DNI overestimation present in the conventional NSRDB across surface sites, particularly in conditions categorized as cloudy overcast. Consequently, this innovative model substantially enhances the overall accuracy of the NSRDB.

Xie, Yu↗
DOE OSTI2024

Improving the National Solar Radiation Database (NSRDB) Using a Physics-Based Direct Normal Irradiance (DNI) Model: Preprint

The National Solar Radiation Database (NSRDB) is a widely used resource providing satellite-derived solar data across the United States and globally. While the NSRDB employs a physical model for computing global horizontal irradiance (GHI), its current method for estimating cloudy-sky direct normal irradiance (DNI) relies on surface observations and empirical models. Recently, a novel physics-based approach, the Fast All-Sky Radiation Model for Solar applications with DNI (FARMS-DNI), was developed to enhance the DNI forecasting. FARMS-DNI incorporates both direct and scattered solar radiation within the circumsolar region, resulting in improved day-ahead DNI predictions when integrated into the Weather Research and Forecasting model with Solar extensions (WRF-Solar). This study integrates FARMS-DNI into the NSRDB algorithm to generate high-resolution DNI data from satellite resources. Our findings reveal that FARMS-DNI effectively mitigates the substantial DNI overestimation present in the conventional NSRDB across surface sites, particularly in conditions categorized as cloudy overcast. Consequently, this innovative model substantially enhances the overall accuracy of the NSRDB.

DNI↗
DOE OSTI2025

Hydroboost

HydroBoost is the most realistic revenue optimization tool for the hybridization of hydropower and battery energy storage systems to date. The innovative representation of how operators actually schedule hydropower in practice results in more realistic predictions of revenue and operations. Unlike other optimization tools, HydroBoost generates forecast energy prices with uncertainty to use in the optimization. This allows HydroBoost to give users a range of potential revenue with an upper bound using the perfect foresight pricing and a lower bound using a naive persistence forecast model. Additional forecast can be generated and used in the optimization, such as additive models, random forest, and neural networks to give further insight into potential revenue. HydroBoost has been designed to be applicable for both run-of-river and reservoir storage sites. The primary focus is on the day-ahead market and requires year-long data with an hour time-step. All time-series input and constraints are contained in an Excel worksheet for convince. The user will run the forecasting generation first with a Python script to give the optimization model the necessary requirements. Next the optimization is ran using Julia and results are generated and stored into a directory as csv files. HydroBoost includes an additional module to generate figures based on the results of the optimization simulation. The results help analyze the results and users to draw insights into how the hydro and battery systems are operated and the revenue each is producing. Additionally, the difference between the perfect foresight model and models that include forecast can easily be inspected.

Phillips, TylerB. [Idaho National Laboratory (INL)↗
DOE OSTI2024

Integration of New Technology Considering the Trade-Offs Between Operational Benefits and Risks: A Case Study of Dynamic Line Rating

Electric grid operators are adept at handling complexity and uncertainty. However, with increasing introduction of renewable generation, distributed energy resources, and more frequent severe weather events, operators will experience new workload and challenging decision scenarios. Here, this paper quantifies risks and benefits from an operator's perspective of introducing weather based forecast Dynamic Line Ratings (DLR) using variable wind conditions in addition to ambient temperature to relieve transmission congestion and facilitating more offshore wind (OSW). A concept of operations (CONOPS) applied to a forecast DLR implementation and its integration with OSW is defined. A method for evaluating tradeoffs of derating to make the rating more conservative but decreasing the benefit was developed and applied to a case study for two existing overhead transmission lines on Long Island, New York. The CONOPS uses historical day-ahead and hour-ahead High Resolution Rapid Refresh weather forecasts and weather station data to support planning and real-time operations. The analysis determines the risk of downgrades in real-time operational rating compared to the forecast and quantifies the frequency and severity of last-minute downgrades. The risk is compared against the benefits in increased capacity to provide insights on the additional amount of uncertainty DLR and OSW will add to the operator's workload.

17 WIND ENERGY↗
DOE OSTI2024

Probabilistic Hydropower Flexibility Valuation: Case Studies for Boating Flow Regime

The optimal scheduling of hydropower generation holds significant importance to power system operation. The unique requirements of environmental constraints and the power system, depending on their respective objectives, demand distinct flow patterns. While power system stakeholders strive to optimize revenue in electricity markets, stakeholders from boating recreation seeks to identify flow ranges that optimize the boating experience. In pursuit of a win-win solution, this study aims to reconcile the interests of various stakeholders in hydropower scheduling. The maximum revenue from day-ahead electricity market is explored through an optimization process considering both plant operation constraints, boating flow constraints, water availability, and market prices. Results of real world case studies at a river in California show that the proposed approach can achieve dual objectives: maximizing market revenue while addressing boating recreation necessities. In addition, as the accuracy of electricity price forecasting and flow forecasting increase, the optimal revenue becomes increasingly advantageous to hydropower plant operators.

13 HYDRO ENERGY↗
DOE OSTI2025

Bidding Curve Design for Hybrid Power Plants with Uncertain Solar Forecast

This paper presents a novel bidding curve design algorithm tailored for hybrid power plants (HPPs) to participate in the wholesale electricity market. Utilizing forecasts for photovoltaic (PV) generation and available battery power, our algorithm strategically computes the bidding curve to maximize HPP profit while adeptly managing the inherent uncertainty associated with PV power generation. In addition, the introduction of the penalty cost in HPP bidding curves provides the system operator a tool to effectively manage the system-level uncertainty that caused by HPPs. Numerical analysis through Monte Carlo simulations confirms that our bidding curve methodology outperforms the benchmark across various scenarios.

bidding curve↗
DOE OSTI2025

Spatiotemporal Downscaling Model for Solar Irradiance Forecast Using Nearest-Neighbor Random Forest and Gaussian Process

Accurate solar photovoltaic (PV) capacity estimation requires high-resolution, site-specific solar irradiance data to account for localized variability. However, global datasets, such as the National Solar Radiation Database (NSRDB), provide regional averages that fail to capture the fine-scale fluctuations critical for large-scale grid integration. This limitation is particularly relevant in the context of increasing distributed energy resources (DERs) penetration, such as rooftop PV. Additionally, it is critical to the implementation of the U.S. Federal Energy Regulatory Commission (FERC) Order 2222, which facilitates DER participation in U.S. bulk power markets. To address this challenge, this study evaluates Nearest-Neighbor Random Forest (NNRF) and Nearest-Neighbor Gaussian Process (NNGP) models for spatiotemporal downscaling of global solar irradiance data. By leveraging historical irradiance and meteorological data, these models incorporate spatial, temporal, and feature-based correlations to enhance local irradiance predictions. The NNRF model, a machine-learning approach, prioritizes computational efficiency and predictive accuracy, while the NNGP model offers a level of interpretability and prediction uncertainty by numerically quantifying correlations and dependencies in the data. Model validation was conducted using day-ahead predictions. The results showed that the average Goodness of Fit (GoF) of the NNRF model of 90.61% across all eight sites outperformed the GoF of the NNGP of 85.88%. Additionally, the computational speed of NNRF was 2.5 times faster than the NNGP. Finally, the NNGP displayed polynomial scaling while the NNRF scaled linearly with increasing number of nearest neighbors. Additional validation of the model on five sites in Puerto Rico further confirmed the superiority of the NNRF model over the NNGP model. These findings highlight the robustness and computational efficiency of NNRF for large-scale solar irradiance downscaling, making it a strong candidate for improving PV capacity estimation and real-time electricity market integration for DERs.

Asiedu, Shadrack (ORCID:0009000646004826)↗