Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “forecast error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Collaborative Distribution System Restoration Planning and Real-Time Dispatch Considering Behind-the-Meter DERs

Modern distribution systems are becoming more resilient against power outages thanks to the flexible generation capacity provided by the increasing integration of distributed energy resources (DERs). Compared to utility-scale DERs, which can be directly controlled by system operators, small-scale, behind-the-meter DERs are much more difficult to coordinate despite being the vast majority. Two major obstacles to the implementation of DERs for service restoration are the coordination of behind-the-meter DERs and the management of uncertainty. In this paper, a novel distribution system restoration strategy is proposed to overcome these two obstacles. The flexibility of be-hind-the-meter DERs is quantified and integrated into the restoration planning models within a hierarchical structure. The model predictive control technique is employed to enable adaptive restoration planning solution adjustments to accommodate fault scenarios and forecast errors. Besides, real-time power dispatch models are proposed to maintain power balance using available DER capability. Comprehensive integration of adaptive restoration planning schemes and real-time dispatch results are achieved through a collaborative restoration framework. Finally, the effectiveness of the proposed restoration strategy is verified through a modified IEEE 123-bus system and a real-world utility system.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Optimal Demand Response Incorporating Distribution LMP with PV Generation Uncertainty

The utilization of aggregated demand-side flexibility via demand response (DR) has become a promising pathway for the integration of renewable energy resources in power systems. Nowadays, there are several management strategies for DR such as the price-based transactive control strategies. However, many of such existing price-based control strategies neglect the physics and operational constraints of the underlying distribution networks when computing the price, raising concerns regarding their theoretical and practical values. This paper studies this issue and investigates optimal DR (ODR) by incorporating the distribution locational marginal price (DLMP). In particular, we discuss DR in connection with DLMPs and propose a multiperiod bilevel optimization problem to find the ODR strategy. Here, the objective is to minimize the peak load, load fluctuation, and payments of load aggregators. In addition, a robust bilevel ODR model is formulated to provide a robust ODR strategy while minimizing operating costs under the worst-case realization of uncertainties; this mitigates the impact of forecasting errors on renewable energy resources. Then, we propose an efficient solution approach by employing the Karush-Kuhn-Tucker conditions and strong duality. Simulation results are presented to illustrate the mutual impacts of the interaction between DR and DLMP and the benefits of the robust ODR strategy.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Self-Supervised T-GCN for Detection of Disturbance and Propagation in Power Grid

Urban power systems increasingly rely on dense sensing to monitor grid reliability, yet disturbance labels are scarce and events are rare. We present a self-supervised spatio-temporal method that detects, localizes, and characterizes grid frequency disturbances across urban areas using only unlabeled data. Our approach trains a tiny Temporal Graph Convolutional Network (T-GCN) to forecast per-site frequency residuals (deviation from 60 Hz). The sensor graph is constructed directly from signals using pre-event Pearson correlation with a cross-correlation lag penalty without geocoding. At inference, node-level anomalies are the model's forecast errors; region-level alarms arise from connected components of high-score nodes. We estimate disturbance propagation by computing per-node arrival times (first persistent exceedance), then fit a planar or time-of-arrival model to obtain direction, speed, and an epicenter proxy. With only three real events collected at decisecond resolution across U.S. cities, we evaluate the T-GCN and report time-to-detect, footprint size, and propagation consistency. We further show that short-window embeddings from the T-GCN's hidden states enable few-shot event-vs-background recognition via a simple prototypical classifier. Despite minimal data and no labels, our system yields fast, spatially coherent detection and interpretable propagation maps, offering a practical, lightweight pathway to city-scale grid resilience analytics.

Niu, Haoran [ORNL] (ORCID:0000000155228297)↗
DOE OSTI2022

Risk-Based Dispatch Bound Calculator

This calculator outputs time-varying lower and upper bounds (matrices), called dispatch bounds, for the controllable portions of the power injections at each node in a distribution network to guarantee that the voltage magnitudes stay within prescribed bounds with at least a given probability for any set of power injections that are within their dispatch bounds. The calculator is meant to be a tool for a central controller of a distribution network to set dispatch bounds for each node that allows each node to independently decide their actual power injection within their dispatch bound. The user can choose whether to assume the forecast errors of the uncontrollable power injections are gaussian or are worst-case (distributionally robust). The user can choose whether the dispatch bounds include the controllable reactive power or just the active power under a constant power factor assumption.

Comden, Joshua↗
DOE OSTI2022

Near-Term Reliability and Resilience (NTRR) (Final Report)

The Near-Term Reliability and Resiliency (NTRR) was awarded in December 2020 as an inter-lab project to examine the reliability and resilience of the electricity grid and natural gas transportation availability. The project builds on studies conducted by The North American Electric Reliability Corporation (NERC), the U.S. Department of Energy (DOE), and other non-governmental research and operational focused on reliability and resilience analyses challenges. The research was conceived to address near-term scenarios (within 10 years), when many local and regional policy transitions could begin to impact grid reliability, resilience, and supporting infrastructure availability. To integrate the natural gas interdependency, the team began with the generating capacity and demand projections from the 2020 NERC Long-Term Reliability Assessment and the Bulk Electric System (BES) transmission topologies defined in the Western Electricity Coordinating Council (WECC) Anchor Data Set, Eastern Interconnection Reliability Assessment Group Multi-Regional Modeling Working Group (ERAG/MMWG) Data Set, the team calculated baseline regional power sector gas demands from present electricity delivery year through the end of delivery year 2030/31 by applying security constrained economic dispatch. This demand was compiled along with demand projections for regional residential, commercial, and industrial natural gas demands from the most recent Energy Information Administration (EIA) Annual Energy Outlook Reference Case into Deloitte’s MarketBuilder® North American Gas Model. Through the application of these demands, MarketBuilder® was projected the topology of natural gas flows in the natural gas pipeline network across the interconnected North American system along with regional natural gas prices that may be seen by market participants in future years Additionally, contingencies and sensitivities focused on the built models of the Eastern Interconnection (EI) and Western Interconnection (WI). They address challenges from the following with the outcomes being an identification of performance under the extreme conditions and an identification of potential grid weaknesses that should be addressed to mitigate the reduced performance and improve the resilience and reliability of the specific regions as well as the National Grid: • Weather events including extreme heat, extreme cold, high wind, no wind, wind and solar forecasting errors, and wildfires. • Gas availability, factoring in supply disruption (contractual and physical), seasonal availability constraints, and infrastructure limitations; and • Transmission availability and congestion.

03 NATURAL GAS↗
DOE OSTI2025

Solar and Storage Integration in the U.S. Southeast: Implications for Resource Adequacy

Resource adequacy concerns may be very different in electricity systems that have higher levels of solar and storage, requiring changes to existing planning models. This study explores a novel approach to evaluating resource adequacy under future scenarios with higher solar and storage in the Southeast U.S. It uses NREL’s Probabilistic Resource Adequacy Suite (PRAS), a collection of probabilistic resource adequacy modeling tools, and compares results when interacting PRAS and a portfolio planning tool with a more traditional modeling approach. The results suggest that traditional models perform reasonably well with lower levels of solar PV, but at higher levels of solar probabilistic tools better capture the changes in resource adequacy concerns—such as winter energy availability—associated with higher solar systems. This is the final study in the Preparing Southeast Markets for Reliable and Affordable Integration of Solar into Operations and Planning project. Two prior reports can be found at: Solar and Storage Integration in the Southeastern United States: Economics, Reliability, and Operations. https://emp.lbl.gov/publications/solar-and-storage-integration Solar and Wind Forecast Error Reserve Sharing in a Multi-Utility Region. https://eta-publications.lbl.gov/sites/default/files/2024-11/multiutility_fe_reserve_sharing_final.pdf

14 SOLAR ENERGY↗
DOE OSTI2022

Robust Scheduling of Networked Microgrids for Economics and Resilience Improvement

The benefits of networked microgrids in terms of economics and resilience are investigated and validated in this work. Considering the stochastic unintentional islanding conditions and conventional forecast errors of both renewable generation and loads, a two-stage adaptive robust optimization is proposed to minimize the total operating cost of networked microgrids in the worst scenario of the modeled uncertainties. By coordinating the dispatch of distributed energy resources (DERs) and responsive demand among networked microgrids, the total operating cost is minimized, which includes the start-up and shut-down cost of distributed generators (DGs), the operation and maintenance (O&M) cost of DGs, the cost of buying/selling power from/to the utility grid, the degradation cost of energy storage systems (ESSs), and the cost associated with load shedding. The proposed optimization is solved with the column and constraint generation (C&CG) algorithm. The results of case studies demonstrate the advantages of networked microgrids over independent microgrids in terms of reducing total operating cost and improving the resilience of power supply.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2020

Probabilistic Look-ahead Contingency Analysis Integration with Commercial Tool and Practical Data

This paper presents an initial effort of integrating a smart sampling-based probabilistic look-ahead contingency analysis algorithm with General Electric (GE) Grid Solutions’ commercial energy management system (EMS) tool as a proof-of-concept for a seamless research tool integration using real world large-scale grid data. With the increasing impact of random forces such as variable generation and load, their stochastic behaviors cannot be ignored. However, the current practices are still dominated by deterministic tools. They are becoming increasingly inadequate for the future grid. The developed look-ahead contingency analysis algorithm incorporates forecast errors of variable energy and load to address the challenges brought by the increasing uncertainty of power system. The algorithm can reveal the potential violations caused by the variance of variable energy and load that are not normally detected by traditional deterministic approaches. To test its performance under practical environments ( real data with real commercial tool), significant efforts have been made to prepare test cases, modify GE EMS tool, and adapt an extreme value distribution algorithm to analyze the GE EMS’s violation-only outputs. The test results clearly demonstrate the effectiveness of the developed algorithm as new transformer violations that were not previously detected have been identified. This performance provides better situational awareness to engineers for their decision-making process under uncertainty. Moreover, with the discussion of computational performance and future work, this paper has shown a clear path for integrating the probabilistic algorithm with commercial tools to make us better equipped for the changing power system.

Modeling and simulation of power systems, constrai↗
DOE OSTI2021

Error-Level-Controlled Synthetic Forecasts for Renewable Generation

Renewable energy resources, including solar and wind energy, play a significant role in sustainable energy systems. However, the inherent uncertainty and intermittency of renewable generation pose challenges to the safe and efficient operation of power systems. Recognizing the importance of short-term (hours ahead) renewable generation forecasting in power systems operation, it becomes crucial to address the potential inaccuracies in these forecasts. To systematically evaluate the performance of controllers in the presence of imperfect forecasts, we generate synthetic forecasts using actual renewable generation profiles (one from solar and one from wind). These synthetic forecasts incorporate different levels of statistical error, allowing us to control and manipulate the accuracy of the predictions. The primary objective is to employ synthetic forecasts with controlled yet realistic error levels to systematically investigate how controllers adapt to variations in forecast accuracy, providing valuable insights into their robustness and effectiveness under real-world conditions.

Array↗
DOE OSTI2024

Autonomous Anomaly Detection for MPC Forecasts of HVAC Systems in Residential Communities

The use of residential heating, ventilation, and air conditioning (HVAC) to shift peak demand or provide ancillary services is a potential solution in the presence of older grids and distributed renewables. However, to ensure the efficient use of devices, utilities need to accurately forecast the load and adopt error correction schemes when necessary. While significant theoretical research exists in the area of predictive control of HVAC, little experimental evidence exists. The lack of experimental data in turn causes researchers to be unprepared for unsystematic errors which emerge due to the higher complexity of the data generating process. This study offers an anomaly detection methodology that uses unsupervised machine learning algorithms to detect and isolate these errors with different forecast error ranges. The results of anomaly detection procedure can then be used for error correction and would eventually help develop better predictive controllers. The methodology is tested using real world data from a smart neighborhood that currently operates in Atlanta. GA.

Lebakula, Viswadeep↗
DOE OSTI2023

Net Load Forecasting With Disaggregated Behind-the-Meter PV Generation

As worldwide use of residential photovoltaic (PV) systems grows, system operators and utilities will need to transition from forecasting pure demand to forecasting net load with behind-the-meter (BTM) PV generation. However, PV generation can be difficult to predict and the measurements of PV generation from BTM residential systems are often invisible behind a measurement of the net load, making net load forecasting challenging. This paper proposes a novel two-stage framework for net load forecasting in areas with limited observability and high BTM PV generation. First, the profiles of observable customers are used to disaggregate the net load measurements into the pure load and PV generation. Then, separate models are used to forecast the PV generation and pure load individually, and the results are combined for a net load forecast. Further, this paper also proposes a compensator for correcting the error of the net load forecast, using historical forecast errors of the PV generation, pure load, and net load. The proposed framework is tested through two case studies for areas with high BTM PV penetration and less than 10% observable customers. The two-stage forecasting model is compared to two benchmark methods - a time series forecasting model, and a model that forecasts the net load directly using historical net load measurements. Results show that the proposed disaggregation-forecasting framework reduces the error of the net load forecast compared to both benchmark models. In addition, when the net load forecast error is periodic, the compensator can correct the error to improve the forecast accuracy.

14 SOLAR ENERGY↗
DOE OSTI2024

Enhanced Carbon Storage Forecasting via Cross-Geology Transfer Learning

Rapid simulation of the spatiotemporal evolution of pressure & saturation for SACROC 1. Neural operator was trained on only 153 simulation runs 2. Trained to account for heterogeneity and variations/uncertainties in engineering, fluids, and geology 3. Pressure forecast has less than 1% error 4. Saturation forecast has less than 2% error 5. Traditional simulator takes 1 hour for a single scenario, while neural operator takes less than 1 minute. Rapid simulation of the spatiotemporal evolution of pressure & saturation for IBDP 1. Transfer Learning was implemented on the SACROC-based Neural Operator that was trained on only 20 simulation runs for IBDP Site 2. SACROC and IBDP Sites have several significant differences in geology and engineering parameters. 3. Pressure forecast has less than 5 psi error 4. Saturation forecast has less than 7% error 5. Traditional simulator takes 1 hour for a single scenario, while neural operator takes less than 1 minute and only 20 simulations for training/validation.

Misra, Siddharth↗
DOE OSTI2022

Curriculum-based Reinforcement Learning for Distribution System Critical Load Restoration

This paper focuses on the critical load restoration problem in distribution systems following major outages. To provide fast online response and optimal sequential decision-making support, a reinforcement learning (RL) based approach is proposed to optimize the restoration. Due to the complexities stemming from the large policy search space, renewable uncertainty, and nonlinearity in a complex grid control problem, directly applying RL algorithms to train a satisfactory policy requires extensive tuning to be successful. To address this challenge, this paper leverages the curriculum learning (CL) technique to design a training curriculum involving a simpler steppingstone problem that guides the RL agent to learn to solve the original hard problem in a progressive and more effective manner. We demonstrate that compared with direct learning, CL facilitates controller training to achieve better performance. To study realistic scenarios where renewable forecasts used for decision-making are in general imperfect, the experiments compare the trained RL controllers against two model predictive controllers (MPCs) using renewable forecasts with different error levels and observe how these controllers can hedge against the uncertainty. Results show that RL controllers are less susceptible to forecast errors than the baseline MPCs and can provide a more reliable restoration process.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Evaluation of the Four-Dimensional Ensemble-Variational Hybrid Data Assimilation with Self-Consistent Regional Background Error Covariance for Improved Hurricane Intensity Forecasts

The feasibility of a hurricane initialization framework based on the Gridpoint Statistical Interpolation (GSI)-based four-dimensional ensemble-variational (GSI-4DEnVar) hybrid data assimilation system for the Hurricane Weather Research and Forecasting model (HWRF) model is evaluated in this study. The system considers the temporal evolution of error covariances via the use of four-dimensional ensemble perturbations that are provided by high-resolution, self-consistent HWRF ensemble forecasts. It is different from the configuration of the GSI-based three-dimensional ensemble-variational (GSI-3DEnVar) hybrid data assimilation system, similar to that used in the operational HWRF, which employs background error covariances provided by coarser-resolution global ensembles from the National Centers for Environmental Prediction (NCEP) Global Forecast System (GFS) ensemble Kalman filtering data assimilation system. In addition, our proposed initialization framework discards the empirical intensity correction in the vortex initialization package that is employed by the GSI-3DEnVar initialization framework in operational HWRF. Data assimilation and numerical simulation experiments for Hurricanes Joaquin (2015), Patricia (2015), and Matthew (2016) are conducted during their intensity changes. The impacts of two initialization frameworks on the HWRF analyses and forecasts are compared. It is found that GSI-4DEnVar leads to a reduction in track, minimum sea level pressure (MSLP), and maximum surface wind (MSW) forecast errors in all of the HWRF simulations, compared with the GSI-3DEnVar initialization framework. With assimilating high-resolution observations within the hurricane inner-core region, GSI-4DEnVar can produce the initial hurricane intensity reasonably well without the empirical vortex intensity correction. Further diagnoses with Hurricane Joaquin indicate that GSI-4DEnVar can significantly alleviate the imbalances in the initial conditions and enhance the performance of the data assimilation and subsequent hurricane intensity and precipitation forecasts

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Using probabilistic solar power forecasts to inform flexible ramp product procurement for the California ISO

How can independent system operators (ISOs) take advantage of probabilistic solar forecasts to lower generation costs and improve reliability of power systems? We discuss one three-step approach for doing so, focusing on how such forecasts might help the California Independent System Operator (CAISO) prepare unexpected net load ramps, where net load equals gross demand minus wind and solar production. First, we enhance an existing solar forecasting system to provide well-calibrated hours-ahead probabilistic forecasts. We then relate the degree of uncertainty reflected in the forecasted prediction intervals (independent variables) to error distributions for net load ramp forecasts for the CAISO real-time market (dependent variable) using machine learning and quantile regression. Projected ramp forecast errors conditioned on solar uncertainty are translated into flexible ramp requirements that therefore reflect real-time meteorological and solar conditions, improving on typical ISO procedures. Detailed descriptions are provided on the quantile regression and kth-nearest neighbor categorization methods for accomplishing that translation. Finally, a multiple time-scale look-ahead market simulation model is applied to a 118-bus IEEE Reliability Test System, modified to represent the CAISO generation mix and demand distributions. The model runs quantify how solar-conditioned ramp requirements can, first, decrease operating costs by reducing requirements compared to often conservative unconditional methods and, second, decrease generation scarcity events and consequently improve reliability by increasing flexibility requirements at times when unconditional forecast-based requirements understate actual ramp uncertainty. Solar-conditioned ramp requirements are found to reduce generation operating costs by about 2% for the test system (which would be equivalent to over $\$100$ million per year for a CAISO-size system).

14 SOLAR ENERGY↗
DOE OSTI2021

How New Mexico Leveraged a COVID-19 Case Forecasting Model to Preemptively Address the Healthcare Needs of the State: Quantitative Analysis

Prior to the COVID-19 pandemic, US hospitals relied on static projections of future trends for long-term planning and were only beginning to consider forecasting methods for short-term planning of staffing and other resources. With the overwhelming burden imposed by COVID-19 on the health care system, an emergent need exists to accurately forecast hospitalization needs within an actionable timeframe. Our goal was to leverage an existing COVID-19 case and death forecasting tool to generate the expected number of concurrent hospitalizations, occupied intensive care unit (ICU) beds, and in-use ventilators 1 day to 4 weeks in the future for New Mexico and each of its five health regions. We developed a probabilistic model that took as input the number of new COVID-19 cases for New Mexico from Los Alamos National Laboratory’s COVID-19 Forecasts Using Fast Evaluations and Estimation tool, and we used the model to estimate the number of new daily hospital admissions 4 weeks into the future based on current statewide hospitalization rates. The model estimated the number of new admissions that would require an ICU bed or use of a ventilator and then projected the individual lengths of hospital stays based on the resource need. By tracking the lengths of stay through time, we captured the projected simultaneous need for inpatient beds, ICU beds, and ventilators. We used a postprocessing method to adjust the forecasts based on the differences between prior forecasts and the subsequent observed data. Thus, we ensured that our forecasts could reflect a dynamically changing situation on the ground. Forecasts made between September 1 and December 9, 2020, showed variable accuracy across time, health care resource needs, and forecast horizon. Forecasts made in October, when new COVID-19 cases were steadily increasing, had an average accuracy error of 20.0%, while the error in forecasts made in September, a month with low COVID-19 activity, was 39.7%. Across health care use categories, state-level forecasts were more accurate than those at the regional level. Although the accuracy declined as the forecast was projected further into the future, the stated uncertainty of the prediction improved. Forecasts were within 5% of their stated uncertainty at the 50% and 90% prediction intervals at the 3- to 4-week forecast horizon for state-level inpatient and ICU needs. However, uncertainty intervals were too narrow for forecasts of state-level ventilator need and all regional health care resource needs. Real-time forecasting of the burden imposed by a spreading infectious disease is a crucial component of decision support during a public health emergency. Our proposed methodology demonstrated utility in providing near-term forecasts, particularly at the state level. This tool can aid other stakeholders as they face COVID-19 population impacts now and in the future.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

The Application of a Genetic Algorithm to the Optimization of a Mesoscale Model for Emergency Response

Besides solving the equations of momentum, heat, and moisture transport on the model grid, mesoscale weather models must account for subgrid-scale processes that affect the resolved model variables. These are simulated with model parameterizations, which often rely on values preset by the user. Such “free” model parameters, along with others set to initialize the model, are often poorly constrained, requiring that a user select each from a range of plausible values. Finding the values to optimize any forecasting tool can be accomplished with a search algorithm, and one such process—the genetic algorithm (GA)—has become especially popular. As applied to modeling, GAs represent a Darwinian process: an ensemble of simulations is run with a different set of parameter values for each member, and the members subsequently judged to be most accurate are selected as “parents” who pass their parameters onto a new generation. At the U.S. Department of Energy’s Savannah River Site in South Carolina, we are applying a GA to the Regional Atmospheric Modeling System (RAMS) mesoscale weather model, which supplies input to a model to simulate the dispersion of an airborne contaminant as part of the site’s emergency response preparations. An ensemble of forecasts is run each day, weather data are used to “score” the individual members of the ensemble, and the parameters from the best members are used for the next day’s forecasts. As meteorological conditions change, the parameters change as well, maintaining a model configuration that is best adapted to atmospheric conditions. Significance Statement We wanted to develop a forecasting system by which a weather model is run over the Savannah River Site each day and repeatedly adjusted according to how well it performed the previous day. To run the model, a series of values (parameters) must be set to control how the model will calculate winds, temperatures, and other desired variables. Each day the model was run several times using different combinations of these parameters and later compared with observed meteorological conditions. Parameters that produced the most accurate forecasts were preferentially reused to create the forecasts for the next day. The process was tested for the summer of 2020 and exhibited lower errors than forecasts produced by the model using default values of the parameters.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

A Multi-Stage Stochastic Risk Assessment With Markovian Representation of Renewable Power

Probabilistic forecasts provide a distribution of possible outputs and so can capture the uncertainty and variability of Variable Renewable Energy (VRE). However, taking advantage of uncertainty information has practical challenges that make it difficult to integrate probabilistic forecasting into control room decision-making. This paper proposes a novel use-case for probabilistic forecasts by incorporating them into the hour-ahead operations for situational awareness via a risk-averse multi-stage stochastic program. We employ a Markovian representation of the probabilistic forecasts that enables the formulation of the multi-stage problem and avoids a scenario generation phase. We test the model on a realistically sized system to assess risk and showcase the capability of using probabilistic renewable forecast as input to produce probabilistic output forecasts of future system states. The results show that the model can capture time consistency in the reserves and Area Control Error (ACE) forecast. The solution times are adequate for risk profiling in hour-ahead timescales.

forecasting↗