Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “forecast error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Relating CMIP5 Model Biases to Seasonal Forecast Skill in the Tropical Pacific

Abstract We examine links between tropical Pacific mean state biases and El Niño/Southern Oscillation forecast skill, using model‐analog hindcasts of sea surface temperature (SST; 1961–2015) and precipitation (1979–2015) at leads of 0–12 months, generated by 28 different models from the fifth phase of the Coupled Model Intercomparison Project (CMIP5). Model‐analog forecast skill has been demonstrated to match or even exceed traditional assimilation‐initialized forecast skill in a given model. Models with the most realistic mean states and interannual variability for SST, precipitation, and 10‐m zonal winds in the equatorial Pacific also generate the most skillful precipitation forecasts in the central equatorial Pacific and the best SST forecasts at 6‐month or longer leads. These results show direct links between model climatological biases and seasonal forecast errors, demonstrating that model‐analog hindcast skill—that is, how well a model can capture the observed evolution of tropical Pacific anomalies—is an informative El Niño/Southern Oscillation metric for climate simulations.

Ding, Hui↗
DOE OSTI2024

Reduced‐Order Modeling for Linearized Representations of Microphysical Process Rates

Abstract Representing cloud microphysical processes in large scale atmospheric models is challenging because many processes depend on the details of the droplet size distribution (DSD, the spectrum of droplets with different sizes in a cloud). While full or partial statistical moments of droplet size distributions are the typical variables used in bulk models, prognostic moments are limited in their ability to represent microphysical processes across the range of conditions experienced in the atmosphere. Microphysical parameterizations employing prognostic moments are known to suffer from structural uncertainty in their representations of inherently higher dimensional cloud processes, which limit model fidelity and lead to forecasting errors. Here we investigate how data‐driven reduced‐order modeling can be used to learn predictors for microphysical process rates in bulk microphysics schemes in an unsupervised manner from higher dimensional bin distributions. Using simulations characteristic of marine stratiform clouds, we simultaneously learn lower dimensional representations of droplet size distributions and predict the evolution of the microphysical state of the system. Droplet collision‐coalescence, the main process for generating warm rain, is estimated to have an intrinsic dimension of three. This intrinsic dimension provides a lower limit on the number of degrees of freedom needed to accurately represent collision‐coalescence in models. We demonstrate how deep learning based reduced‐order modeling can be used to discover intrinsic coordinates describing the microphysical state of the system, where process rates such as collision‐coalescence are globally linearized. These implicitly learned representations of the DSD retain more information about the DSD than typical moment‐based representations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Forward sensitivity approach for estimating eddy viscosity closures in nonlinear model reduction

In this paper, we propose a variational approach to estimate eddy viscosity using forward sensitivity method (FSM) for closure modeling in nonlinear reduced order models. FSM is a data assimilation technique that blends model's predictions with noisy observations to correct initial state and/or model parameters. We apply this approach on a projection based reduced order model (ROM) of the one-dimensional viscous Burgers equation with a square wave defining a moving shock, and the two-dimensional vorticity transport equation formulating a decay of Kraichnan turbulence. We investigate the capability of the approach to approximate an optimal value for eddy viscosity with different measurement configurations. Specifically, we show that our approach can sufficiently assimilate information either through full field or sparse noisy measurements to estimate eddy viscosity closure to cure standard Galerkin reduced order model (GROM) predictions. Therefore, our approach provides a modular framework to correct forecasting error from a sparse observational network on a latent space. We highlight that the proposed GROM-FSM framework is promising for emerging digital twin applications, where real-time sensor measurements can be used to update and optimize surrogate model's parameters.

42 ENGINEERING↗
DOE OSTI2021

Data assimilation empowered neural network parametrizations for subgrid processes in geophysical flows

In the past couple of years, there has been a proliferation in the use of machine learning approaches to represent subgrid-scale processes in geophysical flows with an aim to improve the forecasting capability and to accelerate numerical simulations of these flows. Despite its success for different types of flow, the online deployment of a data-driven closure model can cause instabilities and biases in modeling the overall effect of subgrid-scale processes, which in turn leads to inaccurate prediction. To tackle this issue, we exploit the data assimilation technique to correct the physics-based model coupled with the neural network as a surrogate for unresolved flow dynamics in multiscale systems. In particular, we use a set of neural network architectures to learn the correlation between resolved flow variables and the parametrizations of unresolved flow dynamics and formulate a data assimilation approach to correct the hybrid model during their online deployment. We illustrate our framework in a set of applications of the multiscale Lorenz 96 system for which the parametrization model for unresolved scales is exactly known, and the two-dimensional Kraichnan turbulence system for which the parametrization model for unresolved scales is not known a priori. Our analysis, therefore, comprises a predictive dynamical core empowered by (i) a data-driven closure model for subgrid-scale processes, (ii) a data assimilation approach for forecast error correction, and (iii) both data-driven closure and data assimilation procedures. We show significant improvement in the long-term prediction of the underlying chaotic dynamics with our framework compared to using only neural network parametrizations for future prediction. Moreover, we demonstrate that these data-driven parametrization models can handle the non-Gaussian statistics of subgrid-scale processes, and effectively improve the accuracy of outer data assimilation workflow loops in a modular nonintrusive way.

42 ENGINEERING↗
DOE OSTI2023

Characterizing HVDC Transmission Flexibility under Extreme Operating Conditions

System operators rely on system flexibility, traditionally mainly from generation, to handle unexpected reliability and resilience events, ranging from excessive resource forecast errors to extreme events like heatwaves, earthquakes, and cyberattacks. Flexible transmission, such as controllable high voltage direct current (HVDC) transmission systems present an opportunity to increase overall system flexibility to accommodate operational challenges. This paper provides a methodology to study contributions to system flexibility by controllable, power electronics based transmission. The Western Electricity Coordinating Council (WECC) system is used as an example to study contributions from existing and future HVDC lines. Under extreme system conditions, it is identified that HVDC transmission flexibility can contribute with 24.8 to 28% of avoided unserved energy, and in some areas, the benefits amount to 50 to 70%.

HVDC transmission, PCM, Balancing authorities↗
DOE OSTI2023

Flexibility Requirements for Energy Systems with Renewable Generation under Forecast Uncertainties

Energy systems with high fractions of renewable energy-based resources require adequate assets providing flexibility in electricity usage to maximize the benefits of renewable energy. In this paper, we provide an analytical approach to estimate the flexibility requirements of such energy systems, with forecast uncertainties in both demand and generation. Our analytical results show that even with forecast errors, the expected system operating cost decreases with an increase in the amount of flexibility capacity -- however, there is an inflection point, beyond which addition of further flexibility capacity does not reduce expected system cost any further. Additionally, an enumeration-based approach is presented to estimate the maximum flexibility capacity needed to optimize the operating cost. Numerical experiments conducted on a network-abstracted modified IEEE 30-bus system are used for empirical validation and gaining additional insights on the effect of prosumers' willingness to offer flexibility on the dispatch performance.

Bhattacharya, Saptarshi↗
DOE OSTI2020

Collaborative Distribution System Restoration Planning and Real-Time Dispatch Considering Behind-the-Meter DERs

Modern distribution systems are becoming more resilient against power outages thanks to the flexible generation capacity provided by the increasing integration of distributed energy resources (DERs). Compared to utility-scale DERs, which can be directly controlled by system operators, small-scale, behind-the-meter DERs are much more difficult to coordinate despite being the vast majority. Two major obstacles to the implementation of DERs for service restoration are the coordination of behind-the-meter DERs and the management of uncertainty. In this paper, a novel distribution system restoration strategy is proposed to overcome these two obstacles. The flexibility of be-hind-the-meter DERs is quantified and integrated into the restoration planning models within a hierarchical structure. The model predictive control technique is employed to enable adaptive restoration planning solution adjustments to accommodate fault scenarios and forecast errors. Besides, real-time power dispatch models are proposed to maintain power balance using available DER capability. Comprehensive integration of adaptive restoration planning schemes and real-time dispatch results are achieved through a collaborative restoration framework. Finally, the effectiveness of the proposed restoration strategy is verified through a modified IEEE 123-bus system and a real-world utility system.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Optimal Demand Response Incorporating Distribution LMP with PV Generation Uncertainty

The utilization of aggregated demand-side flexibility via demand response (DR) has become a promising pathway for the integration of renewable energy resources in power systems. Nowadays, there are several management strategies for DR such as the price-based transactive control strategies. However, many of such existing price-based control strategies neglect the physics and operational constraints of the underlying distribution networks when computing the price, raising concerns regarding their theoretical and practical values. This paper studies this issue and investigates optimal DR (ODR) by incorporating the distribution locational marginal price (DLMP). In particular, we discuss DR in connection with DLMPs and propose a multiperiod bilevel optimization problem to find the ODR strategy. Here, the objective is to minimize the peak load, load fluctuation, and payments of load aggregators. In addition, a robust bilevel ODR model is formulated to provide a robust ODR strategy while minimizing operating costs under the worst-case realization of uncertainties; this mitigates the impact of forecasting errors on renewable energy resources. Then, we propose an efficient solution approach by employing the Karush-Kuhn-Tucker conditions and strong duality. Simulation results are presented to illustrate the mutual impacts of the interaction between DR and DLMP and the benefits of the robust ODR strategy.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Self-Supervised T-GCN for Detection of Disturbance and Propagation in Power Grid

Urban power systems increasingly rely on dense sensing to monitor grid reliability, yet disturbance labels are scarce and events are rare. We present a self-supervised spatio-temporal method that detects, localizes, and characterizes grid frequency disturbances across urban areas using only unlabeled data. Our approach trains a tiny Temporal Graph Convolutional Network (T-GCN) to forecast per-site frequency residuals (deviation from 60 Hz). The sensor graph is constructed directly from signals using pre-event Pearson correlation with a cross-correlation lag penalty without geocoding. At inference, node-level anomalies are the model's forecast errors; region-level alarms arise from connected components of high-score nodes. We estimate disturbance propagation by computing per-node arrival times (first persistent exceedance), then fit a planar or time-of-arrival model to obtain direction, speed, and an epicenter proxy. With only three real events collected at decisecond resolution across U.S. cities, we evaluate the T-GCN and report time-to-detect, footprint size, and propagation consistency. We further show that short-window embeddings from the T-GCN's hidden states enable few-shot event-vs-background recognition via a simple prototypical classifier. Despite minimal data and no labels, our system yields fast, spatially coherent detection and interpretable propagation maps, offering a practical, lightweight pathway to city-scale grid resilience analytics.

Niu, Haoran [ORNL] (ORCID:0000000155228297)↗
DOE OSTI2022

Risk-Based Dispatch Bound Calculator

This calculator outputs time-varying lower and upper bounds (matrices), called dispatch bounds, for the controllable portions of the power injections at each node in a distribution network to guarantee that the voltage magnitudes stay within prescribed bounds with at least a given probability for any set of power injections that are within their dispatch bounds. The calculator is meant to be a tool for a central controller of a distribution network to set dispatch bounds for each node that allows each node to independently decide their actual power injection within their dispatch bound. The user can choose whether to assume the forecast errors of the uncontrollable power injections are gaussian or are worst-case (distributionally robust). The user can choose whether the dispatch bounds include the controllable reactive power or just the active power under a constant power factor assumption.

Comden, Joshua↗
DOE OSTI2020

Agent-Based Coordination Scheme for PV Integration (ABC4PV)

Renewables and especially photovoltaics (PV) have benefitted significantly from a host of incentives and policies targeted toward enhanced integration and adoption of specific energy technologies. However, with the push to move forward into a subsidy-free market framework, behind-the-meter residential PV applications have generally struggled to retain their value (unlike utility scale and commercial projects) [1]. This project focused on developing control-theoretic solutions aimed at improving the integration and interaction of behind-the-meter residential PV with other distribution system assets (controllable and non-controllable) to enhance the integrated value of residential PV. To this end, a suite of decentralized control methodologies have been developed to enable effective coordination and control of behind-the-meter residential load customers’ PV, battery storage systems (BSS), controllable loads and other similar assets within a distribution feeder. This interaction aims at procuring energy savings and, thus, energy bill savings. The main source of savings is drawn from reducing the effect of demand charge pricing and is realized at the feeder level, assuming community level interaction and management among the aforementioned assets. Optimal control of the assets is implemented with a distributed optimization methodology, leveraging consensus-based algorithms. The results gathered from the optimal control simulations demonstrates that the savings can be duly achieved and the algorithm decision times (to dynamically control asset set points, for example) are fast. As for the overall efficiency of PV+BSS systems, to procure energy savings from curtailment of the demand charge pricing effects, the optimal control is set up so as to minimize the variance of the load for all customers, throughout a feeder and throughout time in a rolling horizon scheduling with model predictive control. The control takes into account inter-temporal electrochemical storage (battery) degradation costs: specifically, we have developed a long-term lifetime model for the BSS that weighs in the effect of the degradation factor in the dispatch formulations, thus, a considerable operating cost that affects energy decision making. The levelized cost of energy (LCOE – redefined for the purpose of quantifying asset integration effectiveness through the customers’ energy cost) is shown to be below the threshold set for the combined PV+BSS topology of $ 0.14/kWh for multiple cases of PV penetration all the way up to 50%, provided that a policy of shared ownership of and savings is in place. Further, the LCOE calculated for the case before the deployment PV+BSS systems is also achievable, i.e. the deployment of PV+BSS, if planned and scheduled optimally. will have no effect on customers’ energy costs. From the control methodology viewpoint, the developed consensus-based algorithms are shown to converge for a wide range of problem cases (spanning normal operating scenarios and contingencies), guaranteeing dispatch solutions under forecasting errors, communication break-downs and cyber-security attacks. The proposed control solutions are scalable and real-time implementable, with dispatch computations and device set-point updates converging in less than 2s in most practical instances of the above events.

14 SOLAR ENERGY↗
DOE OSTI2022

Near-Term Reliability and Resilience (NTRR) (Final Report)

The Near-Term Reliability and Resiliency (NTRR) was awarded in December 2020 as an inter-lab project to examine the reliability and resilience of the electricity grid and natural gas transportation availability. The project builds on studies conducted by The North American Electric Reliability Corporation (NERC), the U.S. Department of Energy (DOE), and other non-governmental research and operational focused on reliability and resilience analyses challenges. The research was conceived to address near-term scenarios (within 10 years), when many local and regional policy transitions could begin to impact grid reliability, resilience, and supporting infrastructure availability. To integrate the natural gas interdependency, the team began with the generating capacity and demand projections from the 2020 NERC Long-Term Reliability Assessment and the Bulk Electric System (BES) transmission topologies defined in the Western Electricity Coordinating Council (WECC) Anchor Data Set, Eastern Interconnection Reliability Assessment Group Multi-Regional Modeling Working Group (ERAG/MMWG) Data Set, the team calculated baseline regional power sector gas demands from present electricity delivery year through the end of delivery year 2030/31 by applying security constrained economic dispatch. This demand was compiled along with demand projections for regional residential, commercial, and industrial natural gas demands from the most recent Energy Information Administration (EIA) Annual Energy Outlook Reference Case into Deloitte’s MarketBuilder® North American Gas Model. Through the application of these demands, MarketBuilder® was projected the topology of natural gas flows in the natural gas pipeline network across the interconnected North American system along with regional natural gas prices that may be seen by market participants in future years Additionally, contingencies and sensitivities focused on the built models of the Eastern Interconnection (EI) and Western Interconnection (WI). They address challenges from the following with the outcomes being an identification of performance under the extreme conditions and an identification of potential grid weaknesses that should be addressed to mitigate the reduced performance and improve the resilience and reliability of the specific regions as well as the National Grid: • Weather events including extreme heat, extreme cold, high wind, no wind, wind and solar forecasting errors, and wildfires. • Gas availability, factoring in supply disruption (contractual and physical), seasonal availability constraints, and infrastructure limitations; and • Transmission availability and congestion.

03 NATURAL GAS↗
DOE OSTI2025

Solar and Storage Integration in the U.S. Southeast: Implications for Resource Adequacy

Resource adequacy concerns may be very different in electricity systems that have higher levels of solar and storage, requiring changes to existing planning models. This study explores a novel approach to evaluating resource adequacy under future scenarios with higher solar and storage in the Southeast U.S. It uses NREL’s Probabilistic Resource Adequacy Suite (PRAS), a collection of probabilistic resource adequacy modeling tools, and compares results when interacting PRAS and a portfolio planning tool with a more traditional modeling approach. The results suggest that traditional models perform reasonably well with lower levels of solar PV, but at higher levels of solar probabilistic tools better capture the changes in resource adequacy concerns—such as winter energy availability—associated with higher solar systems. This is the final study in the Preparing Southeast Markets for Reliable and Affordable Integration of Solar into Operations and Planning project. Two prior reports can be found at: Solar and Storage Integration in the Southeastern United States: Economics, Reliability, and Operations. https://emp.lbl.gov/publications/solar-and-storage-integration Solar and Wind Forecast Error Reserve Sharing in a Multi-Utility Region. https://eta-publications.lbl.gov/sites/default/files/2024-11/multiutility_fe_reserve_sharing_final.pdf

14 SOLAR ENERGY↗
DOE OSTI2022

Robust Scheduling of Networked Microgrids for Economics and Resilience Improvement

The benefits of networked microgrids in terms of economics and resilience are investigated and validated in this work. Considering the stochastic unintentional islanding conditions and conventional forecast errors of both renewable generation and loads, a two-stage adaptive robust optimization is proposed to minimize the total operating cost of networked microgrids in the worst scenario of the modeled uncertainties. By coordinating the dispatch of distributed energy resources (DERs) and responsive demand among networked microgrids, the total operating cost is minimized, which includes the start-up and shut-down cost of distributed generators (DGs), the operation and maintenance (O&M) cost of DGs, the cost of buying/selling power from/to the utility grid, the degradation cost of energy storage systems (ESSs), and the cost associated with load shedding. The proposed optimization is solved with the column and constraint generation (C&CG) algorithm. The results of case studies demonstrate the advantages of networked microgrids over independent microgrids in terms of reducing total operating cost and improving the resilience of power supply.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
NASA NTRS1975

Cost reductions through earth resource satellites in developed countries

Data from detailed studies on the possible economic impact of the use of remote sensing technology in industry and agriculture are presented and analyzed. The utility of satellite surveillance in reduction of crop production forecast error, recognition and monitoring of crop diseases and insect infestations, and range management is evaluated. Application of satellite maps to facilitate land resource decisions, mineral exploration, geological studies, and water resource inventories is considered, as is the usefulness of early storm warning in the reduction of property damage. The cost of remote sensing is compared to that of conventional methods whenever possible.

Schweickart, R. L.↗
NASA NTRS1978

A study of forecast growth with a barotropic model of the atmosphere

A barotropic model of the atmosphere was used to test various sources of forecast error. These errors are classified as truncation error, physical error, or initial error. It was shown that growth patterns due to each category differ significantly. Initial errors were shown not to grow in a barotropic model contrary to reports of other studies which indicate that they basically do grow. Also, random initial errors were shown to decrease due to the filtering effect of the model itself. Results seem to indicate that instabilities are required for error growth, be they barotropic or baroclinic, and that random errors are not representative of true initial conditions.

Halberstam, I. M.↗
NASA NTRS1981

A stochastic-dynamic model for global atmospheric mass field statistics

A model that yields the spatial correlation structure of atmospheric mass field forecast errors was developed. The model is governed by the potential vorticity equation forced by random noise. Expansion in spherical harmonics and correlation function was computed analytically using the expansion coefficients. The finite difference equivalent was solved using a fast Poisson solver and the correlation function was computed using stratified sampling of the individual realization of F(omega) and hence of phi(omega). A higher order equation for gamma was derived and solved directly in finite differences by two successive applications of the fast Poisson solver. The methods were compared for accuracy and efficiency and the third method was chosen as clearly superior. The results agree well with the latitude dependence of observed atmospheric correlation data. The value of the parameter c sub o which gives the best fit to the data is close to the value expected from dynamical considerations.

Ghil, M.↗
NASA NTRS1984

Normal Mode Initialization

The objective of this research is the development and implementation of normal mode procedures for use with the GLAS analysis/forecast system. Specific tasks of this work include: (1) high latitude filtering of model fields to preserve the GLAS GCM's linear stability during integration; (2) development of nonlinear normal mode initialization (NLNMI) processes, both adiabatic and diabatic. Using NLNMI to initialize GLAS analyses; investigation of the impact of normal mode initialization on the GLAS analysis/forecast system, especially in regard to data assimilation; and (3) diagnosis of the 1-3 day systemic forecast errors of the GLAS GCM.

Bloom, S. C.↗