Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Operational forecasting”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Breaking Down the Computational Barriers to Real-Time Urban Flood Forecasting

Flooding impacts are on the rise globally, and concentrated in urban areas. Currently, there are no operational systems to forecast flooding at spatial resolutions that can facilitate emergency preparedness and response actions mitigating flood impacts. We present a framework for real-time flood modeling and uncertainty quantification that combines the physics of fluid motion with advances in probabilistic methods. The framework overcomes the prohibitive computational demands of high-fidelity modeling in real-time by using a probabilistic learning method relying on surrogate models that are trained prior to a flood event. This shifts the overwhelming burden of computation to the trivial problem of data storage, and enables forecasting of both flood hazard and its uncertainty at scales that are vital for time-critical decision-making before and during extreme events. The framework has the potential to improve flood prediction and analysis and can be extended to other hazard assessments requiring intense high-fidelity computations in real-time.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Diagnosing Near-Surface Model Errors with Candidate Physics Parameterization Schemes for the Multiphysics Rapid Refresh Forecast System (RRFS) Ensemble during Winter over the Northeastern United States and Southern Great Plains

Abstract During the winter of 2020/21 an ensemble of FV3-LAM forecasts was produced over the contiguous United States for the Winter Weather Experiment using five physics suites. These forecasts are evaluated with the goal of optimizing physics parameterizations within the future operational Rapid Refresh Forecast System (RRFS) in the Unified Forecast System (UFS) realm and for selecting suitable physics suites for a multiphysics RRFS ensemble. The five physics suites have different combinations of land surface models (LSMs), planetary boundary layer (PBL) parameterizations, and surface layer schemes, chosen from those used in current and possible future operational systems and likely to be supported in the operational UFS. Full-season evaluation reveals a persistent near-surface cold bias in the U.S. Northeast from one suite and a nighttime warm bias in the southern Great Plains in another suite, while other suites have smaller biases. A representative case is chosen to diagnose the cause for each of these biases using sensitivity simulations with different physics combinations or modified parameters and verified with additional mesonet observations. The cold bias in the Northeast is attributed to aspects of the Noah-MP LSM over snow cover, where Noah-MP simulates lower soil water content, and thus lower thermal conductivity than other LSMs, leading to less upward ground heat flux during nighttime and consequently lower surface temperature. The nighttime warm bias found in the southern Great Plains is attributed to overestimation of vertical mixing in the K -profile-based eddy-diffusivity mass-flux (K-EDMF) PBL scheme and insufficient land–atmospheric coupling from the GFS surface layer scheme over short vegetation. A few key parameters driving these systematic biases are identified.

Meteorology & Atmospheric Sciences↗
DOE OSTI2023

Solar Uncertainty Management and Mitigation for Exceptional Reliability in Grid Operations (SUMMER-GO): Project Final Report

The Solar Uncertainty Management and Mitigation for Exceptional Reliability in Grid Operation (SUMMER-GO) project was recently completed through a collaboration among the National Renewable Energy Laboratory, Maxar, the Electric Reliability Council of Texas (ERCOT), the University of Texas at Dallas, the University of California Berkeley, and the University of Colorado Boulder. The project made significant advances in probabilistic solar power forecasting, both through the development of Bayesian model averaging methods for ensemble forecasting and in bringing these and other advancements into practice with Maxar's delivery of operational forecasts to ERCOT. In addition to creating more reliable solar power forecasts, the project developed methods for their utilization in power system operations. These include the development of risk-aware unit commitment and economic dispatch algorithms and methods to reformulate probabilistic forecasts to be used in these power system operational models. Dynamic power system reserve methods were also developed, which have been shown in silico to create economic savings and reliability improvements on an ERCOT-like system as well as financial savings in the ERCOT system through more granular consideration of the uncertainty associated with solar power forecasts. Finally, a situational awareness tool to help grid operators better understand solar power forecast uncertainty in daily operations was developed and extensively vetted.

14 SOLAR ENERGY↗
DOE OSTI2026

Latent Twins

Over the past decade, scientific machine learning has transformed the development of mathematical and computational frameworks for analyzing, modeling, and predicting complex systems. From inverse problems to numerical partial differential equations (PDEs), dynamical systems, and model reduction, these advances have pushed the boundaries of what can be simulated. Yet they have often progressed in parallel, with representation learning and algorithmic solution methods evolving largely as separate pipelines. With Latent Twins, we propose a unifying mathematical framework that creates a hidden surrogate in latent space for the underlying equations. Whereas digital twins mirror physical systems in the digital world, Latent Twins mirror mathematical systems in a learned latent space governed by operators. Through this lens, classical modeling, inversion, model reduction, and operator approximation all emerge as special cases of a single principle. We establish the fundamental approximation properties of Latent Twins for both ordinary differential equations (ODEs) and PDEs and demonstrate the framework across three representative settings: (i) canonical ODEs, capturing diverse dynamical regimes; (ii) a PDE benchmark using the shallow-water equations, contrasting Latent Twin simulations with deep operator network and forecasts with a four-dimensional variational method baseline; and (iii) a challenging real-data geopotential reanalysis dataset, reconstructing and forecasting from sparse, noisy observations. Latent Twins provide a compact, interpretable surrogate for solution operators that evaluate across arbitrary time gaps in a single-shot, while remaining compatible with scientific pipelines such as assimilation, control, and uncertainty quantification. Looking forward, this framework offers scalable, theory-grounded surrogates that bridge data-driven representation learning and classical scientific modeling across disciplines.

Latent Twins↗
DOE OSTI2022

Advanced Solar and Load Forecasting Incorporating HD Sky Imaging (Phase III)

Due to rapidly changing sky conditions, the available solar irradiance for energy generation is subject to wide swings in amplitude. As the market penetration of solar energy continues to increase rapidly, these variations in solar power generation are beginning to have an impact on grid stability and increased wear on power switches. Solar power forecasting plays a critical role in operations for Independent System Operators (ISOs) and utilities. Accurate forecasts help maintain grid reliability, optimize generation from renewables, and reduce operating costs. Of particular interest to the ISOs and utilities are sudden changes in solar irradiance, termed “ramp events,” due to the movement of clouds. One significant impact of ramp events on the grid is additional ancillary service requirements necessary to manage such variability. Ramp events can also cause voltage fluctuations in the distribution grids and trigger actions of automated line equipment (e.g., tap changers), leading to additional maintenance costs. In high penetration solar regions, forecasts must be made for both transmission-connected and distribution-connected resources – either behind the meter or in front of it. Particularly for distributed solar energy resources, forecasting can be a challenge due to the lack of visibility of the energy resource. Brookhaven National Laboratory (BNL) has been working towards nowcasting Global Horizontal Irradiance (GHI) using low-cost technologies for several years now. The Solar NowCasting technology being developed by BNL is a 0 – 30 min solar “nowcasting” technology applicable to a scale covering both large generating facilities and residential, distributed solar installations that relies on a network of ground-based high-definition (HD) cameras and surface pyranometers. GHI forecasts are being produced for both regions using 8 ground-based HD cameras and at least 2 surface pyranometers. When stitched together, the camera images can be used to forecast the impact of clouds on available solar irradiance over a domain of ~50 km 2 . Phase I of the project was the engineering scale up conceptual design stage. Phase II was the initial field test and demonstration, in which the technology was scaled up by a factor of 20 times and successfully demonstrated in eastern Long Island. In Phase III, an additional forecasting network was added in upstate NY and both networks are currently being operated until at least a full year of data is gathered by the Albany network to allow for the collection of sufficient data to evaluate performance against the persistence and smart persistence models using the Solar Arbiter.

14 SOLAR ENERGY↗
DOE OSTI2026

LAF-Net: A Deep Residual and Cross-Attention Framework for Day-Ahead Load Forecasting: Preprint

Accurate day-ahead load forecasting is essential for reliable power system operations and market efficiency. System operators such as the Midcontinent Independent System Operator (MISO) rely on forecasts from multiple vendors, yet combining them effectively remains a persistent challenge due to vendor-specific biases. This paper presents a novel LSTM-Attention Fusion Network with Error Representation (LAF-Net) that enhances day-ahead hourly load forecasting through deep residual learning and multi-modal cross-attention. The proposed model builds a historical error memory from past vendor performance and dynamically queries it with future hour context to generate adaptive, hour-specific trust weights for each vendor. A bounded residual correction further refines forecasts by mitigating systematic and temporally localized errors. Tested on real MISO LBA data with multi-vendor forecasts, LAF-Net consistently outperforms the best vendor baseline across all 38 LBAs, achieving more than a 40% reduction in system-level mean absolute error (MAE) during peak load hours relative to the best vendor baseline.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Updating and Evaluating Anthropogenic Emissions for NOAA’s Global Ensemble Forecast Systems for Aerosols (GEFS-Aerosols): Application of an SO 2 Bias-Scaling Method

We updated the anthropogenic emissions inventory in NOAA’s operational Global Ensemble Forecast for Aerosols (GEFS-Aerosols) to improve the model’s prediction of aerosol optical depth (AOD). We used a methodology to quickly update the pivotal global anthropogenic sulfur dioxide (SO 2 ) emissions using a speciated AOD bias-scaling method. The AOD bias-scaling method is based on the latest model predictions compared to NASA’s Modern-Era Retrospective analysis for Research and Applications, version 2 (MERRA2). The model bias was subsequently applied to the CEDS 2019 SO 2 emissions for adjustment. The monthly mean GEFS-Aerosols AOD predictions were evaluated against a suite of satellite observations (e.g., MISR, VIIRS, and MODIS), ground-based AERONET observations, and the International Cooperative for Aerosol Prediction (ICAP) ensemble results. The results show that transitioning from CEDS 2014 to CEDS 2019 emissions data led to a significant improvement in the operational GEFS-Aerosols model performance, and applying the bias-scaled SO 2 emissions could further improve global AOD distributions. The biases of the simulated AODs against the observed AODs varied with observation type and seasons by a factor of 3~13 and 2~10, respectively. The global AOD distributions showed that the differences in the simulations against ICAP, MISR, VIIRS, and MODIS were the largest in March–May (MAM) and the smallest in December–February (DJF). When evaluating against the ground-truth AERONET data, the bias-scaling methods improved the global seasonal correlation (r), Index of Agreement (IOA), and mean biases, except for the MAM season, when the negative regional biases were exacerbated compared to the positive regional biases. The effect of bias-scaling had the most beneficial impact on model performance in the regions dominated by anthropogenic emissions, such as East Asia. However, it showed less improvement in other areas impacted by the greater relative transport of natural emissions sources, such as India. The accuracies of the reference observation or assimilation data for the adjusted inputs and the model physics for outputs, and the selection of regions with less seasonal emissions of natural aerosols determine the success of the bias-scaling methods. A companion study on emission scaling of anthropogenic absorbing aerosols needs further improved aerosol prediction.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

An Integrated Platform for Wind Plant Operations: From Atmosphere to Electrons to the Grid

Under the Atmosphere to Electrons to Grid project (A2e2g), the National Renewable Energy Laboratory (NREL) is developing an optimization platform for wind plant operations. The platform merges forecasting tools with aerodynamic and economic models in order to identify optimal operating schedules and controller functions that will maximize a wind plant's value streams for energy and other grid services. In this presentation, we will describe functionalities of the platform. We will also discuss the implications the use of the platform might have for understanding and valuing the capabilities of wind resources for power system operations.

A2E2G↗
DOE OSTI2021

Review of Onsite Temperature and Solar Forecasting Models to Enable Better Building Design and Operations

Advanced building controls and energy optimization for new constructions and retrofits rely on accurate weather data. Traditionally, most studies utilize airport weather information as the decision inputs. However, most buildings are in environments that are quite different than those at the airport miles away. Tree cover, adjacent buildings, and micro-climate effects caused by the larger surrounding area can all yield deviations in air temperature, humidity, solar irradiance, and wind that are large enough to influence design and operation decisions. In order to overcome this challenge, there are many prior studies on developing weather forecasting algorithms from micro-to meso-scales. Additionally, this paper reviews and complies knowledge on common weather data resources, data processing methodologies and forecasting techniques of weather information. Commonly used statistical, machine learning and physical-based models are discussed and presented as two major categories: deterministic forecasting and probabilistic forecasting. Finally, evaluation metrics for forecasting errors are listed and discussed.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Forecasting for the Weather Driven Energy System - A New Task under IEA Wind

The energy system needs a range of forecast types for its operation in addition to the narrow wind power forecast that has been the focus of considerable recent attention. Therefore, the group behind the former IEA Wind Task 36 Forecasting for Wind Energy has initiated a new IEA Wind Task with a much broader perspective, which includes prospective interaction with other IEA Technology Collaboration Programmes such as the ones for PV, hydropower, system integration, hydrogen etc. In the new IEA Wind Task 51 (entitled "Foreacsting for the Weather Drive Energy System") the existing Work Packages (WPs) are complemented by work streams in a matrix structure. The Task is divided in three WPs according to the stakeholders: WP1 is mainly aimed at meteorologists, providing the weather forecast basis for the power forecasts. In WP2, the forecast service vendors are the main stakeholders, while the end users populate WP3. The new Task 51 started in January 2022. Planned activities include 4 workshops. The first will focus on the state of the art in forecasting for the energy system plus related research issues and be held during September 2022 in Dublin. The other three workshops will be held later during the 4-year Task period and address (1) seasonal forecasting with emphasis on Dunkelflaute, storage and hydro, (2) minute-scale forecasting, and (3) extreme power system events. The issues and conclusions of each of the workshops will be documented by a published paper. Additionally, the Recommended Practice on Forecast Solution Selection will be updated to reflect the broader perspective.

geophysics computing↗
DOE OSTI2024

Federated Architecture for Secure and Transactive Distributed Energy Resource Management Solutions

There are fewer conventional, dispatchable generation resources and more variable renewable energy (VRE) and distributed energy resources (DERs). There is more uncertainty from bulk-level VRE and net demand from distribution systems with high DER levels. FAST-DERMS aims to develop and demonstrate a scalable solution for managing uncertainties in supply and demand at the grid edge. We propose that distribution system operators (DSOs) provide firm net load forecasts to the bulk system operator's energy management system (EMS).

distributed energy resources↗
DOE OSTI2021

A Bimodal Diagnostic Cloud Fraction Parameterization. Part I: Motivating Analysis and Scheme Description

Cloud fraction parameterizations are beneficial to regional, convection-permitting numerical weather prediction. For its operational regional midlatitude forecasts, the Met Office uses a diagnostic cloud fraction scheme that relies on a unimodal, symmetric subgrid saturation-departure distribution. This scheme has been shown before to underestimate cloud cover and hence an empirically based bias correction is used operationally to improve performance. This first of a series of two papers proposes a new diagnostic cloud scheme as a more physically based alternative to the operational bias correction. The new cloud scheme identifies entrainment zones associated with strong temperature inversions. Additionally, for model grid boxes located in this entrainment zone, collocated moist and dry Gaussian modes are used to represent the subgrid conditions. The mean and width of the Gaussian modes, inferred from the turbulent characteristics, are then used to diagnose cloud water content and cloud fraction. It is shown that the new scheme diagnoses enhanced cloud cover for a given gridbox mean humidity, similar to the current operational approach. It does so, however, in a physically meaningful way. Using observed aircraft data and ground-based retrievals over the southern Great Plains in the United States, it is shown that the new scheme improves the relation between cloud fraction, relative humidity, and liquid water content. An emergent property of the scheme is its ability to infer skewed and bimodal distributions from the large-scale state that qualitatively compare well against observations. A detailed evaluation and resolution sensitivity study will follow in Part II.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Physics-based Induced Earthquake Forecasting: Process Understanding, and Hazards Mitigation

Disposal of saltwater co-produced with oil and gas is linked to elevated seismicity in the Central and Midwest US. There is a concern that these events may lead to widespread damage and an overall increase in seismicity. Thus an improved understanding of the spatially and temporally variable deformation and stress field associated with fluid injection operation is critically necessary for evaluating time-varying seismic hazards. Despite the improvements in seismic monitoring capacity and the resulting decrease in the magnitude detection threshold, estimates of induced earthquake probability remain elusive due to insufficient models incapable of accounting for the complex physics governing the process of induced seismicity. The proposed research effort will comprehensively analyze, integrate, and interpret geodetic, injection, and seismic data in the vicinity of the injection sites in Oklahoma to resolve the 4-dimensional distribution of pore pressure and stress in the shallow crust. This project, in particular, is focused on exploring the statistical relation between injection operation and increased earthquake hazard. The amplitude of and the extent to which pore pressure changes are determined by some factors, in particular, the hydrogeological properties of the rocks, such as diffusivity. Thus the available deformation data will be used to constrain hydrogeological properties of the medium, to accurately resolve the evolution of crustal stresses due to fluid injection. Having the time-varying models of stress changes, a statistical framework will be implemented to estimate the time-dependent probability of large earthquakes on the nearby fault systems. These data and models help to improve seismic hazard estimates and aid in constructing operational-induced earthquake forecast models. This information can also be integrated into the updated U.S. National Seismic Hazard Map, which local communities and authorities use in their earthquake risk estimates and mitigation efforts.

58 GEOSCIENCES↗
DOE OSTI2023

Machine Learning–Adjusted WRF Forecasts to Support Wind Energy Needs in Black Start Operations

Abstract The push for increased capacity of renewable sources of electricity has led to the growth of wind-power generation, with a need for accurate forecasts of winds at hub height. Forecasts for these levels were uncommon until recently, and that, combined with the nocturnal collapse of the well-mixed boundary layer and daytime growth of the boundary layer through the levels important for energy generation, has contributed to errors in numerical modeling of wind generation resources. The present study explores several machine learning algorithms to both forecast and correct standard WRF Model forecasts of winds and temperature at hub height within wind turbine plants over several different time periods that are critical for the anticipation of potential blackouts and aiding in black start operations on the power grid. It was found that mean square error for day-2 wind forecasts from the WRF Model can be improved by over 90% with the use of a multioutput neural network, and that 60-min forecasts of WRF error, which can then be used to adjust forecasts, can be made with an LSTM with great accuracy. Nowcasting of temperature and wind speed over a 10-min period using an LSTM produced very low error and especially skillful forecasts of maximum and minimum values over the turbine plant area.

17 WIND ENERGY↗
DOE OSTI2020

We Just Want to Pump…You Up! Forecasting Grid-Connected Heat Pump Water Heater Energy Savings and Load Shifting Potential for the Southeast U.S.

Heat pump water heaters (HPWH) can achieve energy savings of 60-70% compared to conventional electric-resistance water heaters. However, even with a favorable simple payback period within the typical product lifetime, HPWHs make up only 1% of all electric water heaters sold in the residential sector. Market adoption is challenged, in part, by the lack of effective energy efficiency programs in the U.S. region with the greatest amount of residential electric water heaters. The recent integration of connected functionality into HPWHs offers the capability to shift load without undue negative impact on customers. This capability can provide value to utilities with peak load constraints, motivating them to promote HPWHs for the first time. This paper will present a methodology to forecast connected HPWH energy use and extrapolate load shifting potential for the Southeast U.S. region. The methodology leverages data from a robust connected HPWH field study conducted in the Pacific Northwest. A coefficient of performance (COP) relationship for HPWHs was developed using ambient and inlet water temperature data to forecast HPWH performance on a month-by-month basis. Using the forecasted COP, HPWH operating hours were calculated for meeting load, which serve as the proxy to extrapolate load shifting potential from the Pacific Northwest to the Southeast. As a use case, analytical results are presented for a specific utility. This methodology, in combination with market analysis, facilitates the development of customized energy savings and load shifting forecasts to understand the potential impacts of launching connected HPWH programs in specific utility service territories.

heat pump water heater, energy savings, load shift↗
DOE OSTI2026

New framework for benchmarking decadal predictions leveraging the PCMDI Metric Package with interactive visualization

Reliable climate predictions across multiple timescales are increasingly critical as climate-related risks continue to rise. With the growing number and diversity of climate prediction systems, systematic intercomparison has become essential. Here, we present a comprehensive evaluation framework based on the PCMDI Metric Package to assess the performance of multiple decadal climate prediction systems. Unlike uninitialized simulations, initialized predictions exhibit bias and predictive skill that evolve with forecast lead time. To address this, we introduce (1) model-by-lead-time portrait plots, which efficiently summarize metrics of global temperature, precipitation, and Arctic/Antarctic sea-ice extent, and (2) an HTML-based interactive visualization platform that provides detailed regional and seasonal diagnostics of model bias, skill scores, and ensemble spread for each model and lead time. Comparisons with uninitialized simulations further quantify the relative impacts of initialization and external forcing on prediction skill. The proposed framework provides a scalable and transparent approach for multi-model climate prediction assessments and can be readily extended to a wide range of operational and research forecasting systems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Enhancing Solar Power Forecasting with Regularized Constrained Quantile Regression Averaging and Bootstrapping Techniques

Probabilistic solar power forecasting (SPF) plays an essential role in optimizing power-grid operations by quantifying the forecast uncertainty. To improve the accuracy and robustness of probabilistic SPF, this paper introduces the regularized constrained quantile regression averaging (rCQRA) method to combine outputs from multiple PSPF models. In addition, a bootstrapping method was used to quantify model uncertainty, providing insights into the reliability and significance of each ensemble component. To evaluate its efficacy, the proposed rCQRA method is used to integrate four PSPF methods. The resulting SPF models are trained and validated using a real-world six-year dataset from a rooftop solar plant in the USA. The performance of the proposed rCQRA method is evaluated and compared with two benchmark methods under three categories of weather conditions. It is shown that the rCQRA method has superior performance in its forecast reliability, sharpness, and accuracy.

Ensemble learning, probabilistic solar power forec↗