Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Operational forecasting”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Enhancing Solar Power Forecasting with Regularized Constrained Quantile Regression Averaging and Bootstrapping Techniques

Probabilistic solar power forecasting (SPF) plays an essential role in optimizing power-grid operations by quantifying the forecast uncertainty. To improve the accuracy and robustness of probabilistic SPF, this paper introduces the regularized constrained quantile regression averaging (rCQRA) method to combine outputs from multiple PSPF models. In addition, a bootstrapping method was used to quantify model uncertainty, providing insights into the reliability and significance of each ensemble component. To evaluate its efficacy, the proposed rCQRA method is used to integrate four PSPF methods. The resulting SPF models are trained and validated using a real-world six-year dataset from a rooftop solar plant in the USA. The performance of the proposed rCQRA method is evaluated and compared with two benchmark methods under three categories of weather conditions. It is shown that the rCQRA method has superior performance in its forecast reliability, sharpness, and accuracy.

Ensemble learning, probabilistic solar power forec↗
DOE OSTI2025

Electrical Load Forecasting Over Multihop Smart Metering Networks With Federated Learning

Electric load forecasting is essential for power management and stability in smart grids. This is mainly achieved via advanced metering infrastructure, where smart meters (SMs) record household energy data. Traditional machine learning (ML) methods are often employed for load forecasting, but require data sharing, which raises data privacy concerns. Federated learning (FL) can address this issue by running distributed ML models at local SMs without data exchange. However, current FL-based approaches struggle to achieve efficient load forecasting due to imbalanced data distribution across heterogeneous SMs. Here, this article presents a novel personalized FL (PFL) method for high-quality load forecasting in metering networks. A meta-learning-based strategy is developed to address data heterogeneity at local SMs in the collaborative training of local load forecasting models. Moreover, to minimize the load forecasting delays in our PFL model, we study a new latency optimization problem based on optimal resource allocation at SMs. A theoretical convergence analysis is also conducted to provide insights into FL design for federated load forecasting. Extensive simulations from real-world datasets show that our method outperforms existing approaches regarding better load forecasting and reduced operational latency costs.

Rahman, Ratun [Univ. of Alabama, Huntsville, AL (U↗
DOE OSTI2022

Advances in the Application and Utility of Subseasonal-to-Seasonal Predictions

The subseasonal-to-seasonal (S2S) predictive time scale, encompassing lead times ranging from 2 weeks to a season, is at the frontier of forecasting science. Forecasts on this time scale provide opportunities for enhanced application-focused capabilities to complement existing weather and climate services and products. There is, however, a “knowledge–value” gap, where a lack of evidence and awareness of the potential socioeconomic benefits of S2S forecasts limits their wider uptake. To address this gap, here we present the first global community effort at summarizing relevant applications of S2S forecasts to guide further decision-making and support the continued development of S2S forecasts and related services. Focusing on 12 sectoral case studies spanning public health, agriculture, water resource management, renewable energy and utilities, and emergency management and response, we draw on recent advancements to explore their application and utility. These case studies mark a significant step forward in moving from potential to actual S2S forecasting applications. We show that by placing user needs at the forefront of S2S forecast development—demonstrating both skill and utility across sectors—this dialogue can be used to help promote and accelerate the awareness, value, and cogeneration of S2S forecasts. We also highlight that while S2S forecasts are increasingly gaining interest among users, incorporating probabilistic S2S forecasts into existing decision-making operations is not trivial. Nevertheless, S2S forecasting represents a significant opportunity to generate useful, usable, and actionable forecast applications for and with users that will increasingly unlock the potential of this forecasting time scale.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Knowledge-Informed Uncertainty-Aware Machine Learning for Time Series Forecasting of Dynamical Engineered Systems

The high complexity and multiscale nature of many engineered systems—such as those in nuclear power plants—make representing and forecasting their dynamic behavior challenging. Physics-based models can be overly complex and computationally intractable, whereas machine learning (ML) tools are often data-hungry and prone to unphysical solutions. This study proposes a knowledge-informed ML-aided hybrid residual modeling approach that offers accurate and efficient time series forecasting for the operation of dynamical engineered systems. Hybrid residual modeling entails a baseline solution from domain knowledge and known physics expressions about the system dynamics integrated with an ML model to capture undiscovered information from the mismatch (i.e., residuals) between true states from measurements and baseline-predicted outputs. This study further quantifies the ML model uncertainty to provide trustworthy solutions. Real-time operational data from thermal-hydraulic flow loops of the cryogenic moderator system in Oak Ridge National Laboratory’s Spallation Neutron Source facility were used to demonstrate the potential of knowledge-informed uncertainty-aware ML in real-world applications. The state variables of the cryogenic helium loop were modeled with (1) first principles–based system identification (sysID), (2) long short-term memory (LSTM) neural network, and (3) hybrid sysID (baseline) + LSTM (residual). The superior predictive capability of the sysID+LSTM model versus stand-alone sysID and LSTM is confirmed by average performance metrics and individual data points across different prediction horizons. By creating a robust representation of the underlying physical system, the widely applicable hybrid residual modeling approach will enable the future development of digital twins for performance prediction, prognostics, and operation control.

Zhao, Xingang↗
DOE OSTI2025

Airport Delay Prediction with Temporal Fusion Transformers

Since flight delay hurts passengers, airlines, and airports, its prediction becomes crucial for the decision-making of all stakeholders in the aviation industry and thus has been attempted by various previous research. However, previous delay predictions are often categorical and at a highly aggregated level. To improve that, this study proposes to apply the novel Temporal Fusion Transformer model and predict numerical airport arrival delays at quarter hour level for U.S. top 30 airports. Inputs to our model include airport demand and capacity forecasts, historic airport operation efficiency information, airport wind and visibility conditions, as well as en-route weather and traffic conditions. The results show that our model achieves satisfactory performance measured by small prediction errors on the test set. In addition, the interpretability analysis of the model outputs identifies the important input factors for delay prediction.

Liu, Ke [University of California Berkeley]↗
DOE OSTI2022

A Review of Behind-the-Meter Solar Generation Modeling and Forecasting

Solar photovoltaic systems largely integrated within the distribution grid are operated 'behind-the-meter' and power generation cannot be directly monitored by most utilities. The increasing penetration of behind-the-meter solar photovoltaic systems can deter efficient network and market operations due to variability and uncertainty in net load, which is exacerbated by limited visibility and the difficulty in analyzing the hosting capacity. Risk introduced by behind-the-meter solar contributions may hinder reliable and secure grid operations due to biased system monitoring and forecasts. Accurate behind-the-meter estimations, together with capacity and specification forecasts, thus play a key role in balancing supply and demand and this article reviews the pertinent literature, identifying key characteristics and predictive methods for efficient behind-the-meter solar photovoltaic generation. Forecasting is central to methods herein. The fundamental characteristics of behind-the-meter solar forecasting, including which methods are applicable for scenario-driven use cases, are driven by the metrics most useful for system-wide performance evaluation. To this aim, the literature is reviewed with a focus on forecasting applications for aggregate, regional behind-the-meter generation useful to bulk system and utility operations. As distinguished from net load forecasting, subtleties in these coincident tasks are explored before concluding with recommendations for current practice and future implementations.

behind-the-meter↗
DOE OSTI2026

Responsible Adoption of Artificial Intelligence (AI) in Electric Grid Operations

The future of the grid will be powered by AI—or undermined by it. Artificial intelligence is rapidly reshaping grid operations, improving fault detection, forecasting accuracy, and real-time optimization. As AI systems move closer to operational decision loops, however, they introduce new consequence pathways: expanded attack surfaces, model integrity risks, regulatory exposure, and human-automation challenges. This talk presents a consequence-driven framework for deploying AI responsibly in the electric grid. Attendees will gain practical strategies to strengthen resilience, boost reliability, and deploy AI securely — ensuring the grid of the future is not only smarter but safer.

25 - ENERGY STORAGE↗
DOE OSTI2020

Probabilistic Zonal Reserve Requirements for Improved Energy Deliverability with Wind Power

In power systems with high penetration of renewable energy resources, uncertainty and variability of these stochastic resources introduce additional challenges for the operation of power systems. To improve the power system's reliability in the face of uncertainty, reserves are required as additional generation capacity to rebalance the power system following random disturbances. However, reserve deliverability is not guaranteed, because it may encounter potential transmission line congestion. Zonal reserve requirements can address this issue, but operators lack efficient ways to allocate reserves to zones while accounting for wind power forecast uncertainty. Herein we propose a methodology for probabilistic zonal reserve requirements to address wind power forecast uncertainties. This method estimates the probability distribution of line flows based on the system generation margin and injection shift factor. This estimate is then used to construct pre-defined and post-zonal reserve requirements. Case studies demonstrate that the proposed method efficiently schedules energy and reserves to balance energy and manage deliverability with wind power forecast uncertainty.We also discuss operational implications of the proposed method.

17 WIND ENERGY↗
DOE OSTI2020

Inferred inflow forecast horizons guiding reservoir release decisions across the United States

Abstract. Medium- to long-range forecasts often guide reservoir release decisions to support water management objectives, including mitigating flood and drought risks. While there is a burgeoning field of science targeted at improving forecast products and associated decision support models, data describing how and when forecasts are applied in practice remain undeveloped. This lack of knowledge may prevent hydrological modelers from developing accurate reservoir release schemes for large-scale, distributed hydrology models that are increasingly used to assess the vulnerabilities of large regions to hydrological stress. We address this issue by estimating seasonally varying, regulated inflow forecast horizons used in the operations of more than 300 dams throughout the conterminous United States (CONUS). For each dam, we take actual forward observed inflows (perfect foresight) as a proxy for forecasted flows available to the operator and then identify for each week of the year the forward horizon that best explains the release decisions taken. Resulting “horizon curves” specify for each dam the inferred inflow forecast horizon as a function of the week of the water year. These curves are analyzed for strength of evidence for contribution of medium- to long-range forecasts in decision making. We use random forest classification to estimate that approximately 80 % of large dams and reservoirs in the US (1553±50 out of 1927 dams with at least 10 Mm3 storage capacity) adopt medium- to long-range inflow forecasts to inform release decisions during at least part of the water year. Long-range forecast horizons (more than 6 weeks ahead) are detected in the operations of reservoirs located in high-elevation regions of the western US, where snowpack information likely guides the release. A simulation exercise conducted on four key western US reservoirs indicates that forecast-informed models of reservoir operations may outperform models that neglect the horizon curve – including during flood and drought conditions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Dynamic Line Rating Models and Their Potential for a Cost‐Effective Transition to Carbon‐Neutral Power Systems

Most transmission system operators (TSOs) currently use seasonally steady-state models considering limiting weather conditions that serve as reference to compute the transmission capacity of overhead power lines. The use of dynamic line rating (DLR) models can avoid the construction of new lines, market splitting, false congestions, and the degradation of lines in a cost-effective way. DLR can also be used in the long run in grid extension and new power capacity planning. In the short run, it should be used to help operate power systems with congested lines. The operation of the power systems is planned to have the market trading into account; thus, it computes transactions hours ahead of real-time operation, using power flow forecasts affected by large errors. In the near future, within a “smart grid” environment, in real-time operation conditions, TSOs should be able to rapidly compute the capacity rating of overhead lines using DLR models and the most reliable weather information, forecasts, and line measurements, avoiding the current steady-state approach that, in many circumstances, assumes ampacities above the thermal limits of the lines. Here, this work presents a review of the line rating methodologies in several European countries and the United States. Furthermore, it presents the results of pilot projects and studies considering the application of DLR in overhead power lines, obtaining significant reductions in the congestion of internal networks and cross-border transmission lines.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Forecasting Solar-Thermal Systems Performance under Transient Operation Using a Data-Driven Machine Learning Approach Based on the Deep Operator Network Architecture

Modeling and prediction of the dynamic behavior of thermal systems operating under intermittent energy input and variable load requirements represent one of the greatest challenges in the development of efficient and reliable renewable-based power generation technologies. In this work, a data-driven machine learning modeling framework was developed based on a modified version of the Deep Operator Network architecture where the time coordinate in the trunk net is replaced with historical data of the predicting quantity. The modeling framework can be used to accurately predict the performance of renewable-based energy conversion technologies including wind- and solar-based power plants. This novel framework was applied on a solar-thermal system that consists of a solar collection loop using a flat plate collector, a power generation loop comprising an Organic Rankine Cycle, and a thermal energy storage tank connecting both loops. Variable solar irradiance, air temperature, and power load profiles were used by the Deep Operator Network to predict the State-of-Charge and the efficiency of the thermal system for several days. The results were compared with the State-of-Charge and efficiency functions calculated using a physics-based model. For a simple operation scenario, characterized by a clear sky solar irradiance profile and constant load, the standard deviation in the State-of-Charge prediction by Deep Operator Network is below 0.9% during a seven-day prediction time horizon. For the most realistic operation scenario that considers real solar irradiance and a rough load profile, the maximum standard deviation in the predictions for the State-of-Charge and efficiency are below 6.8% and 2.5%, respectively. A comparison between Deep Operator Network and Long Short Term Memory network was also performed. In general, both networks predict very well the State-of-Charge for different data density conditions; however, a higher accuracy, with a standard deviation below 2.0%, is obtained by the Deep Operator Network during three and half days using sparser training data of 20-minute points. The same accuracy for the State-of-Charge prediction with the Long Short Term Memory network is achieved only for 14 h. Average standard deviations for the State-of-Charge prediction of 1.1% with the Deep Operator Network and 1.5% with the Long Short Term Memory network are obtained for a four-day prediction time using a denser training data of 5-minute points.

DeepONet↗
DOE OSTI2020

Development and Evaluation of Occupancy-Aware Model Predictive Control for Residential Building Energy Efficiency and Occupant Comfort

The residential sector accounts for 25% of global primary energy consumption. Two methods have previously been proposed to reduce residential energy use associated with the provision of occupant thermal comfort: 1. Occupancy-based HVAC control, operating systems only during confirmed occupancy, and 2. model predictive control (MPC), harnessing a mathematical model and forecasts to find optimal operating strategies. Previous studies estimate the average energy savings of the two methods individually in the range of 21% and 16%, respectively. The research presented herein was carried out to evaluate the energy savings potential in residential buildings by combining both approaches across different climates, house vintages, and occupancy patterns. Occupancy and eight different physical modalities (e.g. CO2 and VOC) data were collected from five homes for time periods of 4–9 weeks. Collected data sets were used to train occupancy prediction models suggested by an extensive literature survey of occupancy model types. The trained prediction models were combined with MPC and detailed EnergyPlus building simulation models to evaluate residential building performance in terms of annual energy savings and thermal comfort, along with discomfort exceedance metrics. Multiple home types and regions were analyzed to understand regional and climate-dependent potential. Based on actual field data, the occupancy models had a prediction inaccuracy between 8% and 35% across the investigated homes. Average occupancy for the collected data ranged from 56% to 86%, a typical range reported in the literature. Building simulations were conducted for three control scenarios: conventional thermostatic control, occupancy-based, and occupancy-based MPC. The results indicate that all advanced strategies improve upon the conventional control, with some scenarios cutting energy use in half with only occasional incurrence of discomfort. The findings indicate that occupancy-aware model predictive residential building control has the potential to drastically reduce energy use and associated emissions while maintaining occupant comfort for both new and existing buildings.

ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATION↗
DOE OSTI2021

A forecast-driven decision-making model for long-term operation of a hydro-wind-photovoltaic hybrid system

Hydro-wind-photovoltaic (PV) hybrid system has the potential to increase the integration of renewable energy sources into an existing grid. For the long-term operation of the system, due to the non-storable nature of wind and PV power, it is essentially to decide the optimal long-term carryover storage of cascade reservoirs. However, it remains a challenge due to high uncertainties of long-term forecasts and complicated hydraulic/electrical relationships between cascade reservoirs. Here in this study, a forecast-driven decision-making model is proposed for the hybrid system, which converts the multi-stage long-term operation process into a two-stage operation problem (including current stage and carryover stage) to avoid using longer-horizon forecast information with lower accuracy. First, the carryover stage energy surfaces (CESs) considering the forecast uncertainties of wind, solar and hydro resources are proposed to characterize carryover stage benefit quantitatively. Then a CESs-based forward decision-making optimization model is developed to guide the long-term operation of a hydro-wind-photovoltaic hybrid system. The applications in a hydro-wind-PV hybrid system of Yalong River basin results show that: compared with conventional operation, 1) power generation increases 9.03%; 2) in terms of the carryover storages control, the reservoir impounding and drawdown timing are delayed, and the drawdown depth is increased, which can be used to formulate better reservoir operation rules.

13 HYDRO ENERGY↗
DOE OSTI2021

Geothermal Operational Optimization with Machine Learning

The Geothermal Operational Optimization with Machine Learning (GOOML) project has developed a generic and extensible component-based system modeling framework to study complex geothermal fields using a data-driven approach. Through building a digital twin of a geothermal steam field with the GOOML modeling framework, operators can analyze historical and forecasted power production, explore possible steam field configurations, and optimize real world operations, all in a cost-effective digital environment. The GOOML modeling software is based on a historical data-assimilation framework that uses first-principal thermodynamics to model steam field components using historical data, and a forecast framework that uses machine-learning-driven models of steam field components to predict future operations. This modeling framework creates countless new opportunities for digital exploration of steam field design and operations. To date, digital twins have been developed for several steam fields in New Zealand and the United States. These digital twins have been validated by comparing hindcast predictions against historical production data. Field design and operations have been explored using genetic optimization and reinforcement learning. Initial results show compelling and often surprising opportunities for improved design and operation of fields with 2 to 5 percent improvements in annual energy production. GOOML is driving a step-change in geothermal operations by applying state-of-the-art machine learning algorithms, comprehensive data analytics, and a first-of-its-kind intelligent geothermal systems model.

40 EE - Geothermal Technologies Office (EE-4G)↗
DOE OSTI2022

A deep learning-based direct forecasting of CO 2 plume migration

Accurate and timely forecasts of CO 2 plume evolution in geological reservoirs are crucial for CO 2 migration detection, leakage risk assessment, and operation decision support. Conventional forecasting usually adopts a two-step strategy, first calibrating reservoir model parameters against observations using iterative inverse modeling (or history matching) and then applying the calibrated model for predictions. This method impedes real-time forecasts due to the heavy computational demand in inverse modeling and may suffer from poor prediction accuracy because of the limited observation data. In this work, we propose a deep learning-based latent space mapping framework to forecast CO 2 plume migration directly by avoiding the inverse modeling. We first use the convolutional autoencoder to map the high-dimensional complex plume extents onto low-dimensional latent space. Next, we use neural networks to learn the relationship between the observation variables and the prediction latent variables. And then for given observation data, we infer the prediction values directly. This one-step direct forecasting is computationally efficient which requires a few number of parallelizable reservoir simulations and it can provide accurate predictions with limited observations by learning the observation-prediction relationship in the reduced dimension. Therefore, our proposed method enables an in-time forecast of dynamic CO 2 plume distributions. In this work, we demonstrate the effectiveness and accuracy of our method in predicting the CO 2 plume migration using four metrics such as plume area, centroid movement distance, and plume spreading in the primary and secondary directions. And the spatio-temporal evolution patterns of plume migration under diverse geological complexities are also accurately quantified.

15 GEOTHERMAL ENERGY↗
DOE OSTI2022

Using probabilistic solar power forecasts to inform flexible ramp product procurement for the California ISO

How can independent system operators (ISOs) take advantage of probabilistic solar forecasts to lower generation costs and improve reliability of power systems? We discuss one three-step approach for doing so, focusing on how such forecasts might help the California Independent System Operator (CAISO) prepare unexpected net load ramps, where net load equals gross demand minus wind and solar production. First, we enhance an existing solar forecasting system to provide well-calibrated hours-ahead probabilistic forecasts. We then relate the degree of uncertainty reflected in the forecasted prediction intervals (independent variables) to error distributions for net load ramp forecasts for the CAISO real-time market (dependent variable) using machine learning and quantile regression. Projected ramp forecast errors conditioned on solar uncertainty are translated into flexible ramp requirements that therefore reflect real-time meteorological and solar conditions, improving on typical ISO procedures. Detailed descriptions are provided on the quantile regression and kth-nearest neighbor categorization methods for accomplishing that translation. Finally, a multiple time-scale look-ahead market simulation model is applied to a 118-bus IEEE Reliability Test System, modified to represent the CAISO generation mix and demand distributions. The model runs quantify how solar-conditioned ramp requirements can, first, decrease operating costs by reducing requirements compared to often conservative unconditional methods and, second, decrease generation scarcity events and consequently improve reliability by increasing flexibility requirements at times when unconditional forecast-based requirements understate actual ramp uncertainty. Solar-conditioned ramp requirements are found to reduce generation operating costs by about 2% for the test system (which would be equivalent to over $\$100$ million per year for a CAISO-size system).

14 SOLAR ENERGY↗
DOE OSTI2026

Co-Simulation Meets AI: MCP-Driven Power System Analysis

GridGPT, a fine-tuned Generative AI model is designed for on-premise use in grid control rooms. This presentation will demonstrate how eGridGPT can seamlessly integrate with control room solutions to offer operators, engineers, and corporate users enhanced guidance and decision support. It is to show how this innovative AI solution can improve state estimation, boost variable energy forecasting, and optimize grid operations. By leveraging eGridGPT's unique features, audience will learn to unlock new levels of automation, predictive analytics, and reliability within their power systems, ultimately leading to reduced downtime and improved operational efficiency.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Forecasting the Decay of Hybrid Perovskite Performance Using Optical Transmittance or Reflected Dark-Field Imaging

The practicality and economic viability of hybrid perovskite solar cells hinge on their operational lifetime, and methods for forecasting the performance of perovskites under different operational stresses are urgently needed. Here, we explore the evolution of material-level optoelectronic properties as MAPbI 3 degrades and discover universal behaviors where the carrier diffusion length (L D ) decays before quasi-Fermi-level splitting (ΔE F ), regardless of the specific stress protocol (oxygen, humidity, thermal stress, or a combination). We employ a machine learning greedy feature selection model that uses initially measured properties to predict the time it takes L D to decrease to 85% of its initial value with a prediction accuracy of 12.8%. This model reveals a strong correlation between the initial rate of transmittance change and the time until loss of transport. We translate this material-level finding to photovoltaic device-level forecasting by demonstrating that the rate of change of transmittance is equivalent to the rate of change of the spatial standard deviation of dark-field image intensity (i.e., scattered light intensity) collected in reflection mode (and thus applicable to devices with opaque contacts). Furthermore, this work demonstrates that transmittance and scattering methods are highly effective for accelerated material (and device) stability evaluation and forecasting.

14 SOLAR ENERGY↗