SEARCH · Engineering Papers

Results for “performance forecasting”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

All sources NASA NTRS DOE OSTI

DOE OSTI2022

A reforecasting-based dynamic reserve estimation for variable renewable generation and demand uncertainty

The installed capacity of renewables-based energy sources has been increasing in traditional power systems. In order to accommodate the increased variability and uncertainty associated with the deeper penetration of renewable sources like solar and wind, adjusted amounts of dynamic reserve are needed. Although probabilistic dynamic reserve estimation methods have been previously developed, most of them consider the uncertainty to be represented by parametric density functions that tend to perform poorly under extreme events and, moreover, neglect uncertainty introduced by the forecasting model itself. Toward addressing these limitations, this work presents, for the first time, a dynamic reserve estimation method for flexibility that incorporates nonparametric density estimation and a machine learning based reforecasting to provide a day-ahead prediction of the mean and spread of uncertainty around the base forecast. The prediction is, in turn, used to estimate the up and down reserve relative to the base forecast. Here, the present method takes various endogenous and exogenous features, including the calendar variables, as input to estimate the day-ahead reserve. Using a combination of reforecasting and dynamic reserve estimation techniques, the method is shown to adjust better to the dynamic nature of reserve requirements providing only what is needed to accommodate the expected deviations. Considering California Independent System Operator (CAISO) solar, wind and load data over an 18 month period, up to 67% reduction in the amount of reserve capacity needed for a one day reserve and reserve penalty for solar uncertainty is demonstrated. Additionally, the risk of reserve insufficiency in meeting the net demand is reduced by 20% with the proposed method.

14 SOLAR ENERGY↗

DOE OSTI2020

Machine learning for international freight transportation management: A comprehensive review

Machine learning (ML) offers a promising avenue for international freight transportation management (IFTM) given its capability to harness the power of data that have become increasingly available to freight transportation researchers and practitioners. This paper conducts a comprehensive investigation of the state-of-the-art in developing ML models for applications to different aspects of IFTM. We start by giving an overview of various fundamental ML methods. Then, how different ML methods have been employed, adapted, and applied to a multitude of subject areas in IFTM are discussed, including demand forecast, operation and asset maintenance, and vehicle trajectory and on-time performance prediction. The potential data sources that may be used to develop ML models are further examined. Subsequently, a synthesis of the exiting work is performed to identify the specific topics addressed in the existing research, ML methods used, the trends of research, and opportunities for further explorations. Four directions for future research are proposed in the end.

Data sources↗

DOE OSTI2025

Arctic extreme precipitation changes from 1980 to 2022 in response to sea ice decline and enhanced atmospheric rivers

Arctic extreme precipitation (EP) broadly impacts permafrost degradation, glacier and snow cover changes, and ice sheet mass balance as well as ecosystems. However, investigation of EP spatiotemporal variations over the Arctic remains challenging, and their primary drivers are still poorly understood. Performance estimation of three state-of-the-art reanalysis products (Climate Forecast System Reanalysis (CFSR), European Centre for Medium-Range Weather Forecasts Reanalysis version 5 (ERA-5), and Modern-Era Retrospective analysis for Research and Applications, version 2 (MERRA-2)) against gauge-based precipitation observations reveals that MERRA-2 outperforms other reanalysis for Arctic EP changes. Based on MERRA-2 data, both annual EP amount and occurrence days averaged over the Arctic show statistically significant positive trends during 1980–2022 (3.37 ± 1.03 mm dec −1 and 0.42 ± 0.17 d dec −1 , respectively), with the most pronounced increase in the autumn. Spatial heterogeneity in annual and seasonal EP trends is found across the Arctic, with the largest positive annual trends of 30 mm dec −1 over the Bering Sea and the Denmark Strait. The significant EP increase is closely associated with intensified atmospheric rivers (ARs) and widespread decline in sea ice concentration (SIC). Specially, SIC and ARs are responsible for 12% and 50% of Arctic EP inter-annual variance, respectively, while ARs directly contribute 28.3% of the total annual EP amounts. These findings explain the mechanistic controls on Arctic EP, providing critical insights for projecting polar weather and climate extremes and their impacts on the Arctic environment.

atmospheric rivers↗

DOE OSTI2026

High-Resolution Regional Atmosphere–Ocean–Wave Coupled Simulations of Hurricane Henri (2021)

To explore the integrated effects of ocean and ocean surface wave related physical processes on TC simulations, a set of three model simulations is performed. * In experiment 'A', the event is modeled using the Weather Research Forecasting (WRF) model alone with prescribed Sea Surface Temperature (SST) at 6-hour intervals. * In experiment ‘AO,’ WRF is coupled with the Finite Volume Community Ocean Model (FVCOM), enabling variable exchange between atmosphere and ocean, but without considering ocean surface wave-related physical processes. * In experiment ‘AOW’, WRF, FVCOM, and Simulating WAves Nearshore (SWAN) exchange variables with each other every hour through the OASIS3-MCT Coupler to allow direct and indirect atmosphere-ocean-wave interactions. * Observational data are also included in this dataset (Dropsonde, HRD-Radar, NDBC_wave). All simulations are initialized at 18:00 UTC on August 19, 2021, within a domain encompassing the western North Atlantic Ocean. The atmospheric domain features a horizontal resolution of 3 km. The ocean domain, which covers a substantial portion of the WRF ocean domain, employs an unstructured triangular grid with resolutions ranging from 3 km near the coast to 9 km in the open ocean, effectively resolving the complex coastline of the U.S. Northeast Coast. Initial and boundary conditions for the atmosphere model are obtained from the 6-hourly 0.25° NCEP (National Centers for Environmental Prediction) Global Forecast System (GFS; NCEP, 2015) data.

17 WIND ENERGY↗

DOE OSTI2026

High-Resolution Regional Atmosphere–Ocean–Wave Coupled Simulations of Hurricane Henri (2021)

17 WIND ENERGY↗

DOE OSTI2026

High-Resolution Regional Atmosphere–Ocean–Wave Coupled Simulations of Hurricane Henri (2021)

To explore the integrated effects of ocean and ocean surface wave related physical processes on tropical cyclone simulations, a set of three model simulations is performed. * In experiment 'A', the event is modeled using the Weather Research Forecasting (WRF) model alone with prescribed Sea Surface Temperature (SST) at 6-hour intervals. * In experiment ‘AO,’ WRF is coupled with the Finite Volume Community Ocean Model (FVCOM), enabling variable exchange between atmosphere and ocean, but without considering ocean surface wave-related physical processes. * In experiment ‘AOW’, WRF, FVCOM, and Simulating WAves Nearshore (SWAN) exchange variables with each other every hour through the OASIS3-MCT Coupler to allow direct and indirect atmosphere-ocean-wave interactions. * Observational data are also included in this dataset (Dropsonde, HRD-Radar, NDBC_wave). All simulations are initialized at 18:00 UTC on August 19, 2021, within a domain encompassing the western North Atlantic Ocean. The atmospheric domain features a horizontal resolution of 3 km. The ocean domain, which covers a substantial portion of the WRF ocean domain, employs an unstructured triangular grid with resolutions ranging from 3 km near the coast to 9 km in the open ocean, effectively resolving the complex coastline of the U.S. Northeast Coast. Initial and boundary conditions for the atmosphere model are obtained from the 6-hourly 0.25° NCEP (National Centers for Environmental Prediction) Global Forecast System (GFS; NCEP, 2015) data. These CSV files are derived from the NetCDF files in the c0 dataset. Unlike the original format, where geographic coordinates were stored in a separate file, each CSV now embeds the corresponding latitude and longitude values alongside the measured or simulated variables.

17 WIND ENERGY↗

DOE OSTI2023

Spatio-Temporal Denoising Graph Autoencoders with Data Augmentation for Missing Photovoltaic Data Imputation

The integration of the global Photovoltaic (PV) market with real time data-loggers has enabled large scale PV data analytical pipelines for power forecasting and long-term reliability assessment of PV fleets. Nevertheless, the performance of PV data analysis heavily depends on the quality of PV timeseries data. This paper proposes a novel Spatio-Temporal Denoising Graph Autoencoder (STD-GAE) framework to impute missing PV Power Data. STDGAE exploits temporal correlation, spatial coherence, and value dependencies from domain knowledge to recover missing data. It is empowered by two modules. (1) To cope with sparse yet various scenarios of missing data, STD-GAE incorporates a domain-knowledge aware data augmentation module that creates plausible variations of missing data patterns. This generalizes STD-GAE to robust imputation over different seasons and environment. (2) STD-GAE nontrivially integrates spatiotemporal graph convolution layers (to recover local missing data by observed “neighboring” PV plants) and denoising autoencoder (to recover corrupted data from augmented counterpart) to improve the accuracy of imputation accuracy at PV fleet level. We have evaluated our proposed model on two realworld PV datasets. Experimental results show that STD-GAE can achieve a gain of 43.14% in imputation accuracy and remains less sensitive to missing rate, different seasons, and missing scenarios, compared with state-of-the-art data imputation methods such as MIDA and LRTC-TNN.

Fan, Yangxin↗

DOE OSTI2021

A comparative study of two-way and offline coupled WRF v3.4 and CMAQ v5.0.2 over the contiguous US: performance evaluation and impacts of chemistry–meteorology feedbacks on air quality

The two-way coupled Weather Research and Forecasting and Community Multiscale Air Quality (WRF-CMAQ) model has been developed to more realistically represent the atmosphere by accounting for complex chemistry–meteorology feedbacks. In this study, we present a comparative analysis of two-way (with consideration of both aerosol direct and indirect effects) and offline coupled WRF v3.4 and CMAQ v5.0.2 over the contiguous US. Long-term (5 years from 2008 to 2012) simulations using WRF-CMAQ with both offline and two-way coupling modes are carried out with anthropogenic emissions based on multiple years of the U.S. National Emission Inventory and chemical initial and boundary conditions derived from an advanced Earth system model (i.e., a modified version of the Community Earth System Model/Community Atmospheric Model). The comprehensive model evaluations show that both two-way WRF-CMAQ and WRF-only simulations perform well for major meteorological variables such as temperature at 2 m, relative humidity at 2 m, wind speed at 10 m, precipitation (except for against the National Climatic Data Center data), and shortwave and longwave radiation. Both two-way and offline CMAQ also show good performance for ozone (O3) and fine particulate matter (PM 2.5 ). Due to the consideration of aerosol direct and indirect effects, two-way WRF-CMAQ shows improved performance over offline coupled WRF and CMAQ in terms of spatiotemporal distributions and statistics, especially for radiation, cloud forcing, O 3 , sulfate, nitrate, ammonium, elemental carbon, tropospheric O 3 residual, and column nitrogen dioxide (NO 2 ). For example, the mean biases have been reduced by more than 10 W m –2 for shortwave radiation and cloud radiative forcing and by more than 2 ppb for max 8 h O 3 . However, relatively large biases still exist for cloud predictions, some PM 2.5 species, and PM 10 that warrant follow-up studies to better understand those issues. The impacts of chemistry–meteorological feedbacks are found to play important roles in affecting regional air quality in the US by reducing domain-average concentrations of carbon monoxide (CO), O 3 , nitrogen oxide (NO x ), volatile organic compounds (VOCs), and PM 2.5 by 3.1 % (up to 27.8 %), 4.2 % (up to 16.2 %), 6.6 % (up to 50.9 %), 5.8 % (up to 46.6 %), and 8.6 % (up to 49.1 %), respectively, mainly due to reduced radiation, temperature, and wind speed. The overall performance of the two-way coupled WRF-CMAQ model achieved in this work is generally good or satisfactory and the improved performance for two-way coupled WRF-CMAQ should be considered along with other factors in developing future model applications to inform policy making.

58 GEOSCIENCES↗

DOE OSTI2026

LAF-Net: A Deep Residual and Cross-Attention Framework for Day-Ahead Load Forecasting: Preprint

Accurate day-ahead load forecasting is essential for reliable power system operations and market efficiency. System operators such as the Midcontinent Independent System Operator (MISO) rely on forecasts from multiple vendors, yet combining them effectively remains a persistent challenge due to vendor-specific biases. This paper presents a novel LSTM-Attention Fusion Network with Error Representation (LAF-Net) that enhances day-ahead hourly load forecasting through deep residual learning and multi-modal cross-attention. The proposed model builds a historical error memory from past vendor performance and dynamically queries it with future hour context to generate adaptive, hour-specific trust weights for each vendor. A bounded residual correction further refines forecasts by mitigating systematic and temporally localized errors. Tested on real MISO LBA data with multi-vendor forecasts, LAF-Net consistently outperforms the best vendor baseline across all 38 LBAs, achieving more than a 40% reduction in system-level mean absolute error (MAE) during peak load hours relative to the best vendor baseline.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2022

Evaluation of WRF-Solar Cloud Forecast Using the NSRDB: Preprint

Cloud forecast is a crucial component in predicting solar irradiance from numerical weather prediction (NWP) models. Assessing cloud properties from the NWP models requires significant work due to the need for high-quality data, spatial analysis covering model extent, and detailed analysis of model performance for different types of clouds. This study presents an evaluation of the WRF-Solar cloud forecast using the National Solar Radiation Database (NSRDB). We propose an evaluation framework applied to a single model prediction as well as ensemble-based forecasts. Various cloud detection metrics are calculated when comparing with the satellite-derived dataset. The mismatched clouds from the WRF-Solar model are quantified using nine cloud types classified by cloud top height and cloud optical depth. The results based on the WRF-Solar forecasts covering the entire U.S. for the full year of 2018 shows mismatched cloud frequency in the range of 8% - 46% for thick and high-level (deep convective) to thin and low-level (cumulus) clouds.

cloud mask forecast↗

DOE OSTI2026

Machine learning-enhanced MPC for demand flexibility in small commercial buildings: An experimental study

Small- and medium-sized commercial buildings (SMCBs) represent the majority of U.S. commercial building stock and a significant share of peak electricity demand, yet they often lack centralized building automation systems, representing a significant untapped resource for urban energy management. This infrastructure gap makes advanced control implementation challenging, limiting the potential for widespread demand flexibility. Model Predictive Control (MPC) has shown strong potential for load shifting, peak demand reduction, and cost savings, but its effectiveness is hindered by unmeasured disturbances such as internal heat gains. This paper presents a Hybrid MPC framework that integrates a physics-based gray-box building thermal model, identified using a lumped disturbance (LD) approach, with a machine learning (ML) model for forecasting unmeasured disturbances. The hybrid approach is designed for buildings with multiple individually controlled heat pump and thermostat pairs, common in SMCBs, and aims to optimize coordinated scheduling of multiple heat pumps under dynamic electricity pricing while respecting comfort constraints. The methodology is validated through both simulations of case study buildings and experimental studies at a highly-instrumented test facility. Simulation results show that the Hybrid MPC achieves substantial load shifting and peak demand reduction, approaching the performance of an ideal MPC with perfect disturbance knowledge, and outperforming a conventional MPC without disturbance forecasting. In experiments, the Hybrid MPC reduced daily HVAC energy costs by 8.7%, peak-price time load (load shifting) by 41.7%, and peak demand by 29.2% compared to baseline control, demonstrating comparable benefits to the 11.6% cost savings, 42.9% load shifting, and 23.2% peak reduction of the ideal MPC. These results demonstrate that the proposed hybrid modeling approach can significantly improve MPC performance in real-world SMCB applications without requiring additional disturbance measurements.

Demand Flexibility↗

DOE OSTI2022

Benchmarking of Solar Irradiance Nowcast Performance Derived from All-Sky Imagers

Fluctuations of the incoming solar irradiance impact the power generation from photovoltaic and concentrating solar thermal power plants. Accurate solar nowcasting becomes necessary to detect these sudden changes of generated power and to provide the desired information for optimal exploitation of solar systems. In the framework of the International Energy Agency's Photovoltaic Power Systems Program Task 16, a benchmarking exercise has been conducted relying on a bouquet of solar nowcasting methodologies by all-sky imagers (ASI). In this paper, four ASI systems nowcast the Global Horizontal Irradiance (GHI) with a time forecast ranging from 1 to 20 min during 28 days with variable cloud conditions spanning from September to November 2019 in southern Spain. All ASIs demonstrated their ability to accurately nowcast GHI, with RMSE ranging from 6.9% to 18.1%. Under cloudy conditions, all ASIs' nowcasts outperform the persistence models. Under clear skies, three ASIs are better than persistence. Discrepancies in the observed nowcasting performance become larger at increasing forecast horizons. The findings of this study highlight the feasibility of ASIs to reliably nowcast GHI at different sky conditions, time intervals and horizons. Such nowcasts can be used either to estimate solar power at distant times or detect sudden GHI fluctuations.

all-sky imagers↗

DOE OSTI2025

Confidence-weighted integration of human and machine judgments for superior decision-making

Large language models (LLMs) can surpass humans in certain forecasting tasks. What role does this leave for humans in the overall decision process? One possibility is that humans, despite performing worse than LLMs, can still add value when teamed with them. A human and machine team can surpass each individual teammate when team members’ confidence is well calibrated and team members diverge in which tasks they find difficult (i.e., calibration and diversity are needed). We simplified and extended a Bayesian approach to combining judgments using a logistic regression framework that integrates confidence-weighted judgments for any number of team members. Using this straightforward method, we demonstrated its effectiveness in both image classification and neuroscience forecasting tasks. Combining human judgments with one or more machines consistently improved overall team performance. Our hope is that this simple and effective strategy for integrating the judgments of humans and machines will lead to productive collaborations.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Reinforcement learning based automated history matching for improved hydrocarbon production forecast

History matching aims to find a numerical reservoir model that can be used to predict the reservoir performance. An engineer and model calibration (data inversion) method are required to adjust various parameters/properties of the numerical model in order to match the reservoir production history. In this study, we develop deep neural networks within the reinforcement learning framework to achieve automated history matching that will reduce engineers’ efforts, human bias, automatically and intelligently explore the parameter space, and remove the need of large set of labeled training data. To that end, a fast-marching-based reservoir simulator is encapsulated as an environment for the proposed reinforcement learning. The deep neural-network-based learning agent interacts with the reservoir simulator within reinforcement learning framework to achieve the automated history matching. Reinforcement learning techniques, such as discrete Deep Q Network and continuous Deep Deterministic Policy Gradients, are used toth, used to train the learning agents. The continuous actions enable the Deep Deterministic Policy Gradients to explore more states at each iteration in a a learning episode; consequently, a better history matching is achieved using this algorithm as compared to Deep Q Network. For simplified dual-target composite reservoir models, the best history-matching performances of the discrete and continuous learning methods in terms of normalized root mean square errors are 0.0447 and 0.0038, respectively. Furthermore, our study shows that continuous action space achieved by the deep deterministic policy gradient drastically outperforms deep Q network.

42 ENGINEERING↗

DOE OSTI2021

Resampling and data augmentation for short-term PV output prediction based on an imbalanced sky images dataset using convolutional neural networks

Integrating photovoltaics (PV) into electricity grids is challenged by potentially large fluctuations in power generation. In recent years, sky image-based PV output prediction using convolutional neural networks (CNNs) has emerged as a promising approach to forecasting fluctuations. A key challenge is imbalanced sky image datasets: because of the geography of solar PV system installations, sky image datasets are often rich in sunny condition data but deficient in cloudy condition data. This imbalance contrasts with the fact that model errors are dominated by cloudy condition performance. In this study, we attempt to remedy this by exploring the enrichment and augmentation of an imbalanced sky images dataset for two PV output prediction tasks: nowcasting (predicting concurrent PV output) and forecasting (predicting 15-minute-ahead future PV output). We empirically examine the efficacy of using different resampling and data augmentation approaches to create a rebalanced dataset for model development. A three-stage greedy search is used to determine the optimal resampling approach, data augmentation techniques and over-sampling rate. The results show that for the nowcast problem, resampling and data augmentation can effectively enhance the model performance, reducing overall root mean squared error (RMSE) by an average of 4%, or a 15 std. (standard deviation) of improvement compared to the variability of the baseline model. In contrast, the treatment RMSE for the forecast problem nearly always overlaps the baseline performance at the ± 2 std. level. The optimal resampling approach expands on the original dataset by over-sampling the minority cloudy data, with the best results from large over-sampling rate (e.g., 4 ~ 6 times over-sampling of cloudy images).

14 SOLAR ENERGY↗

DOE OSTI2023

County-level assessment of behind-the-meter solar and storage to mitigate long duration power interruptions for residential customers

Customer concerns over electric system resilience could drive early adoption of behind-the-meter solar-plus-storage (BTM PVESS), especially as wildfire, hurricane, and other climate-driven risks to electric grids become more pronounced. However, the resilience benefits of BTM PVESS are poorly understood, especially for residential customers, owing to lack of data and methodological challenges, making it difficult to forecast adoption trends. In this paper, we develop a methodology to model the performance of BTM PVESS in providing backup power across a wide range of customer types, geography / climate conditions, and long duration power interruption scenarios, considering both whole-building backup and backup of specific critical loads. We combine novel, disaggregated end-use load profiles across the continental United States with temporally and geospatially aligned solar generation estimates. We then implement a PVESS dispatch algorithm to calculate the amount of load served during interruptions. We find that PVESS with 10 kWh of storage can meet a limited set of critical loads in most United States counties during any month of the year, though this capability drops to meeting only 86% of critical load, averaged across all counties and months, when heating and cooling are considered critical. Backup performance is lowest in winter months where electric heat is common (southeast and northwest U.S.) and in summer months in places with large cooling loads (southwest and southeast U.S.). Winter backup performance varies by roughly 20% depending on infiltration rates, while summer performance varies by close to 15% depending on the efficiency of the central air-conditioning system. Differences in temperature set-points in Harris County correspond to a 40% range in winter backup performance and a 20% range in summer performance. Economic calculations show that a customer’s resilience value of PVESS must be high to motivate adoption of these systems.

14 SOLAR ENERGY↗

DOE OSTI2021

EPIsembleVis: A geo-visual analysis and comparison of the prediction ensembles of multiple COVID-19 models

In this work, we present EPIsembleVis, a web-based comparative visual analysis tool for evaluating the consistency of multiple COVID-19 prediction models. Our approach analyzes a collection of COVID-19 predictions from different epidemiological models as an ensemble and utilizes two metrics to quantify model performance. These metrics include (a) prediction uncertainty (represented as the dispersion of predictions in each ensemble) and (b) prediction error (calculated by comparing individual model predictions with the recorded data). Through an interactive visual interface, our approach provides a data-driven workflow for (a) selecting and constructing the COVID-19 model prediction ensemble based on the spatiotemporal overlap of available predictions of multiple epidemiological models, (b) quantifying the model performance using both the uncertainty of each model prediction ensemble, and the error of each ensemble member that represents individual model predictions, and (c) visualizing the spatiotemporal variability in the projection performance of individual models using a suite of novel ensemble visualization techniques, such as the data availability map, a spatiotemporal textured-tile calendar, multivariate rose chart, and time-series leaflet glyph. We demonstrate the capability of our ensemble visual interface through a case study that investigates the performance of weekly COVID-19 predictions, which are provided through the COVID-19 Forecast Hub UMass-Amherst Influenza Forecasting Center of Excellence [47] for the United States and United States Territories. The EPIsembleVis tool is implemented using open-source web technologies and adaptive system design, rendering it interoperable with Elasticsearch and Kibana for automatically ingesting COVID-19 predictions from online repositories, and it is generalizable for analyzing worldwide projections from more epidemiological models.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2019

Data-Driven Load Modeling and Forecasting of Residential Appliances

The expansion of residential demand side management programs and increased deployment of controllable loads require accurate appliance-level load modeling and forecasting. This paper proposes a conditional hidden semi-Markov model to describe the probabilistic nature of residential appliance demand. Model parameters are estimated directly from power consumption data using scalable statistical learning methods. We also propose an algorithm for short-term load forecasting as a key application for appliance-level load models. Case studies performed using granular sub-metered power measurements from various types of appliances demonstrate the effectiveness of the proposed load model for short-term prediction.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗