Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “performance forecasting”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

Pre-Tropical Cyclone Squall Lines and the Connection to the Diurnal Cycle in Hurricane Laura (2020)

Previous studies on the tropical cyclone (TC) diurnal cycle have shown in observations and modeling the presence of outward propagating squall lines. These squall lines were observed in several TCs during the 2020 Atlantic hurricane season. Of these squall lines, one observed in Hurricane Laura made landfall over 13 hours prior to the hurricane’s eye. This squall was responsible for numerous tornado warnings, which disrupted preparations and evacuations ahead of the storm’s landfall. This study seeks to characterize these squall lines and their environmental and thermodynamic characteristics, determine whether they behave more like midlatitude squall lines or tropical cyclone rain bands, and assess the performance of the convection-allowing High Resolution Rapid Refresh model in forecasting them over the ocean and over land. By using a combination of operational radar data, a network of surface weather observations from land and sea, satellite data, and HRRR model output, this case will undergo an extensive evaluation based on criteria from past literature in order to better understand these features as a whole and in relation to the diurnal cycle.

Vivian L Brasfield↗

Observational Analysis of Atlantic Basin Tropical Cyclone Squall Lines and Relationship to the Diurnal Cycle

Previous studies on the tropical cyclone (TC) diurnal cycle have shown in observations and modeling the presence of outward propagating squall lines. These squall lines were observed in several TCs during recent Atlantic hurricane seasons. Of these squall lines, one observed in Hurricane Laura made landfall over 14 hours prior to the hurricane’s eye. This squall was responsible for 40 tornado warnings, which disrupted preparations and evacuations ahead of the storm’s landfall. This study seeks to characterize these squall lines and their environmental and thermodynamic characteristics, determine whether they behave more like midlatitude squall lines or tropical cyclone rain bands, and assess the performance of the convection-allowing High Resolution Rapid Refresh model in forecasting them over the ocean and over land. By using a combination of operational radar data, a network of surface weather observations from land and sea, satellite data, and HRRR model output, this case will undergo an extensive evaluation based on criteria from past literature in order to better understand these features as a whole and in relation to the diurnal cycle.

Vivian Brasfield↗

Enabling the Assimilation of CrIS Shortwave Infrared Observations in Global NWP at NOAA. Part II: OSEs and Results

The assimilation of data from hyperspectral infrared sounders in global data assimilation systems has historically been focused on observations in the longwave infrared (LWIR) region of the spectrum (650-1100 cm−1), despite the often concurrent availability of measurements from the shortwave infrared (SWIR) region of the spectrum (2150-2550 cm−1), because issues (like solar effects) have generally prevented the assimilation of SWIR observations. Recent advances in radiative transfer models have worked to address some of the previous challenges in simulating SWIR observations, and the assimilation of SWIR data (e.g. from potential future small-satellites) is now a feasible prospect. Still, a better understanding of how these observations perform in a data assimilation system and impact resulting analyses and NWP forecasts is necessary. In this study, the value of SWIR observations in global NWP is assessed by assimilating SWIR observations from the Cross-track Infrared Sounder (CrIS) in NOAA’s Global Data Assimilation System (GDAS). The methodologies used to enable the assimilation of these observations, including the implementation of a scene-dependent observation error and the enhancement of quality control procedures, are discussed, as are the results of Observing System Experiments (OSEs) conducted to evaluate the impact of assimilating SWIR observations on forecast skill. The overall results show that SWIR assimilation produces similar forecast impacts to LWIR assimilation. The ability to demonstrate that the assimilation or SWIR observations in NWP is a realistic prospect may help to shape future constellations of small-satellites to serve as a beneficial complement to the current constellation if hyperspectral IR sounders.

Erin Jones↗

Spatio-Temporal Denoising Graph Autoencoders with Data Augmentation for Missing Photovoltaic Data Imputation

The integration of the global Photovoltaic (PV) market with real time data-loggers has enabled large scale PV data analytical pipelines for power forecasting and long-term reliability assessment of PV fleets. Nevertheless, the performance of PV data analysis heavily depends on the quality of PV timeseries data. This paper proposes a novel Spatio-Temporal Denoising Graph Autoencoder (STD-GAE) framework to impute missing PV Power Data. STDGAE exploits temporal correlation, spatial coherence, and value dependencies from domain knowledge to recover missing data. It is empowered by two modules. (1) To cope with sparse yet various scenarios of missing data, STD-GAE incorporates a domain-knowledge aware data augmentation module that creates plausible variations of missing data patterns. This generalizes STD-GAE to robust imputation over different seasons and environment. (2) STD-GAE nontrivially integrates spatiotemporal graph convolution layers (to recover local missing data by observed “neighboring” PV plants) and denoising autoencoder (to recover corrupted data from augmented counterpart) to improve the accuracy of imputation accuracy at PV fleet level. We have evaluated our proposed model on two realworld PV datasets. Experimental results show that STD-GAE can achieve a gain of 43.14% in imputation accuracy and remains less sensitive to missing rate, different seasons, and missing scenarios, compared with state-of-the-art data imputation methods such as MIDA and LRTC-TNN.

Fan, Yangxin↗

Evaluation of Improved Pushback Forecasts Derived from Airline Ground Operations Data

Accurate and timely predictions of airline pushbacks can potentially lead to improved performance of automated decision-support tools for airport surface traffic, thus reducing the variability and average duration of costly airline delays. One factor which affects the realization of these benefits is the level of uncertainty inherent in the turn processes. To characterize this inherent uncertainty, three techniques are developed for predicting time-to-go until pushback as a function of available ground-time; elapsed ground-time; and the status (not-started/in-progress/completed) of individual turn processes (cleaning, fueling, etc.). These techniques are tested against a large and detailed dataset covering approximately l0(exp 4) real-world turn operations obtained through collaboration with Deutsche Lufthansa AG. Even after the dataset is filtered to obtain a sample of turn operations with minimal uncertainty, the standard deviation of forecast error for all three techniques is lower-bounded away from zero, indicating that turn operations have a significant stochastic component. This lower-bound result shows that decision-support tools must be designed to incorporate robust mechanisms for coping with pushback demand stochasticity, rather than treating the pushback demand process as a known deterministic input.

Carr, Francis↗

A comparative study of two-way and offline coupled WRF v3.4 and CMAQ v5.0.2 over the contiguous US: performance evaluation and impacts of chemistry–meteorology feedbacks on air quality

The two-way coupled Weather Research and Forecasting and Community Multiscale Air Quality (WRF-CMAQ) model has been developed to more realistically represent the atmosphere by accounting for complex chemistry–meteorology feedbacks. In this study, we present a comparative analysis of two-way (with consideration of both aerosol direct and indirect effects) and offline coupled WRF v3.4 and CMAQ v5.0.2 over the contiguous US. Long-term (5 years from 2008 to 2012) simulations using WRF-CMAQ with both offline and two-way coupling modes are carried out with anthropogenic emissions based on multiple years of the U.S. National Emission Inventory and chemical initial and boundary conditions derived from an advanced Earth system model (i.e., a modified version of the Community Earth System Model/Community Atmospheric Model). The comprehensive model evaluations show that both two-way WRF-CMAQ and WRF-only simulations perform well for major meteorological variables such as temperature at 2 m, relative humidity at 2 m, wind speed at 10 m, precipitation (except for against the National Climatic Data Center data), and shortwave and longwave radiation. Both two-way and offline CMAQ also show good performance for ozone (O3) and fine particulate matter (PM 2.5 ). Due to the consideration of aerosol direct and indirect effects, two-way WRF-CMAQ shows improved performance over offline coupled WRF and CMAQ in terms of spatiotemporal distributions and statistics, especially for radiation, cloud forcing, O 3 , sulfate, nitrate, ammonium, elemental carbon, tropospheric O 3 residual, and column nitrogen dioxide (NO 2 ). For example, the mean biases have been reduced by more than 10 W m –2 for shortwave radiation and cloud radiative forcing and by more than 2 ppb for max 8 h O 3 . However, relatively large biases still exist for cloud predictions, some PM 2.5 species, and PM 10 that warrant follow-up studies to better understand those issues. The impacts of chemistry–meteorological feedbacks are found to play important roles in affecting regional air quality in the US by reducing domain-average concentrations of carbon monoxide (CO), O 3 , nitrogen oxide (NO x ), volatile organic compounds (VOCs), and PM 2.5 by 3.1 % (up to 27.8 %), 4.2 % (up to 16.2 %), 6.6 % (up to 50.9 %), 5.8 % (up to 46.6 %), and 8.6 % (up to 49.1 %), respectively, mainly due to reduced radiation, temperature, and wind speed. The overall performance of the two-way coupled WRF-CMAQ model achieved in this work is generally good or satisfactory and the improved performance for two-way coupled WRF-CMAQ should be considered along with other factors in developing future model applications to inform policy making.

58 GEOSCIENCES↗

Evaluation of the synoptic and mesoscale predictive capabilities of a mesoscale atmospheric simulation system

The overall performance characteristics of a limited area, hydrostatic, fine (52 km) mesh, primitive equation, numerical weather prediction model are determined in anticipation of satellite data assimilations with the model. The synoptic and mesoscale predictive capabilities of version 2.0 of this model, the Mesoscale Atmospheric Simulation System (MASS 2.0), were evaluated. The two part study is based on a sample of approximately thirty 12h and 24h forecasts of atmospheric flow patterns during spring and early summer. The synoptic scale evaluation results benchmark the performance of MASS 2.0 against that of an operational, synoptic scale weather prediction model, the Limited area Fine Mesh (LFM). The large sample allows for the calculation of statistically significant measures of forecast accuracy and the determination of systematic model errors. The synoptic scale benchmark is required before unsmoothed mesoscale forecast fields can be seriously considered.

Koch, S. E.↗

LAF-Net: A Deep Residual and Cross-Attention Framework for Day-Ahead Load Forecasting: Preprint

Accurate day-ahead load forecasting is essential for reliable power system operations and market efficiency. System operators such as the Midcontinent Independent System Operator (MISO) rely on forecasts from multiple vendors, yet combining them effectively remains a persistent challenge due to vendor-specific biases. This paper presents a novel LSTM-Attention Fusion Network with Error Representation (LAF-Net) that enhances day-ahead hourly load forecasting through deep residual learning and multi-modal cross-attention. The proposed model builds a historical error memory from past vendor performance and dynamically queries it with future hour context to generate adaptive, hour-specific trust weights for each vendor. A bounded residual correction further refines forecasts by mitigating systematic and temporally localized errors. Tested on real MISO LBA data with multi-vendor forecasts, LAF-Net consistently outperforms the best vendor baseline across all 38 LBAs, achieving more than a 40% reduction in system-level mean absolute error (MAE) during peak load hours relative to the best vendor baseline.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Evaluation of WRF-Solar Cloud Forecast Using the NSRDB: Preprint

Cloud forecast is a crucial component in predicting solar irradiance from numerical weather prediction (NWP) models. Assessing cloud properties from the NWP models requires significant work due to the need for high-quality data, spatial analysis covering model extent, and detailed analysis of model performance for different types of clouds. This study presents an evaluation of the WRF-Solar cloud forecast using the National Solar Radiation Database (NSRDB). We propose an evaluation framework applied to a single model prediction as well as ensemble-based forecasts. Various cloud detection metrics are calculated when comparing with the satellite-derived dataset. The mismatched clouds from the WRF-Solar model are quantified using nine cloud types classified by cloud top height and cloud optical depth. The results based on the WRF-Solar forecasts covering the entire U.S. for the full year of 2018 shows mismatched cloud frequency in the range of 8% - 46% for thick and high-level (deep convective) to thin and low-level (cumulus) clouds.

cloud mask forecast↗

Machine learning-enhanced MPC for demand flexibility in small commercial buildings: An experimental study

Small- and medium-sized commercial buildings (SMCBs) represent the majority of U.S. commercial building stock and a significant share of peak electricity demand, yet they often lack centralized building automation systems, representing a significant untapped resource for urban energy management. This infrastructure gap makes advanced control implementation challenging, limiting the potential for widespread demand flexibility. Model Predictive Control (MPC) has shown strong potential for load shifting, peak demand reduction, and cost savings, but its effectiveness is hindered by unmeasured disturbances such as internal heat gains. This paper presents a Hybrid MPC framework that integrates a physics-based gray-box building thermal model, identified using a lumped disturbance (LD) approach, with a machine learning (ML) model for forecasting unmeasured disturbances. The hybrid approach is designed for buildings with multiple individually controlled heat pump and thermostat pairs, common in SMCBs, and aims to optimize coordinated scheduling of multiple heat pumps under dynamic electricity pricing while respecting comfort constraints. The methodology is validated through both simulations of case study buildings and experimental studies at a highly-instrumented test facility. Simulation results show that the Hybrid MPC achieves substantial load shifting and peak demand reduction, approaching the performance of an ideal MPC with perfect disturbance knowledge, and outperforming a conventional MPC without disturbance forecasting. In experiments, the Hybrid MPC reduced daily HVAC energy costs by 8.7%, peak-price time load (load shifting) by 41.7%, and peak demand by 29.2% compared to baseline control, demonstrating comparable benefits to the 11.6% cost savings, 42.9% load shifting, and 23.2% peak reduction of the ideal MPC. These results demonstrate that the proposed hybrid modeling approach can significantly improve MPC performance in real-world SMCB applications without requiring additional disturbance measurements.

Demand Flexibility↗

Stratospheric Analysis and Forecasting in the Northern Winter of 1999/2000: The NASA DAO's GEOS-3 System

An evaluation is presented of the performance in the northern winter 1999/2000 of the GEOS-3 troposphere-stratosphere data assimilation system (DAS). The impacts of the two main input data types are assessed: upper-air soundings (sondes) provide wind and temperature information and satellite-based (Tiros Operational Vertical Sounders: TOVS) give estimates of the thermal structure. It is shown that in the low stratosphere (300-70hPa) the analyses are generally slightly warmer than the sonde data, but colder than the TOVS data; this relationship reverses between 70 and 10 hPa. There are geographical biases, related to the spatial and temporal coverage of the observation types and to the statistical weights assigned to them in the DAS. Forecasts show a tendency to reduce zonal asymmetries in the atmospheric flow and to suppress stratospheric temperature minima. In the DAS, the analysis increments compensate for this, but it leads to important biases in the multi-day forecasts. The analysis increments are as large as the diabatic forcing in the lower polar stratosphere, indicating a substantial model bias. The results provide important insights into the roles of different data types and the circulation model in producing accurate analyses for studies of polar chemistry and physical processes.

Pawson, Steven↗

Benchmarking of Solar Irradiance Nowcast Performance Derived from All-Sky Imagers

Fluctuations of the incoming solar irradiance impact the power generation from photovoltaic and concentrating solar thermal power plants. Accurate solar nowcasting becomes necessary to detect these sudden changes of generated power and to provide the desired information for optimal exploitation of solar systems. In the framework of the International Energy Agency's Photovoltaic Power Systems Program Task 16, a benchmarking exercise has been conducted relying on a bouquet of solar nowcasting methodologies by all-sky imagers (ASI). In this paper, four ASI systems nowcast the Global Horizontal Irradiance (GHI) with a time forecast ranging from 1 to 20 min during 28 days with variable cloud conditions spanning from September to November 2019 in southern Spain. All ASIs demonstrated their ability to accurately nowcast GHI, with RMSE ranging from 6.9% to 18.1%. Under cloudy conditions, all ASIs' nowcasts outperform the persistence models. Under clear skies, three ASIs are better than persistence. Discrepancies in the observed nowcasting performance become larger at increasing forecast horizons. The findings of this study highlight the feasibility of ASIs to reliably nowcast GHI at different sky conditions, time intervals and horizons. Such nowcasts can be used either to estimate solar power at distant times or detect sudden GHI fluctuations.

all-sky imagers↗

Confidence-weighted integration of human and machine judgments for superior decision-making

Large language models (LLMs) can surpass humans in certain forecasting tasks. What role does this leave for humans in the overall decision process? One possibility is that humans, despite performing worse than LLMs, can still add value when teamed with them. A human and machine team can surpass each individual teammate when team members’ confidence is well calibrated and team members diverge in which tasks they find difficult (i.e., calibration and diversity are needed). We simplified and extended a Bayesian approach to combining judgments using a logistic regression framework that integrates confidence-weighted judgments for any number of team members. Using this straightforward method, we demonstrated its effectiveness in both image classification and neuroscience forecasting tasks. Combining human judgments with one or more machines consistently improved overall team performance. Our hope is that this simple and effective strategy for integrating the judgments of humans and machines will lead to productive collaborations.

97 MATHEMATICS AND COMPUTING↗

Reinforcement learning based automated history matching for improved hydrocarbon production forecast

History matching aims to find a numerical reservoir model that can be used to predict the reservoir performance. An engineer and model calibration (data inversion) method are required to adjust various parameters/properties of the numerical model in order to match the reservoir production history. In this study, we develop deep neural networks within the reinforcement learning framework to achieve automated history matching that will reduce engineers’ efforts, human bias, automatically and intelligently explore the parameter space, and remove the need of large set of labeled training data. To that end, a fast-marching-based reservoir simulator is encapsulated as an environment for the proposed reinforcement learning. The deep neural-network-based learning agent interacts with the reservoir simulator within reinforcement learning framework to achieve the automated history matching. Reinforcement learning techniques, such as discrete Deep Q Network and continuous Deep Deterministic Policy Gradients, are used toth, used to train the learning agents. The continuous actions enable the Deep Deterministic Policy Gradients to explore more states at each iteration in a a learning episode; consequently, a better history matching is achieved using this algorithm as compared to Deep Q Network. For simplified dual-target composite reservoir models, the best history-matching performances of the discrete and continuous learning methods in terms of normalized root mean square errors are 0.0447 and 0.0038, respectively. Furthermore, our study shows that continuous action space achieved by the deep deterministic policy gradient drastically outperforms deep Q network.

42 ENGINEERING↗

Clouds in GEOS-5

The GEOS-5 atmospheric model is being developed as a weather-and-climate capable model. It must perform well in assimilation mode as well as in weather and climate simulations and forecasts and in coupled chemistry-climate simulations. In developing GEOS-5, attention has focused on the representation of moist processes. The moist physics package uses a single phase prognostic condensate and a prognostic cloud fraction. Two separate cloud types are distinguished by their source: "anvil" cloud originates in detraining convection, and large-scale cloud originates in a PDF-based condensation calculation. Ice and liquid phases for each cloud type are considered. Once created, condensate and fraction from the anvil and statistical cloud types experience the same loss processes: evaporation of condensate and fraction, auto-conversion of liquid or mixed phase condensate, sedimentation of frozen condensate, and accretion of condensate by falling precipitation. The convective parameterization scheme is the Relaxed Arakawa-Schubert, or RAS, scheme. Satellite data are used to evaluate the performance of the moist physics packages and help in their tuning. In addition, analysis of and comparisons to cloud-resolving models such as the Goddard Cumulus Ensemble model are used to help improve the PDFs used in the moist physics. The presentation will show some of our evaluations including precipitation diagnostics.

Bacmeister, Julio↗

A stochastic-dynamical approach to the study of the natural variability of the climate

A method, suggested by Leith (1975), which employed stochastic-dynamic forecasts obtained from a general circulation model in such a way as to satisfy the definition of climatic noise, was used to validate assumptions accounting for the effects of external influences in estimating the climatic noise. Two assumptions were investigated: (1) that the weather fluctuations can be represented as a Markov process, and (2) that changing external conditions do not influence the atmosphere's statistical properties on short time scales. The general circulation model's simulation of the daily weather fluctuations was generated by performing integrations with prescribed climatological boundary conditions for random initial atmospheric states, with resulting dynamical forecasts providing an ensemble of simulated data for the autoregressive modeling of weather fluctuations. To estimate the climatic noise from the observational data (consisting of hourly values of sea level pressure and surface temperature at 54 U.S. stations for the month of January for the years 1949-1975) use of the short time-scale assumption is made. The simulated and observed data were found not to be consistent with either white noise or a Markov process of weather fluctuations. Good agreement was found between the results of the hypothetical testing of the simulated and the observed surface temperatures; and only partial support was found for the short time-scale assumption, i.e., for sea level pressure.

Straus, D. M.↗

A Statistical Model to Predict the Extratropical Transition of Tropical Cyclones

This paper introduces a logistic regression model for the extratropical transition(ET) of tropical cyclones in the North Atlantic and the Western North Pacific, using elastic net regularization to select predictors and estimate coefficients.Predictors are chosen from the 1979-2017 best track and reanalysis datasets, and verification is done against the tropical/extratropical labels in the best track data. In an independent test set, the model skillfully predicts ET at lead times up to two days, with latitude and sea surface temperature as its most important predictors. At a lead time of 24 h, it predicts ET with a Matthews correlation coefficient of 0.4 in the North Atlantic, and 0.6 in the Western North Pacific. It identifies 80% of storms undergoing ET in the North Atlantic, and 92% of those in the Western North Pacific. 90% of transition time errors are less than 24 h. Select examples of the model's performance on individual storms illustrate its strengths and weaknesses.Two versions of the model are presented: an "operational model" that may provide baseline guidance for operational forecasts, and a "hazard model"that can be integrated into statistical TC risk models. As instantaneous diagnostics for tropical/extratropical status, both models' zero lead time predictions perform about as well as the widely used Cyclone Phase Space (CPS) in the Western North Pacific and better than the CPS in the North Atlantic, and predict the timings of the transitions better than CPS in both basins.

Melanie Bieli↗

Resampling and data augmentation for short-term PV output prediction based on an imbalanced sky images dataset using convolutional neural networks

Integrating photovoltaics (PV) into electricity grids is challenged by potentially large fluctuations in power generation. In recent years, sky image-based PV output prediction using convolutional neural networks (CNNs) has emerged as a promising approach to forecasting fluctuations. A key challenge is imbalanced sky image datasets: because of the geography of solar PV system installations, sky image datasets are often rich in sunny condition data but deficient in cloudy condition data. This imbalance contrasts with the fact that model errors are dominated by cloudy condition performance. In this study, we attempt to remedy this by exploring the enrichment and augmentation of an imbalanced sky images dataset for two PV output prediction tasks: nowcasting (predicting concurrent PV output) and forecasting (predicting 15-minute-ahead future PV output). We empirically examine the efficacy of using different resampling and data augmentation approaches to create a rebalanced dataset for model development. A three-stage greedy search is used to determine the optimal resampling approach, data augmentation techniques and over-sampling rate. The results show that for the nowcast problem, resampling and data augmentation can effectively enhance the model performance, reducing overall root mean squared error (RMSE) by an average of 4%, or a 15 std. (standard deviation) of improvement compared to the variability of the baseline model. In contrast, the treatment RMSE for the forecast problem nearly always overlaps the baseline performance at the ± 2 std. level. The optimal resampling approach expands on the original dataset by over-sampling the minority cloudy data, with the best results from large over-sampling rate (e.g., 4 ~ 6 times over-sampling of cloudy images).

14 SOLAR ENERGY↗