Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “performance forecasting”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

The Impacts of Horizontal Grid Spacing and Cumulus Parameterization on Subseasonal Prediction in a Global Convection-Permitting Model

Monthlong simulations targeting four Madden–Julian oscillation events made with several global model configurations are verified against observations to assess the roles of grid spacing and convective parameterization on the representation of tropical convection and midlatitude forecast skill. Specifically, the performance of a global convection-permitting model (CPM) configuration with a uniform 3-km mesh is compared to that of a global 15-km mesh with and without convective parameterization, and of a variable-resolution “channel” simulation using 3-km grid spacing only in the tropics with a scale-aware convection scheme. It is shown that global 3-km simulations produce realistic tropical precipitation statistics, except for an overall wet bias and delayed diurnal cycle. The channel simulation performs similarly, although with an unrealistically higher frequency of heavy rain. The 15-km simulations with and without cumulus schemes produce too much light and heavy tropical precipitation, respectively. Without convection parameterization, the 15-km global model produces unrealistically abundant, short-lived, and intense convection throughout the tropics. Only the global CPM configuration is able to capture eastward-propagating Madden–Julian oscillation events, and the 15-km runs favor stationary or westward-propagating convection organized at the planetary scale. The global 3-km CPM exhibits the highest extratropical forecast skill aloft and at the surface, particularly during week 3 of each hindcast. Although more cases are needed to confirm these results, this study highlights many potential benefits of using global CPMs for subseasonal forecasting. Furthermore, results show that alternatives to global convection-permitting resolution—using coarser or spatially variable resolution—feature compromises that may reduce their predictive performance.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Dilated causal convolutional neural networks for forecasting zone airflow to estimate short-term energy consumption

Here this paper investigates the use of dilated causal convolutional neural networks for fine- grained temporal forecasting of building zone states. Specifically, we build and evaluate models using a small set of exogenous features (e.g., external temperature) to autoregressively predict zone airflow setpoints every minute for a 24-hour prediction window. We carefully explore the trade-off between generality and specificity in these models, training and evaluating them based on zone, zone type, month, season, and combinations thereof. When evaluated for a commercial office building in Eastern Washington with 16 zones served by variable air volume air handling units, we find that the highest performance comes from a zone-specific, season-agnostic approach; with it, we obtain an R 2 of 0.704 (averaged over zones) and an average normalized root mean square error (nRMSE) of 0.111. In contrast, the most general model (trained across all zones and seasons) yields an R 2 of only 0.416 and a nRMSE of 0.168, while a baseline zone-specific reduced order model obtains 0.443 R 2 and 0.159 nRMSE. We also report on factors affecting airflow forecasting performance, on the ability of models trained on a specific zone to generalize to other zones, and on the capability of those models trained on a specific month to generalize to other months.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Intercomparison of Deep Learning Model Architectures for Atmospheric River Prediction

With a rapid surge in the application of machine learning (ML) for a diverse range of tasks in climate science, the present study addresses a challenge for climate scientists when selecting the optimal ML or deep learning (DL) architecture for a given application. In particular, a DL intercomparison study was performed with a focus on forecasting the position of atmospheric rivers (ARs) on short-range time scales (up to 5-day lead times). AR predictions from multiple DL architectures, including various types of convolutional autoencoders and a vision transformer (ViT), were compared against ECMWF ERA5 reanalysis and hindcasts from a global climate model. DL models with similar trainable parameters were trained on ERA5 reanalysis data and AR positions derived from a thresholding algorithm to ensure a fair comparison among the DL models. Each model’s performance and accuracy in forecasting AR location and key input fields within a 5-day window were assessed using metrics of root-mean-square error, anomaly correlation, and mean intersection over union. The ViT architecture outperformed other autoencoder models in most of the metrics. Incorporating additional meteorological fields only yielded slight improvements in forecasting certain fields at longer lead times. The results also suggest that a smaller number of input time steps or smaller number of autoregressive steps can achieve better prediction skills, while also improving the overall computational efficiency. This research offers valuable insights into the strengths and weaknesses of different DL techniques for AR forecasting, hopefully guiding the development of improved models for forecasting this phenomenon.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Airport Traffic Management and Planning Framework

Initial results from the Athena project show that high-performance computing and high-fidelity traffic simulation can help guide airport traffic management decisions and understand operating bottlenecks.

ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2023

Learning to concentrate: multi-tracer forecasts on local primordial non-Gaussianity with machine-learned bias

Local primordial non-Gaussianity (LPNG) is predicted by many non-minimal models of inflation, and creates a scale-dependent contribution to the power spectrum of large-scale structure (LSS) tracers, whose amplitude is characterized by b Φ . Knowledge of b Φ for the observed tracer population is therefore crucial for learning about inflation from LSS. Recently, it has been shown that the relationship between linear bias b 1 and b Φ for simulated halos exhibits significant secondary dependence on halo concentration. We leverage this fact to forecast multi-tracer constraints on ${f}^{loc}_{NL}$. We train a machine learning model on observable properties of simulated IllustrisTNG galaxies to predict b Φ for samples constructed to approximate DESI emission line galaxies (ELGs) and luminous red galaxies (LRGs). We find σ(${f}^{loc}_{NL}$) = 2.3, and σ(${f}^{loc}_{NL}$) = 3.7, respectively. These forecasted errors are roughly factors of 3, and 35% improvements over the single-tracer case for each sample, respectively. When considering both ELGs and LRGs in their overlap region, we forecast σ(${f}^{loc}_{NL}$) = 1.5 is attainable with our learned model, more than a factor of 3 improvement over the single-tracer case, while the ideal split by b Φ could reach σ(${f}^{loc}_{NL}$) < 1. In conclusion, we also perform multi-tracer forecasts for upcoming spectroscopic surveys targeting LPNG (MegaMapper, SPHEREx) and show that splitting tracer samples by b Φ can lead to an order-of-magnitude reduction in projected σ(${f}^{loc}_{NL}$) for these surveys.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

The Impact of Constrained Data Assimilation on the Forecasts of Three Convection Systems During the ARM MC3E Field Campaign

A constrained data assimilation (CDA) system based on the ensemble variational (EnVar) method and physical constraints of mass and water conservations is evaluated through three convective cases during the Midlatitude Continental Convective Clouds Experiment (MC3E) of the Atmospheric Radiation Measurement (ARM) program. Compared to the original data assimilation (ODA), the CDA is shown to perform better in the forecasted state variables and simulated precipitation. The CDA is also shown to greatly mitigate the loss of forecast skills in observation denial experiments when radar radial winds are withheld in the assimilation. Modifications to the algorithm and sensitivities of the CDA to the calculation of the time tendencies in the constraints are described.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Managing Uncertainty and Flexibility in Day-Ahead Electricity Markets

Net load imbalances from day ahead forecasts can lead to significant grid operations costs and are expected to increase as variable renewable energy adoption grows. We propose a new wholesale market product to manage the risk of net load imbalances called Flexibility Options. This product relies on probabilistic forecasts to estimate flexibility demand and would be co-optimized in the day-ahead market. We also propose stochastic methods that enable DER and flexible load aggregators to participate in flexibility markets while considering the uncertainty in weather and occupant behavior.

day-ahead market↗
DOE OSTI2024

Dark Energy Survey: Galaxy sample for the baryonic acoustic oscillation measurement from the final dataset

In this paper, we present and validate the galaxy sample used for the analysis of the baryon acoustic oscillation (BAO) signal in the Dark Energy Survey (DES) Y6 data. The definition is based on a color and redshift-dependent magnitude cut optimized to select galaxies at redshifts higher than 0.6, while ensuring a high-quality photo- z determination. The optimization is performed using a Fisher forecast algorithm, finding the optimal i -magnitude cut to be given by i < 19.64 + 2.894 z ph . For the optimal sample, we forecast an increase in precision in the BAO measurement of ∼ 25 % with respect to the Y3 analysis. Our BAO sample has a total of 15,937,556 galaxies in the redshift range 0.6 < z ph < 1.2 , and its angular mask covers 4 , 273.42 deg 2 to a depth of i = 22.5 . We validate its redshift distributions with three different methods: directional neighborhood fitting algorithm (DNF), which is our primary photo- z estimation; direct calibration with spectroscopic redshifts from VIPERS, which is a spectroscopic galaxy sample that overlaps with our BAO sample and is complete within our selection cuts; and clustering redshift using SDSS galaxies. The fiducial redshift distribution is a combination of these three techniques performed by modifying the mean and width of the DNF distributions to match those of VIPERS and clustering redshift. In this paper, we also describe the methodology used to mitigate the effect of observational systematics, which is analogous to the one used in the Y3 analysis. This paper is one of the two dedicated to the analysis of the BAO signal in DES Y6. In its companion paper, we present the angular diameter distance constraints obtained through the fitting to the BAO scale.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

The economic value of photovoltaic performance loss mitigation in electricity spot markets

Photovoltaic (PV) performance is affected by reversible and irreversible losses. These can typically be mitigated through responsive and proactive operations and maintenance (O&M) activities. However, to generate profit, the cost of O&M must be lower than the value of the recovered electricity. This value depends both on the amount of recovered energy and on the electricity prices, which can vary significantly over time in spot markets. The present work investigates the impact of the electricity price variability on the PV profitability and on the related O&M activities in Italy, Portugal, and Spain. Here, it is found that the PV revenues varied by 1.6 × to 1.8 × within the investigated countries in the last 5 years. Moreover, forecasts predict higher average prices in the current decade compared to the previous one. These will increase the future PV revenues by up to 60% by 2030 compared to their 2015–2020 mean values. These higher revenues will make more funds available for better maintenance and for higher quality components, potentially leading to even higher energy yield and profits. Linearly growing or constant price assumptions cannot fully reproduce these expected price trends. Furthermore, significant price fluctuations can lead to unexpected scenarios and alter the predictions.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2026

The Simons Observatory: forecasted constraints on primordial gravitational waves with the expanded array of Small Aperture Telescopes

We present updated forecasts for the scientific performance of the degree-scale (0.5 deg FWHM at 93 GHz), deep-field survey to be conducted by the Simons Observatory (SO). By 2027, the SO Small Aperture Telescope (SAT) complement will be doubled from three to six telescopes, including a doubling of the detector count in the 93 GHz and 145 GHz channels to 48,160 detectors. Combined with a planned extension of the survey duration to 2035, this expansion will significantly enhance SO's search for a B-mode signal in the polarisation of the cosmic microwave background, a potential signature of gravitational waves produced in the very early Universe. Assuming a 1/f noise model with knee multipole ℓ knee = 50 and a moderately complex model for Galactic foregrounds, we forecast a 1σ (or 68% confidence level) constraint on the tensor-to-scalar ratio r of σ r = 1.2 × 10 -3 , assuming no primordial B-modes are present. This forecast assumes that 70% of the B-mode lensing signal can ultimately be removed using high resolution observations from the SO Large Aperture Telescope (LAT) and overlapping large-scale structure surveys. For more optimistic assumptions regarding foregrounds and noise, and assuming the same level of delensing, this forecast constraint improves to σ r = 7 × 10 -4 . These forecasts represent a major improvement in SO's constraining power, being a factor of around 2.5 times better than what could be achieved with the originally planned campaign, which assumed the existing three SATs would conduct a five-year survey.

CMBR experiments↗
DOE OSTI2020

CO 2 plume evolution in a depleted natural gas reservoir: Modeling of conformance uncertainty reduction over time

Uncertainty in the long-term fate of CO 2 injected for geologic carbon sequestration (GCS) is a significant barrier to the adoption of GCS as a greenhouse-gas emission-mitigation for industry and regulatory agencies alike. Here, we present a modeling study that demonstrates that the uncertainty in forecasts of GCS site performance decreases over time as monitoring data are used to update operational models. We consider a case study of GCS in a depleted natural gas reservoir, with CO 2 injection occurring over 20 years, with a 50-year post-injection site care period. We constructed a detailed model to generate the actual model output, which is considered synthetic observation data. A series of simpler operational models based on limited data and assumptions about how an operator would model such a site are then run and compared against actual model output at specific monitoring points after one year, two years, etc. The operational model is updated and improved using the synthetic observation data from the actual model at the same time intervals. Model parameter values and model features needed to be updated over time to improve matches to the actual model. These kinds of model adjustments would be a normal part of reservoir engineering and site management at GCS sites. Uncertainty in two key measures related to site performance decreases with time: extent of the CO 2 plume up-dip migration, and radial extent of the pressure pulse. This conclusion should help allay the concerns of industry and regulators about uncertainty in long-term fate of CO 2 at GCS sites.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

A pre-registered short-term forecasting study of COVID-19 in Germany and Poland during the second wave

Disease modelling has had considerable policy impact during the ongoing COVID-19 pandemic, and it is increasingly acknowledged that combining multiple models can improve the reliability of outputs. Here we report insights from ten weeks of collaborative short-term forecasting of COVID-19 in Germany and Poland (12 October–19 December 2020). The study period covers the onset of the second wave in both countries, with tightening non-pharmaceutical interventions (NPIs) and subsequently a decay (Poland) or plateau and renewed increase (Germany) in reported cases. Thirteen independent teams provided probabilistic real-time forecasts of COVID-19 cases and deaths. These were reported for lead times of one to four weeks, with evaluation focused on one- and two-week horizons, which are less affected by changing NPIs. Heterogeneity between forecasts was considerable both in terms of point predictions and forecast spread. Ensemble forecasts showed good relative performance, in particular in terms of coverage, but did not clearly dominate single-model predictions. The study was preregistered and will be followed up in future phases of the pandemic.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Security Enhancement of Network Constraint Grid-Edge Energy Management System

Network constrained grid edge energy management system (EMS) provides economic solution for active and reactive power dispatch of distributed energy resources (DERs) at the grid edge level. Grid edge EMS ensures secure interconnection of a circuit segment to the distribution system by maintaining grid code requirements (e.g. IEEE 1547–2018). Grid edge EMS is dependent on communication to receive load measurement, which brings a risk of unobservable false data injection attacks (FDIAs). To mitigate the risk, this paper proposes a framework to enhance resilient operation of grid edge EMS by detecting the unobservable FDIAs on loads and replacing them with forecasted values. In this work, a two-step detection algorithm is proposed. In first step, conventional residual based algorithm is deployed. Autoencoder (AE) based data driven mechanism is included in second step to detect the presence of unobservable FDIAs. After ensuring the presence of FDIA, its specific location is detected by checking the maximum residue values till the predefined threshold value is reached. Detected false data injected loads are then replaced with forecasted load values following long-short term memory (LSTM) based forecast to ensure resilient performance of grid edge EMS in the presence of attacks. This proposed security enhancement framework for grid edge EMS is evaluated in IEEE 13 bus system with three integrated DERs. Numerical simulation shows the validation of the proposed framework by reducing voltage violation in real operation of grid edge EMS.

cyber attack detection↗
DOE OSTI2023

Stochastic Price Generation for Evaluating Wholesale Electricity Market Bidding Strategies

This work presents a novel method for generating electricity price scenarios from statistical properties of past electricity prices using a hybrid statistical and reduced-form stochastic model. Previous work in applying stochastic differential equations (SDE) to model electricity prices has focused on daily average prices. To extend stochastic price generation methods to hourly or sub-hourly pricing, we address several weaknesses in the state-of-the-art: (1) we replace the mean-reversion component of the SDE with an ARIMA process that is better able to characterize the daily and weekly trends; (2) we extend the price-spike, or jump process to account for conditional probabilities of price spikes occurring in consecutive time steps by replacing the traditional Poisson process for modeling jumps with a generalized point process model inspired by brain neuron models; and (3) we replace the traditional method of estimating spike intensity with empirical variance with a Markov process based on observed price spike intensity transitions. The method is demonstrated with electricity prices from the US ERCOT market and a use-case example is provided for bidding an energy storage unit into the day-ahead and real-time energy markets of ERCOT using stochastic optimization methods. Results show that the the synthetic price model out performs a (naive) persistence forecast model by resulting in 24% to 47% more in profits over 168 simulated days.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Streamlining Ocean Dynamics Modeling with Fourier Neural Operators: A Multiobjective Hyperparameter and Architecture Optimization Approach

Training an effective deep learning model to learn ocean processes involves careful choices of various hyperparameters. We leverage DeepHyper’s advanced search algorithms for multiobjective optimization, streamlining the development of neural networks tailored for ocean modeling. The focus is on optimizing Fourier neural operators (FNOs), a data-driven model capable of simulating complex ocean behaviors. Selecting the correct model and tuning the hyperparameters are challenging tasks, requiring much effort to ensure model accuracy. DeepHyper allows efficient exploration of hyperparameters associated with data preprocessing, FNO architecture-related hyperparameters, and various model training strategies. We aim to obtain an optimal set of hyperparameters leading to the most performant model. Moreover, on top of the commonly used mean squared error for model training, we propose adopting the negative anomaly correlation coefficient as the additional loss term to improve model performance and investigate the potential trade-off between the two terms. The numerical experiments show that the optimal set of hyperparameters enhanced model performance in single timestepping forecasting and greatly exceeded the baseline configuration in the autoregressive rollout for long-horizon forecasting up to 30 days. Utilizing DeepHyper, we demonstrate an approach to enhance the use of FNO in ocean dynamics forecasting, offering a scalable solution with improved precision.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Huge ensembles – Part 2: Properties of a huge ensemble of hindcasts generated with spherical Fourier neural operators

Abstract. In Part 1, we created an ensemble based on spherical Fourier neural operators. As initial condition perturbations, we used bred vectors, and as model perturbations, we used multiple checkpoints trained independently from scratch. Based on diagnostics that assess the ensemble's physical fidelity, our ensemble has comparable performance to operational weather forecasting systems. However, it requires orders-of-magnitude fewer computational resources. Here in Part 2, we generate a huge ensemble (HENS), with 7424 members initialized each day of summer 2023. We enumerate the technical requirements for running huge ensembles at this scale. HENS precisely samples the tails of the forecast distribution and presents a detailed sampling of internal variability. HENS has two primary applications: (1) as a large dataset with which to study the statistics and drivers of extreme weather and (2) as a weather forecasting system. For extreme climate statistics, HENS samples events 4σ away from the ensemble mean. At each grid cell, HENS increases the skill of the most accurate ensemble member and enhances coverage of possible future trajectories. As a weather forecasting model, HENS issues extreme weather forecasts with better uncertainty quantification. It also reduces the probability of outlier events, in which the verification value lies outside the ensemble forecast distribution.

Mahesh, Ankur↗
DOE OSTI2020

We Just Want to Pump…You Up! Forecasting Grid-Connected Heat Pump Water Heater Energy Savings and Load Shifting Potential for the Southeast U.S.

Heat pump water heaters (HPWH) can achieve energy savings of 60-70% compared to conventional electric-resistance water heaters. However, even with a favorable simple payback period within the typical product lifetime, HPWHs make up only 1% of all electric water heaters sold in the residential sector. Market adoption is challenged, in part, by the lack of effective energy efficiency programs in the U.S. region with the greatest amount of residential electric water heaters. The recent integration of connected functionality into HPWHs offers the capability to shift load without undue negative impact on customers. This capability can provide value to utilities with peak load constraints, motivating them to promote HPWHs for the first time. This paper will present a methodology to forecast connected HPWH energy use and extrapolate load shifting potential for the Southeast U.S. region. The methodology leverages data from a robust connected HPWH field study conducted in the Pacific Northwest. A coefficient of performance (COP) relationship for HPWHs was developed using ambient and inlet water temperature data to forecast HPWH performance on a month-by-month basis. Using the forecasted COP, HPWH operating hours were calculated for meeting load, which serve as the proxy to extrapolate load shifting potential from the Pacific Northwest to the Southeast. As a use case, analytical results are presented for a specific utility. This methodology, in combination with market analysis, facilitates the development of customized energy savings and load shifting forecasts to understand the potential impacts of launching connected HPWH programs in specific utility service territories.

heat pump water heater, energy savings, load shift↗
DOE OSTI2023

Influence of extreme fracture flow channels on the thermal performance of open-loop geothermal systems at commercial scale

Abstract Adequate stewardship of geothermal resources requires accurate forecasting of long-term thermal performance. In enhanced geothermal systems and other fracture-dominated reservoirs, predictive models commonly assume constant-aperture fractures, although spatial variations in aperture can greatly affect reservoir permeability, fluid flow distribution, and heat transport. Whereas previous authors have investigated the effects of theoretical random aperture distributions on thermal performance, here we further explore the influence of permeability heterogeneity considering field-constrained aperture distributions from a meso-scale field site in northern New York, USA. Using numerical models of coupled fluid flow and heat transport, we conduct thermal–hydraulic simulations for a hypothetical reservoir consisting of a relatively impervious porous matrix and a single, horizontal fracture. Our results indicate that in highly channelized fields, most well design configurations and operating conditions result in extreme rates of thermal drawdown (e.g., 50% drop in production well temperatures in under 2 years). However, some other scenarios that account for the risks of short-circuiting can potentially enhance heat extraction when mass flow rate is not excessively high, and the direction of geothermal extraction is not aligned with the most permeable features in the reservoir. Through a parametric approach, we illustrate that well separation distance and relative positioning play a major role in the long-term performance of highly channelized fields, and both can be used to help mitigate premature thermal breakthrough.

Rangel-Jurado, Nicolás↗