Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “FORECASTING”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

National and subnational short-term forecasting of COVID-19 in Germany and Poland during early 2021

During the COVID-19 pandemic there has been a strong interest in forecasts of the short-term development of epidemiological indicators to inform decision makers. In this study we evaluate probabilistic real-time predictions of confirmed cases and deaths from COVID-19 in Germany and Poland for the period from January through April 2021. We evaluate probabilistic real-time predictions of confirmed cases and deaths from COVID-19 in Germany and Poland. These were issued by 15 different forecasting models, run by independent research teams. Moreover, we study the performance of combined ensemble forecasts. Evaluation of probabilistic forecasts is based on proper scoring rules, along with interval coverage proportions to assess calibration. The presented work is part of a pre-registered evaluation study. We find that many, though not all, models outperform a simple baseline model up to four weeks ahead for the considered targets. Ensemble methods show very good relative performance. The addressed time period is characterized by rather stable non-pharmaceutical interventions in both countries, making short-term predictions more straightforward than in previous periods. However, major trend changes in reported cases, like the rebound in cases due to the rise of the B.1.1.7 (Alpha) variant in March 2021, prove challenging to predict. Multi-model approaches can help to improve the performance of epidemiological forecasts. However, while death numbers can be predicted with some success based on current case and hospitalization data, predictability of case numbers remains low beyond quite short time horizons. Additional data sources including sequencing and mobility data, which were not extensively used in the present study, may help to improve performance.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2026

The Simons Observatory: forecasted constraints on primordial gravitational waves with the expanded array of Small Aperture Telescopes

We present updated forecasts for the scientific performance of the degree-scale (0.5 deg FWHM at 93 GHz), deep-field survey to be conducted by the Simons Observatory (SO). By 2027, the SO Small Aperture Telescope (SAT) complement will be doubled from three to six telescopes, including a doubling of the detector count in the 93 GHz and 145 GHz channels to 48,160 detectors. Combined with a planned extension of the survey duration to 2035, this expansion will significantly enhance SO's search for a B-mode signal in the polarisation of the cosmic microwave background, a potential signature of gravitational waves produced in the very early Universe. Assuming a 1/f noise model with knee multipole ℓ knee = 50 and a moderately complex model for Galactic foregrounds, we forecast a 1σ (or 68% confidence level) constraint on the tensor-to-scalar ratio r of σ r = 1.2 × 10 -3 , assuming no primordial B-modes are present. This forecast assumes that 70% of the B-mode lensing signal can ultimately be removed using high resolution observations from the SO Large Aperture Telescope (LAT) and overlapping large-scale structure surveys. For more optimistic assumptions regarding foregrounds and noise, and assuming the same level of delensing, this forecast constraint improves to σ r = 7 × 10 -4 . These forecasts represent a major improvement in SO's constraining power, being a factor of around 2.5 times better than what could be achieved with the originally planned campaign, which assumed the existing three SATs would conduct a five-year survey.

CMBR experiments↗
DOE OSTI2023

Beyond Fisher forecasting for cosmology

The planning and design of future experiments rely heavily on forecasting to assess the potential scientific value provided by a hypothetical set of measurements. The Fisher information matrix, due to its convenient properties and low computational cost, provides an especially useful forecasting tool. However, the Fisher matrix only provides a reasonable approximation to the true likelihood when data are nearly Gaussian distributed and observables have nearly linear dependence on the parameters of interest. Also, Fisher forecasting techniques alone cannot be used to assess their own validity. Thorough sampling of the exact or mock likelihood can definitively determine whether a Fisher forecast is valid, though such sampling is often prohibitively expensive. Here we propose a simple test, based on the Derivative Approximation for likelihoods (DALI) technique, to determine whether the Fisher matrix provides a good approximation to the exact likelihood. We show that the Fisher matrix becomes a poor approximation to the true likelihood in regions where two-dimensional slices of level surfaces of the DALI approximation to the likelihood differ from two-dimensional slices of level surfaces of the Fisher approximation to the likelihood. We demonstrate that our method accurately predicts situations in which the Fisher approximation deviates from the true likelihood for various cosmological models and several data combinations, with only a modest increase in computational cost compared to standard Fisher forecasts.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Forte: An Interactive Visual Analytic Tool for Trust-Augmented Net-Load Forecasting

Accurate net-load forecasting is vital for energy planning, aiding decisions on trade and load distribution. However, assessing the performance of forecasting models across diverse input variables, like temperature and humidity, remains challenging, particularly for eliciting a high degree of trust in the model outcomes. In this context, there is a growing need for data-driven technological interventions to aid scientists in comprehending how models react to both noisy and clean input variables, thus shedding light on complex behaviors and fostering confidence in the outcomes. In this paper, we present Forte, a visual analytics-based application to explore deep probabilistic net-load forecasting models across various input variables and understand the error rates for different scenarios. With carefully designed visual interventions, this web-based interface empowers scientists to derive insights about model performance by simulating diverse scenarios, facilitating an informed decision-making process. We discuss observations made using Forte and demonstrate the effectiveness of visualization techniques to provide valuable insights into the correlation between weather inputs and net-load forecasts, ultimately advancing grid capabilities by improving trust in forecasting models.

Bhattacharjee, Kaustav↗
DOE OSTI2022

MSASGCN : Multi-Head Self-Attention Spatiotemporal Graph Convolutional Network for Traffic Flow Forecasting

Traffic flow forecasting is an essential task of an intelligent transportation system (ITS), closely related to intelligent transportation management and resource scheduling. Dynamic spatial-temporal dependencies in traffic data make traffic flow forecasting to be a challenging task. Most existing research cannot model dynamic spatial and temporal correlations to achieve well-forecasting performance. The multi-head self-attention mechanism is a valuable method to capture dynamic spatial-temporal correlations, and combining it with graph convolutional networks is a promising solution. Therefore, we propose a multi-head self-attention spatiotemporal graph convolutional network (MSASGCN) model. It can effectively capture local correlations and potential global correlations of spatial structures, can handle dynamic evolution of the road network, and, in the time dimension, can effectively capture dynamic temporal correlations. Experiments on two real datasets verify the stability of our proposed model, obtaining a better prediction performance than the baseline algorithms. The correlation metrics get significantly reduced compared with traditional time series prediction methods and deep learning methods without using graph neural networks, according to MAE and RMSE results. Compared with advanced traffic flow forecasting methods, our model also has a performance improvement and a more stable prediction performance. We also discuss some problems and challenges in traffic forecasting.

Cao, Yang↗
DOE OSTI2023

BuildingsBench: A Benchmark for Universal Building Load Forecasting [SWR-23-51]

The residential and commercial building stock in the United States is responsible for a significant percentage of energy consumption and greenhouse gas emissions. Electrification of end-uses, as well as decarbonizing the electrical grid through renewable energy sources such as solar and wind, constitutes the pathway to zero-emission buildings. Forecasting day-ahead building energy consumption is an integral part of this solution. Currently, specialized forecasting models are hand-made for each individual building, which is time-consuming, expensive, and leads to duplicated efforts. BuildingsBench is a Python software framework for training and comparing generalized machine learning models for universal building load forecasting. This challenge tasks a single foundational model to generalize its forecasts for a wide variety of buildings, across geographic regions, building types, weather patterns, and more. This software provide code for pre-training such models and subsequently evaluating their performance on a suite of hundreds of diverse real and synthetic buildings. BuildingsBench is a platform for: - Large-scale pretraining with the synthetic Buildings-900K dataset for short-term load forecasting (STLF). Buildings-900K is statistically representative of the entire U.S. building stock and is extracted from the NREL End-Use Load Profiles database. - Benchmarking on two tasks evaluating generalization: zero-shot STLF and transfer learning for STLF. We provide an index-based PyTorch Dataset for large-scale pretraining, easy data loading for multiple real building energy consumption datasets as PyTorch Tensors or Pandas DataFrames, simple (persistence) to advanced (transformer) baselines, metrics management, and more.

Emami, Patrick↗
DOE OSTI2020

Near-Real-Time Forecast of Satellite-Based Soil Moisture Using Long Short-Term Memory with an Adaptive Data Integration Kernel

Nowcasts, or near-real-time (NRT) forecasts, of soil moisture based on the Soil Moisture Active and Passive (SMAP) mission could provide substantial value for a range of applications including hazards monitoring and agricultural planning. To provide such a NRT forecast with high fidelity, we enhanced a time series deep learning architecture, long short-term memory (LSTM), with a novel data integration (DI) kernel to assimilate the most recent SMAP observations as soon as they become available. The kernel is adaptive in that it can accommodate irregular observational schedules. Testing over the CONUS, this NRT forecast product showcases predictions with unprecedented accuracy when evaluated against subsequent SMAP retrievals. It showed smaller error than NRT forecasts reported in the literature, especially at longer forecast latency. The comparative advantage was due to LSTM’s structural improvements, as well as its ability to utilize more input variables and more training data. The DI-LSTM was compared to the original LSTM model that runs without data integration, referred to as the projection model here. We found that the DI procedure removed the autocorrelated effects of forcing errors and errors due to processes not represented in the inputs, for example, irrigation and floodplain/lake inundation, as well as mismatches due to unseen forcing conditions. The effects of this purely data-driven DI kernel are discussed for the first time in the geosciences. Furthermore, this work presents an upper-bound estimate for the random component of the SMAP retrieval error.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Learning Forecasts of Rare Stratospheric Transitions from Short Simulations

Abstract Rare events arising in nonlinear atmospheric dynamics remain hard to predict and attribute. We address the problem of forecasting rare events in a prototypical example, sudden stratospheric warmings (SSWs). Approximately once every other winter, the boreal stratospheric polar vortex rapidly breaks down, shifting midlatitude surface weather patterns for months. We focus on two key quantities of interest: the probability of an SSW occurring, and the expected lead time if it does occur, as functions of initial condition. These optimal forecasts concretely measure the event’s progress. Direct numerical simulation can estimate them in principle but is prohibitively expensive in practice: each rare event requires a long integration to observe, and the cost of each integration grows with model complexity. We describe an alternative approach using integrations that are short compared to the time scale of the warming event. We compute the probability and lead time efficiently by solving equations involving the transition operator, which encodes all information about the dynamics. We relate these optimal forecasts to a small number of interpretable physical variables, suggesting optimal measurements for forecasting. We illustrate the methodology on a prototype SSW model developed by Holton and Mass and modified by stochastic forcing. While highly idealized, this model captures the essential nonlinear dynamics of SSWs and exhibits the key forecasting challenge: the dramatic separation in time scales between a single event and the return time between successive events. Our methodology is designed to fully exploit high-dimensional data from models and observations, and has the potential to identify detailed predictors of many complex rare events in meteorology.

Finkel, Justin↗
DOE OSTI2023

Improving Tropical Cyclogenesis Forecasts of Hurricane Irma (2017) through the Assimilation of All-Sky Infrared Brightness Temperatures

The assimilation of satellite all-sky infrared (IR) brightness temperatures (BTs) has been shown in previous studies to improve intensity forecasts of tropical cyclones. Here, in this study, we examine whether assimilating all-sky IR BTs can also potentially improve tropical cyclogenesis forecasts by improving the pregenesis cloud and moisture fields. By using an ensemble-based data assimilation system, we show that the assimilation of upper-tropospheric water vapor channel BTs observed by the Meteosat-10 SEVIRI instrument two days before the formation of a tropical depression improves the genesis forecast of Hurricane Irma (2017), a classic Cape Verde storm, by up to 24 h while also capturing its later rapid intensification in deterministic forecasts. In an experiment that withholds the assimilation of all-sky IR BTs, the assimilation of conventional observations from the Global Telecommunications System (GTS) leads to the premature genesis of Hurricane Irma by at least 24 h. This premature genesis is shown to result from an overestimation of the spatial coverage of deep convection within the African easterly wave (AEW) from which Irma eventually forms. The gross overestimation of deep convection without all-sky IR BTs is accompanied by higher column saturation fraction, stronger low-level convergence, and the earlier spinup of a low-level meso- β -scale vortex within the AEW that ultimately becomes Hurricane Irma. Through its adjustment to the initial moisture and cloud conditions, the assimilation of all-sky IR BTs leads to a more realistic convective evolution in forecasts and ultimately a more realistic timing of genesis.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Influence of Local Water Vapor Analysis Uncertainty on Ensemble Forecasts of Tropical Cyclogenesis Using Hurricane Irma (2017) as a Testbed

Abstract Tropical cyclone formation is known to require abundant water vapor in the lower to middle troposphere within the incipient disturbance. In this study, we assess the impacts of local water vapor analysis uncertainty on the predictability of the formation of Hurricane Irma (2017). To this end, we reduce the magnitude of the incipient disturbance’s water vapor perturbations obtained from an ensemble-based data assimilation system that constrained moisture by assimilating all-sky infrared and microwave radiances. Five-day ensemble forecasts are initialized two days before genesis using each set of modified analysis perturbations. Growth of convective differences and intensity uncertainty are evaluated for each ensemble forecast. We observe that when initializing an ensemble forecast with only moisture uncertainty within the incipient disturbance, the resulting intensity uncertainty at every lead time exceeds half that of an ensemble containing initial perturbations to all variables throughout the domain. Although ensembles with different initial moisture uncertainty amplitudes reveal a similar pathway to genesis, uncertainty in genesis timing varies substantially across ensembles since moister members exhibit earlier spinup of the low-level vortex. These differences in genesis timing are traced back to the first 6–12 h of integration, when differences in the position and intensity of mesoscale convective systems across ensemble members develop more quickly with greater initial moisture uncertainty. In addition, the rapid growth of intensity uncertainty may be greatly modulated by the diurnal cycle. Ultimately, this study underscores the importance of targeting the incipient disturbance with high spatiotemporal water vapor observations for ingestion into data assimilation systems. Significance Statement Hurricanes form from clusters of thunderstorms that organize into a coherent system. One of the key ingredients for the formation process is an abundance of moisture. In this study, we test the sensitivity of hurricane formation to the initial moisture content in the vicinity of the cluster of thunderstorms that would become Hurricane Irma (2017). To do so, we initialize sets of forecasts each having a different variability of initial moisture content within the embryonic disturbance. Our results show that the predictability of hurricane formation is highly dependent on the uncertainty of the moisture content within the initial disturbance. Consequently, more high-quality observations of the moisture within the precursor disturbances to hurricanes are expected to improve forecasts of their formation.

Hartman, Christopher M.↗
DOE OSTI2021

Recommended reporting items for epidemic forecasting and prediction research: The EPIFORGE 2020 guidelines

Background: The importance of infectious disease epidemic forecasting and prediction research is underscored by decades of communicable disease outbreaks, including COVID-19. Unlike other fields of medical research, such as clinical trials and systematic reviews, no reporting guidelines exist for reporting epidemic forecasting and prediction research despite their utility. We therefore developed the EPIFORGE checklist, a guideline for standardized reporting of epidemic forecasting research. Methods and findings: We developed this checklist using a best-practice process for development of reporting guidelines, involving a Delphi process and broad consultation with an international panel of infectious disease modelers and model end users. The objectives of these guidelines are to improve the consistency, reproducibility, comparability, and quality of epidemic forecasting reporting. The guidelines are not designed to advise scientists on how to perform epidemic forecasting and prediction research, but rather to serve as a standard for reporting critical methodological details of such studies. Conclusions: These guidelines have been submitted to the EQUATOR network, in addition to hosting by other dedicated webpages to facilitate feedback and journal endorsement.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

ORION: Operational FoRecastIng Of INduced Seismicity

The Operational Forecasting of Induced Seismicity toolkit “ORION” (ORION) is an open-source, observation-based ensemble forecasting toolkit which is geared towards helping operators understand the seismic hazard (i.e., probabilistic assessment of the magnitude and frequency of induced seismic events) at a site. ORION analyzes how the seismic hazard evolves during injection and suggests possible mitigation strategies to employ if an earthquake that exceeds certain threshold is observed. Through its ensemble modeling approach, ORION leverages the benefits of statistical-, physics-, and machine learning-based forecasting methodologies, while reducing the impact of each model’s respective limitations. The ORION toolkit consists of an easy-to-use GUI interface that affords a user as much or as little interaction as desired. Advanced capabilities allow the user to upload local, high-precision earthquake catalogs, projected injection profiles and/or spatiotemporal estimates of pressure/stress, and to tune various model parameters. ORION will then provide a spatial and temporal ensemble forecast of seismicity defined as the probability of exceedance of a given earthquake magnitude over a forecast period. Additionally, ORION will provide probability distribution of the statistically derived maximum possible earthquake magnitude that may be expected. Finally, ORION will provide suggested operational management strategies (e.g. reduce injection volumes at specific wells) based on the level of hazard.

NRAP,NRAP Tools,ORION,Operational Forcasting of In↗
DOE OSTI2021

Gaussian Process Regression for Aggregate Baseline Load Forecasting

Demand response (DR) is one of the most effective ways to maintain the reliability and improve the flexibility of power systems. Accurate forecasts of baseline loads are essential for DR programs. In the era of big data, machine learning-based approaches present a unique opportunity for baseline load forecasting. Thus, this paper presents a machine learning-based approach using a relatively less explored algorithm, Gaussian process regression (GPR), to forecast aggregate baseline loads. As such, a dataset was generated using a set of EnergyPlus simulations. Using the generated dataset, a GPR-based forecasting model was developed. In addition, support vector regression (SVR)-, artificial neural network (ANN)-, and averaging-based models were developed as baseline models for comparison. These models were compared in terms of accuracy, simplicity, and integrity. The prediction performance of the models showed that the GPR-based model is more accurate and reliable than the others. Such high performance shows the potential of the GPR in baseline load forecasting. GPR, therefore, can be used for DR applications.

Amasyali, Kadir↗
DOE OSTI2025

A process-based evaluation of biases in extratropical stratosphere–troposphere coupling in subseasonal forecast systems

Abstract. Two-way coupling between the stratosphere and troposphere is recognized as an important source of subseasonal-to-seasonal (S2S) predictability and can open windows of opportunity for improved forecasts. Model biases can, however, lead to a poor representation of such coupling processes; drifts in a model's circulation related to model biases, resolution, and parameterizations have the potential to feed back on the circulation and affect stratosphere–troposphere coupling. We introduce a set of diagnostics using readily available data that can be used to reveal these biases and then apply these diagnostics to 22 S2S forecast systems. In the Northern Hemisphere, nearly all S2S forecast systems underestimate the strength of the observed upward coupling from the troposphere to the stratosphere, downward coupling within the stratosphere, and the persistence of lower-stratospheric temperature anomalies. While downward coupling from the lower stratosphere to the near surface is well represented in the multi-model ensemble mean, there is substantial intermodel spread likely related to how well each model represents tropospheric stationary waves. In the Southern Hemisphere, the stratospheric vortex is oversensitive to upward-propagating wave flux in the forecast systems. Forecast systems generally overestimate the strength of downward coupling from the lower stratosphere to the troposphere, even as most underestimate the radiative persistence in the lower stratosphere. In both hemispheres, models with higher lids and a better representation of tropospheric quasi-stationary waves generally perform better at simulating these coupling processes.

Garfinkel, Chaim I. (ORCID:000000017258666X)↗
DOE OSTI2022

A Data Quality-Aware Framework to Reliably Forecast Photovoltaic Generation and Consumer Load for an Improved Resilience of Microgrids

Photovoltaic (PV) power and consumer load forecasting plays a critical role to ensure operational resilience of the electric grid. Most data-driven forecasting algorithms rely heavily on the continuous availability of good quality data for periodic training and validation. When deployed at the grid’s edge, prolonged disruptions to communications during extreme events degrade data quality. Factors such as missing observations, epistemic uncertainties, data drift, and concept drift are manifestations of data quality that impact the generalization of such field-deployed forecasting models. Currently, there exists no mechanism in the literature to dynamically switch between models under varying degrees of data quality as quantified by certain metrics for each factor highlighted above. This paper addresses this shortcoming by conceptually introducing a data qualityaware framework for reliable PV generation and consumer load forecasting. The framework’s design incorporates components of missing values, divergence tests, and continuous monitoring of generalization performance to detect changes in data quality caused by communications disruptions and trigger specific classes of forecasting models grouped under three use cases (UC1- UC3). As a first step towards validating this framework, real data collected from an actual field microgrid system is used to demonstrate the viability of the three use cases. Results show that the performance is the best in UC1 with an unadjusted R-square value of 0.954, followed by 0.939 for UC2 and 0.757 for UC3.

Sundararajan, Aditya↗
DOE OSTI2025

Effects of Atmosphere and Ocean Horizontal Model Resolution on Tropical Cyclone and Upper-Ocean Response Forecasts in Four Major Hurricanes

A coupled atmosphere–ocean model is necessary for tropical cyclone (TC) prediction to accurately characterize ocean feedback on atmospheric processes within the TC environment. Here, the ECMWF coupled global model is run at horizontal resolutions from 9 to 1.4 km in the atmosphere, as well as 25 and 8 km in the ocean, to identify how resolution impacts forecast accuracy of four observed major TCs in the Atlantic: Irma, Florence, Teddy, and Ida. Most of the resolutions used here are unprecedented for global models. GOES-16 and synthetic aperture radar (SAR) satellite images and best track data are used for atmospheric validation. Salinity and temperature observations from Air-Launched Autonomous Micro-Observer (ALAMO) floats are used to validate modeled upper-ocean response, including mixed layer deepening, sea surface cooling, and near-inertial waves in the wakes of TCs. Increasing atmospheric resolution leads to more realistic TC structure and stronger winds, significantly improving TC intensity forecasts and modestly improving track errors. Ocean resolution impacts the upper-ocean response but does not influence atmospheric forecasts for the fast-moving TCs considered here. Stronger mixing, sea surface cooling, and near-inertial oscillations are found for both higher atmosphere and ocean resolutions, provided the initial upper-ocean state is the same for the two ocean resolutions. Whether this agrees better with the ALAMO observations also depends on the realism of the initial upper-ocean state in the model, emphasizing the importance of ocean initialization for the accurate upper-ocean response. Overall, the model at all resolutions correctly predicts stronger mixing, surface cooling, and near-inertial oscillation amplitudes to the right of a TC center, as observed by ALAMO floats.

Atmosphere-ocean interaction↗
DOE OSTI2020

Considerations for Medium-Term Load Forecasting in Morocco

There are many factors that determine how demand for electricity may change over time. Medium-term load forecasting is a subset of load forecasting that focuses on the next year. This presentation summarizes analysis performed by NREL on medium-term load forecasting performed for the Moroccan energy system. This analysis includes hourly regressions and load clustering. This work also describes potential next steps that can be implemented by ONEE to improve this medium-term load forecasting.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Probabilistic Forecast of All-Sky Solar Radiation Using Enhanced WRF-Solar: Preprint

This study presents enhancements of the Weather Research and Forecasting model with solar extensions (WRF-Solar) to provide probabilistic forecasts of solar radiation. Our approach builds ensemble WRF-Solar runs by introducing stochastic perturbations of variables that produce the largest uncertainties in predicting surface irradiance and clouds. The key variables are identified using tangent linear sensitivity analysis of six physics packages responsible for all-sky irradiance variability. An optimal strategy to stochastically perturb the selected variables is developed and applied to WRF-Solar to generate ensemble members for day-ahead solar prediction. The National Solar Radiation Database (NSRDB) is used to validate the ensemble forecast at arbitrary locations on the model grid. Preliminary results indicate that the proposed technique can potentially produce WRF-Solar ensembles providing reliable information of solar prediction uncertainty. This study describes the implemented methodology and initial results as well as future research to improve ensemble-based probabilistic forecasts with WRF-Solar.

all-sky↗