Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “probabilistic forecast”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

VFR Trajectory Forecasting using Deep Generative Model for Autonomous Airspace Operations

To enable the airspace integration of autonomous operations, such as uncrewed aircraft conducting cargo deliveries, there is a need to forecast the positions of the surrounding traffic with which they may interact. This paper focuses on forecasting Visual Flight Rules traffic, a significant source of uncertainty and risk in the airspace, especially around small regional airports, due to the unplanned and often untracked nature of such flights. A deep generative model is developed, trained on historical traffic data at example towered and non-towered airports, and used to predict flight trajectories. Experimental results are presented comparing the performance of variational autoencoder and classical machine learning forecasting when applied to both the towered and non-towered airports over varying time horizons. The results show the advantages of the variational autoencoder in producing accurate probabilistic forecasts over varying time horizons.

uncrewed aircraft↗
NASA NTRSDate not supplied

VFR Trajectory Forecasting using Deep Generative Model for Autonomous Airspace Operations

To enable the airspace integration of autonomous operations, such as uncrewed aircraft conducting cargo deliveries, there is a need to forecast the positions of the surrounding traffic with which they may interact. This paper focuses on forecasting Visual Flight Rules traffic, a significant source of uncertainty and risk in the airspace, especially around small regional airports, due to the unplanned and often untracked nature of such flights. A deep generative model is developed, trained on historical traffic data at example towered and non-towered airports, and used to predict flight trajectories. Experimental results are presented comparing the performance of variational autoencoder and classical machine learning forecasting when applied to both the towered and non-towered airports over varying time horizons. The results show the advantages of the variational autoencoder in producing accurate probabilistic forecasts over varying time horizons.

uncrewed aircraft↗
DOE OSTI2025

Huge ensembles – Part 1: Design of ensemble weather forecasts using spherical Fourier neural operators

Abstract. Simulating low-likelihood high-impact extreme weather events in a warming world is a significant and challenging task for current ensemble forecasting systems. While these systems presently use up to 100 members, larger ensembles could enrich the sampling of internal variability. They may capture the long tails associated with climate hazards better than traditional ensemble sizes. Due to computational constraints, it is infeasible to generate huge ensembles (comprised of 1000–10 000 members) with traditional, physics-based numerical models. In this two-part paper, we replace traditional numerical simulations with machine learning (ML) to generate hindcasts of huge ensembles. In Part 1, we construct an ensemble weather forecasting system based on spherical Fourier neural operators (SFNOs), and we discuss important design decisions for constructing such an ensemble. The ensemble represents model uncertainty through perturbed-parameter techniques, and it represents initial condition uncertainty through bred vectors, which sample the fastest-growing modes of the forecast. Using the European Centre for Medium-Range Weather Forecasts Integrated Forecasting System (IFS) as a baseline, we develop an evaluation pipeline composed of mean, spectral, and extreme diagnostics. With large-scale, distributed SFNOs with 1.1 billion learned parameters, we achieve calibrated probabilistic forecasts. As the trajectories of the individual members diverge, the ML ensemble mean spectra degrade with lead time, consistent with physical expectations. However, the individual ensemble members' spectra stay constant with lead time. Therefore, these members simulate realistic weather states during the rollout, and the ML ensemble passes a crucial spectral test in the literature. The IFS and ML ensembles have similar extreme forecast indices, and we show that the ML extreme weather forecasts are reliable and discriminating. These diagnostics ensure that the ensemble can reliably simulate the time evolution of the atmosphere, including low-likelihood high-impact extremes. In Part 2, we generate a huge ensemble initialized each day in summer 2023, and we characterize the simulations of extremes.

Mahesh, Ankur↗
DOE OSTI2024

Solar, Wind, and Load Forecasting Dataset for MISO, NYISO, and SPP Balancing Areas

The Performance-based Energy Resource Feedback, Optimization, and Risk Management (PERFORM) program is an initiative intended to foster "a fundamental shift in grid management rooted in an understanding of asset risk and system risk" (ARPA-E 2020). Launched by the Advanced Research Projects Agency-Energy (ARPA-E), the program supports efforts to incorporate uncertainty in electric power decision making. In support of PERFORM, the National Renewable Energy Laboratory (NREL) has produced a set of time-coincident forecasts of solar, wind, and load profiles. As part of Phase I of the PERFORM effort, NREL created a dataset that consists of one year of time-coincident load, wind, and solar actuals and probabilistic forecasts based on data from the Electric Reliability Council of Texas (ERCOT) (Bryce et al. 2023). In Phase II, NREL developed similar datasets for three other U.S. Independent System Operators (ISO): the Midcontinent Independent System Operator (MISO), the New York Independent System Operator (NYISO), and the Southwest Power Pool (SPP).

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Evaluation of an open forecasting challenge to assess skill of West Nile virus neuroinvasive disease prediction

Abstract Background West Nile virus (WNV) is the leading cause of mosquito-borne illness in the continental USA. WNV occurrence has high spatiotemporal variation, and current approaches to targeted control of the virus are limited, making forecasting a public health priority. However, little research has been done to compare strengths and weaknesses of WNV disease forecasting approaches on the national scale. We used forecasts submitted to the 2020 WNV Forecasting Challenge, an open challenge organized by the Centers for Disease Control and Prevention, to assess the status of WNV neuroinvasive disease (WNND) prediction and identify avenues for improvement. Methods We performed a multi-model comparative assessment of probabilistic forecasts submitted by 15 teams for annual WNND cases in US counties for 2020 and assessed forecast accuracy, calibration, and discriminatory power. In the evaluation, we included forecasts produced by comparison models of varying complexity as benchmarks of forecast performance. We also used regression analysis to identify modeling approaches and contextual factors that were associated with forecast skill. Results Simple models based on historical WNND cases generally scored better than more complex models and combined higher discriminatory power with better calibration of uncertainty. Forecast skill improved across updated forecast submissions submitted during the 2020 season. Among models using additional data, inclusion of climate or human demographic data was associated with higher skill, while inclusion of mosquito or land use data was associated with lower skill. We also identified population size, extreme minimum winter temperature, and interannual variation in WNND cases as county-level characteristics associated with variation in forecast skill. Conclusions Historical WNND cases were strong predictors of future cases with minimal increase in skill achieved by models that included other factors. Although opportunities might exist to specifically improve predictions for areas with large populations and low or high winter temperatures, areas with high case-count variability are intrinsically more difficult to predict. Also, the prediction of outbreaks, which are outliers relative to typical case numbers, remains difficult. Further improvements to prediction could be obtained with improved calibration of forecast uncertainty and access to real-time data streams (e.g. current weather and preliminary human cases). Graphical Abstract

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2014

Prediction of the Arctic Oscillation in Boreal Winter by Dynamical Seasonal Forecasting Systems

This study assesses the skill of boreal winter Arctic Oscillation (AO) predictions with state-of-the-art dynamical ensemble prediction systems (EPSs): GloSea4, CFSv2, GEOS-5, CanCM3, CanCM4, and CM2.1. Long-term reforecasts with the EPSs are used to evaluate how well they represent the AO and to assess the skill of both deterministic and probabilistic forecasts of the AO. The reforecasts reproduce the observed changes in the large-scale patterns of the Northern Hemispheric surface temperature, upper level wind, and precipitation associated with the different phases of the AO. The results demonstrate that most EPSs improve upon persistence skill scores for lead times up to 2 months in boreal winter, suggesting some potential for skillful prediction of the AO and its associated climate anomalies at seasonal time scales. It is also found that the skill of AO forecasts during the recent period (1997-2010) is higher than that of the earlier period (1983-1996).

Arctic Oscillation↗
NASA NTRS2014

NMME Monthly / Seasonal Forecasts for NASA SERVIR Applications Science

This work details use of the North American Multi-Model Ensemble (NMME) experimental forecasts as drivers for Decision Support Systems (DSSs) in the NASA / USAID initiative, SERVIR (a Spanish acronym meaning "to serve"). SERVIR integrates satellite observations, ground-based data and forecast models to monitor and forecast environmental changes and to improve response to natural disasters. Through the use of DSSs whose "front ends" are physically based models, the SERVIR activity provides a natural testbed to determine the extent to which NMME monthly to seasonal projections enable scientists, educators, project managers and policy implementers in developing countries to better use probabilistic outlooks of seasonal hydrologic anomalies in assessing agricultural / food security impacts, water availability, and risk to societal infrastructure. The multi-model NMME framework provides a "best practices" approach to probabilistic forecasting. The NMME forecasts are generated at resolution more coarse than that required to support DSS models; downscaling in both space and time is necessary. The methodology adopted here applied model output statistics where we use NMME ensemble monthly projections of sea-surface temperature (SST) and precipitation from 30 years of hindcasts with observations of precipitation and temperature for target regions. Since raw model forecasts are well-known to have structural biases, a cross-validated multivariate regression methodology (CCA) is used to link the model projected states as predictors to the predictands of the target region. The target regions include a number of basins in East and South Africa as well as the Ganges / Baramaputra / Meghna basin complex. The MOS approach used address spatial downscaling. Temporal disaggregation of monthly seasonal forecasts is achieved through use of a tercile bootstrapping approach. We interpret the results of these studies, the levels of skill by several metrics, and key uncertainties.

Robertson, Franklin R.↗
DOE OSTI2021

COVID-19 dynamics across the US: A deep learning study of human mobility and social behavior

This paper presents a deep learning framework for epidemiology system identification from noisy and sparse observations with quantified uncertainty. The proposed approach employs an ensemble of deep neural networks to infer the time-dependent reproduction number of an infectious disease by formulating a tensor-based multi-step loss function that allows us to efficiently calibrate the model on multiple observed trajectories. The method is applied to a mobility and social behavior-based SEIR model of COVID-19 spread. The model is trained on Google and Unacast mobility data spanning a period of 66 days, and is able to yield accurate future forecasts of COVID-19 spread in 203 US counties within a time-window of 15 days. Interestingly, a sensitivity analysis that assesses the importance of different mobility and social behavior parameters reveals that attendance of close places, including workplaces, residential, and retail and recreational locations, has the largest impact on the effective reproduction number. Furthermore, the model enables us to rapidly probe and quantify the effects of government interventions, such as lock-down and re-opening strategies. Taken together, the proposed framework provides a robust workflow for data-driven epidemiology model discovery under uncertainty and produces probabilistic forecasts for the evolution of a pandemic that can judiciously provide information for policy and decision making. All codes and data accompanying this manuscript are available at https://github.com/PredictiveIntelligenceLab/DeepCOVID19.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Performance evaluation of automated data-driven feature extraction and selection methods for practical and scalable building energy consumption prediction models

Here, this study quantifies the impact of automated feature engineering methods (feature extraction and selection) on the quality and accuracy of machine learning models that predict building energy consumption. The case study compares model performance for three main scenarios: baseline (no feature extraction and selection), feature extraction only, and feature extraction combined with feature selection (filter and/or wrapper methods) for fully trained machine learning models for 200 metered/sub-metered energy measurements across 118 real buildings. For consistency, the same machine learning model architecture (a black box deep learning neural network with probabilistic forecast output) was used for all scenarios. Based on results, all feature engineering methods provided noticeable prediction accuracy improvements (e.g., 29%-68% median prediction improvement) compared to baseline scenarios. However, in this application, feature selection methods provide little practical value due to their limited performance gains and high computational cost. Smarter algorithm development supported by better computational environments will be needed before feature selection methods can reliably and efficiently improve predictive model performance.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Subseasonal Tropical Cyclone Prediction and Modulations by MJO and ENSO in CESM2

Subseasonal tropical cyclone (TC) reforecasts from the Community Earth System Model version 2 (CAM6) subseasonal prediction system are examined in this study. Here, we evaluate the modeled TC climatology and the probabilistic forecast skill of basin-wide TC genesis at weekly temporal resolution. Prediction skill is calculated using the Brier skill score relative to a constant annual mean climatology and to a monthly varying seasonal climatology during TC season. The model captures the observed basin-wide climatological TC seasonality and spatial distributions at weeks 1–6, but TC genesis is largely underestimated from Week 2 onward. For some basins and lead times, the predicted TC genesis is primarily controlled by the number of TC “seeds” and the mean-state climate condition. The model has good prediction skill relative to the constant climatology across all the basins and lead times, but is only skillful in the eastern Pacific, North Indian Ocean, and Southern Hemisphere at Week 1 when compared to the seasonal climatology, indicating limited skill in predicting deviations from the seasonal cycle. We find strong modulations of the predicted TC genesis at up to 3 weeks of forecast lead time by the Madden-Julian Oscillation. The interannual variability of predicted TC genesis and accumulated cyclone energy are skillfully predicted in the North Atlantic and the Northwestern Pacific, with a strong modulation by the El Nino-Southern Oscillation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Generative AI for Power Grid Operations

Generative artificial intelligence (AI) has captured into the mainstream, demonstrating capabilities that once belonged solely to the realm of human cognition. From defeating world champions in complex games to generating human-quality text and images, Generative AI has proven its potential to revolutionize countless industries. The electric power grid is no exception. Generative AI's ability to process vast amounts of data rapidly, assist decision support and identify patterns could significantly enhance power grid operations. For example, Generative AI could improve state estimation where measurements are not available or integrate renewable energy sources more efficiently with probabilistic forecasting. The key contributions of this whitepaper are outlined below: (1) Comprehensive overview of Generative AI's applications in power grid operations: It highlights the opportunities in areas such as forecasting, state estimation, and demonstrating the potential for enhancing efficiency, reliability, and resilience. (2) Expanding Generative AI's impact through synergies with emerging technologies: The paper introduce NREL developed eGridGPT and explores how AI orchestration, multi-agent systems, and Digital Twins can collaborate to optimize grid operations, addressing the complexities of a decarbonized and electrified future. (3) In-depth analysis of challenges in implementing Generative AI: This includes considerations like data availability and quality, model validation, certification, and ethical concerns, ensuring responsible AI deployment. (4) Emphasizing human-AI collaboration: The whitepaper underscores the importance of trustworthy, transparency, and explainability in AI systems to promote seamless interaction between human operators and AI, ultimately improving decision-making. (5) Exploring future research and development: It identifies critical areas for further advancement to fully realize Generative AI's potential in power grid operations. This whitepaper serves as a valuable resource for researchers, practitioners, and policymakers looking to harness Generative AI for a more reliable, stable, and cost-effective power grid.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Predicting Solar Energetic Particles Using SDO/HMI Vector Magnetic Data Products and a Bidirectional LSTM Network

Solar energetic particles (SEPs) are an essential source of space radiation, and are hazardous for humans in space, spacecraft, and technology in general. In this paper, we propose a deep-learning method, specifically a bidirectional long short-term memory (biLSTM) network, to predict if an active region (AR) would produce an SEP event given that (i) the AR will produce an M- or X-class flare and a coronal mass ejection (CME) associated with the flare, or (ii) the AR will produce an M- or X-class flare regardless of whether or not the flare is associated with a CME. The data samples used in this study are collected from the Geostationary Operational Environmental Satellite's X-ray flare catalogs provided by the National Centers for Environmental Information. We select M- and X-class flares with identified ARs in the catalogs for the period between 2010 and 2021, and find the associations of flares, CMEs, and SEPs in the Space Weather Database of Notifications, Knowledge, Information during the same period. Each data sample contains physical parameters collected from the Helioseismic and Magnetic Imager on board the Solar Dynamics Observatory. Experimental results based on different performance metrics demonstrate that the proposed biLSTM network is better than related machine-learning algorithms for the two SEP prediction tasks studied here. We also discuss extensions of our approach for probabilistic forecasting and calibration with empirical evaluation

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Causes and evolution of winter polynyas north of Greenland

During the 42-year period (1979–2020) of satellite measurements, four major winter (December–March) polynyas have been observed north of Greenland: one in December 1986 and three in the last decade, i.e., February of 2011, 2017, and 2018. The 2018 polynya was unparalleled in its magnitude and duration compared to the three previous events. Given the apparent recent increase in the occurrence of these extreme events, this study aims to examine their evolution and causality, in terms of forced versus natural variability. The limited weather station and remotely sensed sea ice data are analyzed combining with output from the fully coupled Regional Arctic System Model (RASM), including one hindcast and two ensemble simulations. We found that neither the accompanying anomalous warm surface air intrusion nor the ocean below had an impact (i.e., no significant ice melting) on the evolution of the observed winter open-water episodes in the region. Instead, the extreme atmospheric wind forcing resulted in greater sea ice deformation and transport offshore, accounting for the majority of sea ice loss in all four polynyas. Our analysis suggests that strong southerly winds (i.e., northward wind with speeds greater than 10 m s –1 ) blowing persistently over the study region for at least 2 d or more were required over the study region to mechanically redistribute some of the thickest Arctic sea ice out of the region and thus to create open-water areas (i.e., a latent heat polynya). To assess the role of internal variability versus external forcing of such events, we carried out and examined results from the two RASM ensembles dynamically downscaled with output from the Community Earth System Model (CESM) Decadal Prediction Large Ensemble (DPLE) simulations. Out of 100 winters in each of the two ensembles (initialized 30 years apart: one in December 1985 and another in December 2015), 17 and 16 winter polynyas were produced north of Greenland, respectively. The frequency of polynya occurrence had no apparent sensitivity to the initial sea ice thickness in the study area pointing to internal variability of atmospheric forcing as a dominant cause of winter polynyas north of Greenland. We assert that dynamical downscaling using a high-resolution regional climate model offers a robust tool for process-level examination in space and time, synthesis with limited observations, and probabilistic forecasts of Arctic events, such as the ones being investigated here and elsewhere.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2012

On the Probability of Occurrence of Extreme Space Weather Events

By virtue of their rarity, extreme space weather events, such as the Carrington event of 1859, are difficult to study, their rates of occurrence are difficult to estimate, and prediction of a specific future event is virtually impossible. Additionally, events may be extreme relative to one parameter but normal relative to others. In this study, we analyze several measures of the severity of space weather events (flare intensity, coronal mass ejection speeds, Dst, and greater than 30 MeV proton fluences as inferred from nitrate records) to estimate the probability of occurrence of extreme events. By showing that the frequency of occurrence scales as an inverse power of the severity of the event, and assuming that this relationship holds at higher magnitudes, we are able to estimate the probability that an event larger than some criteria will occur within a certain interval of time in the future. For example, the probability of another Carrington event (based on Dst less than - 850 nT) occurring within the next decade is approximately 12%. We also identify and address several limitations with this approach. In particular, we assume time stationarity, and thus, the effects of long-term space climate change are not considered. While this technique cannot be used to predict specific events, it may ultimately be useful for probabilistic forecasting.

Riley, Pete↗
NASA NTRS2013

Flight Deck Weather Avoidance Decision Support: Implementation and Evaluation

Weather related disruptions account for seventy percent of the delays in the National Airspace System (NAS). A key component in the weather plan of the Next Generation of Air Transportation System (NextGen) is to assimilate observed weather information and probabilistic forecasts into the decision process of flight crews and air traffic controllers. In this research we explore supporting flight crew weather decision making through the development of a flight deck predicted weather display system that utilizes weather predictions generated by ground-based radar. This system integrates and presents this weather information, together with in-flight trajectory modification tools, within a cockpit display of traffic information (CDTI) prototype. that the CDTI features 2D and perspective 3D visualization models of weather. The weather forecast products that we implemented were the Corridor Integrated Weather System (CIWS) and the Convective Weather Avoidance Model (CWAM), both developed by MIT Lincoln Lab. We evaluated the use of CIWS and CWAM for flight deck weather avoidance in two part-task experiments. Experiment 1 compared pilots' en route weather avoidance performance in four weather information conditions that differed in the type and amount of predicted forecast (CIWS current weather only, CIWS current and historical weather, CIWS current and forecast weather, CIWS current and forecast weather and CWAM predictions). Experiment 2 compared the use of perspective 3D and 21/2D presentations of weather for flight deck weather avoidance. Results showed that pilots could take advantage of longer range predicted weather forecasts in performing en route weather avoidance but more research will be needed to determine what combinations of information are optimal and how best to present them.

CWAM↗
DOE OSTI2020

A Data-Driven Method for Adaptive Reserve Requirement Estimation via Probabilistic Net Load Forecasting

The University of Colorado Boulder Boulder, CO, 80309, USA With the increasing penetration of renewable energy, power systems are subject to more uncertainty. This makes power system reserve scheduling more challenging. Most of the current reserve requirement determination methods calculate reserve requirements based on historical data, which does not consider the real-time or future system uncertainty. In this paper, a data-driven method is developed to determine the non-spinning reserve requirement (NSRR) in the Electric Reliability Council of Texas (ERCOT) system. The method follows the procedure of the current ERCOT method while adaptively determining the NSRR based on probabilistic net load forecasts. Case studies with two years of ERCOT data show that the developed method significantly reduces the NSRR by introducing an adaptive temporal resolution and update rate. Sensitivity analysis with different forecasting and percentile thresholds indicates the flexibility of the developed method.

non-spinning reserve↗
DOE OSTI2024

Short-Term Load Forecasting Considering EV Charging Loads with Prediction Interval Evaluation

Short-term load forecasting plays a critical role in power system planning and operation. Along with the electrification of various loads, electricity demands are becoming increasingly hard to predict. Notably, the recent rise in electric vehicles (EVs) has further contributed to this unpredictability. To address this issue, this paper proposes a probabilistic load forecasting strategy utilizing Gaussian process regression, structured in a day-ahead manner. While many works focus on deterministic prediction, probabilistic forecasting offers additional insights into variability and uncertainty, enabling more flexible and reliable operation for power systems. To enhance the accuracy of the load forecasting model, the inputs include features related to EV charging habits as well as commonly used weather information. The load forecasting results are evaluated using various metrics, including conventional ones that assess the accuracy of point forecasts, as well as additional metrics that test the reliability of prediction intervals. The proposed load forecasting method is finally tested on real residential power consumption data and EV charging data sampled from real-world sources. The results prove that the new features can greatly improve the performance of the load forecasting method.

electrical vehicle↗
DOE OSTI2021

Improving probabilistic infectious disease forecasting through coherence

With an estimated $10.4 billion in medical costs and 31.4 million outpatient visits each year, influenza poses a serious burden of disease in the United States. To provide insights and advance warning into the spread of influenza, the U.S. Centers for Disease Control and Prevention (CDC) runs a challenge for forecasting weighted influenza-like illness (wILI) at the national and regional level. Many models produce independent forecasts for each geographical unit, ignoring the constraint that the national wILI is a weighted sum of regional wILI, where the weights correspond to the population size of the region. We propose a novel algorithm that transforms a set of independent forecast distributions to obey this constraint, which we refer to as probabilistically coherent. Enforcing probabilistic coherence led to an increase in forecast skill for 79% of the models we tested over multiple flu seasons, highlighting the importance of respecting the forecasting system’s geographical hierarchy.

59 BASIC BIOLOGICAL SCIENCES↗