Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Weather Forecasting”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Data Assimilation with Machine Learning Surrogate Models: A Case Study with FourCastNet

Modern data-driven surrogate models for weather forecasting provide accurate short-term predictions but inaccurate and nonphysical long-term forecasts. This paper investigates online weather prediction using machine learning surrogates supplemented with partial and noisy observations. We empirically demonstrate and theoretically justify that, despite the long-time instability of the surrogates and the sparsity of the observations, filtering estimates can remain accurate in the long-time horizon. As a case study, we integrate FourCastNet, a weather surrogate model, within a variational data assimilation framework using partial, noisy ERA5 data. Our results show that filtering estimates remain accurate over a year-long assimilation window and provide effective initial conditions for forecasting tasks, including extreme event prediction.

Adrian, Melissa [Univ. of Chicago, IL (United Stat↗

Outage Forecast-Based Preventative Scheduling Model for Distribution System Resilience Enhancement

Distribution system resilience enhancement is an important topic to ensure customers have access to power supply during extreme events. In fact, certain weather-related extreme events can be predicted ahead of time. Therefore, it is important to investigate how to predict grid outages using extreme weather forecasts, and how outage predictions can be incorporated into distribution system resilience enhancement. In this paper, a preventative scheduling model for distribution systems is proposed. The model targets at allocating resources, especially mobile responsive resources such as mobile backup generators and mobile energy storage systems, to prepare for an extreme event in the day-ahead context. To achieve efficient resource allocation and scheduling, a machine learning-based outage prediction module is developed to predict vulnerable or risky segments of the distribution system based on historical operating records and extreme weather event forecast. By integrating the outage prediction results into the scheduling model, optimal resource allocation can be derived to help distribution systems prepare for an upcoming event and improve resilience performance. A real distribution feeder in North Carolina, U.S. is used in the case study to validate the proposed approach.

distributed energy resources↗

Outage Forecast-Based Preventative Scheduling Model for Distribution System Resilience Enhancement: Preprint

Distribution system resilience enhancement is an important topic to ensure customers have access to the power supply during extreme events. In fact, certain weather-related extreme events can be predicted ahead of time. Therefore, it is important to investigate how to predict grid outages using extreme weather forecasts, and how outage predictions can be incorporated into distribution system resilience enhancement. In this paper, a preventative scheduling model for distribution systems is proposed. The model targets at allocating resources, especially mobile responsive resources such as mobile backup generators and mobile energy storage systems, to prepare for an extreme event in the day-ahead context. To achieve efficient resource allocation and scheduling, a machine learning-based outage prediction module is developed to predict vulnerable or risky segments of the distribution system based on historical operating records and extreme weather event forecasts. By integrating the outage prediction results into the scheduling model, optimal resource allocation can be derived to help distribution systems prepare for an upcoming event and improve resilience performance. A real distribution feeder in North Carolina, U.S. is used in the case study to validate the proposed approach.

distributed energy resources↗

Institutional Framework of Variable Renewable Energy Forecasting in India

The share of variable renewable energy (VRE) in India is growing rapidly, with a national goal of reaching 50% capacity from non-fossil fuel generation by 2030. One implication of this growth is the need for improved VRE forecasting methods. For this reason, the Ministry of New and Renewable Energy (MNRE) in India commissioned this study with support from the United States Agency for International Development (USAID), the National Renewable Energy Laboratory (NREL) in the United States, and the National Institute of Wind Energy (NIWE) in India. The objective of this study was to review the existing institutional framework and suggest changes needed to support the plans for large-scale VRE integration in the country. To achieve that objective, the authors consulted local stakeholders about the status of VRE forecasting in India, reviewed existing studies, and examined VRE forecasting methods around the world to identify best practices. Based on those best practices, the study presents six potential approaches to improve the VRE forecasting framework in India. Approaches include incentivizing VRE forecast improvement and use of the most accurate VRE forecast, creating an institution that will optimize VRE forecasts while maintaining and ensuring access to necessary data for forecasting, implementing a review and certification process for VRE forecast providers, forecasting closer to dispatch time and allowing for more frequent forecast revisions, increasing the frequency of weather forecasts, and aggregating VRE forecasts at the point of interconnection.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Dynamic Line Rating Forecast Time Frames

As dynamic line ratings (DLR) are used to support different use cases, the preferred data source varies according to the forecast horizon. The below guidance is one possibility to utilize weather forecasting. Note that the time-periods of forecasts and spatial resolution may be subject to change as National Oceanic and Atmospheric Administration (NOAA)/National Weather Service (NWS) periodically upgrades its forecast models and data servers. Moreover, Persistence/ML Observations advances in analytics may justify combining data sources for more reliable DLR forecasts. The list below gives a time period (t) followed by possible guidance for data in that interval.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Evaluation of Model Summertime Boundary Layer Cloud Development over Complex Terrain in New York State

Weather forecasting over complex terrain with diverse land cover is challenging. Utilizing the high-resolution observations from New York State Mesonet (NYSM), we are able to evaluate the surface processes of the Weather Research Forecast (WRF) Model in a detailed, scale-dependent manner. Here, in the study, possible impacts of land–atmosphere interaction on surface meteorology and boundary layer cloud development are investigated with different model resolutions, land surface models (LSMs), and planetary boundary layer (PBL) physical parameterizations. The High-Resolution Rapid Refresh, version 3 (HRRR), forecasting model is used as a reference for the sensitivity evaluation. Results show that over complex terrain, the high-resolution simulations (1 km × 60 vertical levels) generally perform better compared to low-resolution (3 km × 50 levels) in both surface meteorology and cloud fields. LSMs play a more important role in surface meteorology compared to PBL schemes. The NoahMP land surface model exhibits daytime warmer and drier biases compared to the Rapid Update Cycle (RUC) due to better prediction of the Bowen ratio in RUC. The PBL schemes would affect the convective strength in the boundary layer. The Shin–Hong (SH) scale-aware scheme tends to produce the strongest convective strength in the PBL, while the ACM2 PBL scheme rarely resolved convection even at 1-km resolution. By considering the radiation effect of subgrid-scale (SGS) clouds, the Mellor–Yamada–Nakanishi–Niino eddy diffusivity mass flux (MYNN-EDMF) predicted the highest cloud coverage and lowest surface solar radiation bias. The configuration of SGS clouds in MYNN-EDMF would not only significantly reduce shortwave radiation bias, but also affect the convection behaviors through land surface–cloud–radiation interaction.

54 ENVIRONMENTAL SCIENCES↗

A 30-yr high-resolution weather research and forecasting model downscaling data over California and Nevada

This dataset presents a 30-year high resolution meteorological dataset obtained using the WRF model (Advanced version Research WRF version 4.4). We used WRF and European Centre for Medium-Range Weather Forecasts Reanalysis v5 as initial and boundary conditions to generate gridded meteorological variables. A large number of surface weather stations was used for model validation. A multi-physics analysis was first developed to identify a good physics suite extended from 6 November 00 UTC to 10 November 23 UTC, 2018, which included the Camp Fire in northern California. Based on the best physics suite, the downscaling dataset extends from 1 December to 28 February, 1990–2021 and the horizontal domain has 1.5 km grid spacing covering the entire states of California and Nevada in the United States. Comparisons between hourly surface observations and WRF simulations of air temperature, relative humidity and wind speeds show mean absolute errors on the order of (1.6-2.0 C), (10 %) and 1.2–1.5 m s -1 , respectively.

54 ENVIRONMENTAL SCIENCES↗

Short-Term Probabilistic Solar Forecasting via Reinforcement Learning over ECMWF

In this paper, we present an innovative reinforcement learning approach for short-term solar forecasting, leveraging data from the European Centre for Medium-Range Weather Forecasts (ECMWF). The methodology begins with the application of the System Advisor Model (SAM) to transform various ECMWF numerical weather prediction members into predictive photovoltaic power generation. To enhance the precision of deterministic forecasting, we introduce a dynamic model selection algorithm based on Q-learning. This algorithm dynamically identifies and utilizes the most accurate ensemble member for forecasting purposes. Furthermore, we employ a support vector regression surrogate model with a Gaussian distribution to generate probabilistic forecasts, providing a holistic view of solar energy generation uncertainty. To expedite the training process and make it more practical for real-world applications, we integrate a rolling update workflow. This innovative workflow reduces the training period from months to a mere 19 days, making our method highly efficient. Numerical results of the case study show that in comparison to benchmark models, the proposed method improves the deterministic and probabilistic solar forecasting accuracy by up to 40.84% and 48.42%, respectively.

ensemble forecasting↗

Performance of reanalysis and mesoscale models off the coast of Hawai'i

The eastern Hawai'i coast in the United States is characterized by considerable wind resource fuelled by persistent trade winds, making it an important area for energy research. The need is strong for reanalyses and higher-resolution regional simulations where observations have been historically limited, such as Hawai'i's offshore environments. However, studies using offshore observations in other parts of the world have shown that significant errors can occur in reanalyses and wind datasets, which can lead to inaccurate estimates of wind energy generation, payback periods, and extreme weather risks at project locations. The degree of such errors is influenced by a number of factors, including spatial resolution and the handling of processes within the planetary boundary layer (PBL). In this work, we provide a wind resource characterization from year-long lidar buoy measurements off the eastern coast of O'ahu, Hawai'i, an environment previously unobserved at the rotor level, and use the characterization to evaluate the performance of two simulation datasets. The O'ahu deployment location is meteorologically unique and less complex than land-based wind resource characterizations, being strongly characterized by trade winds with minimal land–atmosphere interaction influences. Despite the unique and fairly consistent meteorological conditions, we hypothesize that distinct simulation datasets will exhibit diverse ranges of errors similar to those that have been seen for other offshore locations. We find the European Centre for Medium-Range Weather Forecasts (ECMWF) Reanalysis version 5 (ERA5) to strongly underestimate observed wind speeds at the O'ahu location (bias = −1.54 m s −1 at a height of 140 m above sea level), while a regional Weather Research and Forecasting Model (WRF) simulation produced by the University of Hawai'i (UH-WRF) provides a significantly smaller wind speed bias (−0.25 m s −1 ), highlighting the value of running regional, higher-resolution simulations. The large bias noted for ERA5 is driven by significant underestimation of fast wind speeds (>9 m s −1 ), which the study site is largely characterized by, along with discontinuities in the ERA5 diurnal cycle. We also speculate that the relative sparsity of observations for data assimilation in this remote part of the world could influence the performance of ERA5 and that challenges with characterizing island effects could impact the performance of both datasets.

17 WIND ENERGY↗

Arctic extreme precipitation changes from 1980 to 2022 in response to sea ice decline and enhanced atmospheric rivers

Arctic extreme precipitation (EP) broadly impacts permafrost degradation, glacier and snow cover changes, and ice sheet mass balance as well as ecosystems. However, investigation of EP spatiotemporal variations over the Arctic remains challenging, and their primary drivers are still poorly understood. Performance estimation of three state-of-the-art reanalysis products (Climate Forecast System Reanalysis (CFSR), European Centre for Medium-Range Weather Forecasts Reanalysis version 5 (ERA-5), and Modern-Era Retrospective analysis for Research and Applications, version 2 (MERRA-2)) against gauge-based precipitation observations reveals that MERRA-2 outperforms other reanalysis for Arctic EP changes. Based on MERRA-2 data, both annual EP amount and occurrence days averaged over the Arctic show statistically significant positive trends during 1980–2022 (3.37 ± 1.03 mm dec −1 and 0.42 ± 0.17 d dec −1 , respectively), with the most pronounced increase in the autumn. Spatial heterogeneity in annual and seasonal EP trends is found across the Arctic, with the largest positive annual trends of 30 mm dec −1 over the Bering Sea and the Denmark Strait. The significant EP increase is closely associated with intensified atmospheric rivers (ARs) and widespread decline in sea ice concentration (SIC). Specially, SIC and ARs are responsible for 12% and 50% of Arctic EP inter-annual variance, respectively, while ARs directly contribute 28.3% of the total annual EP amounts. These findings explain the mechanistic controls on Arctic EP, providing critical insights for projecting polar weather and climate extremes and their impacts on the Arctic environment.

atmospheric rivers↗

VisMetHack2022: Visualizing winds and surface variables from the ECMWF IFS 1-km nature run

This data collection was contributed to the Visualisation Hackathon 2022 (#VisMetHack2022), in conjunction with the Using ECMWF's Forecasts (UEF2022) workshop. The European Center for Medium-Range Weather Forecasts (ECMWF) and the Oak Ridge National Laboratory (ORNL) are pleased to announce access to the data collection from global 1-km nature run (NR) simulations using the Integrated Forecast System (IFS) with explicit convection. We invite you to join us in exploring this precursor to a digital twin of the earth! The NR simulations reveal unprecedented detail of the earth’s atmosphere, and the then outgoing Editor-in-Chief of AGU JAMES commended the project as one of “stunning ambitions,” enabled by computational capacity at scale. The project also won the 2020 HPCwire Readers Choice Award for Best Use of HPC in Physical Sciences. A set of two NR seasonal simulations have been completed, one corresponding to the northern hemispheric winter months (NDJF) and the other for the North Atlantic tropical cyclone season (ASO). The project used the Summit supercomputer at the Oak Ridge Leadership Computing Facility (OLCF). The simulations were facilitated with an INCITE award from the US Department of Energy Office of Science. For the first seasonal run of four months (NDJF), the hydrostatic IFS model was initialized at 00Z on 1 November 2018. The NR for the TC season (AS) was initialized at 00Z on 1 August 2019. The NR simulations were constrained only by sea surface temperatures (SST) at the lower boundary. The IFS output was saved every 3 hours. After feedback and interest from the scientific community, the simulations were rerun for four specific extreme events, with output every 15 minutes. The special cases include a tropical cycle and three severe storm events over the continental USA.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of the Fitch Wind-Farm Wake Parameterization with Large-Eddy Simulations of Wakes Using the Weather Research and Forecasting Model

Abstract Wind-farm parameterizations in weather models can be used to predict both the power output and farm effects on the flow; however, their correctness has not been thoroughly assessed. We evaluate the wind-farm parameterization of the Weather Research and Forecasting Model with large-eddy simulations (LES) of the wake performed with the same model. We study the impact on the velocity and turbulence kinetic energy (TKE) of inflow velocity, roughness, resolution, number of turbines (one or two), and inversion height and strength. We compare the mesoscale with the LES by spatially averaging the LES within areas correspondent to the mesoscale horizontal spacing: one covering the turbine area and two downwind. We find an excellent agreement of the velocity within the turbine area between the two types of simulations. However, within the same area, we find the largest TKE discrepancies because in mesoscale simulations, the turbine-added TKE has to be highest at the turbine position to be advected downwind. Within the downwind areas, differences between velocities increase as the wake recovers faster in the LES, whereas for the TKE both types of simulations show similar levels. From the various configurations, the impact of inversion height and strength is small for these heights and inversion levels. The highest impact for the one-turbine simulations appears under the low-speed case due to the higher thrust, whereas the impact of resolution is low for the large-eddy simulations but high for the mesoscale simulations. Our findings demonstrate that higher-fidelity simulations are needed to validate wind-farm parameterizations.

17 WIND ENERGY↗

Deep Learning Image Segmentation for Atmospheric Rivers

Abstract The identification of atmospheric rivers (ARs) is crucial for weather and climate predictions as they are often associated with severe storm systems and extreme precipitation, which can cause large impacts on society. This study presents a deep learning model, termed ARDetect, for image segmentation of ARs using ERA5 data from 1960 to 2020 with labels obtained from the TempestExtremes tracking algorithm. ARDetect is a convolutional neural network (CNN)-based U-Net model, with its structure having been optimized using automatic hyperparameter tuning. Inputs to ARDetect were selected to be the integrated water vapor transport (IVT) and total column water (TCW) fields, as well as the AR mask from TempestExtremes from the previous time step to the one being considered. ARDetect achieved a mean intersection-over-union (mIoU) rate of 89.04% for ARs, indicating its high accuracy in identifying these weather patterns and a superior performance than most deep learning–based models for AR detection. In addition, ARDetect can be executed faster than the TempestExtremes method (seconds vs minutes) for the same period. This provides a significant benefit for online AR detection, especially for high-resolution global models. An ensemble of 10 models, each trained on the same dataset but having different starting weights, was used to further improve on the performance produced by ARDetect, thus demonstrating the importance of model diversity in improving performance. ARDetect provides an effective and fast deep learning–based model for researchers and weather forecasters to better detect and understand ARs, which have significant impacts on weather-related events such as floods and droughts.

Galea, Daniel↗

Optimizing the Weather Research and Forecasting Model with OpenMP Offload and Codee

Currently, the Weather Research and Forecasting model (WRF) utilizes shared memory (OpenMP) and distributed memory (MPI) parallelisms. To take advantage of GPU resources on the Perlmutter supercomputer at NERSC, we port parts of the computationally expensive routine Fast Spectral Bin Microphysics (FSBM) to NVIDIA GPUs using OpenMP device offloading directives. To facilitate this process, we explore a workflow for optimization which uses both runtime profilers and a static code inspection tool Codee to refactor the subroutine. We observe an 2.24x overall speedup for the CONUS-12km storm test case.

Wichitrnithed, Chayanon (Namo) [Odin Institute]↗

HexWeather: Hexagonal Spatial Data Aggregation for Weather-Driven Grid Resilience Analysis

Extreme weather accounts for over 8 0 % of major U.S. power outages since 2000, highlighting the need for spatial tools that align weather data with the irregular boundaries of electric infrastructure. This paper introduces HexWeather, a modular, resolution-aware framework for aggregating historical and forecasted weather data using Uber's H3 hexagonal spatial indexing system. Unlike traditional methods that rely on state or county-level grids, HexWeather enables weather analysis across custom geographies such as utility service areas where public datasets are often unavailable or misaligned. Using Open-Meteo data, we evaluate how H3 resolution affects anomaly detection, spatial variability, and forecast uncertainty across three scales: state, county, and utility. Results show that while coarse resolutions suffice for broad trend tracking, finer resolutions are essential for identifying localized variability and operational risks. By applying metrics like Z-score standard deviation and interquartile range, HexWeather quantifies the spatial spread of both historical anomalies and forecasted conditions, allowing users to assess resolution adequacy for each analysis. This framework supports rapid weather data reuse, reproducible anomaly detection, and predictive modeling for infrastructure resilience. By bridging spatial misalignment in traditional datasets and enabling retrospective and forward-looking analysis within the same pipeline, HexWeather lays the groundwork for better post event analysis, outage prediction, and resilience planning.

Morris, Jacob [ORNL]↗

Efficient high-dimensional variational data assimilation with machine-learned reduced-order models

Abstract. Data assimilation (DA) in geophysical sciences remains the cornerstone of robust forecasts from numerical models. Indeed, DA plays a crucial role in the quality of numerical weather prediction and is a crucial building block that has allowed dramatic improvements in weather forecasting over the past few decades. DA is commonly framed in a variational setting, where one solves an optimization problem within a Bayesian formulation using raw model forecasts as a prior and observations as likelihood. This leads to a DA objective function that needs to be minimized, where the decision variables are the initial conditions specified to the model. In traditional DA, the forward model is numerically and computationally expensive. Here we replace the forward model with a low-dimensional, data-driven, and differentiable emulator. Consequently, gradients of our DA objective function with respect to the decision variables are obtained rapidly via automatic differentiation. We demonstrate our approach by performing an emulator-assisted DA forecast of geopotential height. Our results indicate that emulator-assisted DA is faster than traditional equation-based DA forecasts by 4 orders of magnitude, allowing computations to be performed on a workstation rather than a dedicated high-performance computer. In addition, we describe accuracy benefits of emulator-assisted DA when compared to simply using the emulator for forecasting (i.e., without DA). Our overall formulation is denoted AIEADA (Artificial Intelligence Emulator-Assisted Data Assimilation).

58 GEOSCIENCES↗

California - Quality-Controlled Reanalysis and Observational Data for Buoy (130), Morro Bay / Derived Data

This collection provides spatiotemporally paired reanalysis and satellite data to supplement the lidar buoy observations during the California deployments. Point time series of observed and reanalysis data are provided, using inverse distance weighting to geolocate the reanalysis data to the buoy location. Gridded time series of reanalysis data are provided, covering the California coast and extending into the Pacific Ocean. Satellite data in the coastal California region are also provided. The reanalysis collection includes the Modern-Era Retrospective Analysis for Research and Applications version 2 (MERRA-2), the Climate Forecast System version 2 (CFSv2), the North American Regional Reanalysis (NARR), the European Centre for Medium-Range Weather Forecasts Reanalysis version 5 (ERA5), and the analysis system of the Rapid Refresh (RAP). The satellite data collection is that of Ribal and Young (2019). All datasets are publicly available with the sources provided in the References section.

17 WIND ENERGY↗

California - Quality-controlled Reanalysis and Observational Data for Buoy (120), Humboldt / Derived Data

This collection provides spatiotemporally paired reanalysis and satellite data to supplement the lidar buoy observations during the California deployments. Point time series of observed and reanalysis data are provided, using inverse distance weighting to geolocate the reanalysis data to the buoy location. Gridded time series of reanalysis data are provided, covering the California coast and extending into the Pacific Ocean. Satellite data in the coastal California region are also provided. The reanalysis collection includes the Modern-Era Retrospective Analysis for Research and Applications version 2 (MERRA-2), the Climate Forecast System version 2 (CFSv2), the North American Regional Reanalysis (NARR), the European Centre for Medium-Range Weather Forecasts Reanalysis version 5 (ERA5), and the analysis system of the Rapid Refresh (RAP). The satellite data collection is that of Ribal and Young (2019). All datasets are publicly available with the sources provided in the References section.

17 WIND ENERGY↗