Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Weather Forecasting”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Data Assimilation with Machine Learning Surrogate Models: A Case Study with FourCastNet

Modern data-driven surrogate models for weather forecasting provide accurate short-term predictions but inaccurate and nonphysical long-term forecasts. This paper investigates online weather prediction using machine learning surrogates supplemented with partial and noisy observations. We empirically demonstrate and theoretically justify that, despite the long-time instability of the surrogates and the sparsity of the observations, filtering estimates can remain accurate in the long-time horizon. As a case study, we integrate the Fourier Forecasting Neural Network (FourCastNet), a weather surrogate model, within a variational data assimilation framework using partial, noisy ERA5 global reanalysis data from the European Centre for Medium-Range Weather Forecasts (ECMWF). Here, our results show that filtering estimates remain accurate over a year-long assimilation window and provide effective initial conditions for forecasting tasks, including extreme event prediction.

Data assimilation↗

Contrasting Trends in Colorado Fire Weather Index from Reanalysis and Observations

Recent wildfires in Colorado raise the question of whether rising global temperatures have increased fire weather occurrences in Colorado. The U.S. National Weather Service defines fire weather as when “forecast weather conditions will result in a significant threat for the ignition and/or spread of wildfires.” We use two datasets to address the question: “How has the occurrence of fire weather changed in Colorado?” Using 22 years of observed weather conditions from a meteorological tower at the National Renewable Energy Laboratory and 67 years of ERA5 reanalysis data, we assess changing trends in Colorado fire weather as defined by hot, dry, and windy conditions. Additionally, we explore if the difference in recorded wind speeds between observational data and reanalysis data can be explained by differences in spatial and temporal resolution and what are the implications in the context of quantifying fire weather occurrences. The observational data are limited in temporal extent and spatial representativeness, but they capture exact real-world conditions at a location in complex terrain. The reanalysis data are available for an extended period of time and for the entire state, but the data are of relatively coarse spatial and temporal resolution and may fail to capture extremes. To quantify fire risk, we calculate the hot–dry–windy index (HDWI), which relies on wind speed and vapor pressure deficit. No statistically significant trend in the HDWI appears in the observational dataset. However, according to the reanalysis data, strong increasing trends in HDWI values emerge across all of Colorado. This apparent conflict between observational and reanalysis data suggests that reanalysis data may not be representative. Further, more long-term observational datasets are required to assess fire risk.

17 WIND ENERGY↗

Outage Forecast-Based Preventative Scheduling Model for Distribution System Resilience Enhancement

Distribution system resilience enhancement is an important topic to ensure customers have access to power supply during extreme events. In fact, certain weather-related extreme events can be predicted ahead of time. Therefore, it is important to investigate how to predict grid outages using extreme weather forecasts, and how outage predictions can be incorporated into distribution system resilience enhancement. In this paper, a preventative scheduling model for distribution systems is proposed. The model targets at allocating resources, especially mobile responsive resources such as mobile backup generators and mobile energy storage systems, to prepare for an extreme event in the day-ahead context. To achieve efficient resource allocation and scheduling, a machine learning-based outage prediction module is developed to predict vulnerable or risky segments of the distribution system based on historical operating records and extreme weather event forecast. By integrating the outage prediction results into the scheduling model, optimal resource allocation can be derived to help distribution systems prepare for an upcoming event and improve resilience performance. A real distribution feeder in North Carolina, U.S. is used in the case study to validate the proposed approach.

distributed energy resources↗

Towards Scaling Law Analysis For Spatiotemporal Weather Data

Compute-optimal scaling laws are relatively well studied for NLP and CV, where objectives are typically single-step and targets are comparatively homogeneous. Weather forecasting is harder to characterize in the same framework: autoregressive rollouts compound errors over long horizons, outputs couple many physical channels with disparate scales and predictability, and globally pooled test metrics can disagree sharply with per-channel, late-lead behavior implied by short-horizon training. We extend neural scaling analysis for autoregressive weather forecasting from single-step training loss to long rollouts and per-channel metrics. We quantify (1) how prediction error is distributed across channels and how its growth rate evolves with forecast horizon, (2) if power law scaling holds for test error, relative to rollout length when error is pooled globally, and (3) how that fit varies jointly with horizon and channel for parameter, data, and compute-based scaling axes. We find strong cross-channel and cross-horizon heterogeneity: pooled scaling can look favorable while many channels degrade at late leads. We discuss implications for weighted objectives, horizon-aware curricula, and resource allocation across outputs.

Kiefer Jr, Alexander [ORNL] (ORCID:000000025398874↗

Recommendations for Comprehensive and Independent Evaluation of Machine Learning‐Based Earth System Models

Abstract Machine learning (ML) is a revolutionary technology with demonstrable applications across multiple disciplines. Within the Earth science community, ML has been most visible for weather forecasting, producing forecasts that rival modern physics‐based models. Given the importance of deepening our understanding and improving predictions of the Earth system on all time scales, efforts are now underway to develop Earth‐system models (ESMs) capable of representing all components of the coupled Earth system (or their aggregated behavior) and their response to external changes over long timescales. Building trust in ESMs is a much more difficult problem than for weather forecast models, not least because the model must represent the alternate (e.g., future or paleoclimatic) coupled states of the system for which there are no direct observations. Given that the physical principles that enable predictions about the response of the Earth system are often not explicitly coded in these ML‐based models, demonstrating the credibility of ML‐based ESMs thus requires us to build evidence of their consistency with the physical system. To this end, this paper puts forward five recommendations to enhance comprehensive, standardized, and independent evaluation of ML‐based ESMs to strengthen their credibility and promote their wider use.

54 ENVIRONMENTAL SCIENCES↗

Mesoscale Organization in Cumulus-Coupled Stratocumulus

Marine cloud systems cover a substantial portion of the world’s oceans. Most of these clouds form relatively close to the ocean surface, typically within one to two kilometers, a region referred to by meteorologists as the marine boundary layer. They are composed predominantly of liquid water, although ice particles can occur in mid- and high-latitude marine clouds during winter. In satellite imagery, these clouds appear bright against the darker ocean surface below, reflecting a large fraction of incoming sunlight back into space that would otherwise warm the ocean. Because marine boundary layer clouds cover such an extensive area of the ocean, they exert a significant influence on Earth’s overall transfer of solar energy absorbed by the surface and thermal energy emitted to space, a balance known as the planetary radiation budget. Marine boundary layer clouds are typically thin, and their formation and dissipation depend on a delicate balance between processes acting at the ocean surface below and the warm, dry air above. They are notoriously difficult to simulate accurately in weather forecast models, which often produce too few marine low clouds in midlatitudes and clouds in tropical regions that are excessively bright, meaning they reflect too much solar radiation. The marine boundary layer is frequently characterized by widespread overcast cloud cover that often transitions from a continuous, single-layer deck to more broken cloud fields toward the tropics. These transitions typically proceed through an intermediate stage in which shallow, broken clouds form beneath the overlying stratiform cloud deck. Once broken clouds develop below the overcast, they frequently self-organize into cloud clusters known as marine boundary layer convective complexes (MBLCCs), although the mechanisms governing the formation and organization of MBLCCs remain poorly understood. Accurately representing these transitions in long-range weather forecast models is essential because they influence the properties of air masses advected over the continental United States and Europe, and they become increasingly important for forecasts on seasonal and longer timescales. We employed two complementary approaches to investigate the processes controlling MBLCCs and their impact on marine cloud cover. Long-term observations from the U.S. Department of Energy’s Eastern North Atlantic (ENA) Observatory provided a unique dataset that allowed us to characterize fundamental properties of MBLCCs, including their typical size and frequency of occurrence. These observations were combined with high-resolution numerical simulations performed on supercomputers to examine the evolution of MBLCCs during cold-air outbreaks over the ENA region.

54 ENVIRONMENTAL SCIENCES↗

Improved Diagnosis of Precipitation Type with LightGBM Machine Learning

Abstract Existing precipitation-type algorithms have difficulty discerning the occurrence of freezing rain and ice pellets. These inherent biases are not only problematic in operational forecasting but also complicate the development of model-based precipitation-type climatologies. To address these issues, this paper introduces a novel light gradient-boosting machine (LightGBM)-based machine learning precipitation-type algorithm that utilizes reanalysis and surface observations. By comparing it with the Bourgouin precipitation-type algorithm as a baseline, we demonstrate that our algorithm improves the critical success index (CSI) for all examined precipitation types. Moreover, when compared with the precipitation-type diagnosis in reanalysis, our algorithm exhibits increased F1 scores for snow, freezing rain, and ice pellets. Subsequently, we utilize the algorithm to compute a freezing-rain climatology over the eastern United States. The resulting climatology pattern aligns well with observations; however, a significant mean bias is observed. We interpret this bias to be influenced by both the algorithm itself and assumptions regarding precipitation processes, which include biases associated with freezing drizzle, precipitation occurrence, and regional synoptic weather patterns. To mitigate the overall bias, we propose increasing the precipitation cutoff from 0.04 to 0.25 mm h −1 , as it better reflects the precision of precipitation observations. This adjustment yields a substantial reduction in the overall bias. Finally, given the strong performance of LightGBM in predicting mixed precipitation episodes, we anticipate that the algorithm can be effectively utilized in operational settings and for diagnosing precipitation types in climate model outputs. Significance Statement Freezing rain can have significant impacts on transportation and infrastructure, making accurate prediction of precipitation types crucial. In this study, we use a machine learning method known as LightGBM to predict precipitation types. We show that the new algorithm performs better than the existing methods for all precipitation types examined. Additionally, we compute a freezing-rain climatology over the eastern United States. Although the resulting climatology pattern corresponds well to observations, the algorithm overpredicts freezing-rain occurrence. We argue that this bias can be substantially reduced by increasing the precipitation cutoff from 0.04 to 0.25 mm h −1 . Overall, this work highlights the potential of the LightGBM algorithm for both weather forecasting and diagnosing precipitation types in climate models.

Meteorology & Atmospheric Sciences↗

The relative importance of building design parameters in reducing energy use and sensible heat release from buildings in light of forecasted future weather data and building coverage ratio

Buildings typically have a 60-to-75-year lifespan before they require significant maintenance or modifications. However, most builders evaluate the performance of their new buildings using whole-building energy simulation tools based on the current typical meteorological year (TMY) file or actual meteorological year. The energy use consumption and sensible heat release pattern observed from buildings could potentially change based on shifting global climates. Therefore, the recommended energy-efficiency design parameters might also change during these periods. In this study, we evaluate the role of different building design parameters, such as material reflectivity, HVAC COP, and insulation values, on building energy usage and sensible heat release from buildings with different building coverage ratios (BCR), based on the current and future weather file TMY (fTMY) for the middle of the century (2040–2060). The role of sensible heat release from buildings is not accounted for accurately while estimating building energy usage in most whole-building energy simulations. The study conducts a series of whole-building energy simulation analyses using EnergyPlus to evaluate the role of different design parameters based on TMY and fTMY weather conditions. The analysis is conducted for two hot desert climatic cities: Phoenix (USA) and Abu Dhabi (UAE). The results show that, for the base case in a future climate, the sensible heat release is reduced by an average of 30% due to the reduced delta T between the surface and ambient air. Further, the results show an increase in total energy consumption by 5% annually. The results also show that, for buildings with traditional coatings, shorter buildings release more heat than taller buildings. On the other hand, for buildings with reflective paints, shorter buildings release less heat than taller buildings. The findings from this study can be used by policymakers, utility companies, and builders to better understand the relative role of different building design parameters while constructing new and retrofitting existing buildings.

Alhazmi, Mansour [King Fahd University of Petroleu↗

On the predictability of turbulent fluxes from land: PLUMBER2 MIP experimental description and preliminary results

Accurate representation of the turbulent exchange of carbon, water, and heat between the land surface and the atmosphere is critical for modelling global energy, water, and carbon cycles in both future climate projections and weather forecasts. Evaluation of models' ability to do this is performed in a wide range of simulation environments, often without explicit consideration of the degree of observational constraint or uncertainty and typically without quantification of benchmark performance expectations. We describe a Model Intercomparison Project (MIP) that attempts to resolve these shortcomings, comparing the surface turbulent heat flux predictions of around 20 different land models provided with in situ meteorological forcing evaluated with measured surface fluxes using quality-controlled data from 170 eddy-covariance-based flux tower sites. Predictions from seven out-of-sample empirical models are used to quantify the information available to land models in their forcing data and so the potential for land model performance improvement. Sites with unusual behaviour, complicated processes, poor data quality, or uncommon flux magnitude are more difficult to predict for both mechanistic and empirical models, providing a means of fairer assessment of land model performance. When examining observational uncertainty, model performance does not appear to improve in low-turbulence periods or with energy-balance-corrected flux tower data, and indeed some results raise questions about whether the energy balance correction process itself is appropriate. In all cases the results are broadly consistent, with simple out-of-sample empirical models, including linear regression, comfortably outperforming mechanistic land models. In all but two cases, latent heat flux and net ecosystem exchange of CO 2 are better predicted by land models than sensible heat flux, despite it seeming to have fewer physical controlling processes. Land models that are implemented in Earth system models also appear to perform notably better than stand-alone ecosystem (including demographic) models, at least in terms of the fluxes examined here. The approach we outline enables isolation of the locations and conditions under which model developers can know that a land model can improve, allowing information pathways and discrete parameterisations in models to be identified and targeted for future model development.

54 ENVIRONMENTAL SCIENCES↗

Advancing ocean monitoring and knowledge for societal benefit: the urgency to expand Argo to OneArgo by 2030

The ocean plays an essential role in regulating Earth’s climate, influencing weather conditions, providing sustenance for large populations, moderating anthropogenic climate change, encompassing massive biodiversity, and sustaining the global economy. Human activities are changing the oceans, stressing ocean health, threatening the critical services the ocean provides to society, with significant consequences for human well-being and safety, and economic prosperity. Effective and sustainable monitoring of the physical, biogeochemical state and ecosystem structure of the ocean, to enable climate adaptation, carbon management and sustainable marine resource management is urgently needed. The Argo program, a cornerstone of the Global Ocean Observing System (GOOS), has revolutionized ocean observation by providing real-time, freely accessible global temperature and salinity data of the upper 2,000m of the ocean (Core Argo) using cost-effective simple robotics. For the past 25 years, Argo data have underpinned many ocean, climate and weather forecasting services, playing a fundamental role in safeguarding goods and lives. Argo data have enabled clearer assessments of ocean warming, sea level change and underlying driving processes, as well as scientific breakthroughs while supporting public awareness and education. Building on Argo’s success, OneArgo aims to greatly expand Argo’s capabilities by 2030, expanding to full-ocean depth, collecting biogeochemical parameters, and observing the rapidly changing polar regions. Providing a synergistic subsurface and global extension to several key space-based Earth Observation missions and GOOS components, OneArgo will enable biogeochemical and ecosystem forecasting and new long-term climate predictions for which the deep ocean is a key component. Driving forward a revolution in our understanding of marine ecosystems and the poorly-measured polar and deep oceans, OneArgo will be instrumental to assess sea level change, ocean carbon fluxes, acidification and deoxygenation. Emerging OneArgo applications include new views of ocean mixing, ocean bathymetry and sediment transport, and ecosystem resilience assessment. Implementing OneArgo requires about $100 million annually, a significant increase compared to present Argo funding. OneArgo is a strategic and cost-effective investment which will provide decision-makers, in both government and industry, with the critical knowledge needed to navigate the present and future environmental challenges, and safeguard both the ocean and human wellbeing for generations to come.

ARGO↗

Forecasting for the Weather Driven Energy System - A New Task under IEA Wind

The energy system needs a range of forecast types for its operation in addition to the narrow wind power forecast that has been the focus of considerable recent attention. Therefore, the group behind the former IEA Wind Task 36 Forecasting for Wind Energy has initiated a new IEA Wind Task with a much broader perspective, which includes prospective interaction with other IEA Technology Collaboration Programmes such as the ones for PV, hydropower, system integration, hydrogen etc. In the new IEA Wind Task 51 (entitled "Foreacsting for the Weather Drive Energy System") the existing Work Packages (WPs) are complemented by work streams in a matrix structure. The Task is divided in three WPs according to the stakeholders: WP1 is mainly aimed at meteorologists, providing the weather forecast basis for the power forecasts. In WP2, the forecast service vendors are the main stakeholders, while the end users populate WP3. The new Task 51 started in January 2022. Planned activities include 4 workshops. The first will focus on the state of the art in forecasting for the energy system plus related research issues and be held during September 2022 in Dublin. The other three workshops will be held later during the 4-year Task period and address (1) seasonal forecasting with emphasis on Dunkelflaute, storage and hydro, (2) minute-scale forecasting, and (3) extreme power system events. The issues and conclusions of each of the workshops will be documented by a published paper. Additionally, the Recommended Practice on Forecast Solution Selection will be updated to reflect the broader perspective.

geophysics computing↗

Data Assimilation with Machine Learning Surrogate Models: A Case Study with FourCastNet

Modern data-driven surrogate models for weather forecasting provide accurate short-term predictions but inaccurate and nonphysical long-term forecasts. This paper investigates online weather prediction using machine learning surrogates supplemented with partial and noisy observations. We empirically demonstrate and theoretically justify that, despite the long-time instability of the surrogates and the sparsity of the observations, filtering estimates can remain accurate in the long-time horizon. As a case study, we integrate FourCastNet, a weather surrogate model, within a variational data assimilation framework using partial, noisy ERA5 data. Our results show that filtering estimates remain accurate over a year-long assimilation window and provide effective initial conditions for forecasting tasks, including extreme event prediction.

Adrian, Melissa [Univ. of Chicago, IL (United Stat↗

Outage Forecast-Based Preventative Scheduling Model for Distribution System Resilience Enhancement

Distribution system resilience enhancement is an important topic to ensure customers have access to power supply during extreme events. In fact, certain weather-related extreme events can be predicted ahead of time. Therefore, it is important to investigate how to predict grid outages using extreme weather forecasts, and how outage predictions can be incorporated into distribution system resilience enhancement. In this paper, a preventative scheduling model for distribution systems is proposed. The model targets at allocating resources, especially mobile responsive resources such as mobile backup generators and mobile energy storage systems, to prepare for an extreme event in the day-ahead context. To achieve efficient resource allocation and scheduling, a machine learning-based outage prediction module is developed to predict vulnerable or risky segments of the distribution system based on historical operating records and extreme weather event forecast. By integrating the outage prediction results into the scheduling model, optimal resource allocation can be derived to help distribution systems prepare for an upcoming event and improve resilience performance. A real distribution feeder in North Carolina, U.S. is used in the case study to validate the proposed approach.

distributed energy resources↗

Outage Forecast-Based Preventative Scheduling Model for Distribution System Resilience Enhancement: Preprint

Distribution system resilience enhancement is an important topic to ensure customers have access to the power supply during extreme events. In fact, certain weather-related extreme events can be predicted ahead of time. Therefore, it is important to investigate how to predict grid outages using extreme weather forecasts, and how outage predictions can be incorporated into distribution system resilience enhancement. In this paper, a preventative scheduling model for distribution systems is proposed. The model targets at allocating resources, especially mobile responsive resources such as mobile backup generators and mobile energy storage systems, to prepare for an extreme event in the day-ahead context. To achieve efficient resource allocation and scheduling, a machine learning-based outage prediction module is developed to predict vulnerable or risky segments of the distribution system based on historical operating records and extreme weather event forecasts. By integrating the outage prediction results into the scheduling model, optimal resource allocation can be derived to help distribution systems prepare for an upcoming event and improve resilience performance. A real distribution feeder in North Carolina, U.S. is used in the case study to validate the proposed approach.

distributed energy resources↗

Institutional Framework of Variable Renewable Energy Forecasting in India

The share of variable renewable energy (VRE) in India is growing rapidly, with a national goal of reaching 50% capacity from non-fossil fuel generation by 2030. One implication of this growth is the need for improved VRE forecasting methods. For this reason, the Ministry of New and Renewable Energy (MNRE) in India commissioned this study with support from the United States Agency for International Development (USAID), the National Renewable Energy Laboratory (NREL) in the United States, and the National Institute of Wind Energy (NIWE) in India. The objective of this study was to review the existing institutional framework and suggest changes needed to support the plans for large-scale VRE integration in the country. To achieve that objective, the authors consulted local stakeholders about the status of VRE forecasting in India, reviewed existing studies, and examined VRE forecasting methods around the world to identify best practices. Based on those best practices, the study presents six potential approaches to improve the VRE forecasting framework in India. Approaches include incentivizing VRE forecast improvement and use of the most accurate VRE forecast, creating an institution that will optimize VRE forecasts while maintaining and ensuring access to necessary data for forecasting, implementing a review and certification process for VRE forecast providers, forecasting closer to dispatch time and allowing for more frequent forecast revisions, increasing the frequency of weather forecasts, and aggregating VRE forecasts at the point of interconnection.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Dynamic Line Rating Forecast Time Frames

As dynamic line ratings (DLR) are used to support different use cases, the preferred data source varies according to the forecast horizon. The below guidance is one possibility to utilize weather forecasting. Note that the time-periods of forecasts and spatial resolution may be subject to change as National Oceanic and Atmospheric Administration (NOAA)/National Weather Service (NWS) periodically upgrades its forecast models and data servers. Moreover, Persistence/ML Observations advances in analytics may justify combining data sources for more reliable DLR forecasts. The list below gives a time period (t) followed by possible guidance for data in that interval.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Evaluation of Model Summertime Boundary Layer Cloud Development over Complex Terrain in New York State

Weather forecasting over complex terrain with diverse land cover is challenging. Utilizing the high-resolution observations from New York State Mesonet (NYSM), we are able to evaluate the surface processes of the Weather Research Forecast (WRF) Model in a detailed, scale-dependent manner. Here, in the study, possible impacts of land–atmosphere interaction on surface meteorology and boundary layer cloud development are investigated with different model resolutions, land surface models (LSMs), and planetary boundary layer (PBL) physical parameterizations. The High-Resolution Rapid Refresh, version 3 (HRRR), forecasting model is used as a reference for the sensitivity evaluation. Results show that over complex terrain, the high-resolution simulations (1 km × 60 vertical levels) generally perform better compared to low-resolution (3 km × 50 levels) in both surface meteorology and cloud fields. LSMs play a more important role in surface meteorology compared to PBL schemes. The NoahMP land surface model exhibits daytime warmer and drier biases compared to the Rapid Update Cycle (RUC) due to better prediction of the Bowen ratio in RUC. The PBL schemes would affect the convective strength in the boundary layer. The Shin–Hong (SH) scale-aware scheme tends to produce the strongest convective strength in the PBL, while the ACM2 PBL scheme rarely resolved convection even at 1-km resolution. By considering the radiation effect of subgrid-scale (SGS) clouds, the Mellor–Yamada–Nakanishi–Niino eddy diffusivity mass flux (MYNN-EDMF) predicted the highest cloud coverage and lowest surface solar radiation bias. The configuration of SGS clouds in MYNN-EDMF would not only significantly reduce shortwave radiation bias, but also affect the convection behaviors through land surface–cloud–radiation interaction.

54 ENVIRONMENTAL SCIENCES↗