Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Weather Forecasting”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Analyzing and Exploring Training Recipes for Large-Scale Transformer-Based Weather Prediction

Abstract The rapid rise of deep learning (DL) in numerical weather prediction (NWP) has led to a proliferation of models which forecast atmospheric variables with comparable or superior skill than traditional physics-based NWP. However, among these leading DL models, there is a wide variance in both the training settings and architecture used. Further, the lack of thorough ablation studies makes it hard to discern which components are most critical to success. In this work, we show that it is possible to attain high forecast skill even with relatively off-the-shelf architectures, simple training procedures, and moderate compute budgets. Specifically, we train a minimally modified Swin Transformer V2 (SwinV2) on ERA5 data and find that it attains superior skill in terms of mean-square errors of deterministic forecasts when compared against the European Centre for Medium-Range Weather Forecasts’ Integrated Forecasting System (IFS). Almost all DL–NWP systems share a core set of hyperparameters and design decisions. To aid and expedite future DL–NWP research, we present an in-depth, systematic exploration of different loss functions, model sizes and depths, patch sizes, and multistep training objectives. We also examine the model performance with metrics beyond the typical accuracy (ACC) and RMSE and investigate how the performance scales with model size. Through our open-source code, scoring pipelines, and models, we share our findings on key aspects of the training pipeline. These ablations reduce the necessity for expensive hyperparameter tuning and lower the barrier to entry for future DL–NWP research. Significance Statement This study investigates the potential of using large-scale transformer-based models for weather prediction, showing that it is possible to achieve high forecast accuracy with simpler, off-the-shelf architectures. By training a minimally modified SwinV2 transformer on ERA5 data, we show that the model achieves competitive forecast skill in terms of mean-square error for key variables, outperforming the European Centre for Medium-Range Weather Forecasts’ Integrated Forecasting System (IFS) at all lead times. Our findings suggest that effective training strategies, such as multistep fine-tuning and channel-weighted losses, significantly enhance the model’s performance. However, we also highlight that these improvements come with trade-offs in other areas, such as ensemble spread and high-frequency spatial detail. This work highlights the promise of deep learning in improving weather forecasts, which could lead to better preparedness and response to weather events, ultimately benefiting society by providing more reliable weather predictions.

Willard, Jared D. [Lawrence Berkeley National Labo↗

Meta-modeling strategy for data-driven forecasting

Accurately forecasting the weather is a key requirement for climate change mitigation. Data-driven methods offer the ability to make more accurate forecasts, but lack interpretability and can be expensive to train and deploy if models are not carefully developed. Here, we make use of two historical climate data sets and tools from machine learning, to accurately predict temperature fields. Furthermore, we are able to use low fidelity models that are cheap to train and evaluate, to selectively avoid expensive high fidelity function evaluations, as well as uncover seasonal variations in predictive power. This allows for an adaptive training strategy for computationally efficient geophysical emulation.

Skinner, Dominic J↗

Extreme Scale Infrasound Inversion and Prediction for Weather Characterization and Acute Event Detection

Accurate and timely weather predictions are critical to many aspects of society with a profound impact on our economy, general well-being, and national security. In particular, our ability to forecast severe weather systems is necessary to avoid injuries and fatalities, but also important to minimize infrastructure damage and maximize mitigation strategies. The weather community has developed a range of sophisticated numerical models that are executed at various spatial and temporal scales in an attempt to issue global, regional, and local forecasts in pseudo real time. The accuracy however depends on the time period of the forecast, the nonlinearities of the dynamics, and the target spatial resolution. Significant uncertainties plague these predictions including errors in initial conditions, material properties, data, and model approximations. To address these shortcomings, a continuous data collection occurs at an effort level that is even larger than the modeling process. It has been demonstrated that the accuracy of the predictions depends on the quality of the data and is independent to a certain extent on the sophistication of the numerical models. Data assimilation has become one of the more critical steps in the overall weather prediction business and consequently substantial improvements in the quality of the data would have transformational benefits. This paper describes the use of infrasound inversion technology, enabled through exascale computing, that could potentially achieve orders of magnitude improvement in data quality and therefore transform weather predictions with significant impact on many aspects of our society.

58 GEOSCIENCES↗

Comparison of Observations and Predictions of Daytime Planetary-Boundary-Layer Heights and Surface Meteorological Variables in the Columbia River Gorge and Basin During the Second Wind Forecast Improvement Project

The second Wind Forecast Improvement Project (WFIP2) is an 18-month field campaign in the Pacific Northwest U.S.A., whose goal is to improve the accuracy of numerical-weather-prediction forecasts in complex terrain. The WFIP2 campaign involved the deployment of a large suite of in situ and remote sensing instrumentation, including eight 915-MHz wind-profiling radars, and surface meteorological stations. The evolution and annual variability of the daytime convective planetary-boundary-layer (PBL) height is investigated using the wind-profiling radars. Three models with different horizontal grid spacing are evaluated: the Rapid Refresh, the High-Resolution Rapid Refresh, and its nested version. The results are used to assess errors in the prediction of PBL height within the experimental and control versions of the models, with the experimental versions including changes and additions to the model parametrizations developed during the field campaign, and the control version using the parametrizations present in the National Oceanic and Atmospheric Administration/National Centers for Environmental Prediction operational version of the models at the start of the project. Results show that the high-resolution models outperform the low-resolution versions, the experimental versions perform better compared with the control versions, model PBL height estimations are more accurate on cloud-free days, and model estimates of the PBL height growth rate are more accurate than model estimates of the rate of decay. Finally, using surface sensors, we assess surface meteorological variables, finding improved surface irradiance and, to a lesser extent, improved 2-m temperature in the experimental version of the model.

54 ENVIRONMENTAL SCIENCES↗

Global River Topology (GRIT): A Bifurcating River Hydrography

Existing global river networks underpin a wide range of hydrological applications but do not represent channels with divergent river flows (bifurcations, multi‐threaded channels, canals), as these features defy the convergent flow assumption that elevation‐derived networks (e.g., HydroSHEDS, MERIT Hydro) are based on. Yet, bifurcations are important features of the global river drainage system, especially on large floodplains and river deltas, and are also often found in densely populated regions. Here we developed the first raster and vector‐based Global RIver Topology that not only represents the tributaries of the global drainage network but also the distributaries, including multi‐threaded rivers, canals and deltas. We achieve this by merging a 30 m Landsat‐based river mask with elevation‐generated streams to ensure a homogeneous drainage density outside of the river mask for rivers narrower than approximately 30 m. Crucially, we employ the new 30 m digital terrain model, FABDEM, based on TanDEM‐X, which shows greater accuracy over the traditionally used SRTM derivatives. After vectorization and pruning, directionality is assigned by a series of elevation, flow angle and continuity approaches. The new global network and its attributes are validated using gauging stations, comparison with existing networks, and randomized manual checks. The new network represents 19.6 million km of streams and rivers with drainage areas greater than 50 km 2 and includes 67,495 bifurcations. With the advent of hyper‐resolution modeling and artificial intelligence, GRIT is expected to greatly improve the accuracy of many river‐based applications such as flood forecasting, water availability and quality simulations, or riverine habitat mapping.

54 ENVIRONMENTAL SCIENCES↗

Numerical case study of the aerosol–cloud interactions in warm boundary layer clouds over the eastern North Atlantic with an interactive chemistry module

The presence of warm boundary layer stratiform clouds over the eastern North Atlantic (ENA) region is commonly influenced by the Azores High, especially during the summer season. To investigate comprehensive aerosol–cloud interactions, this study employs the Weather Research and Forecasting model coupled with a chemistry component (WRF-Chem), incorporating aerosol chemical components that are relevant to the formation of cloud condensation nuclei (CCN) and accounting for aerosol spatiotemporal variation. This study focuses on aerosol indirect effects, particularly the long-range transport of aerosols, in the ENA region under three different weather regimes: a ridge with a surface high-pressure system, a post-trough with a surface high-pressure system, and a weak trough. The WRF-Chem simulations conducted at a near-large-eddy scale offer valuable insights into the model's performance, especially in terms of its ability to use high spatial resolution to capture mesoscale cloud features across various weather regimes. Our result shows that introducing 5 times more aerosols to either non-precipitating or precipitating clouds significantly increases ambient CCN numbers, resulting in, to varying degrees, higher liquid water path (LWP) values. The substantial aerosol–cloud interaction especially occurs in the precipitating clouds and demonstrates the susceptibility of the LWP to changes in CCN under different regimes. Conversely, thin, non-rain clouds at the edges of a cloud system are prone to evaporation, exhibiting an aerosol drying effect. The aerosols released during this process transition back to the accumulation mode, facilitating future activation. This dynamic behavior is not adequately represented in prescribed-aerosol simulations.

54 ENVIRONMENTAL SCIENCES↗

Constraining chaos: Enforcing dynamical invariants in the training of reservoir computers

Drawing on ergodic theory, we introduce a novel training method for machine learning based forecasting methods for chaotic dynamical systems. The training enforces dynamical invariants—such as the Lyapunov exponent spectrum and the fractal dimension—in the systems of interest, enabling longer and more stable forecasts when operating with limited data. The technique is demonstrated in detail using reservoir computing, a specific kind of recurrent neural network. Finally, results are given for the Lorenz 1996 chaotic dynamical system and a spectral quasi-geostrophic model of the atmosphere, both typical test cases for numerical weather prediction.

97 MATHEMATICS AND COMPUTING↗

Improving the prediction of DNI with physics-based representation of all-sky circumsolar radiation

Direct normal irradiance (DNI) is often interpreted differently in ground measurements and forecasts using numerical weather prediction (NWP) models, leading to substantial bias in DNI forecasting especially under cloudy-sky conditions. To mitigate the bias, we use the Fast All-sky Radiation Model for Solar applications with DNI (FARMS-DNI) to conduct physics-based simulations of solar radiation in the circumsolar region. The DNI is quantified using the sum of the radiation along the sun direction and the scattered radiation within the circumsolar region. FARMS-DNI is coupled with the Weather Research and Forecasting model with solar extensions (WRF-Solar) to predict day-ahead DNI in 9-km pixels over an extended domain covering the contiguous United States. The DNI forecasts for the entire year of 2018 are validated using surface-based observations at the Atmospheric Radiation Measurement (ARM) and Surface Radiation Budget Network (SURFRAD) sites and a satellite-based solar radiation product developed by the procedure of the National Solar Radiation Data Base (NSRDB). The results show that the WRF-Solar coupled with the conventional Beer-Bouguer-Lambert law underestimes the overall DNI forecasts by 30%-60%, which is a joint effect of the uncertainties in computing the circumsolar radiation and forecasting cloud properties. This bias is significantly reduced by using FARMS-DNI.

14 SOLAR ENERGY↗

Day-ahead continuous double auction-based peer-to-peer energy trading platform incorporating trading losses and network utilisation fee

Integration of distributed energy resources, such as photovoltaic solar (PV), introduces new opportunities to establish local energy market frameworks to improve renewable energy utilisation in residential sectors. Such peer-to-peer (P2P) energy trading refers to a local market structure where customers (and prosumers) interact to share excess PV generation to enhance the individual and community social welfare. In this work, a day-ahead continuous double auction (CDA)-based P2P market structure considering network losses and network utilisation fees was designed. Day-ahead PV energy is modelled using fractional integral polynomials and the output is forecasted using an autoregressive integrated moving average model for each market interval. Based on the customer load and excess PV energy, the CDA market is cleared using a bid/ask matching mechanism. The performance of the P2P market was evaluated by computing different welfare metrics while analysing the effect of network constraints. The results show that the designed CDA-based P2P market structure increases the social welfare of all participants by an average of 17.75% compared to the baseline for the presented cases. Moreover, the impact of the forecasting error between the day-ahead and real-time market was also quantified.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Sensor Placement Optimization Study for the Built Environment: Operational Use Cases

Systems of fixed-position radiation sensors can provide information that assists emergency responders following nuclear and radiological incidents. State, local, tribal, and territorial (SLTT) government agencies that implement systems of fixed-position sensors are faced with numerous decisions regarding sensor selection, quantity, and placement. To develop guidance on implementation of radiation detection systems, we simulated the release of radioactive material in an urban environment using a combination of three models: the Weather Research Forecasting (WRF), Quick Urban and Industrial Complex (QUIC), and Monte Carlo N-Particle (MCNP) models. We then evaluated the performance of several hypothetical sensor systems. The small number of simulations we conducted are not sufficient to generate definitive design guidance for radiation sensor systems, but we did identify trends that would be of interest to emergency planners. For a scenario that releases 1000 curies of Cs-137, radiation detectors were needed at 500-meter intervals to have a high likelihood of event detection and to estimate source location and plume detection. We also noted that optimal detector altitude varied with distance to the source. We recommend additional research in this area be conducted to support developing sensor placement guidelines that expand on a range of locations, isotopes, activity levels, and different weather conditions. Original simulation strategies included a range of environments, additional radioisotopes (Am241 and AmBe), and a larger selection of sensor types. These types of expansions would support SLTT guidance on sensor system recommendations.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

A Physics-Based DNI Model for Advancing Solar Resource Assessment and Forecasting: Preprint

Direct Normal Irradiance (DNI) is one of the most used quantities to quantify the magnitude of solar energy resource. The concept of DNI is often interpreted differently for ground measurements and solar forecasting by numerical weather prediction (NWP) models, leading to substantial bias during evaluation of DNI forecasts especially under cloudy-sky conditions. To eliminate the bias, we use the Fast All-sky Radiation Model for Solar applications with DNI (FARMS-DNI) to provide a physics-based solution of solar radiation in the circumsolar region. The FARMS-DNI is implemented in the Weather Research and Forecasting model with solar extensions (WRF-Solar) to forecast day-ahead DNI in the north America. By comparing with conventional predictions from WRF-Solar and satellite observations from the National Solar Radiation Data Base (NSRDB), we found significant improvements in our prediction of DNI.

DNI↗

Exascale Computing and Data Handling: Challenges and Opportunities for Weather and Climate Prediction

The emergence of exascale computing and artificial intelligence offer tremendous potential to significantly advance Earth system prediction capabilities. However, enormous challenges must be overcome to adapt models and prediction systems to use these new technologies effectively. A 2022 WMO report on exascale computing recommends “urgency in dedicating efforts and attention to disruptions associated with evolving computing technologies that will be increasingly difficult to overcome, threatening continued advancements in weather and climate prediction capabilities.” Further, the explosive growth in data from observations, model and ensemble output, and postprocessing threatens to overwhelm the ability to deliver timely, accurate, and precise information needed for decision-making. Artificial intelligence (AI) offers untapped opportunities to alter how models are developed, observations are processed, and predictions are analyzed and extracted for decision-making. Given the extraordinarily high cost of computing, growing complexity of prediction systems, and increasingly unmanageable amount of data being produced and consumed, these challenges are rapidly becoming too large for any single institution or country to handle. This paper describes key technical and budgetary challenges, identifies gaps and ways to address them, and makes a number of recommendations.

Atmosphere↗

Earth's Energy Imbalance More Than Doubled in Recent Decades

Abstract Global warming results from anthropogenic greenhouse gas emissions which upset the delicate balance between the incoming sunlight, and the reflected and emitted radiation from Earth. The imbalance leads to energy accumulation in the atmosphere, oceans and land, and melting of the cryosphere, resulting in increasing temperatures, rising sea levels, and more extreme weather around the globe. Despite the fundamental role of the energy imbalance in regulating the climate system, as known to humanity for more than two centuries, our capacity to observe it is rapidly deteriorating as satellites are being decommissioned.

Mauritsen, Thorsten [Department of Meteorology and↗

Investigation of the Sensitivity of Tropical Cyclogenesis to Aerosol Intervention

Abstract As risks from tropical cyclones (TCs) are fueled by climate change escalation, there is an urgent need for transformational solutions to complement traditional approaches. Seeding TCs using aerosols can be a promising method to reduce cyclone intensity, supported by theoretical understanding of the microphysical effects of aerosols on TC clouds. The ideal time to intervene effectively in TCs is likely during their initial stage, before TC wind speeds reach their peak. However, studies exploring potential aerosol effects on TC formation remain scarce. This study investigates how a TC embryo responds to the addition of aerosols of varying sizes using the Weather Research & Forecasting (WRF) model coupled with a spectral‐bin microphysics model. We found that aerosols of different sizes and concentrations distinctively affect the pre‐TC vortex's microstructure and dynamics. Fine and ultrafine aerosols enhance the latent heat of condensation, freezing, deposition, and riming, initially intensifying the vortex. However, this results in enhancement of the cold pool, thereby reducing inflow and surface fluxes, subsequently weakening the vortex. Coarse aerosols produce the opposite effect to that of fine and ultrafine aerosols. Coarse aerosols lead to a slower initial acceleration owing to enhanced warm rain. However, the resulting weaker cold pool is insufficient to effectively reduce the strength of the vortex at the later stage. This study provides critical insights into how aerosols of varying sizes and concentrations modulate the energy cascade and impact the evolution of a TC embryo, laying the groundwork for further research on TC risk management through aerosol intervention.

54 ENVIRONMENTAL SCIENCES↗

A Vertically Resolved Canopy Improves Chemical Transport Model Predictions of Ozone Deposition to North Temperate Forests

Abstract Dry deposition is the second largest tropospheric ozone (O 3 ) sink and occurs through stomatal and nonstomatal pathways. Current O 3 uptake predictions are limited by the simplistic big‐leaf schemes commonly used in chemical transport models (CTMs) to parameterize deposition. Such schemes fail to reproduce observed O 3 fluxes over terrestrial ecosystems, highlighting the need for more realistic treatment of surface‐atmosphere exchange in CTMs. We address this need by linking a resolved canopy model (1D Multi‐Layer Canopy CHemistry and Exchange Model, MLC‐CHEM) to the GEOS‐Chem CTM and use this new framework to simulate O 3 fluxes over three north temperate forests. We compare results with in situ measurements from four field studies and with standalone, observationally constrained MLC‐CHEM runs to test current knowledge of O 3 deposition and its drivers. We show that GEOS‐Chem overpredicts observed O 3 fluxes across all four studies by up to 2×, whereas the resolved‐canopy models capture observed diel profiles of O 3 deposition and in‐canopy concentrations to within 10%. Relative humidity and solar irradiance are strong O 3 flux drivers over these forests, and uncertainties in those fields provide the largest remaining source of model deposition biases. Flux partitioning analysis shows that: (a) nonstomatal loss accounts for 60% of O 3 deposition on average; (b) in‐canopy chemistry makes only a small contribution to total O 3 fluxes; and (c) the CTM big‐leaf treatment overestimates O 3 ‐driven stomatal loss and plant phytotoxicity in these temperate forests by up to 7×. Results motivate the application of fully online vertically explicit canopy schemes in CTMs for improved O 3 predictions.

Vermeuel, Michael P. [Department of Soil, Water, a↗

Cloud Feedback Uncertainty in the Equatorial Pacific Across CMIP6 Models

Cloud feedback is the largest uncertainty in estimating Equilibrium Climate Sensitivity. In this study we focus on the equatorial Pacific, where CMIP6 model cloud feedback spread is notably large. Cloud radiative effects in this region are relevant for the global climate. Our findings show that models predict a consistent shift towards the ascent regime in response to El Nino-like sea surface warming. Models diverge in terms of the radiative impact due to differences in cloud characteristics in ascent and subsidence regimes. Using the observed relationship between circulation regime and cloud radiative effect, we find a reduction in the regional mean cloud feedback estimate from 0.77 to 0.22 W m -2 K -1 , though this does not substantially lessen the model spread in total feedback. Pathways to reduce this spread include: improving confidence in the regional ocean warming pattern, and using observations and models to understand cloud type and circulation interactions.

CMIP6↗

Arctic sea-ice loss drives a strong regional atmospheric response over the North Pacific and North Atlantic on decadal scales

Previous studies have suggested that Arctic sea-ice loss can have a profound influence on atmospheric circulation far away from the Arctic. However, there is little scientific consensus on the features of these remote responses, with the opposite impacts reported. Here we present a multi-model analysis of the decadal climate response to Arctic sea-ice loss using state-of-the-art energy conserving methodologies to isolate the impacts of sea-ice decline. We observe weakening of the Aleutian Low and development of a geopotential ridge in the North Pacific, associated with drier winter conditions over the southwest United States. Over the Atlantic, a negative NAO-like response drives wetter winter conditions across the western Mediterranean. These decadal-scale impacts substantially differ from reported centennial-scale responses to Arctic sea-ice loss simulated using non-energy conserving methodologies. Factors such as the timescale of the response and methodologies used to isolate the impacts of disappearing sea-ice cover should be carefully considered when consolidating scientific understanding on the future impacts of changing Arctic.

54 ENVIRONMENTAL SCIENCES↗

Case study of a bore wind-ramp event from lidar measurements and HRRR simulations over ARM Southern Great Plains

The rapid change of wind speed and direction on 21 August 2017 is studied using Doppler lidar measurements at five sites of the Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) facility in north-central Oklahoma. The Doppler lidar data were investigated along with meteorological variables such as temperature, humidity, and turbulence available from the large suite of instrumentation deployed at the SGP Central Facility (C1) during the Land-Atmosphere Feedback Experiment in August 2017. Lidar measurements at five sites, separated by 55-70 km, allowed us to document the development and evolution of the wind flow over the SGP area, examine synoptic conditions to understand the mechanism that leads to the ramp event, and estimate the ability of the High-Resolution Rapid Refresh model to reproduce this event. The flow feature in question is an atmospheric bore, a small-scale phenomenon that is challenging to represent in models, that was generated by a thunderstorm outflow northwest of the ARM SGP area. The small-scale nature of bores, its impact on power generation, and the modeling challenges associated with representing bores are discussed in this paper. In conclusion, the results also provide information about model errors between sites of different surface and vegetation types.

54 ENVIRONMENTAL SCIENCES↗