Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Weather Forecasting”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Quantifying sources of subseasonal prediction skill in CESM2

Abstract Subseasonal prediction fills the gap between weather forecasts and seasonal outlooks. There is evidence that predictability on subseasonal timescales comes from a combination of atmosphere, land, and ocean initial conditions. Predictability from the land is often attributed to slowly varying changes in soil moisture and snowpack, while predictability from the ocean is attributed to sources such as the El Niño Southern Oscillation. Here we use a set of subseasonal reforecast experiments with CESM2 to quantify the respective roles of atmosphere, land, and ocean initial conditions on subseasonal prediction skill over land. These reveal that the majority of prediction skill for global surface temperature in weeks 3–4 comes from the atmosphere, while ocean initial conditions become important after week 4, especially in the Tropics. In the CESM2 subseasonal prediction system, the land initial state does not contribute to surface temperature prediction skill in weeks 3–6 and climatological land conditions lead to higher skill, disagreeing with our current understanding. However, land-atmosphere coupling is important in week 1. Subseasonal precipitation prediction skill also comes primarily from the atmospheric initial condition, except for the Tropics, where after week 4 the ocean state is more important.

Richter, Jadwiga H. (ORCID:0000000170480781)↗
DOE OSTI2025

Testing NeuralGCM's capability to simulate future heatwaves based on the 2021 Pacific Northwest heatwave event

AI-based weather and climate models are emerging as accurate and computationally efficient tools. Beyond weather forecasting, they also show promise to accelerate storyline analyses. We evaluate NeuralGCM’s ability to simulate an extreme heatwave against the Energy Exascale Earth System Model (E3SM), a physics-based climate model. NeuralGCM accurately replicates the targeted event, and generates stable and realistic mid-century projections. However, due to the absence of land feedbacks, NeuralGCM underestimates the projected warming amplitude compared to physics-based model references.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Non-autoregressive time-series methods for stable parametric reduced-order models

Advection-dominated dynamical systems, characterized by partial differential equations, are found in applications ranging from weather forecasting to engineering design where accuracy and robustness are crucial. There has been significant interest in the use of techniques borrowed from machine learning to reduce the computational expense and/or improve the accuracy of predictions for these systems. These rely on the identification of a basis that reduces the dimensionality of the problem and the subsequent use of time series and sequential learning methods to forecast the evolution of the reduced state. Often, however, machine-learned predictions after reduced-basis projection are plagued by issues of stability stemming from incomplete capture of multiscale processes as well as due to error growth for long forecast durations. To address these issues, we have developed a non-autoregressive time series approach for predicting linear reduced-basis time histories of forward models. In particular, we demonstrate that non-autoregressive counterparts of sequential learning methods such as long short-term memory (LSTM) considerably improve the stability of machine-learned reduced-order models. Further, we evaluate our approach on the inviscid shallow water equations and show that a non-autoregressive variant of the standard LSTM approach that is bidirectional in the principal component directions obtains the best accuracy for recreating the nonlinear dynamics of partial observations. Moreover-and critical for many applications of these surrogates-inference times are reduced by three orders of magnitude using our approach, compared with both the equation-based Galerkin projection method and the standard LSTM approach.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

High-resolution climate model datasets for energy infrastructure planning in a renewable-dependent future

Electrification and renewables deployment efforts are amplifying the interdependence of the climate and energy systems. Increases in climate model resolution, which is now approaching that of reanalysis datasets and operational weather forecast models, present a unique opportunity to use future climate projections for energy infrastructure planning. In this Perspective, we review recent developments in high-resolution climate modeling, which have been driven by increased computing power and advanced software tools. We then look ahead to discuss how high-resolution climate data can be used to plan for a renewable-dependent future, and envision a unified climate-energy model framework that captures the two-way feedbacks between these interdependent systems.

climate change↗
DOE OSTI2023

The 2023 terahertz science and technology roadmap

Abstract Terahertz (THz) radiation encompasses a wide spectral range within the electromagnetic spectrum that extends from microwaves to the far infrared (100 GHz–∼30 THz). Within its frequency boundaries exist a broad variety of scientific disciplines that have presented, and continue to present, technical challenges to researchers. During the past 50 years, for instance, the demands of the scientific community have substantially evolved and with a need for advanced instrumentation to support radio astronomy, Earth observation, weather forecasting, security imaging, telecommunications, non-destructive device testing and much more. Furthermore, applications have required an emergence of technology from the laboratory environment to production-scale supply and in-the-field deployments ranging from harsh ground-based locations to deep space. In addressing these requirements, the research and development community has advanced related technology and bridged the transition between electronics and photonics that high frequency operation demands. The multidisciplinary nature of THz work was our stimulus for creating the 2017 THz Science and Technology Roadmap (Dhillon et al 2017 J. Phys. D: Appl. Phys. 50 043001). As one might envisage, though, there remains much to explore both scientifically and technically and the field has continued to develop and expand rapidly. It is timely, therefore, to revise our previous roadmap and in this 2023 version we both provide an update on key developments in established technical areas that have important scientific and public benefit, and highlight new and emerging areas that show particular promise. The developments that we describe thus span from fundamental scientific research, such as THz astronomy and the emergent area of THz quantum optics, to highly applied and commercially and societally impactful subjects that include 6G THz communications, medical imaging, and climate monitoring and prediction. Our Roadmap vision draws upon the expertise and perspective of multiple international specialists that together provide an overview of past developments and the likely challenges facing the field of THz science and technology in future decades. The document is written in a form that is accessible to policy makers who wish to gain an overview of the current state of the THz art, and for the non-specialist and curious who wish to understand available technology and challenges. A such, our experts deliver a ‘snapshot’ introduction to the current status of the field and provide suggestions for exciting future technical development directions. Ultimately, we intend the Roadmap to portray the advantages and benefits of the THz domain and to stimulate further exploration of the field in support of scientific research and commercial realisation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Diverging climate response of corn yield and carbon use efficiency across the U.S.

Abstract In this paper, we developed an open-source package to analyze the overall trend and responses of both carbon use efficiency (CUE) and corn yield to climate factors for the contiguous United States. Our algorithm enables automatic retrieval of remote sensing data through the Google Earth Engine (GEE) and U.S. Department of Agriculture (USDA) agricultural production data at the county level through application programming interface (API). Firstly, we integrated satellite products of net primary productivity and gross primary productivity based on the Moderate Resolution Imaging Spectroradiometer (MODIS) sensor, and climatic variables from the European Centre for Medium-Range Weather Forecasts. Secondly, we calculated CUE and commonly used climate metrics. Thirdly, we investigated the spatial heterogeneity of these variables. We applied a random forest algorithm to identify the key climate drivers of CUE and crop yield, and estimated the responses of CUE and yield to climate variability using the spatial moving window regression across the U.S. Our results show that growing degree days (GDD) has the highest predictive power for both CUE and yield, while extreme degree days (EDD) is the least important explanatory variable. Moreover, we observed that in most areas of the U.S., yield increases or stays the same with higher GDD and precipitation. However, CUE decreases with higher GDD in the north and shows more mixed and fragmented interactions in the south. Notably, there are some exceptions where yield is negatively correlated with precipitation in the Missouri and Mississippi River Valleys. As global warming continues, we anticipate a decrease in CUE throughout the vast northern part of the country, despite the possibility of yield remaining stable or increasing.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Journey over Destination: Dynamic Sensor Placement Enhances Generalization

Reconstructing complex, high-dimensional global fields from limited data points is a challenge across various scientific and industrial domains. This is particularly important for recovering spatio-temporal fields using sensor data from, for example, laboratory-based scientific experiments, weather forecasting, or drone surveys. Given the prohibitive costs of specialized sensors and the inaccessibility of
certain regions of the domain, achieving full field coverage is typically not feasible. Therefore, the development of machine learning algorithms trained to reconstruct fields given a limited dataset is of critical importance. In this study, we introduce a general
approach that employs moving sensors to enhance data exploitation during the training of an attention based neural network, thereby improving field reconstruction. The training of sensor locations is accomplished using an end-to-end workflow, ensuring
differentiability in the interpolation of field values associated to the sensors, and is simple to implement using differentiable programming. Additionally, we have incorporated a correction mechanism to prevent sensors from entering invalid regions within the domain. We evaluated our method using two distinct datasets; the results show that our approach enhances learning, as evidenced by improved test scores.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

From Optimization to Sampling Through Gradient Flows

Optimization and sampling algorithms play a central role in science and engineering as they enable finding optimal predictions, policies, and recommendations, as well as expected and equilibrium states of complex systems. The notion of “optimality” is formalized by the choice of an objective function, while the notion of an “expected” state is specified by a probabilistic model for the distribution of states. Optimizing rugged objective functions and sampling multimodal distributions is computationally challenging, especially in high-dimensional problems. Here, for this reason, many optimization and sampling methods have been developed by researchers working in disparate fields such as Bayesian statistics, molecular dynamics, genetics, quantum chemistry, machine learning, weather forecasting, econometrics, and medical imaging.

Trillos, N. García↗
DOE OSTI2020

A Privacy Preserving Model-Free Optimization and Control Framework for Demand Response from Residential Thermal Loads

We consider the problem of optimizing the cost of procuring electricity for a large collection of homes managed by a load serving entity, by pre-cooling or pre-heating the thermal inertial loads in the homes to avoid procuring power during periods of peak electricity pricing. We would like to accomplish this objective in a completely privacy-preserving and model-free manner, that is, without direct access to the state variables (temperatures or power consumption) or the dynamical models (thermal characteristics) of individual homes, while guaranteeing personal comfort constraints of the consumers. We propose a two-stage optimization and control framework to address this problem. In the first stage, we use a long short-term memory (LSTM) network to predict hourly electricity prices, based on historical pricing data and weather forecasts. Given the hourly price forecast and thermal models of the homes, the problem of designing an optimal power consumption trajectory that minimizes the total electricity procurement cost for the collection of thermal loads can be formulated as a large-scale integer program (with millions of variables) due to the on-off cyclical dynamics of such loads. We provide a simple heuristic relaxation to make this large-scale optimization problem model-free and computationally tractable. In the second stage, we translate the results of this optimization problem into distributed open-loop control laws that can be implemented at individual homes without measuring or estimating their state variables, while simultaneously ensuring consumer comfort constraints. We demonstrate the performance of this approach on a large-scale test case comprising of 500 homes in the Houston area and benchmark its performance against a direct model-based optimization and control solution.

Sivaranjani, S.↗
DOE OSTI2021

Examination of Humidity and Ice Supersaturation Profiles Over West Antarctica Using Ground-Based G-Band Radiometer Retrievals

Humidity profiles retrieved from a ground-based millimeter-wave radiometer located at McMurdo Station, Antarctica and the West Antarctica Ice Sheet Divide are presented and their suitability to study the humidity of the polar climate is assessed. The dry conditions of the Antarctic winter and spring are ideal for ground-based millimeter-wave measurements and the retrievals appear to realistically reproduce the spatial and temporal variability of humidity at both sites. Furthermore, the radiometer has the ability to capture daily variability of very low humidity (0.5 to 4 g/kg) in the low-to-mid troposphere with an uncertainty of 10-20% during the Antarctic winter, spring, and summer. Despite the coarse vertical resolution (200-600 m in the first 4 km), the retrievals provide additional information with respect to the European Centre for Medium Range Weather Forecasts (ECMWF) profiles used as background information. The radiometer is also able to realistically identify the location and frequency of supersaturated layers with respect to ice in the mid troposphere. The occurrence of supersaturated layers is correlated with the occurrence of ice clouds identified by a cloud mask. Overall, results show that ground-based microwave and millimeter-wave radiometry is a viable complement to satellite observations to provide continuous information on the thermodynamic state of the low-to-mid troposphere at high latitudes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

TROPHY: A Topologically Robust Physics-Informed Tracking Framework for Tropical Cyclones

Tropical cyclones (TCs) are among the most destructive weather systems. Realistically and efficiently detecting and tracking TCs are critical for assessing their impacts and risks. In particular, the eye is a signature feature of a mature TC. Therefore, knowing the eyes’ locations and movements is crucial for both operational weather forecasts and climate risk assessments. Recently, a multilevel robustness framework has been introduced to study the critical points of time-varying vector fields. The framework quantifies the robustness (i.e., structural stability) of critical points across varying neighborhoods. By relating the multilevel robustness with critical point tracking, the framework has demonstrated its potential in cyclone tracking. An advantage is that it identifies cyclonic features using only 2D wind vector fields, which is encouraging as most tracking algorithms require multiple dynamic and thermodynamic variables at different altitudes. A disadvantage is that the framework does not scale well computationally for datasets containing a large number of cyclones. Herein this paper introduces a topologically robust physics-informed tracking framework (TROPHY) for TC tracking. The main idea is to integrate physical knowledge of TC to drastically improve the computational efficiency of multilevel robustness framework for large-scale climate datasets. First, during preprocessing, we propose a physics-informed feature selection strategy to filter 90% of critical points that are short-lived and have low stability, thus preserving good candidates for TC tracking. Second, during in-processing, we impose constraints during the multilevel robustness computation to focus only on physics-informed neighborhoods of TCs. We apply TROPHY to 30 years of 2D wind fields from reanalysis data in ERA5 and generate a number of TC tracks. In comparison with the observed tracks, we demonstrate that TROPHY can capture TC characteristics (e.g., frequency, intensity, duration, latitudes with maximum intensity, and genesis) that are comparable to and sometimes even better than a well-validated TC tracking algorithm that requires multiple dynamic and thermodynamic scalar fields.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Distributed Cross-Channel Hierarchical Aggregation for Foundation Models

Vision-based scientific foundation models hold significant promise for advancing scientific discovery and innovation. This potential stems from their ability to aggregate images from diverse sources—such as varying physical groundings or data acquisition systems—and to learn spatio-temporal correlations using transformer architectures. However, tokenizing and aggregating images can be compute-intensive, a challenge not fully addressed by current distributed methods. In this work, we introduce the Distributed Cross-Channel Hierarchical Aggregation (D-CHAG) approach designed for datasets with a large number of channels across image modalities. Our method is compatible with any model-parallel strategy and any type of vision transformer architecture, significantly improving computational efficiency. We evaluated D-CHAG on hyperspectral imaging and weather forecasting tasks. When integrated with tensor parallelism and model sharding, our approach achieved up to a 75% reduction in memory usage and more than doubled sustained throughput on up to 1,024 AMD GPUs on the Frontier Supercomputer.

Tsaris, Aristeidis (aris) [ORNL] (ORCID:0000000277↗
DOE OSTI2023

Deep Learning Parameterization of Vertical Wind Velocity Variability via Constrained Adversarial Training

Atmospheric models with typical resolution in the tenths of kilometers cannot resolve the dynamics of air parcel ascent, which varies on scales ranging from tens to hundreds of meters. Small-scale wind fluctuations are thus characterized by a subgrid distribution of vertical wind velocity W with standard deviation σ W . The parameterization of σ W is fundamental to the representation of aerosol–cloud interactions, yet it is poorly constrained. Using a novel deep learning technique, this work develops a new parameterization for σ W merging data from global storm-resolving model simulations, high-frequency retrievals of W , and climate reanalysis products. The parameterization reproduces the observed statistics of σ W and leverages learned physical relations from the model simulations to guide extrapolation beyond the observed domain. Incorporating observational data during the training phase was found to be critical for its performance. The parameterization can be applied online within large-scale atmospheric models, or offline using output from weather forecasting and reanalysis products.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Climate Dynamics Preceding Summer Forest Fires in California and the Extreme Case of 2018

Recent record-breaking wildfire seasons in California prompt an investigation into the climate patterns that typically precede anomalous summer burned forest area. Using burned-area data from the U.S. Forest Service’s Monitoring Trends in Burn Severity (MTBS) product and climate data from the fifth major global reanalysis produced by the European Centre for Medium-Range Weather Forecasts (ERA5) over 1984–2018, relationships between the interannual variability of antecedent climate anomalies and July California burned area are spatially and temporally characterized. Lag correlations show that antecedent high vapor pressure deficit (VPD), high temperatures, frequent extreme high temperature days, low precipitation, high subsidence, high geopotential height, low soil moisture, and low snowpack and snowmelt anomalies all correlate significantly with July California burned area as far back as the January before the fire season. Seasonal regression maps indicate that a global midlatitude atmospheric wave train in late winter is associated with anomalous July California burned area. July 2018, a year with especially high burned area, was to some extent consistent with the general patterns revealed by the regressions: low winter precipitation and high spring VPD preceded the extreme burned area. However, geopotential height anomaly patterns were distinct from those in the regressions. Extreme July heat likely contributed to the extent of the fires ignited that month, even though extreme July temperatures do not historically significantly correlate with July burned area. While the 2018 antecedent climate conditions were typical of a high-burned-area year, they were not extreme, demonstrating the likely limits of statistical prediction of extreme fire seasons and the need for individual case studies of extreme years.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

A Methodology for Estimating the Energy and Moisture Budget of the Convective Boundary Layer Using Continuous Ground-Based Infrared Spectrometer Observations

Abstract Land–atmosphere interactions play a critical role in both the atmospheric water and energy cycles. Changes in soil moisture and vegetation alter the partitioning of surface water and energy fluxes, influencing diurnal evolution of the planetary boundary layer (PBL). The mixing-diagram framework has proven useful in understanding the evolution of the heat and moisture budget within the convective boundary layer (CBL). We demonstrate that observations from the Department of Energy Atmospheric Radiation Measurement (ARM) Southern Great Plains site provide all of the needed inputs needed for the mixing-diagram framework, allowing us to quantify the impact from the surface fluxes, advection, radiative heating, encroachment, and entrainment on the evolution of the CBL. Profiles of temperature and humidity retrieved from the ground-based infrared spectrometer [Atmospheric Emitted Radiance Interferometer (AERI)] are a critical component in this analysis. Large-eddy simulation results demonstrate that mean mixed-layer values derived are shown to be critical to close the energy and moisture budgets. A novel approach demonstrated here is the use of network of AERIs and Doppler lidars to quantify the advective fluxes of heat and moisture. The framework enables the estimation of the entrainment fluxes as a residual, providing a way to observe the entrainment fluxes without using multiple lidar systems. The high temporal resolution of the AERI observations enables the morning, midday, and afternoon evolution of the CBL to be quantified. This work provides a new way to use observations in this framework to evaluate weather and climate models. Significance Statement The energy and moisture budget of the planetary boundary layer (PBL) is influenced by multiple sources, and accurately representing this evolution in numerical models is critical for weather forecasts and climate predictions. The mixing-diagram approach, driven by profiling observations as illustrated here, provides a powerful way to quantify the contributions from each of these sources. In particular, the energy and moisture mixed into the PBL from above the PBL can be determined accurately from ground-based remote sensors using this approach.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

An evaluation of size-resolved cloud microphysics scheme numerics for use with radar observations Part II: Condensation and evaporation

Accurate numerical modeling of clouds and precipitation is essential for weather forecasting and climate change research. While size-resolved (bin) cloud microphysics models predict particle size distributions without imposing shapes, results are subject to artificial size distribution broadening owing to numerical diffusion associated with various processes. Whereas Part I of this study addressed collision–coalescence, here we investigate numerical diffusion that occurs in solving condensation and evaporation. In a parcel model framework, all of the numerical schemes examined converge to one solution of condensation and evaporation as the mass grid is refined, and the advection-based schemes are recommended over the reassigning schemes. Including Eulerian vertical advection in a column limits the convergence to some extent, but that limitation occurs at a sufficiently fine mass grid, and the number of iterations in solving vertical advection should be minimized to reduce numerical diffusion. Insubstantial numerical diffusion in solving condensation can be amplified if collision–coalescence is also active, which in turn can be substantially diminished if turbulence effects on collision are incorporated. Here, large-eddy simulations of a drizzling stratocumulus field reveal that changes in moments of Doppler spectra obtained using different mass grids are consistent with those obtained from the simplified framework, and that spectral moments obtained using a mass grid designed to effectively reduce numerical diffusion are generally closer to observations. Notable differences between the simulations and observations still exist, and our results suggest a need to consider whether factors other than numerical diffusion in the fundamental process schemes employed can cause such differences.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Data-Driven Transition Path Analysis Yields a Statistical Understanding of Sudden Stratospheric Warming Events in an Idealized Model

Abstract Atmospheric regime transitions are highly impactful as drivers of extreme weather events, but pose two formidable modeling challenges: predicting the next event (weather forecasting) and characterizing the statistics of events of a given severity (the risk climatology). Each event has a different duration and spatial structure, making it hard to define an objective “average event.” We argue here that transition path theory (TPT), a stochastic process framework, is an appropriate tool for the task. We demonstrate TPT’s capacities on a wave–mean flow model of sudden stratospheric warmings (SSWs) developed by Holton and Mass, which is idealized enough for transparent TPT analysis but complex enough to demonstrate computational scalability. Whereas a recent article (Finkel et al. 2021) studied near-term SSW predictability, the present article uses TPT to link predictability to long-term SSW frequency. This requires not only forecasting forward in time from an initial condition, but also backward in time to assess the probability of the initial conditions themselves. TPT enables one to condition the dynamics on the regime transition occurring, and thus visualize its physical drivers with a vector field called the reactive current . The reactive current shows that before an SSW, dissipation and stochastic forcing drive a slow decay of vortex strength at lower altitudes. The response of upper-level winds is late and sudden, occurring only after the transition is almost complete from a probabilistic point of view. This case study demonstrates that TPT quantities, visualized in a space of physically meaningful variables, can help one understand the dynamics of regime transitions.

Meteorology & Atmospheric Sciences↗
DOE OSTI2020

A Causal Inference Model Based on Random Forests to Identify the Effect of Soil Moisture on Precipitation

Soil moisture influences precipitation mainly through its impact on land–atmosphere interactions. Understanding and correctly modeling soil moisture–precipitation (SM–P) coupling is crucial for improving weather forecasting and subseasonal to seasonal climate predictions, especially when predicting the persistence and magnitude of drought. However, the sign and spatial structure of SM–P feedback are still being debated in the climate research community, mainly due to the difficulty in establishing causal relationships and the high degree of nonlinearity in land–atmosphere processes. To this end, we developed a causal inference model based on the Granger causality analysis and a nonlinear machine learning model. This model includes three steps: nonlinear anomaly decomposition, nonlinear Granger causality analysis, and evaluation of the quality of SM–P feedback, which eliminates the nonlinear response of interannual and seasonal variability and the memory effects of climatic factors and isolates the causal relationship of local SM–P feedback. We applied this model by using National Climate Assessment–Land Data Assimilation System (NCA-LDAS) datasets over the United States. Here, the results highlight the importance of nonlinear atmosphere responses in land–atmosphere interactions. In addition, the strong feedback over the southwestern United States and the Great Plains both highlight the impacts of topographic factors rather than only the sensitivity of evapotranspiration to soil moisture. Furthermore, the SM–P index defined by our framework is used to benchmark Earth system models (ESMs), which provides a new metric for efficiently identifying potential model biases in modeling local land–atmosphere interactions and may help the development of ESMs in improving simulations of water cycle variability and extremes.

54 ENVIRONMENTAL SCIENCES↗