Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “ensemble forecast”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Impacts of Lake Surface Temperature on the Summer Climate Over the Great Lakes Region

The surface of the Great Lakes interacts with the atmosphere, influencing the weather and climate over the Great Lakes Region (GLR). However, most climate models were not designed with sufficient emphasis on lake–atmosphere interactions, which could potentially cause model biases over the GLR. To understand how lake surface temperature (LST) affects the regional summer climate over the GLR, we conducted twin experiments using the Weather Research and Forecasting model at a spatial resolution of 4 km using two different LST data sets as the bottom boundary condition over the Great Lakes. In this work, our simulations include 10 ensemble members for the summer of 2018 and a single multiyear run for the summers of 2014–2020. Results show that variations in LST influence atmospheric temperature and moisture at a local scale—while affecting the convective environment and precipitation processes over a much larger spatial scale. In particular, an LST that is only 1°C–3°C warmer (depending on the lake) increases near-surface air temperature by 1.93°C and 0.97°C over Lake Superior and Lake Erie, respectively, and increases evaporation over the lakes by 0.23 and 1.1 mm day –1 . The warmer LST reduces mesoscale convective precipitation upstream of the GLR; however, it increases isolated deep convective precipitation and nonconvective precipitation downstream of GLR due to increased local instability and enhancement of moisture transport. Our analyses confirm the robustness of these impacts, which is at least 2 times larger than the model internal variability and is seen across all simulated summer seasons.

54 ENVIRONMENTAL SCIENCES↗

Meeting Global Health Needs via Infectious Disease Forecasting: Development of a Reliable Data-Driven Framework

Infectious diseases (IDs) have a significant detrimental impact on global health. Timely and accurate ID forecasting can result in more informed implementation of control measures and prevention policies. To meet the operational decision-making needs of real-world circumstances, we aimed to build a standardized, reliable, and trustworthy ID forecasting pipeline and visualization dashboard that is generalizable across a wide range of modeling techniques, IDs, and global locations. We forecasted 6 diverse, zoonotic diseases (brucellosis, campylobacteriosis, Middle East respiratory syndrome, Q fever, tick-borne encephalitis, and tularemia) across 4 continents and 8 countries. We included a wide range of statistical, machine learning, and deep learning models (n=9) and trained them on a multitude of features (average n=2326) within the One Health landscape, including demography, landscape, climate, and socioeconomic factors. The pipeline and dashboard were created in consideration of crucial operational metrics—prediction accuracy, computational efficiency, spatiotemporal generalizability, uncertainty quantification, and interpretability—which are essential to strategic data-driven decisions. While no single best model was suitable for all disease, region, and country combinations, our ensemble technique selects the best-performing model for each given scenario to achieve the closest prediction. For new or emerging diseases in a region, the ensemble model can predict how the disease may behave in the new region using a pretrained model from a similar region with a history of that disease. The data visualization dashboard provides a clean interface of important analytical metrics, such as ID temporal patterns, forecasts, prediction uncertainties, and model feature importance across all geographic locations and disease combinations. As the need for real-time, operational ID forecasting capabilities increases, this standardized and automated platform for data collection, analysis, and reporting is a major step forward in enabling evidence-based public health decisions and policies for the prevention and mitigation of future ID outbreaks.

60 APPLIED LIFE SCIENCES↗

Attribution of NAO Predictive Skill Beyond 2 Weeks in Boreal Winter

Weeks 3–6 averaged winter North Atlantic Oscillation (NAO) predictive skill in a state-of-the-art coupled climate prediction system is attributed to two principle sources: upper and lower boundary conditions linked to the stratosphere and El Niño-Southern Oscillation (ENSO), respectively. A 20-member ensemble of 45-day reforecasts over 1999–2015 is utilized, together with uninitialized simulations with the atmospheric component of the prediction system forced with observed radiative forcing and lower boundary conditions. NAO forecast skill for lead times out to 6 weeks is higher following extreme stratospheric polar vortex conditions (weak and strong vortex events) compared to neutral states. Enhanced weeks 3-6 NAO predictive skill for weak vortex events results primarily from stratospheric downward coupling to the troposphere, while enhanced skill for strong vortex events can be partly attributed to lower boundary forcing related to the ENSO phenomenon. Implications for forecast system development and improvement are discussed.

54 ENVIRONMENTAL SCIENCES↗

Ensemble‐Based Assimilation of Satellite All‐Sky Microwave Radiances Improves Intensity and Rainfall Predictions for Hurricane Harvey (2017)

Abstract Ensemble‐based data assimilation of radar observations across inner‐core regions of tropical cyclones (TCs) in tandem with satellite all‐sky infrared (IR) radiances across the TC domain improves TC track and intensity forecasts. This study further investigates potential enhancements in TC track, intensity, and rainfall forecasts via assimilation of all‐sky microwave (MW) radiances using Hurricane Harvey (2017) as an example. Assimilating Global Precipitation Measurement constellation all‐sky MW radiances in addition to GOES‐16 all‐sky IR radiances reduces the forecast errors in the TC track, rapid intensification (RI), and peak intensity compared to assimilating all‐sky IR radiances alone, including a 24‐hr increase in forecast lead‐time for RI. Assimilating all‐sky MW radiances also improves Harvey's hydrometeor fields, which leads to improved forecasts of rainfall after Harvey's landfall. This study indicates that avenues exist for producing more accurate forecasts for TCs using available yet underutilized data, leading to better warnings of and preparedness for TC‐associated hazards in the future.

54 ENVIRONMENTAL SCIENCES↗

Examples of Mission-driven Data Science from Jefferson Lab and ACES

This presentation details mission-driven data science initiatives at Jefferson Lab and the Joint Institute for Advanced Computing on Environmental Studies (ACES). JLab, a U.S. Department of Energy Office of Science national laboratory, operates the Continuous Electron Beam Accelerator Facility (CEBAF), and is the lead institute for the new High Performance Data Facility (HPDF) Hub. The Joint Institute for ACES brings together interdisciplinary teams in health informatics, climate modeling, computer science, and physics to address environmental challenges, including flood modeling. The Hampton Roads region, particularly Norfolk and Virginia Beach, faces increasing flood risks, motivating the need for rapid, reliable, and risk-aware decision support. ACES’s flooding work has a focus on uncertainty quantification (UQ) and machine learning (ML) for coastal flood management. The work is motivated by the increasing vulnerability of communities such as Norfolk and Virginia Beach, Virginia, to frequent coastal flooding events, and the need for rapid, reliable decision support. The research develops computationally efficient ML surrogate models to forecast water levels and flooding risk. A central theme is the quantification and calibration of predictive uncertainty, especially for out-of-distribution (OOD) scenarios, using techniques such as Monte Carlo Dropout, Deep Ensembles, Gaussian Processes, and Deep Quantile Regression (DQR). The study demonstrates that distance-aware UQ is critical for reliable scientific AI, particularly in high-dimensional, safety-critical, and real-time applications.

McSpadden, Diana [Thomas Jefferson National Accele↗

The Influence of Shallow Cloud Populations on Transitions to Deep Convection in the Amazon

Abstract In this study, a pair of convection-permitting (2-km grid spacing), month-long, wet-season Weather Research and Forecasting (WRF) Model simulations with and without the eddy-diffusivity mass-flux (EDMF) scheme are performed for a portion of the Green Ocean Amazon (GoAmazon) 2014/15 field campaign period. EDMF produces an ensemble of subgrid-scale convective plumes that evolve in response to the boundary layer meteorological conditions and can develop into shallow clouds. The objective of this study is to determine how different treatments of shallow cumulus clouds (i.e., with and without EDMF) impact the total cloud population and precipitation across the Amazonian rain forest, with emphasis on impacts on the likelihood of shallow-to-deep convection transitions. Results indicate that the large-scale synoptic conditions in the EDMF and control simulations are nearly identical; however, on the local scale their rainfall patterns diverge drastically and the biases decrease in EDMF. The EDMF scheme significantly increases the frequency of shallow clouds, but the frequencies of deep clouds are similar between the simulations. Deep convective clouds are tracked using a cloud-tracking algorithm to examine the impact of shallow cumulus on the surrounding ambient environment where deep convective clouds initiate. Results suggest that a rapid increase of low-level cloudiness acts to cool and moisten the low to midtroposphere during the day, favoring the transition to deep convection.

54 ENVIRONMENTAL SCIENCES↗

Ecological niche models display nonlinear relationships with abundance and demographic performance across the latitudinal distribution of Astragalus utahensis (Fabaceae)

Abstract The potential for ecological niche models (ENMs) to accurately predict species' abundance and demographic performance throughout their geographic distributions remains a topic of substantial debate in ecology and biogeography. Few studies simultaneously examine the relationship between ENM predictions of environmental suitability and both a species' abundance and its demographic performance, particularly across its entire geographic distribution. Yet, studies of this type are essential for understanding the extent to which ENMs are a viable tool for identifying areas that may promote high abundance or performance of a species or how species might respond to future climate conditions. In this study, we used an ensemble ecological niche model to predict climatic suitability for the perennial forb Astragalus utahensis across its geographic distribution. We then examined relationships between projected climatic suitability and field‐based measures of abundance, demographic performance, and forecasted stochastic population growth (λ s ). Predicted climatic suitability showed a J‐shaped relationship with A. utahensis abundance, where low‐abundance populations were associated with low‐to‐intermediate suitability scores and abundance increased sharply in areas of high predicted climatic suitability. A similar relationship existed between climatic suitability and λ s from the center to the northern edge of the latitudinal distribution. Patterns such as these, where density or demographic performance only increases appreciably beyond some threshold of climatic suitability, support the contention that ENM‐predicted climatic suitability does not necessarily represent a reliable predictor of abundance or performance across large geographic regions.

Baer, Kathryn C.↗

ARM Trajectories Data Set Value-Added Product Report

The U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility’s ARM Trajectories Data Set (ARMTRAJ) Value-Added Product (VAP) provides trajectory data sets initialized at ARM deployment coordinates and configured using ARM data sets. The four trajectory data sets support aerosol, cloud, and planetary boundary-layer research. Trajectory calculations use the Hybrid Single-Particle Lagrangian Integrated Trajectory (HYSPLIT) model informed by the European Centre for Medium-Range Weather Forecasts (ECMWF) fifth-generation atmospheric reanalysis (ERA5) data set at its highest spatial resolution (~31 km). HYSPLIT also runs at multiple initial starting locations surrounding ARM deployments (in latitude/longitude and/or vertical coordinates), facilitating an ensemble for each sample in the data sets. The ensemble mean and variability reported in ARMTRAJ improve the fidelity and provide uncertainty estimates of trajectory coordinates, thermodynamic properties, and other output fields.

54 ENVIRONMENTAL SCIENCES↗

ARM Trajectories Data Set Value-Added Product Report

The U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility’s ARM Trajectories Data Set (ARMTRAJ) Value-Added Product (VAP) provides trajectory data sets initialized at ARM deployment coordinates and configured using ARM data sets. The six trajectory data sets support aerosol, cloud, planetary boundary layer, and related research (aerosol-cloud interactions, etc.), as well as studies using ARM Aerial Facility (AAF) and tethered balloon system (TBS) measurements. Trajectory calculations use the Hybrid Single-Particle Lagrangian Integrated Trajectory (HYSPLIT) model informed by the European Centre for Medium-Range Weather Forecasts (ECMWF) fifth-generation atmospheric reanalysis (ERA5) data set at its highest spatial resolution (~31 km). HYSPLIT also runs at multiple initial starting locations surrounding ARM deployments (in latitude/longitude and/or vertical coordinates), facilitating an ensemble for each sample in the data sets. The ensemble mean and variability reported in ARMTRAJ improve the fidelity and provide uncertainty estimates of trajectory coordinates, thermodynamic properties, and other output fields.

54 ENVIRONMENTAL SCIENCES↗

Equation‐Free Surrogate Modeling of Geophysical Flows at the Intersection of Machine Learning and Data Assimilation

Abstract There is a growing interest in developing data‐driven reduced‐order models for atmospheric and oceanic flows that are trained on data obtained either from high‐resolution simulations or satellite observations. The data‐driven models are non‐intrusive in nature and offer significant computational savings compared to large‐scale numerical models. These low‐dimensional models can be utilized to reduce the computational burden of generating forecasts and estimating model uncertainty without losing the key information needed for data assimilation (DA) to produce accurate state estimates. This paper aims at exploring an equation‐free surrogate modeling approach at the intersection of machine learning and DA in Earth system modeling. With this objective, we introduce an end‐to‐end non‐intrusive reduced‐order modeling (NIROM) framework equipped with contributions in modal decomposition, time series prediction, optimal sensor placement, and sequential DA. Specifically, we use proper orthogonal decomposition (POD) to identify the dominant structures of the flow, and a long short‐term memory network to model the dynamics of the POD modes. The NIROM is integrated within the deterministic ensemble Kalman filter (DEnKF) to incorporate sparse and noisy observations at optimal sensor locations obtained through QR pivoting. The feasibility and the benefit of the proposed framework are demonstrated for the NOAA Optimum Interpolation Sea Surface Temperature (SST) V2 data set. Our results indicate that the NIROM is stable for long‐term forecasting and can model dynamics of SST with a reasonable level of accuracy. Furthermore, the prediction accuracy of the NIROM gets improved by almost one order of magnitude by the DEnKF algorithm.

Pawar, Suraj↗

Multifidelity Ensemble Kalman Filtering Using Surrogate Models Defined by Theory-Guided Autoencoders

Data assimilation is a Bayesian inference process that obtains an enhanced understanding of a physical system of interest by fusing information from an inexact physics-based model, and from noisy sparse observations of reality. The multifidelity ensemble Kalman filter (MFEnKF) recently developed by the authors combines a full-order physical model and a hierarchy of reduced order surrogate models in order to increase the computational efficiency of data assimilation. The standard MFEnKF uses linear couplings between models, and is statistically optimal in case of Gaussian probability densities. This work extends the MFEnKF into to make use of a broader class of surrogate model such as those based on machine learning methods such as autoencoders non-linear couplings in between the model hierarchies. We identify the right-invertibility property for autoencoders as being a key predictor of success in the forecasting power of autoencoder-based reduced order models. We propose a methodology that allows us to construct reduced order surrogate models that are more accurate than the ones obtained via conventional linear methods. Numerical experiments with the canonical Lorenz'96 model illustrate that nonlinear surrogates perform better than linear projection-based ones in the context of multifidelity ensemble Kalman filtering. We additionality show a large-scale proof-of-concept result with the quasi-geostrophic equations, showing the competitiveness of the method with a traditional reduced order model-based MFEnKF.

97 MATHEMATICS AND COMPUTING↗

A Scalable Real-Time Data Assimilation Framework for Predicting Turbulent Atmosphere Dynamics

AI-based foundation models like FourCastNet, GraphCast are revolutionizing weather and climate predictions but are not yet ready for operational use. Their limitation lies in the absence of a data assimilation system to incorporate real-time Earth system observations, crucial for accurately forecasting events like tropical cyclones. To overcome these obstacles, we introduce a generic real-time data assimilation framework and demonstrate its end-to-end performance on the Frontier supercomputer. This framework comprises two primary modules: an ensemble score filter (EnSF), which significantly outperforms the state-of-the-art data assimilation method, and a vision transformer-based surrogate capable of real-time adaptation through the integration of observational data. We demonstrate both the strong and weak scaling of our framework up to 1024 GPUs on the Exascale supercomputer, Frontier. Our results not only illustrate the framework's exceptional scalability on high-performance computing systems, but also demonstrate the importance of supercomputers in real-time data assimilation for weather and climate predictions.

Lu, Dan↗

On the Correspondence between Seasonal Forecast Biases and Long-Term Climate Biases in Sea Surface Temperature

In this paper, the correspondence between mean sea surface temperature (SST) biases in retrospective seasonal forecasts (hindcasts) and long-term climate simulations from five global climate models is examined to diagnose the degree to which systematic SST biases develop on seasonal time scales. The hindcasts are from the North American Multi-Model Ensemble and the climate simulations are from the Coupled Model Intercomparison Project. The analysis suggests that most robust climatological SST biases begin to form within 6 months of a realistically initialized integration, although the growth rate varies with location, time, and model. In regions with large biases, interannual variability and ensemble spread is much smaller than the climatological bias. Additional ensemble hindcasts of the Community Earth System Model with a different initialization method suggest that initial conditions do matter for the initial bias growth, but the overall global bias patterns are similar after 6 months. A hindcast approach is more suitable to study biases over the tropics and sub-tropics than over the extra-tropics because of smaller initial biases and faster bias growth. The rapid emergence of SST biases makes it likely that fast processes with times scales shorter than the seasonal time scales in the atmosphere and upper ocean are responsible for a substantial part of the climatological SST biases. Studying the growth of biases may provide important clues to the causes and ultimately the amelioration of these biases. Further, initialized seasonal hindcasts can profitably be used in the development of high-resolution coupled ocean-atmosphere models.

54 ENVIRONMENTAL SCIENCES↗

Can reanalysis products outperform mesoscale numerical weather prediction models in modeling the wind resource in simple terrain?

Mesoscale numerical weather prediction (NWP) models are generally considered more accurate than reanalysis products in characterizing the wind resource at heights of interest for wind energy, given their finer spatial resolution and more comprehensive physics. However, advancements in the latest ERA-5 reanalysis product motivate an assessment on whether ERA-5 can model wind speeds as well as a state-of-the-art NWP model – the Weather Research and Forecasting (WRF) Model. We consider this research question for both simple terrain and offshore applications. Specifically, we compare wind profiles from ERA-5 and the preliminary WRF runs of the Wind Integration National Dataset (WIND) Toolkit Long-term Ensemble Dataset (WTK-LED) to those observed by lidars at a site in Oklahoma, United States, and in a United States Atlantic offshore wind energy area. We find that ERA-5 shows a significant negative bias (~-1ms-1) at both locations, with a larger bias at the land-based site. WTK-LED-predicted wind speed profiles show a limited negative bias (~-0.5ms-1) offshore and a slight positive bias (~+0.5ms-1) at the land-based site. On the other hand, we find that ERA-5 outperforms WTK-LED in terms of the centered root-mean-square error (cRMSE) and correlation coefficient, for both the land-based and offshore cases, in all atmospheric stability conditions. We find that WTK-LED's higher cRMSE is caused by its tendency to overpredict the amplitude of the wind speed diurnal cycle. At the land-based site, this is partially caused by wind plant wake effects not being accurately captured by WTK-LED.

17 WIND ENERGY↗

Forecasting generative amplification

Generative networks are perfect tools to enhance the speed and precision of LHC simulations. Especially when generating events beyond the size of the training dataset, it is important to understand their statistical precision. We present two complementary methods to estimate the amplification factor without large holdout datasets. Averaging amplification uses Bayesian networks or ensembling to estimate amplification from the precision of integrals over given phase-space volumes. Differential amplification uses hypothesis testing to quantify amplification without any resolution loss. Applied to state-of-the-art event generators, both methods indicate that amplification is already possible in specific regions of phase space.

Bahl, Henning [Heidelberg Univ. (Germany)] (ORCID:↗

Multimodal sensor fusion framework for residential building occupancy detection

For several years now, smart building energy systems have been a research area of intensive activity. In light of the increasing need for sustainable buildings and energy systems, this trend motivates an increasing need for a solution to reduce carbon dioxide emissions and improve energy efficiency. This work proposes a high-performing and transferable occupancy detection framework that combines sensor data from different data modalities, including time series environmental data (temperature, humidity, and illuminance), image data, and acoustic energy data using ensemble method. To draw out the best prediction performance in each modality, the proposed framework was developed, including various models that were designed to learn the occupancy patterns reflected in the physical data streams. To tackle the time series environmental data, we designed two variants of an occupancy detection spatiotemporal pattern network (Occ-STPN) that performs both feature level and decision level fusion, respectively. We also propose a new metric; the fading memory mean square error (FMMSE), that provides a fair evaluation and penalization of delayed occupancy predictions. Multiple open-sourced datasets, including the Electricity Consumption and Occupancy and the University of California, Irvine's (UCI) building occupancy detection dataset, along with our own real data collected from six different houses, were used to validate the algorithms' performance. The experimental results presented herein break down the performance for each sensing modality, and a detailed analysis of the performance is also discussed.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Potential Impacts of Assimilating All-sky Satellite Infrared Radiances on Convection-Permitting Analysis and Prediction of Tropical Convection

Geostationary infrared satellite observations are spatially dense [< 1/(20 km)2] and temporally frequent (< 1/hour). These suggest the possibility of using these observations to constrain sub-synoptic features over data sparse regions, such as tropical oceans. In this study, the potential impacts of assimilating water vapor channel brightness temperature (WV-BT) observations from the geostationary Meteorological Satellite 7 (Meteosat-7) on tropical convection analysis and prediction were systematically examined through a series of ensemble data assimilation experiments. WV-BT observations were assimilated hourly into convection-permitting ensembles using Penn State’s ensemble square root filter (EnSRF). Comparisons against independently observed Meteosat-7 window channel brightness temperature (Window-BT) show that the assimilation of WV-BT generally improved the intensities and locations of large-scale cloud patterns at spatial scales larger than 100 km. However, comparisons against independent soundings indicate that the EnSRF analysis produced a much stronger dry bias than the no data assimilation experiment. This strong dry bias is associated with the use of the simulated WV-BT from the prior mean during the EnSRF analysis step. A stochastic variant of the ensemble Kalman filter (NoMeanSF) is proposed. The NoMeanSF algorithm was able to assimilate the WV-BT without causing such a strong dry bias and the quality of the analyses’ horizontal cloud pattern is similar to EnSRF’s analyses. Finally, deterministic forecasts initiated from the NoMeanSF analyses possess better horizontal cloud patterns above 500 km than those of the EnSRF. These results suggest that it might be better to assimilate all-sky WV-BT through the NoMeanSF algorithm than EnSRF algorithm.

Chan, Man-Yau↗

A High‐Resolution Tropical Mesoscale Convective System Reanalysis (TMeCSR)

Abstract Modern global reanalysis products have greatly accelerated meteorological research in synoptic‐to‐planetary‐scale phenomena. However, their use in studying tropical mesoscale convective systems (MCSs) and their regional‐to‐global impact has mostly been limited to supplying initial and boundary conditions for MCS‐resolving simulations and providing information about the large‐scale environments of MCSs. These limitations are due to difficulties in resolving tropical MCS dynamics in the relatively low‐resolution global models and that tropical MCSs often occur over poorly observed regions. In this work, a Tropical MCS‐resolving Reanalysis product (TMeCSR) was created over a region with frequent tropical MCSs. This region spans the tropical Indian Ocean, tropical continental Asia, Maritime Continent, and Western Pacific. TMeCSR is produced by assimilating all‐sky infrared radiances from geostationary satellites and other conventional observations into an MCS‐resolving regional model using the Ensemble Kalman Filter. The resulting observation‐constrained high‐resolution (9‐km grid spacing) data set is available hourly during the boreal summer (June‐August) of 2017, during which widespread severe flooding occurred. Comparisons of TMeCSR and European Center for Medium Range Weather Forecast Reanalysis version 5 (ERA5) against independent satellite retrievals indicate that TMeCSR's cloud and multiscale rain fields are better than those of ERA5. Furthermore, TMeCSR better captured the diurnal variability of rainfall and the statistical characteristics of MCSs. Forecasts initialized from TMeCSR also have more accurate rain and clouds than those initialized from ERA5. The TMeCSR and ERA5 forecasts have similar performances with respect to sounding and surface observations. These results indicate that TMeCSR is a promising MCS‐resolving data set for tropical MCS studies.

Chan, Man‐Yau↗