Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “multimodel ensemble”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Impact of Model Resolution on Tropical Cyclone Simulation Using the HighResMIP–PRIMAVERA Multimodel Ensemble

A multimodel, multiresolution set of simulations over the period 1950–2014 using a common forcing protocol from CMIP6 HighResMIP have been completed by six modeling groups. Analysis of tropical cyclone performance using two different tracking algorithms suggests that enhanced resolution toward 25 km typically leads to more frequent and stronger tropical cyclones, together with improvements in spatial distribution and storm structure. Both of these factors reduce typical GCM biases seen at lower resolution. Using single ensemble members of each model, there is little evidence of systematic improvement in interannual variability in either storm frequency or accumulated cyclone energy as compared with observations when resolution is increased. Changes in the relationships between large-scale drivers of climate variability and tropical cyclone variability in the Atlantic Ocean are also not robust to model resolution. However, using a larger ensemble of simulations (of up to 14 members) with one model at different resolutions does show evidence of increased skill at higher resolution. The ensemble mean correlation of Atlantic interannual tropical cyclone variability increases from ~0.5 to ~0.65 when resolution increases from 250 to 100 km. In the northwestern Pacific Ocean the skill keeps increasing with 50-km resolution to 0.7. These calculations also suggest that more than six members are required to adequately distinguish the impact of resolution within the forced signal from the weather noise.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Improved Predictability of the Indian Ocean Dipole Using a Stochastic Dynamical Model Compared to the North American Multimodel Ensemble Forecast

This study assesses the predictive skill of eight North American Multimodel Ensemble (NMME) models in predicting the Indian Ocean dipole (IOD). We find that the forecasted ensemble-mean IOD–El Niño–Southern Oscillation (ENSO) relationship deteriorates away from the observed relationship with increasing lead time, which might be one reason that limits the IOD predictive skill in coupled models. We are able to improve the IOD predictive skill using a recently developed stochastic dynamical model (SDM) forced by forecasted ENSO conditions. The results are consistent with the previous result that operational IOD predictability beyond persistence at lead times beyond one season is mostly controlled by ENSO predictability and the signal-to-noise ratio of the Indo-Pacific climate system. The multimodel ensemble (MME) investigated here is found to be of superior skill compared to each individual model at most lead times. Importantly, the skill of the SDM IOD predictions forced with forecasted ENSO conditions were either similar or better than those of the MME IOD forecasts. Moreover, the SDM forced with observed ENSO conditions exhibits significantly higher IOD prediction skill than the MME at longer lead times, suggesting the large potential skill increase that could be achieved by improving operational ENSO forecasts. We find that both cold and warm biases of the predicted Niño-3.4 index may cause false alarms of negative and positive IOD events, respectively, in NMME models. Many false alarms for IOD forecasts at lead times longer than one season in the original forecasts disappear or are significantly reduced in the SDM forced by forecasted ENSO conditions.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2017

Multimodel Ensemble Methods for Prediction of Wake-Vortex Transport and Decay Originating NASA

Several multimodel ensemble methods are selected and further developed to improve the deterministic and probabilistic prediction skills of individual wake-vortex transport and decay models. The different multimodel ensemble methods are introduced, and their suitability for wake applications is demonstrated. The selected methods include direct ensemble averaging, Bayesian model averaging, and Monte Carlo simulation. The different methodologies are evaluated employing data from wake-vortex field measurement campaigns conducted in the United States and Germany.

Korner, Stephan↗
DOE OSTI2022

Multimodel ensemble predictions of precipitation using bayesian neural networks

Multimodel ensembling improves predictions and considers model uncertainties. In this study, we present a Bayesian Neural Network (BNN) ensemble approach for large-scale precipitation predictions based on a set of climate models. BNN infers spatiotemporally varying model weights and biases through the calibration against observations. This ensemble scheme of BNN sufficiently leverages individual model skill for accurate predictions as well as provides interpretability about which models contribute more to the ensemble prediction at which locations and times to inform model development. Additionally, BNN accurately quantifies epistemic uncertainty to avoid overconfident projections. We demonstrate BNN’s superior prediction performance to three state-of-the-art ensemble approaches and discuss its interpretability and uncertainty quantification.

Fan, Patrick↗
DOE OSTI2022

Multimodel Ensemble Predictions of Precipitation using Bayesian Neural Networks

Multimodel ensembling improves predictions and considers model uncertainties. In this study, we present a Bayesian Neural Network (BNN) ensemble approach for large-scale precipitation predictions based on a set of climate models. BNN infers spatiotemporally varying model weights and biases through the calibration against observations. This ensemble scheme of BNN sufficiently leverages individual model skill for accurate predictions as well as provides interpretability about which models contribute more to the ensemble prediction at which locations and times to inform model development. Additionally, BNN accurately quantifies epistemic uncertainty to avoid overconfident projections. We demonstrate BNN’s superior prediction performance to three state-of-the-art ensemble approaches and discuss its interpretability and uncertainty quantification.

Fan, Patrick↗
NASA NTRS2015

Multimodel Ensembles of Wheat Growth: More Models are Better than One

Crop models of crop growth are increasingly used to quantify the impact of global changes due to climate or crop management. Therefore, accuracy of simulation results is a major concern. Studies with ensembles of crop models can give valuable information about model accuracy and uncertainty, but such studies are difficult to organize and have only recently begun. We report on the largest ensemble study to date, of 27 wheat models tested in four contrasting locations for their accuracy in simulating multiple crop growth and yield variables. The relative error averaged over models was 24-38% for the different end-of-season variables including grain yield (GY) and grain protein concentration (GPC). There was little relation between error of a model for GY or GPC and error for in-season variables. Thus, most models did not arrive at accurate simulations of GY and GPC by accurately simulating preceding growth dynamics. Ensemble simulations, taking either the mean (e-mean) or median (e-median) of simulated values, gave better estimates than any individual model when all variables were considered. Compared to individual models, e-median ranked first in simulating measured GY and third in GPC. The error of e-mean and e-median declined with an increasing number of ensemble members, with little decrease beyond 10 models. We conclude that multimodel ensembles can be used to create new estimators with improved accuracy and consistency in simulating growth dynamics. We argue that these results are applicable to other crop species, and hypothesize that they apply more generally to ecological system models.

wheat↗
NASA NTRS2015

Multimodel Ensembles of Wheat Growth: Many Models are Better than One

Crop models of crop growth are increasingly used to quantify the impact of global changes due to climate or crop management. Therefore, accuracy of simulation results is a major concern. Studies with ensembles of crop model scan give valuable information about model accuracy and uncertainty, but such studies are difficult to organize and have only recently begun. We report on the largest ensemble study to date, of 27 wheat models tested in four contrasting locations for their accuracy in simulating multiple crop growth and yield variables. The relative error averaged over models was 2438 for the different end-of-season variables including grain yield (GY) and grain protein concentration (GPC). There was little relation between error of a model for GY or GPC and error for in-season variables. Thus, most models did not arrive at accurate simulations of GY and GPC by accurately simulating preceding growth dynamics. Ensemble simulations, taking either the mean (e-mean) or median (e-median) of simulated values, gave better estimates than any individual model when all variables were considered. Compared to individual models, e-median ranked first in simulating measured GY and third in GPC. The error of e-mean and e-median declined with an increasing number of ensemble members, with little decrease beyond 10 models. We conclude that multimodel ensembles can be used to create new estimators with improved accuracy and consistency in simulating growth dynamics. We argue that these results are applicable to other crop species, and hypothesize that they apply more generally to ecological system models.

model intercomparison↗
DOE OSTI2020

Projected Future Changes in Tropical Cyclones Using the CMIP6 HighResMIP Multimodel Ensemble

Future changes in tropical cyclone properties are an important component of climate change impacts and risk for many tropical and midlatitude countries. In this study we assess the performance of a multimodel ensemble of climate models, at resolutions ranging from 250 to 25 km. We use a common experimental design including both atmosphere-only and coupled simulations run over the period 1950–2050, with two tracking algorithms applied uniformly across the models. There are overall improvements in tropical cyclone frequency, spatial distribution, and intensity in models at 25 km resolution, with several of them able to represent very intense storms. Projected tropical cyclone activity by 2050 generally declines in the South Indian Ocean, while changes in other ocean basins are more uncertain and sensitive to both tracking algorithm and imposed forcings. Coupled models with smaller biases suggest a slight increase in average TC 10 m wind speeds by 2050.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Evaluating Multimodel Ensemble Seasonal Climate Forecasts on Rangeland Plant Production in the California Annual Grassland

Seasonal precipitation and temperature directly affect total plant production in the California Annual Grassland (CAG). Technological advances have resulted in skillful seasonal climate forecasts (i.e., significant correlations between actual and forecasted climate), which could be input into plant production models to inform stocking and other rangeland management decisions. This study presents a procedure for forecasting plant production in the CAG ecosystem to predict annual plant production for grazing, restoration, or other rangeland management practices using a combination of historical gridMET climate data and seasonal hindcasts (i.e., retrospective forecasts, from the North American Multi-Model Ensemble program). Further, the results of this study first confirmed high forecast skill, throughout the growing season at all sites. We also identified skillful plant production forecasts across most of the growing season at two sites and in three of the seven forecasting months at one study site. Forecasting climate and end-of-year plant production across the growing season at three CAG sites allowed us to identify the places and times in the growing season when forecasting might be most helpful in informing management decisions. Integrating plant production forecasting into rangeland management practices could significantly improve rangeland management outcomes. These procedures provide a user guide for creating plant production forecasts for any given area of interest and may be applicable across a wide range of other agricultural and rangeland management systems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Clouds and Convective Self-Aggregation in a Multimodel Ensemble of Radiative-Convective Equilibrium Simulations

The Radiative-Convective Equilibrium Model Intercomparison Project (RCEMIP) is an intercomparison of multiple types of numerical models configured in radiative-convective equilibrium (RCE). RCE is an idealization of the tropical atmosphere that has long been used to study basic questions in climate science. Here, we employ RCE to investigate the role that clouds and convective activity play in determining cloud feedbacks, climate sensitivity, the state of convective aggregation, and the equilibrium climate. RCEMIP is unique among intercomparisons in its inclusion of a wide range of model types, including atmospheric general circulation models (GCMs), single column models (SCMs), cloud-resolving models (CRMs), large eddy simulations (LES), and global cloud-resolving models (GCRMs). The first results are presented from the RCEMIP ensemble of more than 30 models. While there are large differences across the RCEMIP ensemble in the representation of mean profiles of temperature, humidity, and cloudiness, in a majority of models anvil clouds rise, warm, and decrease in area coverage in response to an increase in sea surface temperature (SST). Nearly all models exhibit self-aggregation in large domains and agree that self-aggregation acts to dry and warm the troposphere, reduce high cloudiness, and increase cooling to space. The degree of self-aggregation exhibits no clear tendency with warming. There is a wide range of climate sensitivities, but models with parameterized convection tend to have lower climate sensitivities than models with explicit convection. In models with parameterized convection, aggregated simulations have lower climate sensitivities than unaggregated simulations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

RCEMIP‐ACI: Aerosol‐Cloud Interactions in a Multimodel Ensemble of Radiative‐Convective Equilibrium Simulations

Aerosol‐cloud interactions are a persistent source of uncertainty in climate research. This study presents findings from a model intercomparison project examining the impact of aerosols on clouds and climate in convection‐permitting radiative‐convective equilibrium (RCE) simulations. Specifically, 11 different modeling teams conducted RCE simulations under varying aerosol concentrations, domain configurations, and sea surface temperatures (SSTs). We analyze the response of domain‐mean cloud and radiative properties to imposed aerosol concentrations across different SSTs. Additionally, we explore the potential impact of aerosols on convective aggregation and large‐scale circulation in large‐domain simulations. The results reveal that the cloud and radiative responses to aerosols vary substantially across models. However, a common trend across models, SSTs, and domain configurations is that increased aerosol loading tends to suppress warm rain formation, enhance cloud water content in the mid‐troposphere, and consequently increase mid‐tropospheric humidity and upper‐tropospheric temperature, thereby impacting static stability. The warming of the upper troposphere can be attributed to reduced lateral entrainment effects due to the higher environmental humidity in the mid‐troposphere. However, models do not agree on aerosol impacts on convective updraft velocity based on the preliminary examination of high‐percentiles of vertical velocity at a single mid‐troposheric layer (500 hPa). In large‐domain simulations, where convection tends to self‐organize, aerosol loading does not consistently influence self‐organization but tends to reduce the intensity of large‐scale circulation forming between convective clusters and dry regions. This reduction in circulation intensity can be explained by the increase in static stability due to the upper tropospheric warming.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

A Spatiotemporal-Aware Weighting Scheme for Improving Climate Model Ensemble Predictions

Multimodel ensembling has been widely used to improve climate model predictions, and the improvement strongly depends on the ensembling scheme. In this work, we propose a Bayesian neural network (BNN) ensembling method, which combines climate models within a Bayesian model averaging framework, to improve the predictive capability of model ensembles. Our proposed BNN approach calculates spatiotemporally varying model weights and biases by leveraging individual models' simulation skill, calibrates the ensemble prediction against observations by considering observation data uncertainty, and quantifies epistemic uncertainty when extrapolating to new conditions. More importantly, the BNN method provides interpretability about which climate model contributes more to the ensemble prediction at which locations and times. Thus, beyond its predictive capability, the method also brings insights and understanding of the models to guide further model and data development. In this study, we design experiments using an ensemble of CMIP6 climate model simulations to illustrate the BNN ensembling method's capability with respect to prediction accuracy, interpretability, and uncertainty quantification (UQ). We demonstrate that BNN can correctly assign larger weights to the regions and seasons where the individual model fits the observation better. Moreover, its offered interpretability is consistent with our understanding of localized climate model performance. Additionally, BNN shows an increasing uncertainty when the prediction is farther away from the period with constrained data, which appropriately reflects our trustworthiness of the models in the changing climate.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Arctic Sea Ice in CMIP6

Abstract We examine CMIP6 simulations of Arctic sea‐ice area and volume. We find that CMIP6 models produce a wide spread of mean Arctic sea‐ice area, capturing the observational estimate within the multimodel ensemble spread. The CMIP6 multimodel ensemble mean provides a more realistic estimate of the sensitivity of September Arctic sea‐ice area to a given amount of anthropogenic CO 2 emissions and to a given amount of global warming, compared with earlier CMIP experiments. Still, most CMIP6 models fail to simulate at the same time a plausible evolution of sea‐ice area and of global mean surface temperature. In the vast majority of the available CMIP6 simulations, the Arctic Ocean becomes practically sea‐ice free (sea‐ice area <1 × 10 6 km 2 ) in September for the first time before the Year 2050 in each of the four emission scenarios SSP1‐1.9, SSP1‐2.6, SSP2‐4.5, and SSP5‐8.5 examined here.

Notz, Dirk↗
DOE OSTI2020

Seasonal and CO 2 -Induced Shifts of the ITCZ: Testing Energetic Controls in Idealized Simulations with Comprehensive Models

The Tropical Rain Belts with an Annual Cycle and Continent Model Intercomparison Project (TRACMIP) ensemble—a multimodel ensemble of slab-ocean simulations in idealized configurations—provides a test of the relationship between the zonal mean ITCZ and the cross-equatorial atmospheric energy transports (AHT eq ). In a gross sense, the ITCZ position is linearly related to AHT eq , as expected from the energetic framework. Yet, in many aspects, the TRACMIP model simulations do not conform to the framework. Throughout the annual cycle there are large excursions in the ITCZ position unrelated to changes in the AHT eq and, conversely, substantial variations in the magnitude of the AHT eq while the ITCZ is stationary at its northernmost position. Variations both in the net vertical energy input at the ITCZ location and in the vertical profile of ascent play a role in setting the model behavior apart from the conceptual framework. Nevertheless, a linear fit to the ITCZ–AHT eq relationship captures a substantial fraction of the seasonal variations in these quantities as well as the intermodel or across-climate variations in their annual mean values. The slope of the ITCZ–AHT eq linear fit for annual mean changes across simulations with different forcings and configurations varies in magnitude and even sign from model to model and we identify variations in the vertical profile of ascent as a key factor. A simple sea surface temperature–based index avoids the complication of changes in the vertical structure of the atmospheric circulation and provides a more reliable diagnostic for the ITCZ position.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2017

Similarity Assessment of Land Surface Model Outputs in the North American Land Data Assimilation System

Multimodel ensembles are often used to produce ensemble mean estimates that tend to have increased simulation skill over any individual model output. If multimodel outputs are too similar, an individual LSM would add little additional information to the multimodel ensemble, whereas if the models are too dissimilar, it may be indicative of systematic errors in their formulations or configurations. The article presents a formal similarity assessment of the North American Land Data Assimilation System (NLDAS) multimodel ensemble outputs to assess their utility to the ensemble, using a confirmatory factor analysis. Outputs from four NLDAS Phase 2 models currently running in operations at NOAA/NCEP and four new/ upgraded models that are under consideration for the next phase of NLDAS are employed in this study. The results show that the runoff estimates from the LSMs were most dissimilar whereas the models showed greater similarity for root zone soil moisture, snow water equivalent, and terrestrial water storage. Generally, the NLDAS operational models showed weaker association with the common factor of the ensemble and the newer versions of the LSMs showed stronger association with the common factor, with the model similarity increasing at longer time scales. Trade-offs between the similarity metrics and accuracy measures indicated that the NLDAS operational models demonstrate a larger span in the similarity-accuracy space compared to the new LSMs. The results of the article indicate that simultaneous consideration of model similarity and accuracy at the relevant time scales is necessary in the development of multimodel ensemble.

land surface models↗