Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “multimodel ensemble”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Multimodel Ensemble Methods for Prediction of Wake-Vortex Transport and Decay Originating NASA

Several multimodel ensemble methods are selected and further developed to improve the deterministic and probabilistic prediction skills of individual wake-vortex transport and decay models. The different multimodel ensemble methods are introduced, and their suitability for wake applications is demonstrated. The selected methods include direct ensemble averaging, Bayesian model averaging, and Monte Carlo simulation. The different methodologies are evaluated employing data from wake-vortex field measurement campaigns conducted in the United States and Germany.

Korner, Stephan↗

Multimodel Ensembles of Wheat Growth: More Models are Better than One

Crop models of crop growth are increasingly used to quantify the impact of global changes due to climate or crop management. Therefore, accuracy of simulation results is a major concern. Studies with ensembles of crop models can give valuable information about model accuracy and uncertainty, but such studies are difficult to organize and have only recently begun. We report on the largest ensemble study to date, of 27 wheat models tested in four contrasting locations for their accuracy in simulating multiple crop growth and yield variables. The relative error averaged over models was 24-38% for the different end-of-season variables including grain yield (GY) and grain protein concentration (GPC). There was little relation between error of a model for GY or GPC and error for in-season variables. Thus, most models did not arrive at accurate simulations of GY and GPC by accurately simulating preceding growth dynamics. Ensemble simulations, taking either the mean (e-mean) or median (e-median) of simulated values, gave better estimates than any individual model when all variables were considered. Compared to individual models, e-median ranked first in simulating measured GY and third in GPC. The error of e-mean and e-median declined with an increasing number of ensemble members, with little decrease beyond 10 models. We conclude that multimodel ensembles can be used to create new estimators with improved accuracy and consistency in simulating growth dynamics. We argue that these results are applicable to other crop species, and hypothesize that they apply more generally to ecological system models.

wheat↗

Multimodel Ensembles of Wheat Growth: Many Models are Better than One

Crop models of crop growth are increasingly used to quantify the impact of global changes due to climate or crop management. Therefore, accuracy of simulation results is a major concern. Studies with ensembles of crop model scan give valuable information about model accuracy and uncertainty, but such studies are difficult to organize and have only recently begun. We report on the largest ensemble study to date, of 27 wheat models tested in four contrasting locations for their accuracy in simulating multiple crop growth and yield variables. The relative error averaged over models was 2438 for the different end-of-season variables including grain yield (GY) and grain protein concentration (GPC). There was little relation between error of a model for GY or GPC and error for in-season variables. Thus, most models did not arrive at accurate simulations of GY and GPC by accurately simulating preceding growth dynamics. Ensemble simulations, taking either the mean (e-mean) or median (e-median) of simulated values, gave better estimates than any individual model when all variables were considered. Compared to individual models, e-median ranked first in simulating measured GY and third in GPC. The error of e-mean and e-median declined with an increasing number of ensemble members, with little decrease beyond 10 models. We conclude that multimodel ensembles can be used to create new estimators with improved accuracy and consistency in simulating growth dynamics. We argue that these results are applicable to other crop species, and hypothesize that they apply more generally to ecological system models.

model intercomparison↗

Similarity Assessment of Land Surface Model Outputs in the North American Land Data Assimilation System

Multimodel ensembles are often used to produce ensemble mean estimates that tend to have increased simulation skill over any individual model output. If multimodel outputs are too similar, an individual LSM would add little additional information to the multimodel ensemble, whereas if the models are too dissimilar, it may be indicative of systematic errors in their formulations or configurations. The article presents a formal similarity assessment of the North American Land Data Assimilation System (NLDAS) multimodel ensemble outputs to assess their utility to the ensemble, using a confirmatory factor analysis. Outputs from four NLDAS Phase 2 models currently running in operations at NOAA/NCEP and four new/ upgraded models that are under consideration for the next phase of NLDAS are employed in this study. The results show that the runoff estimates from the LSMs were most dissimilar whereas the models showed greater similarity for root zone soil moisture, snow water equivalent, and terrestrial water storage. Generally, the NLDAS operational models showed weaker association with the common factor of the ensemble and the newer versions of the LSMs showed stronger association with the common factor, with the model similarity increasing at longer time scales. Trade-offs between the similarity metrics and accuracy measures indicated that the NLDAS operational models demonstrate a larger span in the similarity-accuracy space compared to the new LSMs. The results of the article indicate that simultaneous consideration of model similarity and accuracy at the relevant time scales is necessary in the development of multimodel ensemble.

land surface models↗

GEOS S2S-2_1 File Specification: GMAO Seasonal and Sub-Seasonal Forecast Output

The NASA GMAO seasonal (9 months) and subseasonal (45 days) forecasts are produced with the Goddard Earth Observing System (GEOS) Atmosphere-Ocean General Circulation Model and Data Assimilation System Version S2S-2_1. The new system replaces version S2S-1.0 described in Borovikov et al (2017), and includes upgrades to many components of the system. The atmospheric model includes an upgrade from a pre-MERRA-2 version running on a latitude-longitude grid at approx. 1 degree resolution to a current version running on a cubed sphere grid at approximately 1/2 degree resolution. The important developments are related to the dynamical core (Putman et al., 2011), the moist physics (''two-moment microphysics'' of Barahona et al., 2014) and the cryosphere (Cullather et al., 2014). As in the previous GMAO S2S system, the land model is that of Koster et al (2000). GMAO S2S-2_1 now includes the Goddard Chemistry Aerosol Radiation and Transport (GOCART, Colarco et al., 2010) single moment interactive aerosol model that includes predictive aerosols including dust, sea salt and several species of carbon and sulfate. The previous version of GMAO S2S specified aerosol amounts from climatology, which were used to inform the atmospheric radiation only. The ocean model includes an upgrade from MOM4 to MOM5 (Griffies 2012), and continues to be run on the tripolar grid at approximately 1/2 degree resolution in the tropics with 40 vertical levels. As in S2S-1.0, the sea ice model is from the Los Alamos Sea Ice model (CICE4, Hunke and Lipscomb 2010). The Ocean Data Assimilation System (ODAS) has been upgraded from the one described in Borovikov et al., 2017 to one that uses a modified version of the Penny, 2014 Local Ensemble Transform Kalman Filter (LETKF), and now assimilates along-track altimetry. The ODAS also does a nudging to MERRA-2 SST and sea ice boundary conditions. The atmospheric data assimilation fields used to constrain the atmosphere in the ODAS have been upgraded from MERRA to a MERRA-2 like system. The system is initialized using a MERRA-2-like atmospheric reanalysis (Gelaro et al. 2017) and the GMAO S2S-2_1 ocean analysis. Additional ensemble members for forecasts are produced with initial states at 5-day intervals, with additional members based on perturbations of the atmospheric and ocean states. Both subseasonal and seasonal forecasts are submitted to the National MultiModel Ensemble (NMME) project, and are part of the US/Canada multimodel seasonal forecasts (http://www.cpc.ncep.noaa.gov/products/NMME/). A large suite of retrospective forecasts (''hindcasts'') have been completed, and contribute to the calculation of the model's baseline climatology and drift, anomalies from which are the basis of the seasonal forecasts.

Seasonal Forecast↗

Sulfate Aerosol Control of Tropical Atlantic Climate over the Twentieth Century

The tropical Atlantic interhemispheric gradient in sea surface temperature significantly influences the rainfall climate of the tropical Atlantic sector, including droughts over West Africa and Northeast Brazil. This gradient exhibits a secular trend from the beginning of the twentieth century until the 1980s, with stronger warming in the south relative to the north. This trend behavior is on top of a multi-decadal variation associated with the Atlantic multi-decadal oscillation. A similar long-term forced trend is found in a multimodel ensemble of forced twentieth-century climate simulations. Through examining the distribution of the trend slopes in the multimodel twentieth-century and preindustrial models, the authors conclude that the observed trend in the gradient is unlikely to arise purely from natural variations; this study suggests that at least half the observed trend is a forced response to twentieth-century climate forcings. Further analysis using twentieth-century single-forcing runs indicates that sulfate aerosol forcing is the predominant cause of the multimodel trend. The authors conclude that anthropogenic sulfate aerosol emissions, originating predominantly from the Northern Hemisphere, may have significantly altered the tropical Atlantic rainfall climate over the twentieth century

Chang, C.-Y.↗

Radiative Forcing by Well-Mixed Greenhouse Gases: Estimates from Climate Models in the Intergovernmental Panel on Climate Change (IPCC) Fourth Assessment Report (AR4)

The radiative effects from increased concentrations of well-mixed greenhouse gases (WMGHGs) represent the most significant and best understood anthropogenic forcing of the climate system. The most comprehensive tools for simulating past and future climates influenced by WMGHGs are fully coupled atmosphere-ocean general circulation models (AOGCMs). Because of the importance of WMGHGs as forcing agents it is essential that AOGCMs compute the radiative forcing by these gases as accurately as possible. We present the results of a radiative transfer model intercomparison between the forcings computed by the radiative parameterizations of AOGCMs and by benchmark line-by-line (LBL) codes. The comparison is focused on forcing by CO2, CH4, N2O, CFC-11, CFC-12, and the increased H2O expected in warmer climates. The models included in the intercomparison include several LBL codes and most of the global models submitted to the Intergovernmental Panel on Climate Change (IPCC) Fourth Assessment Report (AR4). In general, the LBL models are in excellent agreement with each other. However, in many cases, there are substantial discrepancies among the AOGCMs and between the AOGCMs and LBL codes. In some cases this is because the AOGCMs neglect particular absorbers, in particular the near-infrared effects of CH4 and N2O, while in others it is due to the methods for modeling the radiative processes. The biases in the AOGCM forcings are generally largest at the surface level. We quantify these differences and discuss the implications for interpreting variations in forcing and response across the multimodel ensemble of AOGCM simulations assembled for the IPCC AR4.

Collins, W. D.↗

Advancing Drought Understanding, Monitoring and Prediction

Having the capacity to monitor droughts in near-real time and providing accurate drought prediction from weeks to seasons in advance can greatly reduce the severity of social and economic damage caused by drought, a leading natural hazard for North America. The congressional mandate to establish the National Integrated Drought Information System (NIDIS; Public Law 109-430) in 2006 was a major impulse to develop, integrate, and provide drought information to meet the challenges posed by this hazard. Significant progress has been made on many fronts. On the research front, efforts by the broad scientific community have resulted in improved understanding of North American droughts and improved monitoring and forecasting tools. We now have a better understanding of the droughts of the twentieth century including the 1930s "Dust Bowl"; we have developed a broader array of tools and datasets that enhance the official North American Drought Monitor based on different methodologies such as state-of-the-art land surface modeling (e.g., the North American Land Data Assimilation System) and remote sensing (e.g., the evaporative stress index) to better characterize the occurrence and severity of drought in its multiple manifestations. In addition, we have new tools for drought prediction [including the new National Centers for Environmental Prediction (NCEP) Climate Forecast System, version 2, for operational prediction and an experimental National Multimodel Ensemble] and have explored diverse methodologies including ensemble hydrologic prediction approaches. Broad NIDIS-inspired progress is influencing the development of a Global Drought Information System (GDIS) under the auspices of the World Climate Research Program. Despite these advances, current drought monitoring and forecasting capabilities still fall short of users' needs, especially the need for skillful and reliable drought forecasts at regional and local scales. To tackle this outstanding challenging problem, focused and coordinated research efforts are needed, drawing from excellence across the broad drought research community. To meet this challenge, National Oceanic and Atmospheric Administration (NOAA)'s Drought Task Force was established in October 2011 with the ambitious goal of achieving significant new advances in the ability to understand, monitor, and predict drought over North America. The Task Force (duration of October 2011-September 2014) is an initiative of NOAA's Climate Program Office Modeling, Analysis, Predictions, and Projections (MAPP) program in partnership with NIDIS. It brings together over 30 leading MAPP-funded drought scientists from multiple academic and federal institutions [involves scientists from NOAA's research laboratories and centers, the National Aeronautics and Space Administration (NASA), U.S. Department of Agriculture, National Center for Atmospheric Research (NCAR), and many universities] in a concerted research effort that builds on individual MAPP research projects. These projects span the wide spectrum of drought research needed to make fundamental advances, from those aimed at the basic understanding of drought mechanisms to those aimed at testing new drought monitoring and prediction tools for operational and service purposes (as part of NCEP's Climate Test Bed). The Drought Task Force provides focus and coordination to MAPP drought research activities and also facilitates synergies with other national and international drought research efforts, including those by the GDIS.

GDIS↗

Northern Winter Climate Change: Assessment of Uncertainty in CMIP5 Projections Related to Stratosphere-Troposphere Coupling

Future changes in the stratospheric circulation could have an important impact on northern winter tropospheric climate change, given that sea level pressure (SLP) responds not only to tropospheric circulation variations but also to vertically coherent variations in troposphere-stratosphere circulation. Here we assess northern winter stratospheric change and its potential to influence surface climate change in the Coupled Model Intercomparison Project-Phase 5 (CMIP5) multimodel ensemble. In the stratosphere at high latitudes, an easterly change in zonally averaged zonal wind is found for the majority of the CMIP5 models, under the Representative Concentration Pathway 8.5 scenario. Comparable results are also found in the 1% CO2 increase per year projections, indicating that the stratospheric easterly change is common feature in future climate projections. This stratospheric wind change, however, shows a significant spread among the models. By using linear regression, we quantify the impact of tropical upper troposphere warming, polar amplification, and the stratospheric wind change on SLP. We find that the intermodel spread in stratospheric wind change contributes substantially to the intermodel spread in Arctic SLP change. The role of the stratosphere in determining part of the spread in SLP change is supported by the fact that the SLP change lags the stratospheric zonally averaged wind change. Taken together, these findings provide further support for the importance of simulating the coupling between the stratosphere and the troposphere, to narrow the uncertainty in the future projection of tropospheric circulation changes.

climate change↗

Strengthening of Ocean Heat Uptake Efficiency Associated with the Recent Climate Hiatus

The rate of increase of global-mean surface air temperature (SAT(sub g)) has apparently slowed during the last decade. We investigated the extent to which state-of-the-art general circulation models (GCMs) can capture this hiatus period by using multimodel ensembles of historical climate simulations. While the SAT(sub g) linear trend for the last decade is not captured by their ensemble means regardless of differences in model generation and external forcing, it is barely represented by an 11-member ensemble of a GCM, suggesting an internal origin of the hiatus associated with active heat uptake by the oceans. Besides, we found opposite changes in ocean heat uptake efficiency (k), weakening in models and strengthening in nature, which explain why the models tend to overestimate the SAT(sub g) trend. The weakening of k commonly found in GCMs seems to be an inevitable response of the climate system to global warming, suggesting the recovery from hiatus in coming decades.

Climate hiatus↗

A Vertically Flow-Following, Icosahedral Grid Model for Medium-Range and Seasonal Prediction. Part 1: Model Description

A hydrostatic global weather prediction model based on an icosahedral horizontal grid and a hybrid terrain following/ isentropic vertical coordinate is described. The model is an extension to three spatial dimensions of a previously developed, icosahedral, shallow-water model featuring user-selectable horizontal resolution and employing indirect addressing techniques. The vertical grid is adaptive to maximize the portion of the atmosphere mapped into the isentropic coordinate subdomain. The model, best described as a stacked shallow-water model, is being tested extensively on real-time medium-range forecasts to ready it for possible inclusion in operational multimodel ensembles for medium-range to seasonal prediction.

mathematical models↗

Basin-Scale Assessment of the Land Surface Water Budget in the National Centers for Environmental Prediction Operational and Research NLDAS-2 Systems

The purpose of this study is to evaluate the components of the land surface water budget in the four land surface models (Noah, SAC-Sacramento Soil Moisture Accounting Model, (VIC) Variable Infiltration Capacity Model, and Mosaic) applied in the newly implemented National Centers for Environmental Prediction (NCEP) operational and research versions of the North American Land Data Assimilation System version 2 (NLDAS-2). This work focuses on monthly and annual components of the water budget over 12 National Weather Service (NWS) River Forecast Centers (RFCs). Monthly gridded FLUX Network (FLUXNET) evapotranspiration (ET) from the Max-Planck Institute (MPI) of Germany, U.S. Geological Survey (USGS) total runoff (Q), changes in total water storage (dS/dt, derived as a residual by utilizing MPI ET and USGS Q in the water balance equation), and Gravity Recovery and Climate Experiment (GRACE) observed total water storage anomaly (TWSA) and change (TWSC) are used as reference data sets. Compared to these ET and Q benchmarks, Mosaic and SAC (Noah and VIC) in the operational NLDAS-2 overestimate (underestimate) mean annual reference ET and underestimate (overestimate) mean annual reference Q. The multimodel ensemble mean (MME) is closer to the mean annual reference ET and Q. An anomaly correlation (AC) analysis shows good AC values for simulated monthly mean Q and dS/dt but significantly smaller AC values for simulated ET. Upgraded versions of the models utilized in the research side of NLDAS-2 yield largely improved performance in the simulation of these mean annual and monthly water component diagnostics. These results demonstrate that the three intertwined efforts of improving (1) the scientific understanding of parameterization of land surface processes, (2) the spatial and temporal extent of systematic validation of land surface processes, and (3) the engineering-oriented aspects such as parameter calibration and optimization are key to substantially improving product quality in various land data assimilation systems.

NLDAS-2↗

Soil Organic Carbon and Nitrogen Feedbacks on Crop Yields Under Climate Change

A critical omission from climate change impact studies on crop yield is the interaction between soil organic carbon (SOC), nitrogen (N) availability, and carbon dioxide (CO2). We used a multimodel ensemble to predict the effects of SOC and N under different scenarios of temperatures and CO2 concentrations on maize (Zea mays L.) and wheat (Triticum aestivum L.) yield in eight sites across the world. We found that including feedbacks from SOC and N losses due to increased temperatures would reduce yields by 13% in wheat and 19% in maize for a 3°C rise temperature with no adaptation practices. These losses correspond to an additional 4.5% (+3°C) when compared to crop yield reductions attributed to temperature increase alone. Future CO2 increase to 540 ppm would partially compensate losses by 80% for both maize and wheat at +3°C, and by 35% for wheat and 20% for maize at +6°C, relative to the baseline CO2 scenario.

Basso, B.↗

Mid-Latitude Freshwater Availability Reduced by Projected Vegetation Responses to Climate Change

Plants are expected to generate more global-scale runoff under increasing atmospheric carbon dioxide concentrations through their influence on surface resistance to evapotranspiration. Recent studies using Earth System Models from phase 5 of the Coupled Model Intercomparison Project ostensibly reaffirm this result, further suggesting that plants will ameliorate the dire reductions in water availability projected by other studies that use aridity metrics. Here we complicate this narrative by analysing the change in precipitation partitioning to plants, runoff and storage in multiple Earth system models under both high carbon dioxide concentrations and warming. We show that projected plant responses directly reduce future runoff across vast swaths of North America, Europe and Asia because bulk canopy water demands increase with additional vegetation growth and longer and warmer growing seasons. These runoff declines occur despite increased surface resistance to evapotranspiration and vegetation total water use efficiency, even in regions with increasing or unchanging precipitation. We demonstrate that constraining the large uncertainty in the multimodel ensemble with regional-scale observations of evapotranspiration partitioning strengthens these results. We conclude that terrestrial vegetation plays a large and unresolved role in shaping future regional freshwater availability, one that will not ubiquitously ameliorate future warming-driven surface drying.

Mankin, Justin S.↗

An Assessment of Multimodel Simulations for the Variability of Western North Pacific Tropical Cyclones and Its Association with ENSO

An assessment of simulations of the interannual variability of tropical cyclones (TCs) over the western North Pacific (WNP) and its association with El Niño-Southern Oscillation (ENSO), as well as a subsequent diagnosis for possible causes of model biases generated from simulated large-scale climate conditions, are documented in the paper. The model experiments are carried out by the Hurricane Work Group under the U.S. Climate Variability and Predictability Research Program (CLIVAR) using five global climate models (GCMs) with a total of 16 ensemble members forced by the observed sea surface temperature and spanning the 28-yr period from 1982 to 2009. The results show GISS and GFDL model ensemble means best simulate the interannual variability of TCs, and the multimodel ensemble mean (MME) follows. Also, the MME has the closest climate mean annual number of WNP TCs and the smallest root-mean-square error to the observation. Most GCMs can simulate the interannual variability of WNP TCs well, with stronger TC activities during two types of El Niño-namely, eastern Pacific (EP) and central Pacific (CP) El Niño-and weaker activity during La Niña. However, none of the models capture the differences in TC activity between EP and CP El Niño as are shown in observations. The inability of models to distinguish the differences in TC activities between the two types of El Niño events may be due to the bias of the models in response to the shift of tropical heating associated with CP El Niño.

climate models↗

Improving Surface PM2.5 Forecasts in the United States Using an Ensemble of Chemical Transport Model Outputs: 2. Bias Correction with Satellite Data for Rural Areas

This work serves as the second of a two-part study to improve surface PM2.5 forecasts in the continental U.S. through the integrated use of multi satellite aerosol optical depth (AOD) products (MODIS Terra/Aqua and VIIRS DT/DB), multichemical transport model (CTM) (GEOS-Chem, WRF-Chem, and CMAQ) outputs, and ground observations. In Part I of the study, an ensemble Kalman filter (KF) technique using three CTM outputs and ground observations was developed to correct forecast bias and generate a single best forecast of PM2.5 for next day over non rural areas that have surface PM2.5 measurements in the proximity of 125 km. Here, with AOD data, we extended the bias correction into rural areas where the closest air quality monitoring station is at least 125–300 km away. First, we ensembled all of satellite AOD products to yield the single best AOD. Second, we corrected daily PM2.5 in rural areas from multiple models through the AOD spatial pattern between these areas and non rural areas, referred to as “extended ground truth” or EGT, for the present day. Lastly, we applied the KF technique to reduce the forecast bias for next day using the EGT. Our results find that the ensemble of bias-corrected daily PM2.5 from three CTMs for both today and next day show the best performance. Together, the two-part study develops a multimodel and multi-AOD bias-correction technique that has the potential to improve PM2.5 forecasts in both rural and non rural areas in near real time, and be readily implemented at state levels.

Huanxin Zhang↗

Modelling climate change impacts on maize yields under low nitrogen input conditions in sub‐Saharan Africa

Smallholder farmers in sub‐Saharan Africa (SSA) currently grow rainfed maize with limited inputs including fertilizer. Climate change may exacerbate current production constraints. Crop models can help quantify the potential impact of climate change on maize yields, but a comprehensive multimodel assessment of simulation accuracy and uncertainty in these low‐input systems is currently lacking. We evaluated the impact of varying [CO2], temperature and rainfall conditions on maize yield, for different nitrogen (N) inputs (0, 80, 160 kg N/ha) for five environments in SSA, including cool subhumid Ethiopia, cool semi‐arid Rwanda, hot subhumid Ghana and hot semi‐arid Mali and Benin using an ensemble of 25 maize models. Models were calibrated with measured grain yield, plant biomass, plant N, leaf area index, harvest index and in‐season soil water content from 2‐year experiments in each country to assess their ability to simulate observed yield. Simulated responses to climate change factors were explored and compared between models. Calibrated models reproduced measured grain yield variations well with average relative root mean square error of 26%, although uncertainty in model prediction was substantial (CV = 28%). Model ensembles gave greater accuracy than any model taken at random. Nitrogen fertilization controlled the response to variations in [CO2], temperature and rainfall. Without N fertilizer input, maize (i) benefited less from an increase in atmospheric [CO2], (ii) was less affected by higher temperature or decreasing rainfall and (iii) was more affected by increased rainfall because N leaching was more critical. The model inter-comparison revealed that simulation of daily soil N supply and N leaching plays a crucial role in simulating climate change impacts for low-input systems. Climate change and N input interactions have strong implications for the design of robust adaptation practices across SSA, because the impact of climate change will be modified if farmers intensify maize production with more mineral fertilizer.

Crop simulation model↗