Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Ensemble models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Discussion on “Saving Storage in Climate Ensembles: A Model-Based Stochastic Approach”

Abstract We thank the authors for this interesting paper that highlights important ideas and concepts for the future of climate model ensembles and their storage, as well as future uses of stochastic emulators. Stochastic emulators are particularly relevant because of the statistical nature of climate model ensembles, as discussed in previous work of the authors (Castruccio et al. in J Clim 32:8511–8522, 2019; Hu and Castruccio in J Clim 34:8409–8418, 2021). We thank the authors for sharing of some of their data with us in order to illustrate this discussion. In the following, in Sect. 1 we discuss alternative techniques currently used and studied, namely lossy compression and ideas emerging from the climate modeling community, that could feed the discussion on ensemble and storage. In that section, we also present numerical results of compression performed on the data shared by the authors. In Sect. 2, we discuss the current statistical model proposed by the authors and its context. We discuss other potential uses of stochastic emulators in climate and Earth modeling.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Approaching periodic systems in ensemble density functional theory via finite one-dimensional models

Ensemble density functional theory (EDFT) is a generalization of ground-state DFT, which is based on an exact formal theory of finite collections of a system's ground and excited states. EDFT in various forms has been shown to improve the accuracy of calculated energy level differences in isolated model systems, atoms, and molecules, but it is not yet clear how EDFT could be used to calculate band gaps for periodic systems. We extend the application of EDFT toward periodic systems by estimating the thermodynamic limit with increasingly large finite one-dimensional 'particle in a box' systems, which approach the uniform electron gas (UEG). Using ensemble-generalized Hartree and local spin density approximation exchange-correlation functionals, we find that corrections go to zero in the infinite limit, as expected for a metallic system. However, there is a correction to the effective mass, with results comparable to other calculations on 1D, 2D, and 3D UEGs, which indicates promise for non-trivial results from EDFT on periodic systems.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
NASA NTRS2019

ESD Reviews: Model Dependence in Multi-Model Climate Ensembles: Weighting, Sub-Selection and Out-Of-Sample Testing

The rationale for using multi-model ensembles in climate change projections and impacts research is often based on the expectation that different models constitute independent estimates; therefore, a range of models allows a better characterisation of the uncertainties in the representation of the climate system than a single model. However, it is known that research groups share literature, ideas for representations of processes, parameterisations, evaluation data sets and even sections of model code. Thus, nominally different models might have similar biases because of similarities in the way they represent a subset of processes, or even be near-duplicates of others, weakening the assumption that they constitute independent estimates. If there are near-replicates of some models, then treating all models equally is likely to bias the inferences made using these ensembles. The challenge is to establish the degree to which this might be true for any given application. While this issue is recognised by many in the community, quantifying and accounting for model dependence in anything other than an ad-hoc way is challenging. Here we present a synthesis of the range of disparate attempts to define, quantify and address model dependence in multi-model climate ensembles in a common conceptual framework, and provide guidance on how users can test the efficacy of approaches that move beyond the equally weighted ensemble. In the upcoming Coupled Model Intercomparison Project phase 6 (CMIP6), several new models that are closely related to existing models are anticipated, as well as large ensembles from some models. We argue that quantitatively accounting for dependence in addition to model performance, and thoroughly testing the effectiveness of the approach used will be key to a sound interpretation of the CMIP ensembles in future scientific studies.

Abramowitz, Gab↗
DOE OSTI2023

Systems and methods for modeling water quality

A system, method, device and computer-readable medium for creating an ensemble model of water quality. The ensemble model is generated by determining a set of optimal component models for spectral regions of a body of water, and combining the optimal models. The optimal models can be based on remote sensing data, including satellite imagery. A K-fold partition approach or a global approach can be used to determine the optimal component models, and the optimal component models can be combined through spectral space partition rules to generate an ensemble model of water quality. The ensemble model not only has improved water quality prediction ability, but also has strong spatial and temporal extensibility. The spatial and temporal extensibility of the ensemble model is fundamentally important and desirable for long-term and large-scale remote sensing monitoring and assessment of water quality.

Liu, Hongxing↗
NASA NTRS1999

Reconstruction of the 1997/1998 El Nino from TOPEX/POSEIDON and TOGA/TAO Data Using a Massively Parallel Pacific-Ocean Model and Ensemble Kalman Filter

Two massively parallel data assimilation systems in which the model forecast-error covariances are estimated from the distribution of an ensemble of model integrations are applied to the assimilation of 97-98 TOPEX/POSEIDON altimetry and TOGA/TAO temperature data into a Pacific basin version the NASA Seasonal to Interannual Prediction Project (NSIPP)ls quasi-isopycnal ocean general circulation model. in the first system, ensemble of model runs forced by an ensemble of atmospheric model simulations is used to calculate asymptotic error statistics. The data assimilation then occurs in the reduced phase space spanned by the corresponding leading empirical orthogonal functions. The second system is an ensemble Kalman filter in which new error statistics are computed during each assimilation cycle from the time-dependent ensemble distribution. The data assimilation experiments are conducted on NSIPP's 512-processor CRAY T3E. The two data assimilation systems are validated by withholding part of the data and quantifying the extent to which the withheld information can be inferred from the assimilation of the remaining data. The pros and cons of each system are discussed.

Keppenne, C. L.↗
NASA NTRS2016

Lessons from Climate Modeling on the Design and Use of Ensembles for Crop Modeling

Working with ensembles of crop models is a recent but important development in crop modeling which promises to lead to better uncertainty estimates for model projections and predictions, better predictions using the ensemble mean or median, and closer collaboration within the modeling community. There are numerous open questions about the best way to create and analyze such ensembles. Much can be learned from the field of climate modeling, given its much longer experience with ensembles. We draw on that experience to identify questions and make propositions that should help make ensemble modeling with crop models more rigorous and informative. The propositions include defining criteria for acceptance of models in a crop MME, exploring criteria for evaluating the degree of relatedness of models in a MME, studying the effect of number of models in the ensemble, development of a statistical model of model sampling, creation of a repository for MME results, studies of possible differential weighting of models in an ensemble, creation of single model ensembles based on sampling from the uncertainty distribution of parameter values or inputs specifically oriented toward uncertainty estimation, the creation of super ensembles that sample more than one source of uncertainty, the analysis of super ensemble results to obtain information on total uncertainty and the separate contributions of different sources of uncertainty and finally further investigation of the use of the multi-model mean or median as a predictor.

Model ensembles↗
DOE OSTI2024

Systematic and objective evaluation of Earth system models: PCMDI Metrics Package (PMP) version 3

Systematic, routine, and comprehensive evaluation of Earth system models (ESMs) facilitates benchmarking improvement across model generations and identifying the strengths and weaknesses of different model configurations. By gauging the consistency between models and observations, this endeavor is becoming increasingly necessary to objectively synthesize the thousands of simulations contributed to the Coupled Model Intercomparison Project (CMIP) to date. The Program for Climate Model Diagnosis and Intercomparison (PCMDI) Metrics Package (PMP) is an open-source Python software package that provides quick-look objective comparisons of ESMs with one another and with observations. The comparisons include metrics of large- to global-scale climatologies, tropical inter-annual and intra-seasonal variability modes such as the El Niño–Southern Oscillation (ENSO) and Madden–Julian Oscillation (MJO), extratropical modes of variability, regional monsoons, cloud radiative feedbacks, and high-frequency characteristics of simulated precipitation, including its extremes. The PMP comparison results are produced using all model simulations contributed to CMIP6 and earlier CMIP phases. An important objective of the PMP is to document the performance of ESMs participating in the recent phases of CMIP, together with providing version-controlled information for all datasets, software packages, and analysis codes being used in the evaluation process. Among other purposes, this also enables modeling groups to assess performance changes during the ESM development cycle in the context of the error distribution of the multi-model ensemble. Quantitative model evaluation provided by the PMP can assist modelers in their development priorities. In this paper, we provide an overview of the PMP, including its latest capabilities, and discuss its future direction.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2021

Large-scale features of Last Interglacial climate: results from evaluating the lig127k simulations for the Coupled Model Intercomparison Project (CMIP6)–Paleoclimate Modeling Intercomparison Project (PMIP4)

The modeling of paleoclimate, using physically based tools, is increasingly seen as a strong out-of-sample test of the models that are used for the projection of future climate changes. New to the Coupled Model Intercomparison Project (CMIP6) is the Tier 1 Last Interglacial experiment for 127 000 years ago (lig127k), designed to address the climate responses to stronger orbital forcing than the midHolocene experiment, using the same state-of-the-art models as for the future and following a common experimental protocol. Here we present a first analysis of a multi-model ensemble of 17 climate models, all of which have completed the CMIP6 DECK (Diagnostic, Evaluation and Characterization of Klima) experiments. The equilibrium climate sensitivity (ECS) of these models varies from 1.8 to 5.6°C. The seasonal character of the insolation anomalies results in strong summer warming over the Northern Hemisphere continents in the lig127k ensemble as compared to the CMIP6 piControl and much-reduced minimum sea ice in the Arctic. The multi-model results indicate enhanced summer monsoonal precipitation in the Northern Hemisphere and reductions in the Southern Hemisphere. These responses are greater in the lig127k than the CMIP6 midHolocene simulations as expected from the larger insolation anomalies at 127 than 6 ka. New synthesis for surface temperature and precipitation, targeted for 127 ka, have been developed for comparison to the multi-model ensemble. The lig127k model ensemble and data reconstructions are in good agreement for summer temperature anomalies over Canada, Scandinavia, and the North Atlantic and for precipitation over the Northern Hemisphere continents. The model–data comparisons and mismatches point to further study of the sensitivity of the simulations to uncertainties in the boundary conditions and of the uncertainties and sparse coverage in current proxy reconstructions. The CMIP6–Paleoclimate Modeling Intercomparison Project (PMIP4) lig127k simulations, in combination with the proxy record, improve our confidence in future projections of monsoons, surface temperature, and Arctic sea ice, thus providing a key target for model evaluation and optimization.

Last Interglacial climate↗
NASA NTRS2024

Critical Load Exceedances for North America and Europe using an Ensemble of Models and an Investigation of Causes for Environmental Impact Estimate Variability: An AQMEII4 Study

Exceedances of critical loads for deposition of sulphur (S) and nitrogen (N) to different ecosystems were estimated using European and North American ensembles of air quality models, under Phase 4 of the Air Quality Model Evaluation International Initiative (AQMEII4), to identify where risk of ecosystem harm is expected to occur based on model deposition estimates. The ensembles were driven by common emissions and lateral boundary condition inputs. Model output was regridded to common North American and Europe 0.125° resolution domains, which were then used to calculate critical load exceedances. New, targeted deposition diagnostics implemented in AQMEII4 allowed an unprecedented level of post-simulation analysis to be carried out and facilitated the identification of specific causes of model-to-model variability in critical load exceedance estimates. New datasets for North American critical loads for acidity for forest soil water and aquatic ecosystems were combined with the ensemble deposition predictions to show a substantial decrease in the area and number of locations in exceedance between 2010 and 2016 (forest soils: 13.2 % to 6.1 %; aquatic ecosystems: 21.2 % to 11.4 %). All models agreed in the direction of the ensemble exceedance change between 2010 and 2016. The North American ensemble also predicted a decrease in both severity and total area in exceedance between the years 2010 and 2016 for eutrophication-impacted ecosystems in the USA (sensitive epiphytic lichen: 81.5 % to 75.8 %). The exceedances for herbaceous community richness also decreased between 2010 and 2016, from 13.9 % to 3.9 %. The uncertainty associated with the North American eutrophication results is high; there were sharp differences between the models in both predictions of total N deposition and the change in N deposition, and hence in the predicted eutrophication exceedances between the two years. The European ensemble was used to predict relatively static exceedances of critical loads with respect to acidification (4.48 % to 4.32 % from 2009 to 2010) while eutrophication exceedance increased slightly (60.2 % to 62.2 %). While most models showed the same changes in critical load exceedances as the ensemble between the two years, the spatial extent and magnitude of exceedances varied significantly between the models. The reasons for this variation were examined in detail by first ranking the relative contribution of different sources of sulphur and nitrogen deposition in terms of deposited mass and model-to-model variability in that deposited mass, followed by their analysis using AQMEII4 diagnostics, along with evaluation of the most recent literature. All models in both the North American and European ensembles had net annual negative biases with respect to observed wet deposition of sulphate, nitrate and ammonium. Diagnostics and recent literature suggest that this bias may stem from insufficient cloud scavenging of aerosols and gases, and may be improved through the incorporation of multiphase hydrometeor scavenging within the modelling frameworks. The inability of North American models to predict the timing of the seasonal peak in wet ammonium ion deposition (observed maximum was in April, while all models predicted a June maximum) may also relate to the need for multiphase hydrometeor scavenging (absence of snow scavenging in all models employed here). High variability in the relative importance of particulate sulphate, nitrate and ammonium deposition fluxes between models was linked to the use of updated particle dry deposition parameterizations in some models. However, recent literature and further development of some of the models within the ensemble suggests these particulate biases may also be ameliorated via the incorporation of multiphase hydrometeor scavenging. Annual sulphur and nitrogen deposition prediction variability was linked to SO 2 and HNO 3 dry deposition parameterizations, and diagnostic analysis showed that the cuticle and soil deposition pathways dominate the deposition mass flux of these species. Further work improving parameterizations for these deposition pathways should reduce variability in model acidifying gas deposition estimates. The absence of base cation chemistry in some models was shown to be a major factor in positive biases in fine mode particulate ammonium and particle nitrate concentrations. Models employing ammonia bidirectional fluxes had both the largest and the smallest magnitude biases, depending on the model and bidirectional flux algorithm employed. A careful analysis of bidirectional flux models suggests that those with poor NH 3 performance may underestimate the extent of NH 3 emissions fluxes from forested areas. Based on these results, an increased process-research focus is therefore recommended for the following model processes and on observations which may assist in model evaluation and improvement: multiphase hydrometeor scavenging combined with updated particle dry deposition, cuticle and soil deposition pathway algorithms for acidifying gases, base cation chemistry and emissions, and NH 3 bidirectional fluxes. Comparisons with satellite observations suggest that oceanic NH 3 emissions sources should be included in regional chemical transport models. The choice of land use database employed within any given model was shown to significantly influence deposition totals in several instances, and employing a common land use database across chemical transport models and critical load calculations is recommended for future work.

critical loads↗
NASA NTRS2023

AgMIP-Wheat Multi-Model Simulations on Climate Change Impact and Adaptation for Global Wheat

The climate change impact and adaptation simulations from the Agricultural Model Intercomparison and Improvement Project (AgMIP) for wheat provide a unique dataset of multi-model ensemble simulations for 60 representative global locations covering all global wheat mega environments. The multi-model ensemble reported here has been thoroughly benchmarked against a large number of experimental data, including different locations, growing season temperatures, atmospheric CO2 concentration, heat stress scenarios, and their interactions. In this paper, we describe the main characteristics of this global simulation dataset. Detailed cultivar, crop management, and soil datasets were compiled for all locations to drive 32 wheat growth models. The dataset consists of 30-year simulated data including 25 output variables for nine climate scenarios, including Baseline (1980-2010) with 360 or 550 ppm CO2, Baseline +2oC or +4oC with 360 or 550 ppm CO2, a mid-century climate change scenario (RCP8.5, 571 ppm CO2), and 1.5°C (423 ppm CO2) and 2.0oC (487 ppm CO2) warming above the pre-industrial period (HAPPI). This global simulation dataset can be used as a benchmark from a well-tested multi-model ensemble in future analyses of global wheat. Also, resource use efficiency (e.g., for radiation, water, and nitrogen use) and uncertainty analyses under different climate scenarios can be explored at different scales. The DOI for the dataset is 10.5281/zenodo.4027033 (AgMIP-Wheat, 2020), and all the data are available on the data repository of Zenodo (http://doi.org/10.5281/zenodo.4027033). Two scientific publications have been published based on some of these data here.

Agricultural Model Intercomparison and Improvement↗
NASA NTRS2003

Cloud Modeling Using Field Project Data for the Study of Precipitation Processes

The use of cloud-resolving models (CRMs) in the study of precipitation process and their relation to the large-scale environment can be generally categorized into two approaches. The first approach is so called "cloud ensemble modeling". In this approach, many clouds of different size in various stages of their lifecycles can be present at any model simulation time. Large-scale effects are derived from observations and imposed into the model as the main forcing. The advantage of this approach is that the modeled convection will be forced to have the same intensity, thermodynamic budget and organization as the obserations.This approach will also allow CRMs to perform multi-day or multi-week time integrations. The second approach usually requires initial temperature and water vapor profiles that have a medium to large CAPE, and open lateral boundary conditions are used. The modeled clouds could be termed "self-forced convection". Model improvements, such as in the microphysics, are achieved using the second approach. In cloud ensemble modeling, accurate large-scale advective tendencies for temperature and water vapor are the main forcing for the CRMs. We found that the large-scale advective terms for temperature and water vapor are not always consistent, For example, large-scale forcing could indicate strong drying which would produce cooling in the model through evaporation but not contain large-scale advective heating to compensate. This discrepancy in forcing would cause differences between the observed and modeled latent heating profiles. Good measurements of other quantities (i.e., surface fluxes and radiation) are also required to perform variational objective analysis that computes and minimizes a "cost function" that constrains the difference between the large-scale advective forcing in temperature and water vapor. With self-forced convection, accurate vertical distributions of temperature, moisture (water vapor), and horizontal winds are required. The timing of the measurements relative to cloud development is crucial (i.e., prior to cloud triggering). Microphysical measurements (i.e., the cloud number concentration and size distribution) can also be used in this second approach but are of secondary importance with cloud ensemble modeling. In this paper, data collected during TRMM field campaigns (FCs; i.e., SCSMEX, LBA and KWAJEX) which were aimed at validating TRMM products (i.e., rainfall and the vertical distribution of latent heating) will be used to examine the impact of errors in the initial conditions (e.g.., soundings an large-scale forcing) on simulated rainfall distributions and brightness. Rainfall and precipitations simulated from a CRM will also be compared with those estimated by a schocastic model.

Tao, W.-K.↗
NASA NTRS2013

On the Lack of Stratospheric Dynamical Variability in Low-top Versions of the CMIP5 Models

We describe the main differences in simulations of stratospheric climate and variability by models within the fifth Coupled Model Intercomparison Project (CMIP5) that have a model top above the stratopause and relatively fine stratospheric vertical resolution (high-top), and those that have a model top below the stratopause (low-top). Although the simulation of mean stratospheric climate by the two model ensembles is similar, the low-top model ensemble has very weak stratospheric variability on daily and interannual time scales. The frequency of major sudden stratospheric warming events is strongly underestimated by the low-top models with less than half the frequency of events observed in the reanalysis data and high-top models. The lack of stratospheric variability in the low-top models affects their stratosphere-troposphere coupling, resulting in short-lived anomalies in the Northern Annular Mode, which do not produce long-lasting tropospheric impacts, as seen in observations. The lack of stratospheric variability, however, does not appear to have any impact on the ability of the low-top models to reproduce past stratospheric temperature trends. We find little improvement in the simulation of decadal variability for the high-top models compared to the low-top, which is likely related to the fact that neither ensemble produces a realistic dynamical response to volcanic eruptions.

troposphere↗