SEARCH · Engineering Papers

Results for “Ensemble models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Generalizable Image Segmentation for Microstructure Characterization Through Integrated SEM and EBSD Analysis

We demonstrate generalizable semantic segmentation using minimal ground truth data. Correlated scanning electron microscopy (SEM) images and electron backscatter diffraction (EBSD) measurements of frictionstir processed 316L stainless steel plates were used to train deep learning models for grain boundary segmentation. Secondary electron (SE) imaging taken at an accelerating voltage of 10 keV correlated to EBSD-derived grain boundaries produced the best performing model. Notably, an ensemble of three models trained on a single SE image produced accurate segmentation over a series of BSE images of samples manufactured under different processing parameters, with a resultant mean absolute error in grain size of 0.34 µm. The striking generalizability of the models likely results from the similar escape depths of the SE training input and the EBSD training output and the reduced probability of dislocation artifacts appearing in the image. This finding highlights the importance of considering the physical principles behind imaging in the development of robust segmentation models for microstructure characterization.

Taufique, Mohammad Fuad Nur↗

DOE OSTI2022

Robust Anthropogenic Signal Identified in the Seasonal Cycle of Tropospheric Temperature

Previous work identified an anthropogenic fingerprint pattern in T AC (x, t), the amplitude of the seasonal cycle of mid- to upper-tropospheric temperature (TMT), but did not explicitly consider whether fingerprint identification in satellite T AC (x, t) data could have been influenced by real-world multidecadal internal variability (MIV). Here we address this question here using large ensembles (LEs) performed with five climate models. LEs provide many different sequences of internal variability noise superimposed on an underlying forced signal. Despite differences in historical external forcings, climate sensitivity, and MIV properties of the five models, their T AC (x, t) fingerprints are similar and statistically identifiable in 239 of the 240 LE realizations of historical climate change. Comparing simulated and observed variability spectra reveals that consistent fingerprint identification is unlikely to be biased by model underestimates of observed MIV. Even in the presence of large (factor of 3–4) intermodel and inter-realization differences in the amplitude of MIV, the anthropogenic fingerprints of seasonal cycle changes are robustly identifiable in models and satellite data. This is primarily due to the fact that the distinctive, global-scale fingerprint patterns are spatially dissimilar to the smaller-scale patterns of internal T AC (x, t) variability associated with the Atlantic multidecadal oscillation and El Niño–Southern Oscillation. The robustness of the seasonal cycle detection and attribution results shown here, taken together with the evidence from idealized aquaplanet simulations, suggest that basic physical processes are dictating a common pattern of forced T AC (x, t) changes in observations and in the five LEs. The key processes involved include GHG-induced expansion of the tropics, lapse-rate changes, land surface drying, and sea ice decrease.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2002

Mesoscale Convective Systems During SCSMEX: Simulations with a Regional Climate Model and a Cloud-Resolving Model

The South China Sea Monsoon Experiment (SCSMEX) was conducted in May-June 1998. One of its major objectives is to better understand the key physical processes for the onset and evolution of the summer monsoon over Southeast Asia and southern China (Lau et al. 2000). Multiple observation platforms (e.g., soundings, Doppler radar, ships, wind seafarers, radiometers, etc.) during SCSMEX provided a first attempt at investigating the detailed characteristics of convection and circulation changes, associated with monsoons over the South China Sea region. SCSMEX also provided precipitation derived from atmospheric budgets (Johnson and Ciesielski 2002) and comparison to those obtained from the Tropical Rainfall Measuring Mission (TRMM). In this paper, a regional climate model and a cloud-resolving model are used to perform multi-day integrations to understand the precipitation processes associated with the summer monsoon over Southeast Asia and southern China. The regional climate model is used to understand the soil - precipitation interaction and feedback associated with a flood event that occurred in and around China's Atlantic River during SCSMEX. Sensitivity tests on various land surface models, cumulus parameterization schemes (CASE), sea surface temperature (SST) variations and midlatitude influences are also performed to understand the processes associated with the onset of the monsoon over the S. China Sea during SCSMEX. Cloud-resolving models (CRMs) use more sophisticated and physically realistic parameterizations of cloud microphysical processes with very fine spatial and temporal resolution. One of the major characteristics of CRMs is an explicit interaction between clouds, radiation and the land/ocean surface. It is for this reason that GEWEX (Global Energy and Water Cycle Experiment) has formed the GCSS (GEWEX Cloud System Study) expressly for the purpose of improving the representation of the moist processes in large-scale models using CRMs. The Goddard Cumulus Ensemble (GCE) model is a CRM and is used to simulate convective systems associated with the onset of the South China Sea monsoon in 1998. The BRUCE model includes the same land surface model, cloud physics, and radiation scheme used in the regional climate model. A comparison between the results from the GCE model and regional climate model is performed.

Tao, W. K.↗

NASA NTRS2018

Comparisons of Two Spatial Implementations of a Crop Model Using Remotely Sensed Observations over Southeastern United States

Global food security is one of the most pressing issues of the current century, particularly for developing nations. Agricultural simulation models can be a key component in testing new technologies, seeds and cultivars etc. However, inaccurate input information, model related errors and the mode of implementation can also add to model uncertainties. In this study, the crop model is implemented in two separate fashions: a)gridded (GriDSSAT model) and b) using random spatial ensembles (RHEAS model). This is done in the Southeastern US to evaluate and understand the modelperformance over a region data availabilities. Once the model performance is assessed, multiple satellite based earth observation parameters such as soil moisture, vegetation index etc. can be assimilated into crop models to reduce input and model related uncertainties particularly in data limited regions. In this study, the National Agricultural Statistical Services (NASS) reported yield data at county levels are used for comparison andvalidation purposes. The GriDSSAT model estimation of corn yields in comparison with the reported NASS yields showed an overall RMSD of nearly 3720 (kg/ha) whereas RMSD for the RHEAS model implementation was 3550 (kg/ha). Overall the GriDSSAT model had negative bias of nearly 2400 kg/ha (except for 2013) while RHEAS had a slight positive bias of 400 kg/ha (approx.).

SERVIR↗

NASA NTRS2022

Kamodo’s Model-Agnostic Satellite Flythrough: Lowering the Utilization Barrier for Heliophysics Model Outputs

Heliophysics model outputs are increasingly accessible, but typically are not usable by the majority of the community unless directly collaborating with the relevant model developers. Prohibitive factors include complex file output formats, cryptic metadata, unspecified and often customized coordinate systems, and non-linear coordinate grids. Some pockets of progress exist, giving interfaces to various simulation outputs, but only for a small set of outputs and typically not with open-source, freely available packages. Additionally, the increasing array of tools built upon these sporadic interfaces are typically model-specific. We present Kamodo’s model-agnostic satellite flythrough capabilities as the solution to the utilization barrier for heliophysics model outputs. Developed at the Community Coordinated Modeling Center, these flythrough capabilities are built in Python upon a network of model-agnostic interfaces developed in collaboration with model developers, providing interpolation results the community can trust. Kamodo’s flythrough capabilities present the user with a growing variety of flythrough tools based upon a rapidly expanding library of heliophysics model outputs in several domains, currently including a variety of Ionosphere-Thermosphere-Mesosphere and global magnetosphere model outputs. Each capability is designed to be easily accessible via simplistic model-agnostic syntax, with the entire package freely available in the cloud on Github. Here, we describe the tools developed, include several sample applications for common science questions, demonstrate interoperability with selected packages, and summarize ongoing developments.

Software↗

NASA NTRS2020

Modelling climate change impacts on maize yields under low nitrogen input conditions in sub‐Saharan Africa

Smallholder farmers in sub‐Saharan Africa (SSA) currently grow rainfed maize with limited inputs including fertilizer. Climate change may exacerbate current production constraints. Crop models can help quantify the potential impact of climate change on maize yields, but a comprehensive multimodel assessment of simulation accuracy and uncertainty in these low‐input systems is currently lacking. We evaluated the impact of varying [CO2], temperature and rainfall conditions on maize yield, for different nitrogen (N) inputs (0, 80, 160 kg N/ha) for five environments in SSA, including cool subhumid Ethiopia, cool semi‐arid Rwanda, hot subhumid Ghana and hot semi‐arid Mali and Benin using an ensemble of 25 maize models. Models were calibrated with measured grain yield, plant biomass, plant N, leaf area index, harvest index and in‐season soil water content from 2‐year experiments in each country to assess their ability to simulate observed yield. Simulated responses to climate change factors were explored and compared between models. Calibrated models reproduced measured grain yield variations well with average relative root mean square error of 26%, although uncertainty in model prediction was substantial (CV = 28%). Model ensembles gave greater accuracy than any model taken at random. Nitrogen fertilization controlled the response to variations in [CO2], temperature and rainfall. Without N fertilizer input, maize (i) benefited less from an increase in atmospheric [CO2], (ii) was less affected by higher temperature or decreasing rainfall and (iii) was more affected by increased rainfall because N leaching was more critical. The model inter-comparison revealed that simulation of daily soil N supply and N leaching plays a crucial role in simulating climate change impacts for low-input systems. Climate change and N input interactions have strong implications for the design of robust adaptation practices across SSA, because the impact of climate change will be modified if farmers intensify maize production with more mineral fertilizer.

Crop simulation model↗

DOE OSTI2026

Challenges and alternatives to empirical orthogonal functions for earth system data

Empirical orthogonal functions (EOFs) applied to gridded Earth system data enables users to diagnose modes of variability with relative ease. Yet, many challenges to interpretation exist such that they must be used with awareness and intention when applied to gridded climate data, especially with large ensembles. Utilizing data from two different Earth system modelling large ensemble frameworks, the Energy Exoscale Earth System Model and the Community Earth System Model, as well as reanalysis data, common EOF pitfalls are summarized and discussed. Challenges include erroneous mode swapping, sign flipping, and the temporal variability of the centers of action. For modes of variability with similar contribution to variance, mode swapping is not uncommon. Sign flipping can occur with almost any mode where the pattern is correct, but the sign is arbitrary. Although the variability of the center of action is not necessarily problematic, it potentially complicates interpretation over multi-century timescales. A wide variety of alternative methods to EOFs exist, but fitness-for-purpose must be evaluated. Additionally, illustrations of alternative methods and examples of proper use are provided. Alternative methods fit into three categories: EOF variants, linear methods, and multilinear methods.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Assessing boundary condition and parametric uncertainty in numerical-weather-prediction-modeled, long-term offshore wind speed through machine learning and analog ensemble

To accurately plan and manage wind power plants, not only does the time-varying wind resource at the site of interest need to be assessed but also the uncertainty connected to this estimate. Numerical weather prediction (NWP) models at the mesoscale represent a valuable way to characterize the wind resource offshore, given the challenges connected with measuring hub-height wind speed. The boundary condition and parametric uncertainty associated with modeled wind speed is often estimated by running a model ensemble. However, creating an NWP ensemble of long-term wind resource data over a large region represents a computational challenge. Here, we propose two approaches to temporally extrapolate wind speed boundary condition and parametric uncertainty using a more convenient setup in which a mesoscale ensemble is run over a short-term period (1 year), and only a single model covers the desired long-term period (20 year). We quantify hub-height wind speed boundary condition and parametric uncertainty from the short-term model ensemble as its normalized across-ensemble standard deviation. Then, we develop and apply a gradient-boosting model and an analog ensemble approach to temporally extrapolate such uncertainty to the full 20-year period, for which only a single model run is available. As a test case, we consider offshore wind resource characterization in the California Outer Continental Shelf. Both of the proposed approaches provide accurate estimates of the long-term wind speed boundary condition and parametric uncertainty across the region (R 2 >0.75), with the gradient-boosting model slightly outperforming the analog ensemble in terms of bias and centered root-mean-square error. At the three offshore wind energy lease areas in the region, we find a long-term median hourly uncertainty between 10 % and 14 % of the mean hub-height wind speed values. Finally, we assess the physical variability in the uncertainty estimates. In general, we find that the wind speed uncertainty increases closer to land. Also, neutral conditions have smaller uncertainty than the stable and unstable cases, and the modeled wind speed in winter has less boundary condition and parametric sensitivity than summer.

17 WIND ENERGY↗

DOE OSTI2025

One‐at‐a‐Time Parameter Perturbation Ensemble of the Community Land Model, Version 5.1

Comprehensive land models are subject to significant parametric uncertainty, which can be hard to quantify due to the large number of parameters and high model computational costs. We constructed a large parameter perturbation ensemble (PPE) for the Community Land Model version 5.1 with biogeochemistry configuration (CLM5.1-BGC). We performed more than 2,000 simulations perturbing 211 parameters across six forcing scenarios. This provides an expansive data set, which can be used to identify the most influential parameters on a wide range of output variables globally, by biome, or by plant functional type. We found that parameter effects can exceed scenario effects and that a small number of parameters explains a large fraction of variance across our ensemble. The most important parameters can differ regionally and also based on the forcing scenario. The software infrastructure developed for this experiment has greatly reduced the human and computer time needed for CLM PPEs, which can facilitate routine investigation of parameter sensitivity and uncertainty, as well as automated calibration.

Kennedy, Daniel [NSF National Center for Atmospher↗

NASA NTRS2010

Sources of Uncertainty in Predicting Land Surface Fluxes Using Diverse Data and Models

In the domain of predicting land surface fluxes, models are used to bring data from large observation networks and satellite remote sensing together to make predictions about present and future states of the Earth. Characterizing the uncertainty about such predictions is a complex process and one that is not yet fully understood. Uncertainty exists about initialization, measurement and interpolation of input variables; model parameters; model structure; and mixed spatial and temporal supports. Multiple models or structures often exist to describe the same processes. Uncertainty about structure is currently addressed by running an ensemble of different models and examining the distribution of model outputs. To illustrate structural uncertainty, a multi-model ensemble experiment we have been conducting using the Terrestrial Observation and Prediction System (TOPS) will be discussed. TOPS uses public versions of process-based ecosystem models that use satellite-derived inputs along with surface climate data and land surface characterization to produce predictions of ecosystem fluxes including gross and net primary production and net ecosystem exchange. Using the TOPS framework, we have explored the uncertainty arising from the application of models with different assumptions, structures, parameters, and variable definitions. With a small number of models, this only begins to capture the range of possible spatial fields of ecosystem fluxes. Few attempts have been made to systematically address the components of uncertainty in such a framework. We discuss the characterization of uncertainty for this approach including both quantifiable and poorly known aspects.

Dungan, Jennifer L.↗

DOE OSTI2022

Multifidelity Ensemble Kalman Filtering Using Surrogate Models Defined by Theory-Guided Autoencoders

Data assimilation is a Bayesian inference process that obtains an enhanced understanding of a physical system of interest by fusing information from an inexact physics-based model, and from noisy sparse observations of reality. The multifidelity ensemble Kalman filter (MFEnKF) recently developed by the authors combines a full-order physical model and a hierarchy of reduced order surrogate models in order to increase the computational efficiency of data assimilation. The standard MFEnKF uses linear couplings between models, and is statistically optimal in case of Gaussian probability densities. This work extends the MFEnKF into to make use of a broader class of surrogate model such as those based on machine learning methods such as autoencoders non-linear couplings in between the model hierarchies. We identify the right-invertibility property for autoencoders as being a key predictor of success in the forecasting power of autoencoder-based reduced order models. We propose a methodology that allows us to construct reduced order surrogate models that are more accurate than the ones obtained via conventional linear methods. Numerical experiments with the canonical Lorenz'96 model illustrate that nonlinear surrogates perform better than linear projection-based ones in the context of multifidelity ensemble Kalman filtering. We additionality show a large-scale proof-of-concept result with the quasi-geostrophic equations, showing the competitiveness of the method with a traditional reduced order model-based MFEnKF.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS2003

Radar Reflectivity Simulated by a 2-D Spectra Bin Model: Sensitivity of Cloud-aerosol Interaction

The Goddard Cumulus Ensemble (GCE) model with bin spectra microphysics is used to simulate mesoscale convective systems.The model uses explicit bins to represent size spectra of cloud nuclei, water drops, ice crystals, snow and graupel. Each hydrometeorite category is described by 33 mass bins. The simulations provide a unique data set of simulated raindrop size distribution in a realistic dynamic frame. Calculations of radar parameters using simulated drop size distribution serve as an evaluation of numerical model performance. In addition, the GCE bin spectra modes is a very useful tool to study uncertainties related to radar observations; all the environmental parameters are precisely known. In this presentation, we concentrate on the discussion of Z-R (ZDR-R) relation in the simulated systems. Due to computational limitations, the spectra bin model has been run in two dimensions with 31 stretched vertical layers and 1026 horizontal grid points (1 km resolution). Two different cases, one in midlatitude continent, the other in tropical ocean, have been simulated. The continental case is a strong convection which lasted for two hours. The oceanic case is a persistent system with more than 10 hours' life span. It is shown that the simulated Z-R (ZDR-R) relations generally agree with observations using radar and rain gauge data. The spatial and temporal variations of Z-R relation in different locations are also analyzed. Impact of aerosols on cloud formation and raindrop size distribution was studied. Both clean (low CCN) and dirty (high CCN) cases are simulated. The Z-R relation is shown to vary considerable in the initial CCN concentrations.

Li, Kiaowen↗

NASA NTRS2010

Effects of Irrigation on Global Climate During the 20th Century

Various studies have documented the effects of modern ]day irrigation on regional and global climate, but none, to date, have considered the time ]varying impact of steadily increasing irrigation rates on climate during the 20th century. We investigate the impacts of observed irrigation changes over this century with two ensemble simulations using an atmosphere general circulation model. Both ensembles are forced with transient climate forcings and observed sea surface temperatures from 1902 to 2000; one ensemble includes irrigation specified by a time ]varying data set of irrigation water withdrawals. Early in the century, irrigation is primarily localized over southern and eastern Asia, leading to significant cooling in boreal summer (June.August) over these regions. This cooling spreads and intensifies by century fs end, following the rapid expansion of irrigation over North America, Europe, and Asia. Irrigation also leads to boreal winter (December.February) warming over parts of North America and Asia in the latter part of the century, due to enhanced downward longwave fluxes from increased near ]surface humidity. Precipitation increases occur primarily downwind of the major irrigation areas, although precipitation in parts of India decreases due to a weaker summer monsoon. Irrigation begins to significantly reduce temperatures and temperature trends during boreal summer over the Northern Hemisphere midlatitudes and tropics beginning around 1950; significant increases in precipitation occur in these same latitude bands. These trends reveal the varying importance of irrigation ]climate interactions and suggest that future climate studies should account for irrigation, especially in regions with unsustainable irrigation resources.

Puma, M. J.↗

NASA NTRS2018

The Next-Generation Goddard Convective-Stratiform Heating Algorithm: New Tropical and Warm-Season Retrievals for GPM

The Goddard convective-stratiform heating (CSH) algorithm, used to estimate cloud heating in support of the Tropical Rainfall Measuring Mission (TRMM), is upgraded in support of the Global Precipitation Measurement (GPM) mission. The algorithm's lookup tables (LUTs) are revised using new and additional cloud-resolving model (CRM) simulations from the Goddard Cumulus Ensemble (GCE) model, producing smoother heating patterns that span a wider range of intensities because of the increased sampling and finer GPM product grid. Low-level stratiform cooling rates are reduced in the land LUTs for a given rain intensity because of the rain evaporation correction in the new four-class ice (4ICE) scheme. Additional criteria, namely, echo-top heights and low-level reflectivity gradients, are tested for the selection of heating profiles. Those resulting LUTs show greater and more precise variation in their depth of heating as well as a tendency for stronger cooling and heating rates when low-level dBZ values decrease toward the surface. Comparisons versus TRMM for a 3-month period show much more low-level heating in the GPM retrievals because of increased detection of shallow convection, while upper-level heating patterns remain similar. The use of echo tops and low-level reflectivity gradients greatly reduces midlevel heating from ~2 to 5 km in the mean GPM heating profile, resulting in a more top-heavy profile like TRMM versus a more bottom-heavy profile with much more midlevel heating. Integrated latent heating rates are much better balanced versus surface rainfall for the GPM retrievals using the additional selection criteria with an overall bias of +4.3%.

Lang, Stephen E.↗

NASA NTRS1999

Modeling the Dynamics of Ensemble-Averaged Linear Disturbances in Homogeneous Shear Flow

In order to expand the predictive capability of single-point turbulence closure models to account for the early-stage transition regime, a methodology for the formulation and calibration of model equations for the ensemble-averaged disturbance kinetic energy and energy dissipation rate is presented. The calibration is based on homogeneous shear flow where disturbances can be described by rapid distortion theory (RDT). The relationship between RDT and linear stability theory is exploited in order to obtain a closed set of modeled equations. The linear disturbance equations are solved directly so that the numerical simulation yields a database from which the closure coefficients in the ensemble-averaged disturbance equations can be determined. Key words: transition/turbulence modeling, homogeneous shear, rapid distortion theory.

Thacker, W. D.↗

DOE OSTI2024

Uncertainty-informed selection of CMIP6 Earth System Model subsets for use in multisectoral and impact models

Earth system models (ESMs) and general circulation models (GCMs) are heavily used to provide inputs to sectoral impact and multisector dynamic models, which include representations of energy, water, land, economics, and their interactions. Therefore, representing the full range of model uncertainty, scenario uncertainty, and interannual variability that ensembles of these models capture is critical to the exploration of the future co-evolution of the integrated human–Earth system. The pre-eminent source of these ensembles has been the Coupled Model Intercomparison Project (CMIP). With more modeling centers participating in each new CMIP phase, the size of the model archive is rapidly increasing, which can be intractable for impact modelers to effectively utilize due to computational constraints and the challenges of analyzing large datasets. In this work, we present a method to select a subset of the latest phase, CMIP6, featuring models for use as inputs to a sectoral impact or multisector dynamics models, while prioritizing preservation of the range of model uncertainty, scenario uncertainty, and interannual variability in the full CMIP6 ensemble results. This method is intended to help impact modelers select climate information from the CMIP archive efficiently for use in downstream models that require global coverage of climate information. This is particularly critical for large-ensemble experiments of multisector dynamic models that may be varying additional features beyond climate inputs in a factorial design, thus putting constraints on the number of climate simulations that can be used. We focus on temperature and precipitation outputs of CMIP6 models, as these are two of the most used variables among impact models, and many other key input variables for impacts are at least correlated with one or both of temperature and precipitation (e.g., relative humidity). Besides preserving the multi-model ensemble variance characteristics, we prioritize selecting CMIP6 models in the subset that preserve the very likely distribution of equilibrium climate sensitivity values as assessed by the latest Intergovernmental Panel on Climate Change (IPCC) report. This approach could be applied to other output variables of climate models and, possibly when combined with emulators, offers a flexible framework for designing more efficient experiments on human-relevant climate impacts. It can also provide greater insight into the properties of existing CMIP6 models.

Snyder, Abigail C.↗

DOE OSTI2021

CryoFold: Determining protein structures and data-guided ensembles from cryo-EM density maps

Cryoelectron microscopy requires molecular modeling for refinement of structures. Ensemble models arrive at low free-energy molecular structures, but are computationally expensive and limited to resolving only small proteins. Here, we introduce CryoFold, a pipeline of molecular dynamics simulations that determines ensembles of protein structures by integrating density data of varying sparsity at 3–5 Å resolution with sequence information and coarse-grained topological knowledge of the protein folds. We present six examples, folding proteins between 72 and 2,000 residues, including large membrane and multi-domain systems, and results from two Electron Microscopy Data Bank (EMDB) competitions. Driven by data from a single state, CryoFold discovers ensembles of common low-energy models together with rare low-probability structures that capture the equilibrium distribution of proteins constrained by the density maps. Many of these conformations are experimentally validated and functionally relevant. We arrive at a set of best practices for data-guided protein folding that are controlled using a Python graphical user interface (GUI).

59 BASIC BIOLOGICAL SCIENCES↗

NASA NTRS2017

Classifying Multi-Model Wheat Yield Impact Response Surfaces Showing Sensitivity to Temperature and Precipitation Change

Crop growth simulation models can differ greatly in their treatment of key processes and hence in their response to environmental conditions. Here, we used an ensemble of 26 process-based wheat models applied at sites across a European transect to compare their sensitivity to changes in temperature (minus 2 to plus 9 degrees Centigrade) and precipitation (minus 50 to plus 50 percent). Model results were analysed by plotting them as impact response surfaces (IRSs), classifying the IRS patterns of individual model simulations, describing these classes and analysing factors that may explain the major differences in model responses. The model ensemble was used to simulate yields of winter and spring wheat at four sites in Finland, Germany and Spain. Results were plotted as IRSs that show changes in yields relative to the baseline with respect to temperature and precipitation. IRSs of 30-year means and selected extreme years were classified using two approaches describing their pattern. The expert diagnostic approach (EDA) combines two aspects of IRS patterns: location of the maximum yield (nine classes) and strength of the yield response with respect to climate (four classes), resulting in a total of 36 combined classes defined using criteria pre-specified by experts. The statistical diagnostic approach (SDA) groups IRSs by comparing their pattern and magnitude, without attempting to interpret these features. It applies a hierarchical clustering method, grouping response patterns using a distance metric that combines the spatial correlation and Euclidian distance between IRS pairs. The two approaches were used to investigate whether different patterns of yield response could be related to different properties of the crop models, specifically their genealogy, calibration and process description. Although no single model property across a large model ensemble was found to explain the integrated yield response to temperature and precipitation perturbations, the application of the EDA and SDA approaches revealed their capability to distinguish: (i) stronger yield responses to precipitation for winter wheat than spring wheat; (ii) differing strengths of response to climate changes for years with anomalous weather conditions compared to period-average conditions; (iii) the influence of site conditions on yield patterns; (iv) similarities in IRS patterns among models with related genealogy; (v) similarities in IRS patterns for models with simpler process descriptions of root growth and water uptake compared to those with more complex descriptions; and (vi) a closer correspondence of IRS patterns in models using partitioning schemes to represent yield formation than in those using a harvest index. Such results can inform future crop modelling studies that seek to exploit the diversity of multi-model ensembles, by distinguishing ensemble members that span a wide range of responses as well as those that display implausible behaviour or strong mutual similarities.

Classification; Climate change; Crop model; Ensemb↗