Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Time-Series”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

JWST NIRCam Time Series Observations

We explain how to make time-series observations with the Near-Infrared camera (NIRCam) science instrument of the James Webb Space Telescope. Both photometric and spectroscopic observations are described. We present the basic capabilities and performance of NIRCam and show examples of how to set its observing parameters using the Space Telescope Science Institute's Astronomer's Proposal Tool (APT).

science instruments↗

Online Visualization and Value Added Services of MERRA-2 Data at GES DISC

NASA climate reanalysis datasets from MERRA-2, distributed at the Goddard Earth Sciences Data and Information Services Center (GES DISC), have been used in broad research areas, such as climate variations, extreme weather, agriculture, renewable energy, and air quality, etc. The datasets contain numerous variables for atmosphere, land, and ocean, grouped into 95 products. The total archived volume is approximately 337 TB ( approximately 562K files) at the end of October 2017. Due to the large number of products and files, and large data volumes, it may be a challenge for a user to find and download the data of interest. The support team at GES DISC, working closely with the MERRA-2 science team, has created and is continuing to work on value added data services to best meet the needs of a broad user community. This presentation, using aerosol over Asia Monsoon as an example, provides an overview of the MERRA-2 data services at GES DISC, including: How to find the data? How many data access methods are provided? What are the best data access methods for me? How do download the subsetted (parameter, spatial, temporal) data and save in preferred spatial resolution and data format? How to visualize and explore the data online? In addition, we introduce a future online analytic tool designed for supporting application research, focusing on long-term hourly time-series data access and analysis.

Shen, Suhung↗

Early Season Large-Area Winter Crop Mapping Using MODIS NDVI Data, Growing Degree Days Information and a Gaussian Mixture Model

Knowledge on geographical location and distribution of crops at global, national and regional scales is an extremely valuable source of information applications. Traditional approaches to crop mapping using remote sensing data rely heavily on reference or ground truth data in order to train/calibrate classification models. As a rule, such models are only applicable to a single vegetation season and should be recalibrated to be applicable for other seasons. This paper addresses the problem of early season large-area winter crop mapping using Moderate Resolution Imaging Spectroradiometer (MODIS) derived Normalized Difference Vegetation Index (NDVI) time-series and growing degree days (GDD) information derived from the Modern-Era Retrospective analysis for Research and Applications (MERRA-2) product. The model is based on the assumption that winter crops have developed biomass during early spring while other crops (spring and summer) have no biomass. As winter crop development is temporally and spatially non-uniform due to the presence of different agro-climatic zones, we use GDD to account for such discrepancies. A Gaussian mixture model (GMM) is applied to discriminate winter crops from other crops (spring and summer). The proposed method has the following advantages: low input data requirements, robustness, applicability to global scale application and can provide winter crop maps 1.5-2 months before harvest. The model is applied to two study regions, the State of Kansas in the US and Ukraine, and for multiple seasons (2001-2014). Validation using the US Department of Agriculture (USDA) Crop Data Layer (CDL) for Kansas and ground measurements for Ukraine shows that accuracies of greater than 90% can be achieved in mapping winter crops 1.5-2 months before harvest. Results also show good correspondence to official statistics with average coefficients of determination R(exp. 2) greater than 0.85.

mixture model↗

Data, Meet Compute: NASA's Cumulus Ingest Architecture

NASA's Earth Observing System Data and Information System (EOSDIS) houses nearly 30PBs of critical Earth Science data and with upcoming missions is expected to balloon to between 200PBs-300PBs over the next seven years. In addition to the massive increase in data collected, researchers and application developers want more and faster access - enabling complex visualizations, long time-series analysis, and cross dataset research without needing to copy and manage massive amounts of data locally. NASA has looked to the cloud to address these needs, building its Cumulus system to manage the ingest of diverse data in a wide variety of formats into the cloud. In this talk, we look at what Cumulus is from a high level and then take a deep dive into how it manages complexity and versioning associated with multiple AWS Lambda and ECS microservices communicating through AWS Step Functions across several disparate installations

EOSDIS↗

GMI-IPS: Python Processing Software for Aircraft Campaigns

NASA's Atmospheric Tomography Mission (ATom) seeks to understand the impact of anthropogenic air pollution on gases in the Earth's atmosphere. Four flight campaigns are being deployed on a seasonal basis to establish a continuous global-scale data set intended to improve the representation of chemically reactive gases in global atmospheric chemistry models. The Global Modeling Initiative (GMI), is creating chemical transport simulations on a global scale for each of the ATom flight campaigns. To meet the computational demands required to translate the GMI simulation data to grids associated with the flights from the ATom campaigns, the GMI ICARTT Processing Software (GMI-IPS) has been developed and is providing key functionality for data processing and analysis in this ongoing effort. The GMI-IPS is written in Python and provides computational kernels for data interpolation and visualization tasks on GMI simulation data. A key feature of the GMI-IPS, is its ability to read ICARTT files, a text-based file format for airborne instrument data, and extract the required flight information that defines regional and temporal grid parameters associated with an ATom flight. Perhaps most importantly, the GMI-IPS creates ICARTT files containing GMI simulated data, which are used in collaboration with ATom instrument teams and other modeling groups. The initial main task of the GMI-IPS is to interpolate GMI model data to the finer temporal resolution (1-10 seconds) of a given flight. The model data includes basic fields such as temperature and pressure, but the main focus of this effort is to provide species concentrations of chemical gases for ATom flights. The software, which uses parallel computation techniques for data intensive tasks, linearly interpolates each of the model fields to the time resolution of the flight. The temporally interpolated data is then saved to disk, and is used to create additional derived quantities. In order to translate the GMI model data to the spatial grid of the flight path as defined by the pressure, latitude, and longitude points at each flight time record, a weighted average is then calculated from the nearest neighbors in two dimensions (latitude, longitude). Using SciPya's Regular Grid Interpolator, interpolation functions are generated for the GMI model grid and the calculated weighted averages. The flight path points are then extracted from the ATom ICARTT instrument file, and are sent to the multi-dimensional interpolating functions to generate GMI field quantities along the spatial path of the flight. The interpolated field quantities are then written to a ICARTT data file, which is stored for further manipulation. The GMI-IPS is aware of a generic ATom ICARTT header format, containing basic information for all flight campaigns. The GMI-IPS includes logic to edit metadata for the derived field quantities, as well as modify the generic header data such as processing dates and associated instrument files. The ICARTT interpolated data is then appended to the modified header data, and the ICARTT processing is complete for the given flight and ready for collaboration. The output ICARTT data adheres to the ICARTT file format standards V1.1. The visualization component of the GMI-IPS uses Matplotlib extensively and has several functions ranging in complexity. First, it creates a model background curtain for the flight (time versus model eta levels) with the interpolated flight data superimposed on the curtain. Secondly, it creates a time-series plot of the interpolated flight data. Lastly, the visualization component creates averaged 2D model slices (longitude versus latitude) with overlaid flight track circles at key pressure levels. The GMI-IPS consists of a handful of classes and supporting functionality that have been generalized to be compatible with any ICARTT file that adheres to the base class definition. The base class represents a generic ICARTT entry, only defining a single time entry and 3D spatial positioning parameters. Other classes inherit from this base class; several classes for input ICARTT instrument files, which contain the necessary flight positioning information as a basis for data processing, as well as other classes for output ICARTT files, which contain the interpolated model data. Utility classes provide functionality for routine procedures such as: comparing field names among ICARTT files, reading ICARTT entries from a data file and storing them in data structures, and returning a reduced spatial grid based on a collection of ICARTT entries. Although the GMI-IPS is compatible with GMI model data, it can be adapted with reasonable effort for any simulation that creates Hierarchical Data Format (HDF) files. The same can be said of its adaptability to ICARTT files outside of the context of the ATom mission. The GMI-IPS contains just under 30,000 lines of code, eight classes, and a dozen drivers and utility programs. It is maintained with GIT source code management and has been used to deliver processed GMI model data for the ATom campaigns that have taken place to date.

Damon, M. R.↗

Global-scale Evaluation of SMAP, SMOS and ASCAT Soil Moisture Products Using Triple Collocation

Global-scale surface soil moisture products are currently available from multiple remote sensing platforms. Footprint-scale assessments of these products are generally restricted to limited number of densely-instrumented validation sites. However, by taking active and passive soil moisture products together with a third independent soil moisture estimates via land surface modeling, triple collocation (TC) can be applied to estimate the correlation metric of satellite soil moisture products (versus an unknown ground truth) over a quasi-global domain. Here, an assessment of Soil Moisture Active Passive (SMAP), Soil Moisture Ocean Salinity (SMOS) and Advanced SCATterometer (ASCAT) surface soil moisture retrievals via TC is presented. Considering the potential violation of TC error assumptions, the impact of active-passive and satellite-model error cross correlations on the TC-derived inter-comparison results is examined at in situ sites using quadruple collocation analysis. In addition, confidence intervals for the TC-estimated correlation metric are constructed from moving-block bootstrap sampling designed to preserve the temporal persistence of the original (unevenly-sampled) soil moisture time-series. This study is the first to apply TC to obtain a robust global-scale cross-assessment of SMAP, SMOS and ASCAT soil moisture retrieval accuracy in terms of anomaly temporal correlation. Our results confirm the overall advantage of SMAP (with a global average anomaly correlation of 0.76) over SMOS (0.66) and ASCAT (0.63) that has been established in several recent regional, ground-based studies. SMAP is also the best-performing product over the majority of applicable land pixels (52%), although SMOS and ASCAT each shows advantage in distinct geographic regions.

global-scale↗

Learning Model Structural Uncertainty with Gaussian Processes

The advent of commercially available quantum computers has marked the beginning of quantum computing as a reality. Both quantum gate and annealing computers have been released by major computer hardware companies. In this work, the D-Wave 2XTM quantum annealing computer housed at the NASA Advanced Systems computational facility is investigated to accelerate Machine Learning (ML) for image registration. NASA collects large amounts of images over the globe remotely using space-based monitoring. Images of a fixed areas of the land surface are taken over time. Due to the orbit of the sensors, the viewing angles deviate slightly, and it is necessary to align or register the images precisely to create image time series over the land surface. Unaligned images can lead to substantial analysis errors. These time-series are then used in modeling Earth Systems models such as hydrological, weather, and carbon monitoring models. In this work, we consider the Moderate Resolution Image Spectrometer (MODIS) data collected by the NASA's terra satellite. Artificial Neural Networks (ANNs) is a natural fit for ML modelling of images. Several successes have been reported using machine learning related to image processing. We investigate the use of ML to register MODIS images. ANNs are investigated in combination with a Restricted Boltzmann Machines (RBM) as an auto-encoder. We will present results showing the accuracy and efficiency of this approach.The D-Wave 2XTM quantum annealer samples the ground-state wave-function of a spin-Ising systems with quadratic interactions between qubits and a Chimera connectivity. The system sits in a ~15 mK thermal bath. One can think of the system as being placed in the ground state initially and subject to thermal excitations governed by Boltzmann statistics. If this is assumed true, one can use the statistics from the D-Wave 2XTM to train RBMs. Generating statistics for training Boltzmann machines is an NP-hard problem and constitutes the largest compute cost. We investigate the use of the D-Wave 2XTM to accelerate the training of the RBMs in our ANNs and report on the results.

Kouatchou, Jules↗

Satellite Remote Sensing: Ocean Color

Satellite ocean color instruments routinely provide global, synoptic views of the Earth's marine biosphere. These spaceborne radiometers measure light exiting the top of the atmosphere at discrete wavelengths in the ultraviolet to shortwave infrared region of the spectrum. This includes measurements of the color of the ocean - information used to infer the contents of the sunlit upper ocean, such as concentrations of phytoplankton, suspended sediments, and dissolved organic carbon. Continuous marine biological, ecological, and biogeochemical data records from satellite ocean color instruments now span over twenty years. This time-series not only supports Earth system and climate research, but also ecosystem and watershed management activities, including detection of nuisance and harmful algal blooms.

Biosphere↗

Hydrodynamic Modeling of Solar Acoustic Wave Propagation

Acoustic waves in the sun are separated into two categories: global and local. Global oscillations are excited through convection, and resonate in the solar interior. As with all resonant media, propagation of these acoustic waves is limited to specific frequencies for a given wavenumber. These modes are easily distinguished in 1-v diagrams, such as in figure 1. Global modes dominate the spectrum in the 2-5 mHz range. Local oscillations, so-called "sunquakes", are usually excited by particularly strong flares and can be observed as ring-shaped waves propagating away from the point of impact. The propagation is best displayed in a time-distance diagram, where a slit passing from the source to some distance away. Distance is displayed on the x-axis, and the time-series is plotted along the y-axis; an example is shown in figure 1, showing the sunquake induced by the Sept 2017 X-class flare.

Hydrodynamic↗

Changes in Vegetation Cover of the Arctic National Wildlife Refuge Estimated from MODIS Greenness Trends, 2000 to 2018

The Arctic National Wildlife Refuge (ANWR) was established in 1980 and covers 19 million acres (77,000 km2) in northeast Alaska. Wildlife habitats in the ANWR are vulnerable to long-lasting effects from any disturbance, in part because short growing seasons in the arctic provide limited time for species to recover. Trends and transitions in the growing season MODerate resolution Imaging Spectroradiometer (MODIS) Normalized Difference Vegetation Index (NDVI) time-series at 250-m resolution were analyzed for the period from 2000 to 2018 to understand recent patterns of vegetation change in all ecoregions of the ANWR. Statistical analysis of changes in each MODIS pixel NDVI time series was conducted using the "Breaks for Additive Seasonal and Trend" method (BFAST) to map regional change rates. Results suggested that most negative NDVI anomalies in the tundra-covered river drainages of the Brooks Range Mountains and coastal plain have been associated with early spring thawing and elevated levels of surface moisture in low elevation drainages of the northern ANWR ecoregions.

Arctic National Wildlife Refuge↗

Sidewall Effects on Exact Reynolds-Stress Budgets in an Impinging Shock Wave/Boundary Layer Interaction

Large-eddy simulations are performed using wall-resolved mesh for a Mach 2.29 impinging shock wave/boundary-layer interaction. Flow conditions are based on an experiment and therefore entire span was simulated, including the two sidewalls. Mean flow comparison with the experimental data showed that the interaction was larger in the simulation. Time-series analysis of a rake of pressure probes immediately downstream of the mean reflected shock position showed a peak in weighted power spectral density occurred about $St_{Lint}=0.01$, owing to a larger interaction length. Budgets of Reynolds-stress transport calculated across the span and along the corner bisector showed high degree of anisotropy. Merging of the secondary flows and separation along the corner gives rise to unstablecounter rotating vortices, which straddle the corner and grow in size. This also leads to a development of new behavior in the viscous sublayer along the corner bisector, where the pressure strain andmolecular diffusion mechanisms become prominent.

Vyas, Manan A.↗

Evapotranspiration-Based Irrigation Scheduling in Cool-Season Vegetables

Crop evapotranspiration (ETc) is strongly linked with photosynthetically active vegetation fraction (Fc). Estimation of ETc may support efficiency gains in irrigation water management, which in turn can mitigate nitrate leaching, promote water supply sustainability, and reduce energy costs associated with water pumping or transport. The University of California Cooperative Extension operates the CropManage (CM) model as a freely-available web-application for growers and consultants to support irrigation and nitrogen scheduling decisions. CM accounts for the rapid growth and typically brief cycle of cool-season vegetables, where Fc and crop coefficient (fraction of reference ET) can change daily during canopy development. Daily weather conditions are inherently accounted for by use of grass reference ETo data imported from the California Dept. Water Resources. Crop water requirement calculations are output in terms of irrigation system runtime. Empirical equations are used to estimate daily Fc time-series for a given crop type, primarily as a function of planting date and expected harvest. An applications programming interface (API) enables CM to import satellite-based Fc observations from NASA's Satellite Irrigation Management Support, which uses Landsat imagery to monitor about eight million irrigation acres statewide. The API is intended to provide a check on internal CM predictions of Fc and to facilitate expansion of the web-app to new crops and regions. A replicated irrigation trial was performed on cauliflower during spring/summer 2018 at the USDA Agricultural Research Station in Salinas, CA. The crop was established by sprinkler irrigation, and CropManage was then used to guide a series of drip irrigation treatments at 50%, 75%, 100%, and 150% of ETc replacement levels. Results will be presented with respect to water use efficiency, nitrogen use efficiency, biomass yield, and marketable yield. Additional findings will be presented for a celery trial harvested during autumn 2018.

Johnson, Lee↗

MARGInS Model-Based Analysis of Realizable Goals in Systems

The high complexity of modern aircraft and spacecraft requires elaborate Verification and Validation (V&V) approaches to make sure that such complex systems work properly and reliably. MARGInS is a framework for the analysis, understanding, and prediction of the behavior of a complex, hybrid system. MARGInS contains a set of machine learning and statistical algorithms for multivariate clustering, treatment learning, critical factor determination, time-series analysis, event prediction, and safety-boundary detection and characterization. The framework supports system testing and can be configured to find novel features in test suites, determine classes of behavior, propose new experiments that can efficiently explore and characterize the boundaries between classes of system behavior, and to create visualizations and reports.

He, Yuning↗

NASA’s Mid-Atlantic Communities and Areas at Intensive Risk Demonstration: Translating Compounding Hazards to Societal Risk

Remote sensing provides a unique perspective on our dynamic planet, tracking changes and revealing the course of complex interactions. Long term monitoring and targeted observation combine with modeling and mapping to provide increased awareness of hydro-meteorological and geological hazards. Disasters often follow hazards and the goal of NASA’s Disasters Program is to look at the earth as a highly coupled system to reduce risk and enable resilience. Remote sensing and geospatial science are used as tools to help answer critical questions that inform decisions. Data is not the same as information, nor does understanding of processes necessarily translate into decision support for disaster preparedness, response and recovery. Accordingly, NASA is engaging the scientific and decision-support communities to apply remote sensing, modeling, and related applications in Communities and Areas at Intensive Risk (CAIR). In 2017, NASA’s Applied Sciences Disasters Program hosted a regional workshop to explore these issues with particular focus on coastal Virginia and North Carolina. The workshop brought together partners in academia, emergency management, and scientists from NASA and partnering federal agencies to explore capabilities among the team that could improve understanding of the physical processes related to these hazards, their potential impact to changing communities, and to identify methodologies for supporting emergency response and risk mitigation. The resulting initiative, the mid-Atlantic CAIR project, demonstrates the ability to integrate satellite derived earth observations and physical models into actionable, trusted knowledge. Severe storms and associated storm surge, sea level rise, and land subsidence coupled with increasing populations and densely populated, aging critical infrastructure often leave coastal regions and their communities extremely vulnerable. The integration of observations and models allow for a comprehensive understanding of the compounding risk experienced in coastal regions and enables individuals in all positions make risk-informed decisions. This initiative uses a representative storm surge case as a baseline to produce flood inundation maps. These maps predict building level impacts at current day and for sea level rise (SLR) and subsidence scenarios of the future in order to inform critical decisions at both the tactical and strategic levels. To accomplish this analysis, the mid-Atlantic CAIR project brings together Federal research activities with academia to examine coastal hazards in multiple ways: 1) reanalysis of impacts from 2011 Hurricane Irene, using numerical weather modeling in combination with coastal surge and hydrodynamic, urban inundation modeling to evaluate combined impact scenarios considering SLR and subsidence, 2) remote sensing of flood extent from available optical imagery, 3) adding value to remotely sensed flood maps through depth predictions, and 4) examining coastal subsidence as measured through time-series analysis of synthetic aperture radar observations. Efforts and results are published via ArcGIS story maps to communicate neighborhoods and infrastructure most vulnerable to changing conditions. Story map features enable time-aware flood mapping using hydrodynamic models, photographic comparison of flooding following Hurricane Irene, as well as visualization of heightened risk in the future due to SLR and land subsidence.

Rogers, Laura↗

Generating Accurate and Consistent Top-Of-Atmosphere Reflectance Products from the New Generation Geostationary Satellite Sensors

GeoNEX is a collaborative project by scientists from NASA, NOAA, JAXA, and other organizations around the world with the purpose of generating a suite of Earth-monitoring products using data streams from the latest geostationary (GEO) sensors including the GOES-16/17 ABI and the Himawari-8/9 AHI. An accurate and consistent top-of-atmosphere (TOA) reflectance product, in particular the bidirectional reflectance factor (BRF), is the starting point in the scientific processing chain. We describe the main considerations and corresponding algorithms in generating the GeoNEX TOA BRF product. First, a special advantage of geostationary data streams is their high temporal resolution (~10 minutes per full-disk scan), providing a key source of information for many downstream products. To fully utilize this high temporal frequency demands a high georegistration accuracy for every acquired image. Our analysis shows that there can be substantial georegistration uncertainties in both GOES and Himawari L1b data which we addressed by implementing a phase-based correction algorithm to remove residual errors. Second, geostationary sensors have distinct illumination-view geometry features in that the solar angle changes for every pixel. Therefore, to accurately derive a BRF requires a solar position algorithm and the estimation of the pixel-wise acquisition time within an uncertainty of 10 seconds. Third, we discuss the measures we adopted to check and correct residual radiometric calibration issues of individual sensors to enable time-series analysis as well as the cross calibration between different satellite sensors (including those from low-Earth orbit). Finally, we also explain the rationale for the choice of the global grid/tile system of the GeoNEX TOA BRF product.

Wang, Weile↗

Observation of Absorbing Aerosols Above Clouds over the South-East Atlantic Ocean from the Geostationary Satellite SEVIRI – Part 1: Method Description and Sensitivity

High temporal resolution observations from satellites have a great potential for studying the impact of biomass burning aerosols and clouds over the South East Atlantic Ocean (SEAO). This paper presents a method developed to retrieve simultaneously aerosol and cloud properties in aerosol above cloud conditions from the geostationary instrument Meteosat Second Generation/Spinning Enhanced Visible and Infrared Imager (MSG/SEVIRI). The above-cloud Aerosol Optical Thickness (AOT), the Cloud Optical Thickness (COT) and the Cloud droplet Effective Radius (CER) are derived from the spectral contrast and the magnitude of the signal measured in three channels in the visible to shortwave infrared region. The impact of the absorption from atmospheric gases on the satellite signal is corrected by applying transmittances calculated using the water vapour profiles from a Met Office forecast model. The sensitivity analysis shows that a 10% error on the humidity profile leads to an 18.5% bias on the above-cloud AOT, which highlights the importance of an accurate atmospheric correction scheme. In situ measurements from the CLARIFY-2017 airborne field campaign are used to constrain the aerosol size distribution and refractive index that is assumed for the aforementioned retrieval algorithm. The sensitivities in the retrieved AOT, COT and CER to the aerosol model assumptions are assessed. Between 09:00-15:00 UTC, an uncertainty of 40% is estimated on the above-cloud AOT, which is dominated by the sensitivity of the retrieval to the single scattering albedo. The absorption AOT is less sensitive to the aerosol assumptions with an uncertainty generally lower than 17% between 09:00-15:00 UTC. Outside of that time range, as the scattering angle decreases, the sensitivity of the AOT and the absorption AOT to the aerosol model increases. The retrieved cloud properties are only weakly sensitive to the aerosol model assumptions throughout the day, with biases lower than 6% on the COT and 3% on the CER. The stability of the retrieval over time is analysed. For observations outside of the backscattering glory region, the time-series of the aerosol and cloud properties are physically consistent, which confirms the ability of the retrieval to monitor the temporal evolution of aerosol above cloud events over the SEAO.

Peers, Fanny↗

NIRCam: The JWST Near-IR Camera and Slitless Spectrograph

NIRCam is the primary near-infrared camera for JWST. It is well-suited for a wide variety of star formation and other scientific studies and will also be used for aligning the JWST primary mirror segments and telescope. NIRCam will provide high sensitivity, high spatial resolution images in a variety of filters over the 0.6 - 5 μm wavelength region including coronagraphic modes and slitless spectroscopic capabilities. NIRCam consists of two identical optical modules that have adjacent 2.2' x 2.2' fields of view on the sky. Each module is composed of two channels that observe the same field at short (< 2.4 μm) or long (> 2.4 μm) wavelengths simultaneously, with optimized spatial sampling in each channel. NIRCam optical elements include narrow (R = 100), medium (R = 10), and wide (R <= 4) filters, coronagraphic imaging spot and bar masks, and grisms that provide wide-field or time-series slitless spectroscopy. These major NIRCam features will be introduced, and some applications to galactic star formation will be briefly presented.

Greene, Thomas↗

A Framework for Evaluating Climate Model Performance Metrics

The CMIP5 archive contains future climate projections from over 50 models provided by dozens of modeling centers from around the world. Individual model projections, however, are subject to biases created by structural model uncertainties. As a result, ensemble averaging of multiple models is often used to add value to model projections: consensus projections have been shown to consistently outperform individual models. Previous reports for the IPCC establish climate change projections based on an equal-weighted average of all model projections. However, certain models reproduce climate processes better than other models. Should models be weighted based on performance? Unequal ensemble averages have previously been constructed using a variety of mean state metrics. What metrics are most relevant for constraining future climate projections? This project develops a framework for systematically testing metrics in models to identify optimal metrics for unequal weighting multi-model ensembles. A unique aspect of this project is the construction and testing of climate process-based model evaluation metrics. A climate process-based metric is defined as a metric based on the relationship between two physically related climate variables?e.g., outgoing longwave radiation and surface temperature. Metrics are constructed using high-quality Earth radiation budget data from NASA's Clouds and Earth's Radiant Energy System (CERES) instrument and surface temperature data sets. It is found that regional values of tested quantities can vary significantly when comparing weighted and unweighted model ensembles. For example, one tested metric weights the ensemble by how well models reproduce the time-series probability distribution of the cloud forcing component of reflected shortwave radiation. The weighted ensemble for this metric indicates lower simulated precipitation (up to .7 mm/day) in tropical regions than the unweighted ensemble: since CMIP5 models have been shown to overproduce precipitation, this result could indicate that the metric is effective in identifying models which simulate more realistic precipitation. Ultimately, the goal of the framework is to identify performance metrics for advising better methods for ensemble averaging models and create better climate predictions.

Noel C Baker↗