Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Integrated assessment model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Estimating dermal contact soil exposure for amphibians

Abstract Chemical exposure estimation through the dermal route is an underemphasized area of ecological risk assessment for terrestrial animals. Currently, there are efforts to create exposure models to estimate doses from this pathway for use in ecological risk assessment. One significant limitation has been insufficient published data to characterize exposure and to support the selection and parameterization of appropriate models, particularly for amphibians in terrestrial habitats. Recent publications measuring pesticide doses to terrestrial‐phase amphibians have begun to rectify this situation. We collated and summarized available measurements of terrestrial amphibian dermal exposure to pesticides from 11 studies in which researchers measured tissue concentrations associated with known pesticide experimental application rates. This data set included tissue concentrations in 11 amphibian species and 14 different pesticides. We then compared the results of two screening exposure models that differed based on surface area scaling approaches as a function of body weight (one based on birds as surrogates for amphibians and another amphibian‐specific) to the measured tissue residue concentrations. We define a false‐negative rate for each screening model as the proportion of amphibians for which the predicted concentration is less than the observed concentration (i.e., underestimate), contrary to the intent of screening models, which are intended to have a bias for higher exposure concentrations. The screening model that uses birds as surrogates did not have any instances where estimated expected avian doses were less than measured amphibian body burdens. When using the amphibian‐specific exposure model that corrected for differences between avian and amphibian surface area, measured concentrations were greater than model estimates for 11.3% of the 1158 comparisons. The database of measured pesticide concentrations in terrestrial amphibians is provided for use in calculating bioconcentration factors and for future amphibian dermal exposure model development. Integr Environ Assess Manag 2023;19:9–16. © 2022 SETAC. This article has been contributed to by U.S. Government employees and their work is in the public domain in the USA.

Environmental Sciences & Ecology↗
DOE OSTI2026

Forest aboveground biomass estimation through integration of sentinel-2 and PALSAR-2 time series: assessing models trained on GEDI and field inventory benchmarks

Accurate and spatially explicit forest Aboveground Biomass (AGB) mapping through remote sensing is critical for quantifying terrestrial carbon stocks and informing effective forest management strategies. However, AGB estimation in dense forests with complex terrain remains challenging due to satellite sensor signal saturation problem (saturation issue occurs in high biomass forests), structural complexity, and limited ground truth for calibration. This study presents a novel framework that integrates multi-temporal Sentinel-2 optical imagery, ALOS PALSAR-2 Synthetic Aperture Radar (SAR) data, and topographic variables with explainable Machine Learning to map AGB across mountainous forests within subtropical and temperate oceanic climate zones of Mexico. We evaluate the effects of temporal granularity and sensor synergy by comparing multiple temporal inputs and sensor configurations (Sentinel-2, PALSAR-2, and their fusion), and assess model performance using two reference datasets: NASA GEDI LiDAR-derived biomass and Mexico’s National Forest and Soil Inventory (INFyS). Our results showed that models trained on INFyS consistently outperformed those trained on GEDI, highlighting limitations in GEDI’s reliability in biomass estimates within this study region. Furthermore, the integration of Sentinel-2 and PALSAR-2 provided improved predictions compared to single-sensor models, particularly when combined with temporally explicit yearly statistics. The best-performing model, which was trained on INFyS data, and considered both Sentinel-2 and PALSAR-2 yearly statistics, as well as topographic variables, achieved an R2 of 0.64, RMSE of 51.10 Mg/ha, and relative RMSE (rRMSE) of 58.69%. Explainable ML analysis identified Sentinel-2 spectral indices and topographic features as key predictors, while PALSAR-2 metrics provided complementary information, partially mitigating saturation effects in high-biomass areas. Specifically, integrating both sensors substantially improved AGB estimation in high biomass forest (≥200 Mg/ha), yielding 98% gains over optical-only model, with resulting estimates exceeding GEDI L4B by 29% and ESA-CCI-BIOMASS by 174%. Terrain-stratified analysis indicated close agreement with GEDI in low-slope areas, with increasing divergence as slope steepness increased, while estimates remained consistently higher than ESA-CCI-BIOMASS across all slope classes. The proposed approach advances multi-sensor fusion and temporal feature engineering for AGB mapping using open-access satellite datasets, providing a scalable and reproducible framework for annual biomass monitoring in topographically complex mountainous forests. The resulting 25 m resolution biomass product has the potential to provide spatially detailed information for forest monitoring and may support applications in carbon accounting and forest management.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Long-Term Science Goals with In Situ Observations at the Sun-Earth Lagrange Point L4

The Korean heliospheric community, led by the Korea Astronomy and Space Science Institute (KASI), is currently assessing the viability of deploying a spacecraft at the Sun-Earth Lagrange Point L4 in collaboration with National Aeronautics and Space Administration (NASA). The aim of this mission is to utilize a combination of remote sensing and in situ instruments for comprehensive observations, complementing the capabilities of the L1 and L5 observatories. The paper outlines long-term scientific objectives, underscoring the significance of multi-point in-situ observations to better understand critical heliospheric phenomena. These include coronal mass ejections, magnetic flux ropes, heliospheric current sheets, kinetic waves and instabilities, suprathermal electrons and solar energetic particle events, as well as remote detection of solar radiation phenomena. Furthermore, the mission’s significance in advancing space weather prediction and space radiation exposure assessment models through the integration of L4 observations is discussed. This article is concluded with an emphasis on the potential of L4 observations to propel advancements in heliospheric science.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Plant-specific Model and Data Analysis using Dynamic Security Modeling and Simulation

The requirements for U.S. nuclear power plants to maintain a large on-site physical security force contribute to their high operational costs. The cost of maintaining the current physical security posture is approximately 10% of the overall operation and maintenance budget for commercial nuclear power plants. The goal of the Light Water Reactor Sustainability (LWRS) program’s physical security pathway is to develop tools, methods, and technologies and provide the technical basis for an optimized physical security posture. The conservatisms built into current security postures may be analyzed and minimized in order to reduce security costs while still ensuring adequate security and operational safety. The research performed at Idaho National Laboratory within LWRS program’s physical security pathway has successfully developed a dynamic force-on-force modeling framework using various computer simulation tools and integrating them with the dynamic assessment Event Modeling Risk Assessment using Linked Diagrams (EMRALD) tool. This document provides an update on the progress in applying a dynamic computational framework that links results from a commercially available force-on-force simulation tool, a commercially available thermal-hydraulic tool, and EMRALD to an operating commercial nuclear power plant. This report is only a summary of the progress and does not contain specific modeling results as those contain sensitive security information. This process of including plant procedures and multiple analysis results is being called Modeling and Analysis for Safety Security using Dynamic EMRALD Framework or MASS-DEF. Previous reports described how a user could integrate their plant-specific force-on-force models with the dynamic simulation tool EMRALD, model operator actions, integrate with probabilistic risk assessment tools, such as CAFTA (Computer Aided Fault Tree Analysis System) or SAPHIRE (Systems Analysis Programs for Hands-on Integrated Reliability Evaluations), and with thermal-hydraulic tools, such as RELAP-5. Previous reports applied various combinations of available simulations codes with EMRALD using generic plant models to demonstrate how to perform the analysis. This report documents the results of applying the dynamic computational framework to an actual nuclear facility using their security scenarios and timelines. This report does not contain any plant's sensitive information and/or Safeguards Information. The purpose of this study was to verify that results achieved using generic models are similar to actual plant results and to refine our guidance on the use of the framework. This assessment enables further analysis, such as what-if scenarios and staff-reduction evaluation, thereby optimizing physical security at plants.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2020

Parametric Vehicle Choice Modeling: ParaChoice

Assess the evolving integration potential of light-duty (LDV) and heavy-duty vehicle (HDV) technologies, fuels, and infrastructure and their contributions to lowering emissions and petroleum consumption. Leverage existing LDV and build HDV ParaChoice capability to conduct parametric analyses that explore the trade-space for key factors that influence consumer choice and technology, fuel and infrastructure development. ParaChoice provides the unique capability to examine tipping points and tradeoffs, and can help quantify the effects of and mitigate uncertainty introduced by data sources and assumptions.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Assessment of the ParFlow–CLM CONUS 1.0 integrated hydrologic model: evaluation of hyper-resolution water balance components across the contiguous United States

Abstract. Recent advancements in computational efficiency and Earth system modeling have awarded hydrologists with increasingly high-resolution models of terrestrial hydrology, which are paramount to understanding and predicting complex fluxes of moisture and energy. Continental-scale hydrologic simulations are, in particular, of interest to the hydrologic community for numerous societal, scientific, and operational benefits. The coupled hydrology–land surface model ParFlow–CLM configured over the continental United States (PFCONUS) has been employed in previous literature to study scale-dependent connections between water table depth, topography, recharge, and evapotranspiration, as well as to explore impacts of anthropogenic aquifer depletion to the water and energy balance. These studies have allowed for an unprecedented process-based understanding of the continental water cycle at high resolution. Here, we provide the most comprehensive evaluation of PFCONUS version 1.0 (PFCONUSv1) performance to date by comparing numerous modeled water balance components with thousands of in situ observations and several remote sensing products and using a range of statistical performance metrics for evaluation. PFCONUSv1 comparisons with these datasets are a promising indicator of model fidelity and ability to reproduce the continental-scale water balance at high resolution. Areas for improvement are identified, such as a positive streamflow bias at gauges in the eastern Great Plains, a shallow water table bias over many areas of the model domain, and low bias in seasonal total water storage amplitude, especially for the Ohio, Missouri, and Arkansas River basins. We discuss several potential sources for model bias and suggest that minimizing error in topographic processing and meteorological forcing would considerably improve model performance. Results here provide a benchmark and guidance for further PFCONUS model development, and they highlight the importance of concurrently evaluating all hydrologic components and fluxes to provide a multivariate, holistic validation of the complete modeled water balance.

O'Neill, Mary M. F. (ORCID:0000000221455165)↗
DOE OSTI2021

System risk quantification and decision making support using functional modeling and dynamic Bayesian network

Risk-informed decision-making requires a probabilistic assessment of the likelihood of success of control action, given the system status. This paper presents a systematic state transition modeling approach integrating dynamic probabilistic risk assessment with a decision-making process using a dynamic Bayesian network (DBN) coupled with functional modeling. A functional model designed with multilevel flow modeling (MFM) technique was used to build a system state structure inferred by energy, mass, and information flow so that one can verify the developed model with respect to system functionality. The MFM model represents the causal relationship among the nodes, which captures the structure of process parameters and control units. Each node may have multiple possible states, and the DBN structured by the MFM model represents the time-domain transitions among the defined states. Furthermore, the MFM-DBN integrated state transition modeling is a white-box approach that allows one to draw the system's risk profile by updating the system states and supports the decisions probabilistically with physical inference. An example of a simple heating system has been used to illustrate this process, including decision-making support based on quantitative risk profile. For demonstrating its applicability to a complex system operational decision making, a case study of station blackout accident scenario leading to the seal loss of coolant accident in a nuclear power plant is presented. The proposed approach effectively provided the risk profile along time for each option so that the operators can make the best decision, which minimizes the plant risk.

42 ENGINEERING↗
DOE OSTI2024

Integrating in situ environmental covariates in an American lobster catch model to improve impact assessment

The installation and operation of floating offshore wind power is an integral component of societal transition to renewable energy generation where fixed bottom offshore wind is not possible. However, it will cause unique ecosystem changes. To disentangle the effects of offshore wind installations from the concurrent effects of climate change and the fishing practices on commercially significant resources, we must develop detailed characterizations of the resources before development occurs. In the Gulf of Maine, American lobster is the most commercially and culturally important fishery. At the time of writing, this is the largest fishery by value in North America. Our understanding of baseline localized parameters (such as catch per trap at the spatial scale of individual turbines) should be informed by relationships to environmental, biological, and survey-specific functional drivers of catch. A more mechanistic understanding of catch will allow for strategic adjustments to Post- Deployment fishery responses and ultimately, the development of research- and commercial-scale floating offshore wind development. Here, we used survey data from the New England Aqua Ventus Pre-Construction Commercial Trapping Survey to develop Generalized Additive Models describing seasonal catch per trap for legal and sublegal lobsters. We found fall catch to be nearly twice that of spring. Bottom temperature dynamics could be used to predict catch, and the Fall survey was associated with a warmer temperature regime. By using analytical tools that incorporate environmental heterogeneity, we developed monitoring methods from preconstruction baseline data that will be applicable over the post-construction operating period of an offshore wind farm.

BACI↗
DOE OSTI2026

Integrating Marine Hydrokinetic and Offshore Wind Energy: A Review of Technologies, Deployment, and Challenges

Together, offshore wind (OSW) and marine hydrokinetic (MHK) technologies have vast potential to expand the world’s access to abundant energy resource. With more than 60 GW of offshore wind energy capacity and 527 MW of ocean energy deployed globally by 2023, there is a significant amount of available resources; however, technical and non-technical challenges prevent the combined large-scale deployment of these technologies. There is still a lack of research that provides a parallel review of both MHK and OSW technologies in order to better understand their synergistic working principles. This paper aimed to address that research gap by presenting a comprehensive side-by-side review of the worldwide technological landscape, global deployment trends, integration strategies, and modeling approaches for MHK and OSW. A particular focus has been given on analyzing existing modeling and simulation techniques, assessing integration and control strategies, and comparing technologies based on water depth. Furthermore, this study provides important insights into the readiness levels of both technologies by highlighting ongoing international projects. By addressing these issues, this review will give researchers and industry stakeholders an outline for assessing the maturity of OSW and MHK systems and facilitating their transition to large-scale, sustainable deployment.

16 - TIDAL AND WAVE POWER↗
DOE OSTI2022

Identifying Opportunities and Recommendations for the Integration of Advanced Reactors for Industrial Heat and Electricity Users

Nuclear power in the United States has been used traditionally to provide baseload electric power to the grid. Advancements in nuclear power to create smaller and safer reactors have renewed interest in nuclear as a source of both heat and electricity for a variety of applications. There is great interest in coupling nuclear reactors with industrial applications because nuclear power is a low carbon energy source that can be utilized for process heating, hydrogen generation, on-site electricity demand, and more. Idaho National Laboratory is developing guidelines to identify and assist industrial heat and electricity decarbonization by integrating with nuclear power plants (NPPs) to provide clean, abundant, and dispatchable energy. Considerations include specific industrial hazards which impact NPP siting, heat transport requirements and associated technologies, and implementation feasibility based on site-specific demand profiles. To assess integration feasibility, facility process models are developed based on real data obtained from a survey of baseline requirements and process information from industrial facilities in the United States. An assessment of safety and siting requirements is also performed to determine how nuclear industrial pairings could meet licensing requirements for NPPs. In addition, site characterization of an industrial plant is essential to determining the feasibility and suitable integration methods for each industry. Characterization includes facility distance from the nearest population center, site size, rail or water transport availability, and proximity to undeveloped land. These characteristics are important to determine reactor- or industry-side design requirements for safe, efficient operation. The siting and technical data assessment will reveal opportunities for single-use nuclear integration and co-location opportunities for industries to share benefits from a single reactor. In addition to existing facilities, this “energy-park” style cooperation could include new construction like data centers which can cost-share energy investments or provide a stable demand-and-revenue stream to the investor. Deliverables will contain a library of documents and models to guide various industries toward understanding nuclear technologies based on their users’ needs. This paper is a summary of the current project status, and provides insights on suitable pairings for specific industries and reactor technologies

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Modeling the Integration of Marine Energy into Microgrids - Wave Resource Assessment

This submission has wave resource assessments which were conducted for six locations based on IEC requirements using the DOE WPTO Hindcast data and MHKiT. The locations are chosen to provide varying wave climates and include PacWave South, OR; Wave Energy Testing Site (WETS), HI; Molokai, HI; St. Paul, AK; Yakutat, Ak; and Sebastion, FL. It includes the data gathered and the resulting report. This submission also includes a link to Hindcast dataset and some relevant software.

16 TIDAL AND WAVE POWER↗
DOE OSTI2023

An assessment of the utility of multirate time integration for the modeling of laser powder bed fusion

Finite element simulation of the laser powder bed fusion process is made challenging by the inherently multiscale nature of the process. When using the typical global time stepping techniques, slowly-evolving regions of the domain receive the same numerical treatment as the regions with the highest temperature rates. The current work details the implementation and evaluation of an implicit multirate method which is able to advance different regions of the domain with distinct time steps, depending on their current solution rate. Previous work indicates that this representation of the temporal scales of the problem can lead to significant reductions in wall clock run time, and it is shown herein that multirate time integration, when used with a uniform process-scale mesh, can result in speedups of approximately 19, 42, and 87 times, for domains with edge lengths of approximately 1 mm, 2 mm, and 5 mm, respectively. When used in conjunction with $\ h$-refinement (limited to two levels of refinement), the resulting speedups (taken relative to the uniform mesh) are around 28, 85, and 665 times. The method is demonstrated to converge as indicated by the literature, and its use with an AM-Bench domain is demonstrated.

42 ENGINEERING↗
DOE OSTI2026

System-Level Integration of Modular Language Models for Real-Time Risk Assessment in Third-Party Risk Management Systems

Large enterprises typically rely on dedicated teams to govern and implement security measures throughout their supply chains, ensuring compliance with enterprise security procedures. There is a significant reliance on Third-Party Risk Management (TPRM) platforms, which often require complete, highly structured information from potential vendors. The review and compliance assurance processes are time- and labor intensive, often requiring several rounds of review between the supply chain security risk management teams, business users, and potential vendors, leading to delays in the supply chain processing and consumer experience. Significant challenges in the risk management paradigm include handling unstructured data in various formats and providing real-time feedback to users to reduce the required review time. This paper presents a novel solution to these challenges. A modular multi-step system architecture is proposed using advances in language processing, specifically for unstructured responses and provides real-time feedback (i.e., 3 seconds) so that users can improve their responses before the TPSRM team review. This novel system architecture will increase information accuracy and significantly reduce time and labor during the review process.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2024

Projecting Large Fires in the Western US With an Interpretable and Accurate Hybrid Machine Learning Method

More frequent and widespread large fires are occurring in the western United States (US), yet reliable methods for predicting these fires, particularly with extended lead times and a high spatial resolution, remain challenging. In this study, we proposed an interpretable and accurate hybrid machine learning (ML) model, that explicitly represented the controls of fuel flammability, fuel availability, and human suppression effects on fires. The model demonstrated notable accuracy with a F 1 -score of 0.846 ± 0.012, surpassing process-driven fire danger indices and four commonly used ML models by up to 40% and 9%, respectively. More importantly, the ML model showed remarkably higher interpretability relative to other ML models. Specifically, by demystifying the “black box” of each ML model using the explainable AI techniques, we identified substantial structural differences across ML fire models, even among those with similar accuracy. The relationships between fires and their drivers, identified by our model, were aligned closer with established fire physical principles. The ML structural discrepancy led to diverse fire predictions and our model predictions exhibited greater consistency with actual fire occurrence. With the highly interpretable and accurate model, we revealed the strong compound effects from multiple climate variables related to evaporative demand, energy release component, temperature, and wind speed, on the dynamics of large fires and megafires in the western US. Our findings highlight the importance of assessing the structural integrity of models in addition to their accuracy. They also underscore the critical need to address the rise in compound climate extremes linked to large wildfires.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Offshore Wind Farm Turbine and Energy Storage Optimization

Abstract This paper evaluates the technical and economic feasibility of repurposing decommissioned offshore oil and gas platforms as electrical substations for offshore wind projects in the U.S. Gulf of America, a region characterized by relatively low and highly variable wind speeds, extensive legacy offshore infrastructure, and exposure to merchant electricity markets. A unified techno-economic framework is developed using the Repurposing Offshore Infrastructure for Continued Energy (ROICE) Economic Model (REM) to integrate Gulfspecific wind resource assessment, commercial wind turbine performance, offshore infrastructure cost modeling, and wholesale electricity market exposure. Gulf wind speed data are vertically extrapolated to turbine hub height and combined with manufacturer power curves to compute annual energy production and capacity factors across a broad portfolio of commercial turbines, enabling identification of turbine designs best suited for low-wind offshore environments. Hourly electricity price data from the Midcontinent Independent System Operator (MISO) day-ahead market are incorporated to characterize revenue potential, price volatility, and the temporal alignment between wind generation and market conditions. In addition, a conceptual framework for offshore battery energy storage system (BESS) integration is developed to support future investigation of market-responsive energy shifting at repurposed platforms. Results from the turbine evaluation demonstrate that machines with lower cut-in wind speeds and earlier ‘rated-power’ characteristics significantly outperform larger, industry-standard offshore turbines for the same net power under Gulf wind conditions, underscoring the need for region-specific technology selection. Market analysis further reveals substantial price variability and limited intrinsic alignment between wind production and high-price periods, motivating consideration of operational flexibility mechanisms. While storage optimization is not implemented in this study, the REM framework establishes a transparent and replicable foundation for co-evaluating turbine selection, infrastructure constraints, and market exposure, providing a practical pathway for assessing the potential role of repurposed offshore platforms in enabling economically viable offshore wind development in the Gulf of America.

02 PETROLEUM↗
DOE OSTI2025

Bayesian Calibration of Nuclear Graphite Property Models Accounting for Model Inadequacy and Impacts on Component Performance

Nuclear-grade structural graphite is extensively utilized in the core designs of various advanced nuclear reactors. In the reactor environment, graphite is subjected to prolonged exposure to extreme conditions, including high temperatures, radiation, and potentially molten salt and oxygen. Such exposure can induce several degradation mechanisms in graphite, including nonuniform volumetric strains caused by irradiation and thermal expansion, leading to stresses that may compromise the performance of graphite components. Assessing component integrity requires accurate models of graphite's thermomechanical response. This report documents the Bayesian calibration of thermomechanical properties for nuclear-grade graphite and their application to graphite component modeling and simulation using the Grizzly code. As part of this work, uncertainty-quantified models were developed for the elastic modulus, coefficient of thermal expansion, irradiation-induced dimensional change, and irradiation-induced creep for graphite grades IG-110, NBG-18, NBG-17, PCEA, and 2114. Using a hierarchical Bayesian approach, multiple experimental data sources were combined to develop Gaussian process models for the properties. Using the Kennedy O'Hagan framework, the uncertainties due to inadequacies in the model and the inherent spread in the experimental data were quantified for three different models. These uncertainty-quantified models, with a model-form correction, were subsequently applied to a coupled-physics simulation of representative graphite components, revealing that the uncertainties have a large impact on the components' deformation.

36 - MATERIALS SCIENCE↗
DOE OSTI2025

HELPR Version 1.1.0 User Guide

Hydrogen Extremely Low Probability of Rupture (HELPR) is a modular probabilistic fracture mechanics modeling platform developed to assess structural integrity of pipelines for transmission and distribution of hydrogen. HELPR couples fatigue and fracture engineering models with probabilistic methods to generate fast predictions and enables quantification of prediction uncertainty and sensitivity. This user manual serves as a guide through the various analysis features HELPR contains.

08 HYDROGEN↗
DOE OSTI2026

Rapid Evaluation Framework for the CMIP7 Assessment Fast Track

As Earth system models (ESMs) grow in complexity and in volume of output data, there is an increasing need for rapid, comprehensive evaluation of their scientific performance. The upcoming Assessment Fast Track for the Seventh Phase of the Coupled Model Intercomparison Project (CMIP7) will require expeditious response for model analyses designed to inform and drive integrated Earth system assessments. To meet this challenge, the Rapid Evaluation Framework (REF), a community-driven platform for benchmarking and performance assessment of ESMs, was designed and developed. The initial implementation of the REF, constructed to meet the near-term needs of the CMIP7 Assessment Fast Track, builds upon four disparate community evaluation and benchmarking tools that are coupled together using the Coordinated Model Evaluation Capabilities (CMEC) framework. The REF runs within a containerized workflow for portability and reproducibility and is aimed at generating and organizing diagnostics covering a variety of model variables. The REF leverages well documented observational datasets to provide assessments of model fidelity across a collection of diagnostics. All diagnostics were identified and selected with community involvement and consultation. Operational integration with the Earth System Grid Federation (ESGF) will permit automated execution of the REF for selected diagnostics as soon as model output data are published on ESGF by the originating modeling centers. The REF is designed to be portable across a range of current computational platforms to facilitate use by modeling centers for assessing the evolution of model versions or gauging the relative performance of CMIP simulations before being published on ESGF. When integrated into production simulation workflows, results from the REF provide immediate quantitative feedback that allows model developers and scientists to quickly identify model biases and performance issues. After the REF is released to the community, its subsequent development and support will be prioritized by an international consortium of scientists and engineers, enabling a broader impact across Earth science disciplines. For instance, the REF will facilitate improvements to models and will enhance confidence in model projections through process-based selection of models based on their performance with respect to observations. Production of reproducible diagnostics and community-based assessments are key features of the REF. Furthermore, providing interoperability with existing evaluation packages assures that contributions from previous community efforts will be available for use in future model intercomparison projects.

Hoffman, Forrest [ORNL] (ORCID:0000000158024134)↗