Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Ground-Truthing: Exploratory Borehole Characterization and Modeling to Verify and Expand Techno-Economic Evaluation of Earth Source Heat at Cornell U

This report documents the successful completion of DOE award DE-EE0009255: Ground- Truthing: Exploratory Borehole Characterization and Modeling to Verify and Expand Techno- Economic Evaluation of Earth Source Heat at Cornell University . Cornell University is evaluating the technical and economic feasibility of using deep direct-use (DDU) geothermal energy, referred to locally as Earth Source Heat (ESH), to serve as a renewable energy source for campus heating. To meet this objective, Cornell drilled an approximately 3-kilometer-deep exploratory borehole: the Cornell University Borehole Observatory (CUBO), or ESH-1. The team conducted an extensive suite of geophysical, hydrologic, thermal, mechanical, and geochemical measurements to evaluate subsurface conditions and geothermal development potential. This report summarizes the well drilling and testing tasks, findings, and conclusions.

15 GEOTHERMAL ENERGY↗
DOE OSTI2025

Co-Firing Switchgrass and Waste Coal in A Power Plant: A Techno-Economic and Life Cycle Evaluation for The Ohio River Valley (SWITCH) (Final Technical Report for Ohio State/FE0032204)

Abandoned coal mine lands (AMLs) represent one of the most persistent environmental challenges in the United States. Prior to the enactment of the Surface Mining Control and Reclamation Act (SMCRA) in 1977, coal mining operations were not legally required to reclaim disturbed lands, leaving behind approximately 500,000 AML sites nationwide. These sites pose severe environmental and health risks, including acid mine drainage, soil and water contamination, and spontaneous combustion of waste coal piles. Millions of Americans live within one mile of these AMLs, underscoring the urgency of remediation. Traditional reclamation practices, such as planting cool-season grasses, often fail to fully restore ecological function or leverage the economic potential of these lands. This project addressed these challenges by developing integrated strategies for resource recovery, land reclamation, and sustainable energy production. This project evaluated an integrated strategy to convert this liability into an opportunity by recovering waste coal and co-firing it with switchgrass (Panicum virgatum L.) cultivated on reclaimed or marginal AML areas in existing coal-fired power plants. Switchgrass not only provides a renewable feedstock but also aids in land reclamation and carbon sequestration. 1) Remote Sensing and Machine Learning for Waste Coal Identification Using Sentinel-2 satellite imagery and supervised classification, we applied four machine learning models to detect historical waste coal piles. Random Forest achieved the highest accuracy (precision: 86%, recall: 77%). Time-series analysis revealed gradual vegetation recovery since 1986, indicating natural reclamation processes in historical sites, while active mining areas showed ongoing disturbance. This workflow enables scalable monitoring and prioritization of reclamation efforts. 2) UAS-Based Stockpile Volume Estimation To quantify recoverable waste coal, we evaluated Unmanned Aerial Systems (UAS) equipped with Light Detection and Ranging (LiDAR) and multispectral sensors. Structure-from-Motion (SfM) photogrammetry combined with interpolated Digital Terrain Models (DTMs) achieved strong agreement with LiDAR reference volumes (Root Mean Square Error (RMSE) ≈147 m 3 , Mean Absolute Percentage Error (MAPE) ≈2%). Sensitivity analysis confirmed that spatial resolution significantly influences accuracy, emphasizing the need for high-resolution data for precise volume estimation. This approach offers a scalable, cost-effective, and accurate alternative to conventional ground-based surveys. 3) Switchgrass Cultivation for Bioenergy and Water Quality Improvement We assessed the hydrological and water quality impacts of converting AMLs to switchgrass production areas using the Soil and Water Assessment Tool (SWAT). Results showed that converting 10% of the watershed area into the switchgrass production zone reduced streamflow by 3.1%, total suspended solids by 18.1%, total nitrogen by 7.6%, and total phosphorus by 6.2%, while achieving biomass yields of 8.6–9.2 metric tons per hectare. These findings highlight switchgrass as a dual-benefit strategy for land reclamation and bioenergy feedstock production. 4) Integrated Co-Firing and CCS for Carbon-Negative Power Generation We modeled co-firing scenarios using the Power Plant Flexible Model (PPFM) to evaluate plant efficiency, greenhouse gas (GHG) emissions, and levelized cost of electricity (LCOE). Without carbon capture and storage (CCS), increasing switchgrass co-firing ratios reduced LCOE from $\$$150/MWh at 0% biomass to $\$$110/MWh at full substitution. Under CCS, costs remained higher (~$\$$250/MWh at 0% biomass) but decreased to $\$$200/MWh at 100% biomass, while enabling net-zero or carbon-negative electricity due to switchgrass sequestration benefits. Although CCS introduced efficiency penalties, pairing it with biomass co-firing offset these impacts and maximized climate benefits. Overall, optimizing co-firing ratios between 60-100%, supported by reliable logistics and storage strategies, emerged as a practical pathway to balance affordability, sustainability, and net-zero or negative GHG emissions while promoting productive reuse of AMLs.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2026

Getting Started with Evaluations with Means and Uncertainties (EMU 3.0)

One of the most fundamental quantities in nuclear physics is the reaction cross section. A cross section represents the probability that a nuclear reaction will resolve through a given channel given a target nucleus and a projectile with a certain energy. A nuclear evaluation is a set of discrete data and interpolation rules to convert those discrete nuclear reaction data—such as the cross section—into a continuous function at arbitrary energies. Evaluated nuclear data files that can appear in Evaluated Nuclear Data File (ENDF) and Generalized Nuclear Data Structure (GNDS) formats, storing a “most-complete” discretized representation of nuclear data, based on both experimental measurements and theory models.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Hierarchical Optimal Power Flow with Improved Gradient Evaluation

Existing algorithms to solve alternating-current optimal power flow (AC-OPF) often exploit linear approximations to simplify system models and accelerate computations. In this paper, we improve a recent hierarchical OPF algorithm, which rested on primal-dual gradients evaluated in a linearized distribution power flow model. Specifically, we identify a risk of voltage violation arising from the model linearization, and propose a more accurate gradient evaluation method to eliminate that risk. We further develop a hierarchical primal-dual algorithm to solve OPF based on the proposed gradient evaluation method. Numerical results on IEEE networks show that our algorithm can enhance voltage safety with satisfactory computational efficiency.

distributed algorithm↗
DOE OSTI2023

Evaluation of Multi-Fidelity Soil Moisture Products Across the Continental United States

We have aggregated the most recent soil moisture datasets from a diverse range of sources, encompassing the Continental United States (CONUS). These sources encompass gridded data from remote sensing products, reanalysis products, machine learning-based projects, and land surface modeling products. Additionally, we have obtained and processed in-situ soil moisture observations from the International Soil Moisture Network. The collected datasets exhibit variations in both temporal and spatial resolutions. Among the 20 datasets, six are available at a spatial resolution of 0.25 degrees, while three are at a coarser spatial resolution of 25 km. To minimize spatial interpolation, we conducted data uncertainty evaluations at the 0.25-degree spatial resolution. For our data evaluations, we maintained a monthly temporal resolution, which effectively captures soil moisture seasonality and interannual variability. Our data processing strategy preserves the raw data and interpolated data at their original temporal resolutions. Datasets with higher temporal resolutions, including daily, three-hourly, and hourly datasets, are set aside for subsequent analyses. These analyses will delve into topics such as soil moisture changes and recovery during extreme weather events. Furthermore, we have processed auxiliary data to enhance our evaluation, leveraging tools such as Google Earth Engine. This includes incorporating topography data, land use land cover data, Köppen-Geiger climate classification, and more to provide a comprehensive assessment from multiple sources.

Li, Lingcheng↗
DOE OSTI2023

Evaluation of BISON metallic fuel performance modeling against experimental measurements within FIPD and IMIS databases

Simulations were conducted using the BISON fuel performance code on an automated process to read initial and operating conditions from two databases—the Fuels Irradiation and Physics Database (FIPD) and Integral Fast Reactor Materials Information System (IMIS) database. These databases contain metallic fuel data from the Experimental Breeder Reactor-II (EBR-II) and the Fast Flux Test Facility (FFTF). The work demonstrates use of an integrated framework to access EBR-II fuel pin data for evaluating fuel performance models contained within BISON to predict fuel performance of next-generation metallic fuel systems. Between IMIS and FIPD, there is enough information to conduct 1,977 unique EBR-II metallic fuel pin histories from 29 different experiments, and 338 pins from FFTF MFF-3 and MFF-5 with varying levels of details between the two databases. Each of these fuel performance histories includes a high-resolution power history, flux history, coolant channel flow rates, and coolant channel temperatures, and new model developments in BISON since the initial demonstration of this integrated framework. Fission gas release (FGR), cumulative damage fraction, fuel axial swelling, FCCI wastage thickness, cladding profilometry, and burnup were all simulated in BISON and compared to post-irradiation examination (PIE) results to evaluate BISON fuel performance modeling. Implementation of new fuel performance models into a generic BISON input file coupled with IMIS and FIPD yielded results with a better representation of physics than the initial evaluation of the integrated framework. Cladding profilometry, FGR, and fuel axial swelling were found to be in good agreement with PIE measurements for most of the pins simulated. The chosen mechanical contact solver was found to significantly impact the axial fuel swelling and cladding strain predictions when used in conjunction with the U-Pu-Zr hot-pressing model since it bound the fuel to prevent further swelling and increased hydrostatic stresses. This work suggests that fuel performance modeling in BISON under steady-state conditions represents the PIE data well and should be reassessed when new PIE data become available in IMIS and FIPD databases and when improved physical models to better capture fuel performance are added to BISON.

Paaren, Kyle M.↗
DOE OSTI2022

Evaluating Basin-Scale Forest Adaptation Scenarios: Wildfire, Streamflow, Biomass, and Economic Recovery Synergies and Trade-Offs

Active forest management is applied in many parts of the western United States to reduce wildfire severity, mitigate vulnerability to drought and bark beetle mortality, and more recently, to increase snow retention and late-season streamflow. A rapidly warming climate accelerates the need for these restorative treatments, but the treatment priority among forest patches varies considerably. We simulated four treatment scenarios across the 3,450 km 2 Wenatchee River basin in eastern Washington, United States. We used a decision support tool (DST) to assess trade-offs and synergies within and among treatments on wildfire risk and smoke emissions, water yield and snow retention, biomass production, and economic return. Treatment scenarios emphasized prescribed burning ( BurnOnly ), biomass production ( MaxBiomass ), gap-based thinning to optimize water yield ( IdealWater ), and a principle-based restoration scenario ( RA1 ). Fire hazard, smoke emissions, and biomass production metrics were evaluated across scenarios using the Forest Vegetation Simulator, and water yields were modeled using the Distributed Hydrology Soil Vegetation Model. Simulations were summarized to both patch- (10 1 –10 2 ha) and subwatershed- (10 3 –10 4 ha) scales, and treatment effects were evaluated against an untreated baseline landscape. We used logic models to rank effect sizes by scenario across metrics along a continuum between −1 (no or weak effect) to +1 (large effect). All treatments produced benefits across one or more ecosystem services and led to synergistic benefits to water yield and wildfire hazard reduction. Tradeoffs among resource benefits were clear in wilderness where reliance on prescribed burning without mechanical treatment increased costs and eliminated the potential for biomass recovery. The BurnOnly scenario improved fire risk metrics and streamflow, but effect sizes were lower compared to other treatments. IdealWater showed the strongest benefits overall, demonstrating the ability to capture multiple resource benefits through spatially explicit thinning. Our study provides a framework for integrating strategic and tactical models that evaluate tradeoffs and synergies gained through varied management approaches. We demonstrate the utility of decision support modeling to enhance management synergies across large landscapes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Assessing the cumulative effects of nearshore habitat restoration actions for multiple populations of juvenile salmon in Whidbey Basin, Washington: foundation and approach for synthesis and evaluation

Ecosystem restoration is a common tool for re-establishing ecosystem processes, structures, and functions to improve biodiversity and services in coastal and estuarine ecosystems. In the Salish Sea, salmon habitats have been fragmented, reduced in size, and diminished in quality, and the ecosystem processes that form and sustain these habitats have been degraded and disrupted as well. This loss is especially prevalent in estuaries, where up to 90% of former salmon habitat has been lost or compromised. Salmon species are integral to the identities and cultures of people in the Pacific Northwest, yet salmon abundances remain at historic lows, especially in urbanized areas. Recent investments in restoration are creating rearing habitat and repairing lost ecosystem function. However, restoration efforts in this region have largely proceeded at the site scale, with less attention to big-picture thinking regarding how restoration will effectively recover degraded or lost habitats for target species. As a result, no landscape-scale evaluation program exists, and the cumulative benefits of multiple interventions are unknown. We describe innovative methods for science synthesis related to the evaluation of cumulative effects of ecosystem restoration for Pacific salmon, using years of existing, but disparate data. Building from previous work on cumulative effects evaluation and incorporating a hierarchy of hypotheses approach, we propose using causal inference across numerous hypotheses in a framework to assess the cumulative benefits to Pacific salmon from multiple estuarine restoration projects. We present the framework as a method that can be used to address many complex questions and provide examples from the Salish Sea where the approach is being implemented. The framework draws on science synthesis from numerous fields and uses a hierarchy of hypotheses, causal analysis at multiple scales, and a new hierarchy of synthesis for assessing multiple lines of evidence documenting restoration effects on Pacific salmon. We propose causal inference to synthesize dissimilar data streams, in our case, to identify various manifestations of cumulative effects of restoration and benefits to salmon, and to further inform restoration and recovery planning. A unifying framework would allow for the detection of thresholds at which restoration provides measurable improvement and would greatly advance understanding of the effects of restoration on ecosystems.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Evaluation of Deep Learning Model Architectures for Point-of-Care Ultrasound Diagnostics

Point-of-care ultrasound imaging is a critical tool for patient triage during trauma for diagnosing injuries and prioritizing limited medical evacuation resources. Specifically, an eFAST exam evaluates if there are free fluids in the chest or abdomen but this is only possible if ultrasound scans can be accurately interpreted, a challenge in the pre-hospital setting. In this effort, we evaluated the use of artificial intelligent eFAST image interpretation models. Widely used deep learning model architectures were evaluated as well as Bayesian models optimized for six different diagnostic models: pneumothorax (i) B- or (ii) M-mode, hemothorax (iii) B- or (iv) M-mode, (v) pelvic or bladder abdominal hemorrhage and (vi) right upper quadrant abdominal hemorrhage. Models were trained using images captured in 27 swine. Using a leave-one-subject-out training approach, the MobileNetV2 and DarkNet53 models surpassed 85% accuracy for each M-mode scan site. The different B-mode models performed worse with accuracies between 68% and 74% except for the pelvic hemorrhage model, which only reached 62% accuracy for all model architectures. These results highlight which eFAST scan sites can be easily automated with image interpretation models, while other scan sites, such as the bladder hemorrhage model, will require more robust model development or data augmentation to improve performance. With these additional improvements, the skill threshold for ultrasound-based triage can be reduced, thus expanding its utility in the pre-hospital setting.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

An Evaluation of the Economic and Resilience Benefits of a Microgrid in Northampton, Massachusetts

Recent developments and advances in distributed energy resource (DER) technologies make them valuable assets in microgrids. This paper presents an innovative evaluation framework for microgrid assets to capture economic benefits from various grid and behind-the-meter services in grid-connecting mode and resilience benefits in islanding mode. In particular, a linear programming formulation is used to model different services and DER operational constraints to determine the optimal DER dispatch to maximize economic benefits. For the resiliency analysis, a stochastic evaluation procedure is proposed to explicitly quantify the microgrid survivability against a random outage, considering uncertainties associated with photovoltaic (PV) generation, system load, and distributed generator failures. Optimal coordination strategies are developed to minimize unserved energy and improve system survivability, considering different levels of system connectedness. The proposed framework has been applied to evaluate a proposed microgrid in Northampton, Massachusetts that would link the Northampton Department of Public Works, Cooley Dickenson Hospital, and Smith Vocational Area High School. The findings of this analysis indicate that over a 20-year economic life, a 441 kW/441 kWh battery energy storage system, and 386 kW PV solar array can generate $2.5 million in present value benefits, yielding a 1.16 return on investment ratio. Results of this study also show that forming a microgrid generally improves system survivability, but the resilience performance of individual facilities varies depending on power-sharing strategies.

25 ENERGY STORAGE↗
DOE OSTI2022

Oxidation of p-[125I]Iodobenzoic Acid and p-[211At]Astatobenzoic Acid Derivatives and Evaluation In Vivo

The alpha particle-emitting radionuclide astatine-211 (211At) is of interest for targeted radiotherapy; however, low in vivo stability of many 211At-labeled cancer-targeting molecules has limited its potential. As an alternative labeling method, we evaluated whether a specific type of astatinated aryl compound that has the At atom in a higher oxidation state might be stable to in vivo deastatination. In the research effort, para-iodobenzoic acid methyl ester and dPEG4-amino acid methyl ester derivatives were prepared as HPLC standards. The corresponding para-stannylbenzoic acid derivatives were also prepared and labeled with 125I and 211At. Oxidization of the [125I]iodo- and [211At]astato-benzamidyl-dPEG4-acid methyl ester derivatives provided materials for in vivo evaluation. A biodistribution was conducted in mice with coinjected oxidized 125I- and 211At-labeled compounds. The oxidized radioiodinated derivative was stable to in vivo deiodination, but unfortunately the oxidized [211At]astatinated benzamide derivative was found to be unstable under the conditions of isolation by radio-HPLC (post animal injection). Another biodistribution study in mice evaluated the tissue concentrations of coinjected [211At]NaAtO3 and [125I]NaIO3. Comparison of the tissue concentrations of the isolated material from the oxidized [211At]benzamide derivative with those of [211At]astatate indicated the species obtained after isolation was likely [211At]astatate.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Industrial Energy Assessment Training Effectiveness Evaluation: An Eye-Tracking Study

It is essential to understand the effectiveness of any training program so it can be improved accordingly. Various studies have applied standard metrics for the evaluation of visual behavior to recognize the areas of interest that attract individuals’ attention as there is a high correlation between attentional behavior and where one is focusing on. However, through reviewing the literature, we believe that studies that applied eye-tracking technologies for training purposes are still limited, especially in the industrial energy assessment training field. In this paper, the effectiveness of industrial energy assessment training was quantitatively evaluated by measuring the attentional allocation of trainees using eye-tracking technology. Moreover, this study identifies the areas that require more focus based on evaluating the performance of subjects after receiving the training. Additionally, this research was conducted in a controlled environment to remove the distractions that may be caused by environmental factors to only concentrate on variables that influence the learning behavior of subjects. The experiment results showed that after receiving the training, the subjects’ performance in energy assessment was significantly improved in two areas: production, and recycling and waste management, and the designed training program enhanced the knowledge of participants in identifying energy-saving opportunities to the knowledge level of experienced participants.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

A Comprehensive Open-Source R Software For Statistical Metrology Calculations: From Uncertainty Evaluation To Risk Analysis

Whether calibrating equipment or inspecting products on the factory floor, metrology requires many complicated statistical calculations to achieve a full understanding and evaluation of measurement uncertainty and quality. In order to assist its workforce in performing these calculations in a consistent and rigorous way, the Primary Standards Lab at Sandia National Laboratories (SNL) has developed a free and open-source software package for computing various metrology calculations from uncertainty propagation to risk analysis. In addition to propagating uncertainty through a measurement model using the well-known Guide to Expression of Uncertainty in Measurement or Monte Carlo approaches, evaluating the individual Type A and Type B uncertainty components that go into the measurement model often requires other statistical methods such as analysis of variance or determining uncertainty in a fitted curve. Once the uncertainty in a measurement has been calculated, it is usually evaluated from a risk perspective to ensure the measurement is suitable for making a particular conformance decision. Finally, SNL’s software can perform all these calculations in a single application via an easy-to-use graphical interface, where the different functions are integrated so the results of one calculation can be used as inputs to another calculation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Satellite-based evaluation of AeroCom model bias in biomass burning regions

Global models are widely used to simulate biomass burning aerosol (BBA). Exhaustive evaluations on model representation of aerosol distributions and properties are fundamental to assess health and climate impacts of BBA. Here we conducted a comprehensive comparison of Aerosol Comparisons between Observations and Models (AeroCom) project model simulations with satellite observations. A total of 59 runs by 18 models from three AeroCom Phase-III experiments (i.e., biomass burning emissions, CTRL16, and CTRL19) and 14 satellite products of aerosols were used in the study. Aerosol optical depth (AOD) at 550 nm was investigated during the fire season over three key fire regions reflecting different fire dynamics (i.e., deforestation-dominated Amazon, Southern Hemisphere Africa where savannas are the key source of emissions, and boreal forest burning in boreal North America). The 14 satellite products were first evaluated against AErosol RObotic NETwork (AERONET) observations, with large uncertainties found. But these uncertainties had small impacts on the model evaluation that was dominated by modeling bias. Through a comparison with Polarization and Directionality of the Earth’s Reflectances measurements with the Generalized Retrieval of Aerosol and Surface Properties algorithm (POLDER-GRASP), we found that the modeled AOD values were biased by –93 % to 152 %, with most models showing significant underestimations even for the state-of-the-art aerosol modeling techniques (i.e., CTRL19). By scaling up BBA emissions, the negative biases in modeled AOD were significantly mitigated, although it yielded only negligible improvements in the correlation between models and observations, and the spatial and temporal variations in AOD biases did not change much. For models in CTRL16 and CTRL19, the large diversity in modeled AOD was in almost equal measures caused by diversity in emissions, lifetime, and the mass extinction coefficient (MEC). We found that in the AeroCom ensemble, BBA lifetime correlated significantly with particle deposition (as expected) and in turn correlated strongly with precipitation. Additional analysis based on Cloud-Aerosol LIdar with Orthogonal Polarization (CALIOP) aerosol profiles suggested that the altitude of the aerosol layer in the current models was generally too low, which also contributed to the bias in modeled lifetime. Modeled MECs exhibited significant correlations with the Ångström exponent (AE, an indicator of particle size). Comparisons with the POLDER-GRASP-observed AE suggested that the models tended to overestimate the AE (underestimated particle size), indicating a possible underestimation of MECs in models. The hygroscopic growth in most models generally agreed with observations and might not explain the overall underestimation of modeled AOD. Our results imply that current global models contain biases in important aerosol processes for BBA (e.g., emissions, removal, and optical properties) that remain to be addressed in future research.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Earth-system-model evaluation of cloud and precipitation occurrence for supercooled and warm clouds over the Southern Ocean's Macquarie Island

Abstract. Over the remote Southern Ocean (SO), cloud feedbacks contribute substantially to Earth system model (ESM) radiative biases. The evolution of low Southern Ocean clouds (cloud-top heights < ∼ 3 km) is strongly modulated by precipitation and/or evaporation, which act as the primary sink of cloud condensate. Constraining precipitation processes in ESMs requires robust observations suitable for process-level evaluations. A year-long subset (April 2016–March 2017) of ground-based profiling instrumentation deployed during the Macquarie Island Cloud and Radiation Experiment (MICRE) field campaign (54.5∘ S, 158.9∘ E) combines a 95 GHz (W-band) Doppler cloud radar, two lidar ceilometers, and balloon-borne soundings to quantify the occurrence frequency of precipitation from the liquid-phase cloud base. Liquid-based clouds at Macquarie Island precipitate ∼ 70 % of the time, with deeper and colder clouds precipitating more frequently and at a higher intensity compared to thinner and warmer clouds. Supercooled cloud layers precipitate more readily than layers with cloud-top temperatures > 0 ∘C, regardless of the geometric thickness of the layer, and also evaporate more frequently. We further demonstrate an approach to employ these observational constraints for evaluation of a 9-year GISS-ModelE3 ESM simulation. Model output is processed through the Earth Model Column Collaboratory (EMC2) radar and lidar instrument simulator with the same instrument specifications as those deployed during MICRE, therefore accounting for instrument sensitivities and ensuring a coherent comparison. Relative to MICRE observations, the ESM produces a smaller cloud occurrence frequency, smaller precipitation occurrence frequency, and greater sub-cloud evaporation. The lower precipitation occurrence frequency by the ESM relative to MICRE contrasts with numerous studies that suggest a ubiquitous bias by ESMs to precipitate too frequently over the SO when compared with satellite-based observations, likely owing to sensitivity limitations of spaceborne instrumentation and different sampling methodologies for ground- versus space-based observations. Despite these deficiencies, the ESM reproduces the observed tendency for deeper and colder clouds to precipitate more frequently and at a higher intensity. The ESM also reproduces specific cloud regimes, including near-surface clouds that account for ∼ 25 % of liquid-based clouds during MICRE and optically thin, non-precipitating clouds that account for ∼ 27 % of clouds with bases higher than 250 m. We suggest that the demonstrated framework, which merges observations with appropriately constrained model output, is a valuable approach to evaluate processes responsible for cloud radiative feedbacks in ESMs.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Evaluation of global teleconnections in CMIP6 climate projections using complex networks

In climatological research, the evaluation of climate models is one of the central research subjects. As an expression of large-scale dynamical processes, global teleconnections play a major role in interannual to decadal climate variability. Their realistic representation is an indispensable requirement for the simulation of climate change, both natural and anthropogenic. Therefore, the evaluation of global teleconnections is of utmost importance when assessing the physical plausibility of climate projections. We present an application of the graph-theoretical analysis tool δ-MAPS, which constructs complex networks on the basis of spatio-temporal gridded data sets, here sea surface temperature and geopotential height at 500 hPa. Complex networks complement more traditional methods in the analysis of climate variability, like the classification of circulation regimes or empirical orthogonal functions, assuming a new non-linear perspective. While doing so, a number of technical tools and metrics, borrowed from different fields of data science, are implemented into the δ-MAPS framework in order to overcome specific challenges posed by our target problem. Those are trend empirical orthogonal functions (EOFs), distance correlation and distance multicorrelation, and the structural similarity index. δ-MAPS is a two-stage algorithm. In the first place, it assembles grid cells with highly coherent temporal evolution into so-called domains. In a second step, the teleconnections between the domains are inferred by means of the non-linear distance correlation. We construct 2 unipartite and 1 bipartite network for 22 historical CMIP6 climate projections and 2 century-long coupled reanalyses (CERA-20C and 20CRv3). Potential non-stationarity is taken into account by the use of moving time windows. The networks derived from projection data are compared to those from reanalyses. Our results indicate that no single climate projection outperforms all others in every aspect of the evaluation. But there are indeed models which tend to perform better/worse in many aspects. Differences in model performance are generally low within the geopotential height unipartite networks but higher in sea surface temperature and most pronounced in the bipartite network representing the interaction between ocean and atmosphere.

58 GEOSCIENCES↗
DOE OSTI2023

Regime-oriented causal model evaluation of Atlantic–Pacific teleconnections in CMIP6

The climate system and its spatio-temporal changes are strongly affected by modes of long-term internal variability, like the Pacific decadal variability (PDV) and the Atlantic multidecadal variability (AMV). As they alternate between warm and cold phases, the interplay between PDV and AMV varies over decadal to multidecadal timescales. Here, we use a causal discovery method to derive fingerprints in the Atlantic–Pacific interactions and to investigate their phase-dependent changes. Dependent on the phases of PDV and AMV, different regimes with characteristic causal fingerprints are identified in reanalyses in a first step. In a second step, a regime-oriented causal model evaluation is performed to evaluate the ability of models participating in the Coupled Model Intercomparison Project Phase 6 (CMIP6) in representing the observed changing interactions between PDV, AMV and their extra-tropical teleconnections. The causal graphs obtained from reanalyses detect a direct opposite-sign response from AMV to PDV when analyzing the complete 1900–2014 period and during several defined regimes within that period, for example, when AMV is going through its negative (cold) phase. Reanalyses also demonstrate a same-sign response from PDV to AMV during the cold phase of PDV. Historical CMIP6 simulations exhibit varying skill in simulating the observed causal patterns. Generally, large-ensemble (LE) simulations showed better network similarity when PDV and AMV were out of phase compared to other regimes. Also, the two largest ensembles (in terms of number of members) were found to contain realizations with similar causal fingerprints to observations. For most regimes, these same models showed higher network similarity when compared to each other. This work shows how causal discovery on LEs complements the available diagnostics and statistical metrics of climate variability to provide a powerful tool for climate model evaluation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Assessment of the ParFlow–CLM CONUS 1.0 integrated hydrologic model: evaluation of hyper-resolution water balance components across the contiguous United States

Abstract. Recent advancements in computational efficiency and Earth system modeling have awarded hydrologists with increasingly high-resolution models of terrestrial hydrology, which are paramount to understanding and predicting complex fluxes of moisture and energy. Continental-scale hydrologic simulations are, in particular, of interest to the hydrologic community for numerous societal, scientific, and operational benefits. The coupled hydrology–land surface model ParFlow–CLM configured over the continental United States (PFCONUS) has been employed in previous literature to study scale-dependent connections between water table depth, topography, recharge, and evapotranspiration, as well as to explore impacts of anthropogenic aquifer depletion to the water and energy balance. These studies have allowed for an unprecedented process-based understanding of the continental water cycle at high resolution. Here, we provide the most comprehensive evaluation of PFCONUS version 1.0 (PFCONUSv1) performance to date by comparing numerous modeled water balance components with thousands of in situ observations and several remote sensing products and using a range of statistical performance metrics for evaluation. PFCONUSv1 comparisons with these datasets are a promising indicator of model fidelity and ability to reproduce the continental-scale water balance at high resolution. Areas for improvement are identified, such as a positive streamflow bias at gauges in the eastern Great Plains, a shallow water table bias over many areas of the model domain, and low bias in seasonal total water storage amplitude, especially for the Ohio, Missouri, and Arkansas River basins. We discuss several potential sources for model bias and suggest that minimizing error in topographic processing and meteorological forcing would considerably improve model performance. Results here provide a benchmark and guidance for further PFCONUS model development, and they highlight the importance of concurrently evaluating all hydrologic components and fluxes to provide a multivariate, holistic validation of the complete modeled water balance.

O'Neill, Mary M. F. (ORCID:0000000221455165)↗