Engineering PapersSearch

SEARCH · Engineering Papers

Results for “Model comparison”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Contrasting Parametric Sensitivities in Two Global Vegetation Models Using Parameter Perturbation Ensembles

Uncertainty in land model projections remains high and the roles of parametric and structural uncertainty are difficult to disentangle. To compare parametric sensitivity across model structures we present two parameter perturbation ensembles using the Community Land Model (CLM) operating in satellite phenology mode. The ensembles contrast two vegetation modules: (a) the default CLM vegetation module and (b) the Functionally Assembled Terrestrial Ecosystem Simulator (CLM-FATES). We perturbed over 300 parameters and quantified their effects on biophysical fluxes globally and across biomes. Most parameters have minimal impact on biophysical fluxes, with only a few substantially influencing results. While both models exhibit similar parameter sensitivity for some fluxes, CLM-FATES shows larger spread in gross primary productivity (GPP), driven by strong sensitivity to carboxylation rate. CLM-FATES also shows a weaker GPP response to soil hydrology parameters and exhibits higher water use efficiency (WUE). Cross-model comparisons reveal similar sensitivities for some parameters (e.g., leaf dimension) but divergent responses to others (e.g., stomatal intercept), highlighting underlying structural differences. Differences in WUE and sensitivity to hydrology and stomatal conductance parameters underscore how model structure fundamentally alters parametric sensitivity. The data sets generated from these ensembles can be used to identify influential parameters and guide future calibration efforts.

Foster, A. C. [NSF National Center for Atmospheric

Data from: "Towards CONUS-Wide ML-Augmented Conceptually-Interpretable Modeling of Catchment-Scale Precipitation-Storage-Runoff Dynamics"

This data package was generated to support the manuscript “Towards CONUS-Wide Machine Learning-Augmented Conceptually Interpretable Modeling of Catchment-Scale Precipitation-Storage-Runoff Dynamics.” It provides input files, model outputs, plotting data, scripts, notebooks, and documentation used to develop, evaluate, and reproduce Mass-Conserving Perceptron (MCP)-based hydrologic modeling experiments across 513 selected Catchment Attributes and Meteorology for Large-sample Studies in the United States (CAMELS-US) basins. The files are organized by modeling component and analysis purpose, including rainfall–runoff experiments, snow module experiments, coupled hydrologic-snow experiments, Long Short-Term Memory (LSTM) benchmark results, model skill metrics, initialization and epoch records, cell-state normalization files, Akaike Information Criterion (AIC)-based model comparison files, and data used to generate manuscript figures. Tabular files can be opened using standard spreadsheet software or Python/R data-analysis tools. Python scripts, Jupyter notebooks, and selected MATLAB scripts are included for model execution, postprocessing, plotting, and statistical analysis. Quality assurance and quality control were conducted through the source-data selection and modeling workflow. Meteorological forcing, streamflow, and static catchment attributes were derived from the CAMELS-US dataset, and snow water equivalent data were derived from the University of Arizona (UA) Snow Water Equivalent dataset. Selected basins and time periods were screened during the associated research workflow to avoid missing observations or poor-quality cases. Static geospatial features were processed primarily using Quantum Geographic Information System (QGIS) and Geospatial Data Abstraction Library (GDAL) workflows. Additional details are provided in the associated manuscript and documentation.

ESS-DIVE CSV File Formatting Guidelines Reporting

chatHPC: Empowering HPC users with large language models

The ever-growing number of pre-trained large language models (LLMs) across scientific domains presents a challenge for application developers. While these models offer vast potential, fine-tuning them with custom data, aligning them for specific tasks, and evaluating their performance remain crucial steps for effective utilization. However, applying these techniques to models with tens of billions of parameters can take days or even weeks on modern workstations, making the cumulative cost of model comparison and evaluation a significant barrier to LLM-based application development. To address this challenge, we introduce an end-to-end pipeline specifically designed for building conversational and programmable AI agents on high performance computing (HPC) platforms. Our comprehensive pipeline encompasses: model pre-training, fine-tuning, web and API service deployment, along with crucial evaluations for lexical coherence, semantic accuracy, hallucination detection, and privacy considerations. Here, we demonstrate our pipeline through the development of chatHPC, a chatbot for HPC question answering and script generation. Leveraging our scalable pipeline, we achieve end-to-end LLM alignment in under an hour on the Frontier supercomputer. We propose a novel self-improved, self-instruction method for instruction set generation, investigate scaling and fine-tuning strategies, and conduct a systematic evaluation of model performance. The established practices within chatHPC will serve as a valuable guidance for future LLM-based application development on HPC platforms.

97 MATHEMATICS AND COMPUTING

Assessing High Burnup U-19Pu-10Zr Fuel Performance against Historical and Modeled Behavior

Advancing the deployment of sodium-cooled fast reactors (SFRs) requires thorough testing of metallic fuel pins under accident conditions to establish safe operational limits of high burnup fuel. To conduct transient testing, a comprehensive understanding of steady-state fuel behavior obtained through both experimental characterization and accurate predictive capabilities is needed. This study comparatively assesses the steady-state irradiation performance of two high burnup U-19Pu-10Zr fuel pins, DP-36 and DP-40, irradiated under prototypic fast reactor conditions in preparation for planned safety testing at the Transient Reactor Test Facility. Since DP-40 was designated for use in the test and DP-36 serves as its sibling pin, non-destructive, engineering-scale post-irradiation examinations (PIE) were conducted on both pins while destructive examinations were performed exclusively on DP-36. The results were then assessed against historical performance data from similar fuel pins irradiated in the Experimental Breeder Reactor-II. Additionally, the steady-state irradiation of each pin was modeled using the BISON fuel performance code to assess the accuracy of current modeling capabilities in predicting the baseline irradiation behavior. Non-destructive examinations included neutron radiography to measure fuel column elongation, gamma scanning to verify pin integrity and fission product migration, and profilometry to assess dimensional changes. Benchmarking against existing PIE data revealed consistent patterns in axial fuel column growth and cladding diametral strain, though both pins exhibited longer low-density “fluff” structures, which can have implications for core reactivity and source term calculations. Destructive examinations on DP-36 included fission gas release analysis and sectioning for optical microscopy, which showed more complex constituent redistribution patterns than the traditionally accepted 3-ring model. The axial evolution of fractional areas and porosities of each of the redistributed zones were quantified and presented. Modeling comparisons showed agreement in fractional fission gas release but consistently overestimated axial and radial swelling and disagreed with measured axial porosity patterns. These conservative overpredictions suggested that the pins would appear closer to failure or operational limits at the start of transient tests, potentially leading to higher strain accumulation during the transient. While conservative estimates provide safety margins, they can negatively impact fuel economics. A review of the swelling models identified areas for improvement in the gaseous swelling, solid swelling, and fuel hot-pressing models when applied to ternary fuel. The results of this study highlight the critical importance of conducting pre-test characterization on both test and sibling pins to accurately capture steady-state fuel behavior, providing a precise baseline for post-test evaluations and essential inputs for transient modeling of the planned experiments. The analysis also revealed significant data gaps that require further investigation to enhance the understanding and prediction of fuel swelling and pore dynamics. Collecting comprehensive data across different irradiation conditions, burnup levels, and fuel compositions are essential for refining existing models and developing mechanistic models for both binary and ternary metallic fuels, ultimately improving the integration of modeling and experimental approaches in accident testing.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS

Localized Interactions in Neutrino Simulations

The Deep Underground Neutrino Experiment (DUNE) requires precise modeling of neutrino--nucleus interactions to achieve its neutrino-oscillation measurement goals. GENIE, the Monte Carlo event generator used by DUNE, exhibits a known discrepancy with MicroBooNE measurements of transverse kinematic imbalance (TKI): the data display a larger high-TKI tail while maintaining a peak similar to that predicted by the baseline GENIE model. Previous variations of final-state interaction (FSI) strength affected both the peak and the tail and therefore did not resolve the discrepancy. This work investigates whether inconsistencies between local and global treatments of intranuclear physics contribute to the observed mismodeling. The GENIE FSI routines were modified to use the particle position when generating nucleons, thereby introducing a local-density treatment in the hA and hN intranuclear models for their 2018 and 2025 implementations. Meson-exchange-current (MEC) localization was also tested for the hN 2018 model. Comparisons of the intranuclear scattering-center momentum and its radial dependence confirm that the localization was implemented as intended. Localization produces modest changes in the proton momentum spectrum, primarily at low momentum, but only a small change in the TKI distribution between approximately \SI{0.25}{\giga\electronvolt} and \SI{0.40}{\giga\electronvolt}. These changes are insufficient to account for the discrepancy with MicroBooNE data. Although a localized treatment improves the internal consistency of the GENIE model, the origin of the TKI discrepancy remains unresolved.

Bulla, Braden [Unlisted, US, IL]

A Benchmarking Framework for Evaluating Large Language Model Capabilities in Nuclear Reactor Safety Applications

Large language models (LLMs) are increasingly capable of answering technical questions, synthesizing domain knowledge, and supporting engineering workflows. For nuclear science and engineering, these capabilities require careful, domain-specific evaluation before they can be credibly incorporated into safety-related activities, regulatory review, or technical decision support. This paper presents preliminary results from benchmarking framework for evaluating LLM capabilities in nuclear contexts. The framework is organized into three evaluation categories: nuclear fundamentals, general dual-use knowledge, and plant specific knowledge. These categories are intended to distinguish general nuclear engineering competence from broader technical reasoning and more context-dependent nuclear knowledge. Initial evaluations focus on nuclear fundamentals using questions representative of the knowledge expected of a nuclear professional engineer. Results indicate that contemporary frontier models perform at a high level and substantially exceed the performance of older model generations, with some models approaching saturation of the current benchmark. These findings suggest both the rapid improvement of LLM capabilities in specialized technical domains and the need for more discriminating evaluation methods. The paper presents the benchmark structure, preliminary model-comparison results, and ongoing work. This work supports development of verifiable, responsible, and safety-conscious methods for assessing AI systems in nuclear engineering applications.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN

Diagnosing the representation of surface and layered soil moisture in Earth system models

Surface soil moisture (mrsos) and vertically integrated soil moisture (mrsol) over the top 10 cm should, by definition, be physically consistent in Earth System Models (ESMs). However, an evaluation of nine CMIP6 models reveals substantial inconsistencies: in some models, mrsos and integrated mrsol agree globally; in others, they align only in specific regions; and in a few, they diverge across all grid cells. These discrepancies arise from a combination of factors, including metadata errors, inconsistent variable definitions, or diagnostic sequencing within the model. We demonstrate how such issues can lead to significant biases, even when both variables are present and seemingly well-defined. As model complexity increases and multi-model comparisons become more common, assumptions about variable equivalence may lead to flawed conclusions. This study highlights the need for routine consistency checks, improved metadata standards, and community-wide practices that ensure reliability of derived variables across ESM outputs, particularly in preparation for CMIP7.

Earth system models

Comparison of structurally diverse simulation models for prediction of epidemic outcomes caused by a long-distance dispersed pathogen

Long-distance dispersal (LDD) pathogens pose substantial challenges for epidemic control due to their ability to generate new infection foci at great distances. While various modeling approaches have been developed to understand and manage such outbreaks, little work has compared how models of different structures behave under shared conditions. Here, in this study, we compare four structurally distinct epidemiological models — EPIMUL, GEMF, PoPS, and Warwick — each adapted to simulate the spread of wheat stripe rust (WSR), a wind-dispersed LDD pathogen, under identical epidemiological parameters and dispersal kernel. Using data from a controlled field experiment, we evaluate the ability of each model to replicate disease prevalence under nine intervention scenarios that vary in timing and culling area. While the models differ substantially in design — ranging from spatial grid-based to network-based and raster-based frameworks — the shared dispersal kernel allowed for close alignment in their predictions. All models accurately captured general epidemic trends, particularly the strong effect of early intervention on disease suppression. We qualitatively compared their behavioral responses across scenarios and also evaluated an ensemble prediction by averaging across model outputs. Our findings highlight how integrating shared epidemiological components into distinct modeling frameworks can improve consistency and accuracy, while reinforcing the importance of early culling in managing LDD pathogen outbreaks.

Dispersal kernel

Pathways for decarbonization of the buildings sector in Ukraine

The paper focuses on Ukraine’s intention to achieve a two-thirds reduction in buildings’ energy consumption for heating and cooling by 2050, concurrently aiming for net zero greenhouse gas emissions and heightened energy security. Here, the study examines the outcomes of retrofitting existing residential, commercial, and public buildings with highly efficient materials, improving construction standards, and transitioning to advanced heating systems. However, Russia’s invasion in 2022 inflicted substantial damage, prompting a shift from retrofit and decarbonization to reconstruction. The Ukrainian government’s Reconstruction Plan emphasizes clean, sustainable, and resilient energy systems. The study employs energy system and integrated assessment models (TIMES-Ukraine and GCAM-Ukraine) to explore scenarios taking into consideration the war, reconstruction, and a net zero CO 2 pathway. Using two models allowed the inter-model comparison. The analysis addresses vital questions on energy resiliency measures and the compounding effects of decarbonization. Findings indicate that Ukraine’s energy goals can be met through strategic retrofitting and economy-wide decarbonization, emphasizing the importance of low-carbon alternatives like district heating with renewable sources. Electrification with renewables and fuel-switching emerges as crucial for achieving building decarbonization. The study offers valuable insights into navigating energy challenges amidst the war and outlines a pathway for Ukraine’s sustainable energy future.

29 ENERGY PLANNING, POLICY, AND ECONOMY

DECOVALEX-2023: An international collaboration for advancing the understanding and modeling of coupled thermo-hydro-mechanical-chemical (THMC) processes in geological systems

The DECOVALEX initiative is an international research collaboration (www.decovalex.org), initiated in 1992, for advancing the understanding and modeling of coupled thermo-hydro-mechanical-chemical (THMC) processes in geological systems. DECOVALEX stands for “DEvelopment of COupled Models and VALidation against EXperiments”. The creation of this international initiative was motivated by the recognition that prediction of these coupled effects is an essential part of the performance and safety assessment of geologic disposal systems for radioactive waste and spent nuclear fuel. DECOVALEX emphasizes joint analysis and comparative modeling of the complex perturbations and coupled processes in geologic repositories and how these impact long-term performance predictions. The most recent phase of the DECOVALEX Project, here referred to as DECOVALEX-2023, started in early 2020 and ended in late 2023. More than fifty research teams associated with 17 international DECOVALEX partner organizations participated in the comparative evaluation of eight modeling tasks covering a wide range of spatial and temporal scales, geological formations, and coupled processes. This Virtual Special Issue on DECOVALEX-2023 provides an in-depth overview of these collaborative research efforts and how these have advanced the state-of-the-art of understanding and modeling coupled THMC processes. While primarily focused on radioactive waste, much of the work included here has wider application to many geoengineering topics.

Coupled processes

Implementation and Evaluation of Emission‐Driven Land‐Atmosphere Coupled Simulation in E3SMv2.1

Emissions-driven (prognostic CO 2 ) simulations are essential for representing two-way carbon-climate feedback in Earth System Models. We present an emissions-driven land–atmosphere coupled biogeochemistry (BGC) configuration (BGCLNDATM_progCO2) in version 2.1 of the Energy Exascale Earth System Model (E3SMv2.1). This is the first E3SM configuration that performs land-atmosphere emission-hindcasts. Here, we document its implementation, evaluate the model's performance against observations and other models, and propose a structured evaluation protocol for such emissions-driven simulations. We conducted transient historical simulations (1850–2014) with BGCLNDATM_progCO2 and compare them to reference simulations—a land-atmosphere coupled simulation without BGC and a standalone land simulation with BGC, both using prescribed CO 2 concentrations—and to observations. BGCLNDATM_progCO2 overestimates atmospheric CO 2 concentrations by 11–23 ppm yet stays within the 40-ppm spread CMIP6 emission-driven models and retains physical climate properties comparable to the reference runs. The CO 2 biases are partly attributed to underrepresented oceanic CO 2 uptake and inadequate representations of some terrestrial processes. In general, introducing prognostic CO 2 did not change physical climate metrics at the global scale but had larger regional effects, particularly over land where spatially heterogeneous CO 2 and prognostic leaf area index influenced surface energy balance. Finally, we propose a general evaluation protocol including spin-up assessment, atmospheric CO 2 benchmarking, physical climate evaluation, and land biogeochemical analysis to support scientific rigor and facilitate inter-model comparisons. The new configuration lays the groundwork for future enhancements, including improved terrestrial biogeochemical processes, integrated marine biogeochemistry, and additional human–Earth system interactions. These developments advance E3SM toward fully coupled emissions-driven simulations, enabling more accurate carbon–climate feedback projections and informing mitigation policy by providing physically consistent carbon-budget metrics for mitigation scenarios.

54 ENVIRONMENTAL SCIENCES

Observation of quantum effects on radiation reaction in strong fields

Radiation reaction, the force experienced by an accelerated charge due to radiation emission, has long been the subject of extensive theoretical and experimental research. Experimental verification of a quantum, strong-field description of radiation reaction is fundamentally important, and has wide-ranging implications for astrophysics, laser-driven particle acceleration, next-generation particle colliders and inverse-Compton photon sources for medical and industrial applications. However, the difficulty of accessing regimes where strong field and quantum effects dominate inhibited previous efforts to observe quantum radiation reaction in charged particle dynamics with high significance. We report the first high significance (> 5σ) observation of strong-field radiation reaction on electron spectra where quantum effects are substantial. We obtain the first, quantitative, strong evidence favouring the quantum-continuous and quantum-stochastic models over the classical model; the quantum models perform comparably. The lower electron energy losses predicted by the quantum models accounts for their improved performance. Model comparison was performed using a novel Bayesian framework which has widespread utility for laser-particle collision experiments, including those utilising conventional accelerators, where some collision parameters cannot be measured directly.

Los, Eva E. [Imperial College London (United Kingd

Divertor shaping with neutral baffling as a solution to the tokamak power exhaust challenge

Exhausting power from the hot fusion core to the plasma-facing components is one fusion energy’s biggest challenges. The MAST Upgrade tokamak uniquely integrates strong containment of neutrals within the exhaust area (divertor) with extreme divertor shaping capability. By systematically altering the divertor shape, this study shows the strongest evidence to date to our knowledge that long-legged divertors with a high magnetic field gradient (total flux expansion) deliver key power exhaust benefits without adversely impacting the hot fusion core. These benefits are already achieved with relatively modest geometry adjustments that are more feasible to integrate in reactor designs. Benefits include reduced target heat loads and improved access to, and stability of, a neutral gas buffer that ‘shields’ the target and enhances power exhaust (detachment). Analysis and model comparisons shows these benefits are obtained by combining multiple shaping aspects: long-legged divertors have expanded plasma-neutral interaction volume that drive reductions in particle and power loads, while total flux expansion enhances detachment access and stability. Containing the neutrals in the exhaust area with physical structures further augments these shaping benefits. These results demonstrate strategic variation in the divertor geometry and magnetic topology is a potential solution to one of fusion’s power exhaust challenge.

magnetically confined plasmas

Extended Rice–Thomson analysis and atomistic simulations revealing grain boundary effects on fracture in refractory high-entropy alloys

Significance This work serves to extend the fundamental ductile vs. brittle fracture theory, specifically the Rice–Thomson criterion, by introducing a grain boundary ahead of an initiating crack which propagates at an oblique angle to impinge the boundary. Atomistic fracture simulations on two refractory complex concentrated alloys, the brittle NbMoTaW and the ductile Nb 45 Ta 25 Ti 15 Hf 15 , demonstrate qualitative correspondence with the extended Rice–Thomson criterion and experimental observations. Abstract Understanding how grain boundaries mediate fracture remains a critical challenge in designing ductile, high-performance refractory alloys. Here, we extend the Rice–Thomson criterion to account for the angle between cracks and the impinging grain boundaries (GBs), capturing the competition between intergranular fracture and dislocation-mediated plasticity. Using machine learning interatomic potentials, we performed molecular statics simulations to probe fracture mechanisms in nanocrystalline NbMoTaW and Nb 45 Ta 25 Ti 15 Hf 15 , each with two different grain sizes, revealing trends consistent with experimental observations and the extended Rice model. Comparison with averaged R-curves for bulk samples demonstrates that GBs enhance ductility in Nb 45 Ta 25 Ti 15 Hf 15 in both grain sizes investigated. In contrast, GBs only locally improve fracture resistance in NbMoTaW when cracks are temporarily pinned at GBs inclined at high angles from the crack, but generally promote brittle intergranular fracture. These contrasting behaviors are attributed to differences in GB cohesion, reflecting clear alloying trends that align with ab-initio calculations and trends observed experimentally. Our results bridge classical fracture theory, atomistic simulations, and experimental observations, providing a comprehensive understanding of the fracture mechanisms in nanocrystalline refractory complex concentrated alloys.

36 MATERIALS SCIENCE

Long-Range Transverse-Momentum Correlations and Radial Flow in Pb-Pb Collisions at the LHC

This Letter presents measurements of long-range transverse-momentum correlations using a new observable, 𝑣 0⁡ (𝑝 T ), serving as a probe of event-by-event radial-flow fluctuations, the underlying radial expansion, and the medium’s properties in heavy-ion collisions. Results are reported for inclusive charged particles, pions, kaons, and protons across various centrality intervals in Pb-Pb collisions at $\sqrt{𝑠_{\textrm{NN}}}$ = 5.02 TeV, recorded by the ALICE detector. A pseudorapidity-gap technique, similar to that used in anisotropic-flow studies, is employed to suppress short-range correlations. At low 𝑝 T , a characteristic mass ordering consistent with hydrodynamic collective flow is observed. At higher 𝑝 T (>3 GeV/𝑐), protons exhibit larger 𝑣 0 ⁡(𝑝 T ) than pions and kaons, in agreement with expectations from quark-recombination models. Comparisons to viscous hydrodynamic calculations with varying bulk viscosity and equation of state demonstrate the sensitivity of the 𝑣 0 ⁡(𝑝 T ) observable to these key medium properties. The findings establish 𝑣 0 ⁡(𝑝 T ) as a valuable addition to the set of observables used in Bayesian analyses for extracting the transport properties and constraining the equation of state of strongly interacting matter, while also helping to systematically explore its sensitivity and impact within such global studies.

Acharya, S. [INFN] (ORCID:0000000292135329)

Measurement of directed flow in Au + Au collisions at $\sqrt{s{NN}}$ = 19.6 and 27 GeV with the STAR event plane detector

In heavy-ion collision experiments, the global collectivity of final-state particles can be quantified by anisotropic flow coefficients (𝑣 𝑛 ) . The first-order flow coefficient, also referred to as the directed flow (𝑣 1 ), describes the collective sideward motion of produced particles and nuclear fragments in heavy-ion collisions. It carries information on the very early stage of the collision, especially at large pseudorapidity (𝜂), where it is believed to be generated during the nuclear passage time. Directed flow therefore probes the onset of bulk collective dynamics during thermalization, providing valuable experimental guidance to models of the pre-equilibrium stage. In 2018, the Event Plane Detector (EPD) was installed in STAR and used for the Beam Energy Scan phase-II (BES-II) data taking. The combination of EPD (2.1 < |𝜂| < 5.1) and high-statistics BES-II data enables us to extend the 𝑣 1 measurement to the forward and backward 𝜂 regions. In this paper, we present the measurement of 𝑣 1 over a wide 𝜂 range in Au + Au collisions at $\sqrt{s_{NN}}$ = 19.6 and 27 GeV using the STAR EPD. The results of the analysis at $\sqrt{s_{NN}}$ = 19.6 GeV exhibit excellent consistency with the previous PHOBOS measurement, while elevating the precision of the overall measurement. The increased precision of the measurement also revealed finer structures in heavy-ion collisions, including a potential observation of the first-order event-plane decorrelation. Multiple physics models were compared to the experimental results. Only a transport model and a three-fluid hybrid model can reproduce a sizable 𝑣 1 at large 𝜂 as was observed experimentally. The model comparison also indicates 𝑣 1 at large 𝜂 might be sensitive to the QGP phase transition.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS

Machine learning methods for weather forecasting

SAND2025-14466O This repository contains code for developing, training, and evaluating machine learning models for weather and climate forecasting, including forecast skill assessment, feature importance analysis, and reproducible workflows for model comparison. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Holthuijzen, Maike [Sandia National Lab. (SNL-CA),

Object-Based Evaluation of Dynamical and Statistical Downscaled Precipitation Products over CONUS

High-resolution precipitation data, generated through dynamical downscaling (DD) or statistical downscaling (SD) of global climate model output, provide critical information for regional climate assessment and adaptation planning. Most downscaling development and validation have focused on accurate gridscale precipitation construction and ignored the spatial structure of precipitation across model grids and at the event scale. However, many applications, e.g., hydrologic modeling and the analysis using the downscaled precipitation, require a reasonable representation of the spatial structure of precipitation within watersheds. Therefore, a set of standard metrics to evaluate the representation of the spatial structure of individual storms across diverse downscaled precipitation products is desired. To address this need, we conducted an object-based evaluation of precipitation in decades-long DD and SD products over the contiguous United States (CONUS). Specifically, we evaluate their ability to reproduce various features of precipitation objects in the observations: total volume, precipitation area, peak intensity, and spatial structure. Multiple metrics (bias, Perkins score, and nonparametric statistical tests) are used to quantify model performance. Our evaluation reveals notable variations in performance among individual products across different climate zones and seasons, as well as between extreme and nonextreme events. In general, most DD products exhibit balanced performance across the four precipitation object features, while SD products vary more significantly in their performance across products. Based on this comprehensive evaluation, we provide guidance on choosing downscaled products for specific regions, seasons, and precipitation object features. These findings and recommendations can inform precipitation-relevant modeling and analysis over CONUS, guide future downscaling technique developments, and provide actionable information for climate impact assessment and adaptation.

Downscaling