Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “VALID”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Software Validation Work With The ZPPR-15 Data

The analysis activities for fast reactors involve using many different pieces of software that are relied upon for their predictive capabilities. For this software to be considered reliable, documented proof that the predictions of the software are accurate is required. In this manuscript, the validation work that covers some of the Argonne software used in fast reactor design activities is discussed and displayed. This validation work includes neutron and gamma flux distributions, reaction rate distributions, and reactivity worth. In an ideal world, a reactor development program would have access to a comprehensive set of experimental facilities to help inform the design aspects of the reactor itself. While thermal-hydraulics experiments, and to a limited degree mechanical experiments, can be carried out today for validation needs, neutronics related experimental facilities are rather impractical because of the lack of experimental facilities. Given the desired time table for construction of new reactors, the reconstitution or creation of new neutronic experimental facilities is untenable and thus those reactor development programs must rely upon any available experimental measurements that are qualitatively similar to the design. While a methodology has been proposed to assess the similarity between the past experimental measurements and the reactor itself, that aspect is beyond the scope of this manuscript. In this manuscript, the focus is entirely placed on the analysis results for a series of experiments carried out at the ZPPR facility in Idaho in the mid-1980s. In this regard, this manuscript only shows the validation of the stated neutronics software for specific loadings of the ZPPR reactor. Because of the fuel form, its proposed enrichment, and the material content of the reactor core, the ZPPR-15 experiments were identified as potential validation data for the reactor. The ZPPR-15 experiments were intended as mockups of a 330 MWe Integral Fast Reactor program which was a follow on program to the Clinch River Breeder Reactor. In the ZPPR-15 series of experiments, measurements of the neutron spectrum, control rod worth, sodium void worth, foil reaction rate distributions, Doppler worth of heated samples, gamma dose, and axial expansion worth were all carried out and published. In many cases, these reactivity coefficients are good candidates to validate the reactivity coefficient calculation scheme used by the analysis software and included in the safety analysis activities of fast reactor development projects today. This manuscript discusses the modeling methodology and accuracy of the calculated experimental results using the LANL software MCNP and the ANL software package ARC (Argonne Reactor Codes). As will be shown, for many of the experimental measurements, the two software packages are found to be good predictive analysis tools for those experiments. In other cases, problems with the analysis methodology or underlying cross section data are exposed which indicates where predictive analysis is not as reliable. Finally, in some of the measurements the conclusion is reached that the experimental measurement cannot be reproduced with the analysis software as it is simply too difficult.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Selection and Ranking of Experiments from the Halden Database in support of Multiscale Model Validation

Validating fuel performance codes, such as BISON, requires an extensive amount of experiments covering a wide range of operating conditions and fuel types. Within the light-water reactor (LWR) space, there have been several international experimental programs that have contributed to the wealth of available experimental data available for use. One of those international programs, the Halden Reactor Project (HRP), began in 1958 and utilized the Halden Boiling Water Reactor to conduct many highly instrumented experiments until the reactor closed in 2018. Idaho National Laboratory, through the U.S. Department of Energy, has utilized several Halden experiments to perform the initial validation of the BISON code based upon their inclusion in international modeling and simulation benchmarks. Recently, the HRP has provided member organizations a complete copy of all available data, reports, and presentations since the HRP began. This report provides an initial exploration of the data available in the database for use in validating the multiscale models under development in the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program for LWR applications. Ranking tables that identify potential validation cases are provided for the high priority models of interest. It was found that some of the recommended high priority experiments correspond to additional rods in existing assemblies already available in the BISON validation suite. It is expected that several of these cases will be incorporated into future NEAMS milestones in the fuels technical area for increased validation of BISON.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2026

Software Validation Work With The ZPPR-15 Data

The analysis activities for fast reactors involve using many different pieces of software that are relied upon for their predictive capabilities. For this software to be considered reliable, documented proof that the predictions of the software are accurate is required. In this manuscript, the validation work that covers some of the Argonne software used in fast reactor design activities is discussed and displayed. This validation work includes neutron and gamma flux distributions, reaction rate distributions, and reactivity worth. In an ideal world, a reactor development program would have access to a comprehensive set of experimental facilities to help inform the design aspects of the reactor itself. While thermal-hydraulics experiments, and to a limited degree mechanical experiments, can be carried out today for validation needs, neutronics related experimental facilities are rather impractical because of the lack of experimental facilities. Given the desired time table for construction of new reactors, the reconstitution or creation of new neutronic experimental facilities is untenable and thus those reactor development programs must rely upon any available experimental measurements that are qualitatively similar to the design. While a methodology has been proposed to assess the similarity between the past experimental measurements and the reactor itself, that aspect is beyond the scope of this manuscript. In this manuscript, the focus is entirely placed on the analysis results for a series of experiments carried out at the ZPPR facility in Idaho in the mid-1980s. In this regard, this manuscript only shows the validation of the stated neutronics software for specific loadings of the ZPPR reactor. Because of the fuel form, its proposed enrichment, and the material content of the reactor core, the ZPPR-15 experiments were identified as potential validation data for the reactor. The ZPPR-15 experiments were intended as mockups of a 330 MWe Integral Fast Reactor program which was a follow on program to the Clinch River Breeder Reactor. In the ZPPR-15 series of experiments, measurements of the neutron spectrum, control rod worth, sodium void worth, foil reaction rate distributions, Doppler worth of heated samples, gamma dose, and axial expansion worth were all carried out and published. In many cases, these reactivity coefficients are good candidates to validate the reactivity coefficient calculation scheme used by the analysis software and included in the safety analysis activities of fast reactor development projects today. This manuscript discusses the modeling methodology and accuracy of the calculated experimental results using the LANL software MCNP and the ANL software package ARC (Argonne Reactor Codes). As will be shown, for many of the experimental measurements, the two software packages are found to be good predictive analysis tools for those experiments. In other cases, problems with the analysis methodology or underlying cross section data are exposed which indicates where predictive analysis is not as reliable. Finally, in some of the measurements the conclusion is reached that the experimental measurement cannot be reproduced with the analysis software as it is simply too difficult.

Aliberti, Gerardo↗
DOE OSTI2025

Guiding Principles for Geochemical/Thermodynamic Model Development and Validation in Nuclear Waste Disposal: A Close Examination of Recent Thermodynamic Models for H + —Nd 3+ —NO 3 - (—Oxalate) Systems

Development of a defensible source-term model (STM), usually a thermodynamical model for radionuclide solubility calculations, is critical to a performance assessment (PA) of a geologic repository for nuclear waste disposal. Such a model is generally subjected to rigorous regulatory scrutiny. In this article, we highlight key guiding principles for STM model development and validation in nuclear waste management. We illustrate these principles by closely examining three recently developed thermodynamic models with the Pitzer formulism for aqueous H + —Nd 3+ —NO 3 - (—oxalate) systems in a reverse alphabetical order of the authors: the XW model developed by Xiong and Wang, the OWC model developed by Oakes et al., and the GLC model developed by Guignot et al., among which the XW model deals with trace activity coefficients for Nd(III), while the OWC and GLC models are for concentrated Nd(NO 3 ) 3 electrolyte solutions. The principles highlighted include the following: (1) Principle 1. Validation against independent experimental data: A model should be validated against experimental data or field observations that have not been used in the original model parameterization. We tested the XW model against multiple independent experimental data sets including electromotive force (EMF), solubility, water vapor, and water activity measurements. The results show that the XW model is accurate and valid for its intended use for predicting trace activity coefficients and therefore Nd solubility in repository environments. (2) Principle 2. Testing for relevant and sensitive variables: Solution pH is such a variable for an STM and easily acquirable. All three models are checked for their ability to predict pH conditions in Nd(NO 3 ) 3 electrolyte solutions. The OWC model fails to provide a reasonable estimate for solution pH conditions, thus casting serious doubt on its validity for a source-term calculation. In contrast, both the XW and GLC models predict close-to-neutral pH values, in agreement with experimental measurements. (3) Principle 3. Honoring physical constraints: Upon close examination, it is found that the Nd(III)-NO 3 association schema in the OWC model suffers from two shortcomings. Firstly, its second stepwise stability constant for Nd(NO 3 ) 2+ (log K 2 ) is much higher than the first stepwise stability constant for NdNO 3 2+ (log K 1 ), thus violating the general rule of (log K 2 –log K 1 ) < 0, or $\frac{K1}{K2}$>1. Secondly, the OWC model predicts abnormally high activity coefficients for Nd(NO 3 ) 2 + (up to ~900) as the concentration increases. (4) Principle 4. Minimizing degrees of freedom for model fitting: The OWC model with nine fitted parameters is compared with the GLC model with five fitted parameters, as both models apply to the concentrated region for Nd(NO 3 ) 3 electrolyte solutions. The latter appears superior to the former because the latter can fit osmotic coefficient data equally well with fewer model parameters. The work presented here thus illustrates the salient points of geochemical model development, selection, and validation in nuclear waste management.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2024

Chlorine Validation through Critical Integral Experiments

An increased interest in the validation of chlorine nuclear data, specifically 35Cl, in recent years has led to the prioritization of conducting chlorine critical experiments for nuclear data validation and criticality safety evaluations. A previous experiment was conducted with PVC and CPVC (chlorinated polyvinyl chloride) to reduce the margin of subcriticality for PF-4 operations with aqueous plutonium chloride solutions. Challenges in determining the composition of specific polymers, namely the CPVC, made it difficult to characterize, and therefore benchmark. Additional materials that were utilizable for chlorine validation were not immediately clear, as form, strength, purity, and composition are all important. A series of possible absorber materials were identified and studied, but ultimately granular sodium chloride was chosen. In addition to the needs of LANL’s PF-4 other industry collaborators have brought attention to the need for chlorine validation. Specifically, the need for HEU electrorefining with LiCl salts at Y-12 was taken into consideration for this experiment, with the experimental configurations being finely tuned to best meet their needs. Needs for validation were also presented by Idaho National Lab (INL) and TerraPower for validation of their Molten Chloride Reactor Experiment (MCRE) and Molten Chloride Fast Reactor (MCFR) and have also been considered.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Summary Report Of The FY25 Reactor Physics Verification And Validation Exercises In The Advanced Reactor Technologies - Gas-cooled Reactor Program

Valdiation and verification of numerical tools is critical for ensuring reasonable predictions for design scoping, licensing, and safety analsyis. In this report, two reactor physics verification and validation exercises are presented. The first of these exercises focuses on burnup analysis with data from the Advanced Gas Reactor (AGR) program. Simulations are performed with Monte Carlo N-Particle (MCNP) and are compared with the experimental measurements for the AGR 1 and 2 experiments that utilize both UCO and UO2 fuel. The second exercises utilizes data from the HTR-Proteus experiments to perform reactor physics validation. Specifications of the experimental facility are provdied, along with a demonstration of initial modeling efforts in Serpent for one of the determistic packing experiments. Both cases are part of the Generation-IV international forum (GIF) Very High-Temperature Reactor (VHTR) Computational Methods, Validation, and Benchmarking (CMVB) program, an international collaborative organization dedicated to the verification and validation of High-Temperature Gas-Cooled Reactor (HTGR) analysis. Participation in the CMVB allows the US Department of Energy (DOE) to leverage these existing validation activities to provide extra value through benchmarking activities with other CMVB members.

and Benchmarking (CMVB) program↗
DOE OSTI2025

Summary Report Of The FY25 Computational Fluid Dynamics Verification And Validation Exercises In The Advanced Reactor Technologies - Gas-cooled Reactor Program

Verification and Validation (V&V) of numerical tools is critical for ensuring reasonable predictions during design, safety analysis, and licensing. Recent work in the Advanced Reactor Technologies - Gas-cooled Reactor (ART-GCR) program has focused on V&V of common Computational Fluid Dynamics (CFD) tools that are used within the Untied States. This report presents an update on these CFD V&V activities. These Generation IV Forum (GIF) Very High Temperature Reactor (VHTR) Computational Methods, Validation, and Benchmarking (CMVB) is an international organization dedicated to the verification and validation of High Temperature Gas-Cooled Reactor (HTGR) simulation tools. Participation in the CMVB provides additional value to the V&V activities, as it allows for access to a wider range of data, and provides valuable benchmarking exercises. Three HTGR phenomena are targeted: Reactor Cavity Cooling System (RCCS) performance, core bypass flow, and lower plenum mixing. Simulations of the University of Wisconsin-Madison (UW-Madison) RCCS facilities are performed with Reynolds Averaged Navier-Stokes (RANS) in StarCCM+. Results are compared for both forced and natural convection conditions, with both exhibiting good agreement with experimental measurements. The Idaho National Laboratory (INL) matched index of refraction (MIR) and Korean Atomic Energy Research Institute (KAERI) bypass flow expeirments are used to validation CFD predictions of bypass flow. Simulations are performed with RANS in StarCCM+ and with Large Eddy Simulation (LES) in NekRS. Finally, preliminary simulations of the Institute of Nuclear and New Energy Technology (INET) lower plenum mixing facilities are presented. Initial work has developed models with LES, RANS, and porous media models. These preliminary models are presented and compared to each other to gauge differences in predictions with each of the three methods.

and Benchmarking (CMVB)↗
DOE OSTI2021

Code validation of SAM using natural-circulation experimental data from the compact integral effects test (CIET) facility

The primary objective of this study is to validate the system analysis code, SAM, using experimental data from the Compact Integral Effects Test (CIET) experimental loop. SAM is a modern system analysis code being developed at Argonne National Laboratory for safety analysis of designs for advanced non-light water reactors (non-LWRs), such as sodium-cooled fast reactors, high-temperature gas-cooled reactors, and fluoride salt-cooled high-temperature reactors (FHRs). To support SAM code development for the wide range of non-LWR applications, it is of paramount importance to validate the code against experiments highly relevant to these reactor concepts. Additionally, the CIET facility, which was designed to reproduce the thermal-hydraulics response of FHRs under both forced- and natural-circulation conditions, has been identified and selected as one of the benchmark test facilities for SAM code validation. In this study, two sets of available CIET tests were selected for SAM code validation purposes, namely, power step change transient tests and steady-state natural-circulation tests. For all selected tests, SAM-predicted results show very good agreement with experimental data. The successful validation of SAM against these selected CIET experiments demonstrates that the computer code is well suited for thermal-hydraulics analysis of FHR designs.

42 ENGINEERING↗
DOE OSTI2022

Validation of edge turbulence codes against the TCV-X21 diverted L-mode reference case

Self-consistent full-size turbulent-transport simulations of the divertor and scrape-off-layer (SOL) of existing tokamaks have recently become feasible. This enables the direct comparison of turbulence simulations against experimental measurements. In this work, we perform a series of diverted ohmic L-mode discharges on the tokamak à configuration variable (TCV) tokamak, building a first-of-a-kind dataset for the validation of edge turbulence models. This dataset, referred to as TCV-X21, contains measurements from five diagnostic systems from the outboard midplane (OMP) to the divertor targets—giving a total of 45 one- and two-dimensional comparison observables in two toroidal magnetic field directions. The experimental dataset is used to validate three flux-driven 3D fluid-turbulence models—GBS, GRILLIX and TOKAM3X. With each model, we perform simulations of the TCV-X21 scenario, individually tuning the particle and power source rates to achieve a reasonable match of the upstream separatrix value of density and electron temperature. We find that the simulations match the experimental profiles for most observables at the OMP—both in terms of profile shape and absolute magnitude—while a comparatively poorer agreement is found towards the divertor targets. The match between simulation and experiment is seen to be sensitive to the value of the resistivity, the heat conductivities, the power injection rate and the choice of sheath boundary conditions. Additionally, despite targeting a sheath-limited regime, the discrepancy between simulations and experiment also suggests that the neutral dynamics should be included. The results of this validation show that turbulence models are able to perform simulations of existing devices and achieve reasonable agreement with experimental measurements. Where disagreement is found, the validation helps to identify how the models can be improved. By publicly releasing the experimental dataset and validation analysis, this work should help to guide and accelerate the development of predictive turbulence simulations of the edge and SOL.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Advanced Performance Metrics and their Application to the Sensitivity Analysis for Model Validation and Calibration

High-quality generator dynamic models are critical to reliable and accurate power systems studies and planning. With the availability of PMUs, measurement-based approach for model validation has gained significant prominence. In this approach, the quality of a model is analyzed by visually comparing measured generator response with the model-based simulated response for large system disturbances. This paper proposes a new set of performance metrics to assess the model validation results to facilitate automation of the model validation process. In the proposed methodology, first, the slow governor response and comparatively faster oscillatory response are separated, and then a separate set of performance metrics is calculated for each of these two components. These proposed metrics quantify the mismatch between the actual and model-based response in a comprehensive manner without missing any information enabling automation of the process. Furthermore, in this paper, we are also proposing that the sensitivity analysis for model calibration be performed with respect to the proposed metrics for the systematic identification of key parameters. In this work, results obtained using both simulated and real-world case-studies validate the effectiveness of the proposed performance metrics for model validation and their application to the sensitivity analysis for model calibration.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Cross‐Cultural Validation of the Binge Eating Disorder Screener‐7 ( BEDS ‐7) Across 42 Countries

ABSTRACT Objective This study aimed to evaluate the reliability and validity of the Binge Eating Disorder Screener‐7 (BEDS‐7) across 42 countries and 26 languages, assessing its reliability and validity as a screening tool for binge‐eating disorder (BED) in diverse cultural contexts. Specifically, it sought to enhance early recognition of BED symptoms in primary care settings globally, contributing to a standardized framework for assessing BED. Method The International Sex Survey, a cross‐sectional online study, was conducted in 42 countries and 26 languages. A diverse community sample of 82,243 participants, aged 18 years or older, completed the BEDS‐7 and measures of sexuality, mental health, substance use, and sociodemographic characteristics. Confirmatory factor analyses and tests of measurement invariance were employed to evaluate the reliability and validity of the BEDS‐7 across languages, countries, genders, and sexual orientations. Results The BEDS‐7 demonstrated scalar factorial invariance across languages and countries, indicating consistent factor loadings and item intercepts. In contrast, the screener showed residual invariance across gender and sexual orientation groups, supporting its robustness across these demographics. Kruskal–Wallis tests revealed significant differences in BED symptoms across languages, countries, genders, and sexual orientations, with the highest BED scores observed among queer, pansexual, and gender‐diverse individuals. The BEDS‐7 also demonstrated adequate reliability (Cronbach's alpha > 0.80) and moderate criterion validity. Discussion The findings provide further evidence of the reliability and validity of the BEDS‐7 as a potential screening tool for identifying probable cases of BED globally, facilitating early intervention in primary care settings.

Gewirtz‐Meydan, Ateret [School of Social Work, Fac↗
DOE OSTI2024

Validation of a Hybrid Domain Overlapping Coupling Between SAM and CFD Against the TALL-3D Transients

The System Thermal Hydraulics (STH) code SAM has been coupled to the Computational Fluid Dynamics (CFD) code Simcenter STAR-CCM+ utilizing a hybrid domain overlapping method with an explicit coupling in time. The coupling aims to extend the STH code’s applicability to scenarios where local momentum and energy transfers are important yet difficult for STH codes to capture, such as three-dimensional (3D) mixing. The coupling method’s numerical stability was verified in the past against two closed-loop configurations, and it was validated against a double T-junction experiment with 3D scalar mixing. In the present work, the coupling method is validated against the TALL-3D STH/CFD coupling benchmark facility. TALL-3D is a three-legged, liquid-metal facility with a large, pool-type enclosure (test section) that exhibits 3D flow effects to be modeled by a CFD code. The rest of the system exhibits approximately 1D behavior well-predicted by an STH code. First, the present STAR-CCM+ CFD model of the 3D test section is validated against experimental data. Then, the SAM-STARCCM+ coupled model is validated against six different TALL-3D steady states, including SAM standalone model results for comparison. Lastly, the SAM-STARCCM+ coupled model is validated against two TALL-3D transients, one exhibiting flow reversal in the test section and one exhibiting nonlinear, Limit Cycle Oscillations (LCO). For the first transient, the SAM-STARCCM+ coupled model properly predicts an increase in the test section’s inlet temperature during flow reversal, and this is not predicted by the SAM standalone model. Following flow reversal, the SAM-STARCCM+ coupled model better-predicts the initial flow recovery and following oscillations as the system approaches a final natural circulation state. For the second transient, no true final steady state is observed due to LCO. Neither the SAM-STARCCM+ coupled model nor the SAM standalone model can perfectly capture the experiment’s changing oscillation frequency during the transient. However, the SAM-STARCCM+ coupled model does reproduce the oscillatory feedback observed in the system. This is a significant achievement as the SAM-STARCCM+ coupled model only uses an explicit coupling in time, as opposed to a semi-implicit coupling. In comparison, previous STH/CFD coupling efforts of the TALL-3D facility required semi-implicit coupling to obtain similar results.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Availability of Critical Benchmark Experiments for the Pebble Tanker Transportation Model for Nuclear Criticality Safety Validation of TRISO Pebbles

This study addresses the need for comprehensive investigations into TRi-structural ISOtropic (TRISO) fuel pebble transportation validation. In this work, an exploratory model, the pebble tanker(PT), was developed with the aim of facilitating the validation of nuclear criticality safety calculations in the context of industrial-scale transportation of TRISO fuel. The PT model was designed to investigate the availability and applicability of critical benchmark experiments crucial for assessing the transportation of these pebbles. This work incorporated sensitivity/uncertainty (S/U) similarity studies to quantify the applicability of critical benchmark experiments and to address nuclear data uncertainties in the context of TRISO transportation. Two container models were investigated: one for the Hermes-type pebble and one for the Pebble Bed Modular Reactor (PBMR)–type pebble. The models were simplified, considering fuel, containment, and either water or air, to enable a focus on the underlying physics of applications involving TRISO fuel pebbles using the PT model. A crucial aspect under consideration was the capacity of the transport package to hold pebbles while ensuring subcriticality in the flooded state. An approach in the criticality validation process involves assessing the similarity between systems through an integral index parameter evaluation. This involves calculating a correlation coefficient (referred to as c k ) based on shared nuclear data–induced uncertainty between a benchmark experiment and the application of the PT model. To facilitate this analysis, the SCALE tools, particularly the CSAS6-Shift, TSUNAMI-3D-Shift, and TSUNAMI-IP sequences, were employed for comprehensive studies in neutronics and S/U analysis. Our findings showed that there are sufficient critical experimental benchmarks to perform this validation of the PT model in the most reactive state, i.e. when the tanker is flooded. This paper provides valuable insights into validating a transport package for Generation IV TRISO fuel pebbles.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2022

Validation of realistic Monte Carlo plasma gamma-ray source on JET discharges

A novel modelling methodology has been developed for the creation of a realistic plasma gamma-ray source for Monte Carlo transport simulations in the tokamak JET. The methodology couples the TRANSP code for plasma transport calculations with the MCNP Monte Carlo particle transport code, thus connecting plasma physics with gamma-ray transport. Here, we present the validation of the developed source methodology by comparing calculated gamma-ray spectra with measurements performed at JET. The validation focuses on gamma-ray spectra measured by the tangential gamma-ray spectrometer during two JET three ion RF scenario discharges, performed in the JET 2019 deuterium experimental campaign. For validation the calculated plasma gamma-ray spectrum was combined with the neutron induced prompt gamma-ray background, originating in the vacuum vessel, and scaled to absolute values calculating the total number of plasma gamma-ray and neutron emitting reactions. The comparison between calculated and measured gamma-ray spectra shows good agreement with the shape of the calculated gamma-ray spectra matching that of measurements for both studied discharges. Moreover, the calculated absolute values of the gamma-ray spectra were of the same order of magnitude at the position of the gamma-ray detector located at the end of a long line-of-sight in a biological shield. Finally, the comparison has validated the developed plasma gamma-ray source methodology for MCNP photon transport calculations at JET. The validation provides a basis for the developed plasma gamma-ray source to be used as a support for the development of future tokamaks such as DEMO.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Dark energy survey: Modeling strategy for multiprobe cluster cosmology and validation for the full six-year dataset

Here, we introduce an updated To&Krause2021 model for joint analyses of cluster abundances and large-scale two-point correlations of weak lensing and galaxy and cluster clustering (termed CL+3×2 pt analysis) and validate that this model meets the systematic accuracy requirements of analyses with the statistical precision of the final Dark Energy Survey (DES) Year 6 (Y6) dataset. The validation program consists of two distinct approaches, (i) identification of modeling and parametrization choices and impact studies using simulated analyses with each possible model misspecification and (ii) end-to-end validation using mock catalogs from customized Cardinal simulations that incorporate realistic galaxy populations and DES-Y6-specific galaxy and cluster selection and photometric redshift modeling, which are the key observational systematics. In combination, these validation tests indicate that the model presented here meets the accuracy requirements of DES-Y6 for CL+3×2 pt based on a large list of tests for known systematics. In addition, we also validate that the model is sufficient for several other data combinations: the CL+GC subset of this data vector (excluding galaxy–galaxy lensing and cosmic shear two-point statistics) and the CL+3×2 pt+BAO+SN (combination of CL+3×2 pt with the previously published Y6 DES baryonic acoustic oscillation and Y5 supernovae data).

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Validation of earthquake ground-motion models in southern California, USA, using precariously balanced rocks

Accurate estimates of earthquake ground shaking rely on uncertain ground-motion models derived from limited instrumental recordings of historical earthquakes. A critical issue is that there is currently no method to empirically validate the resultant ground-motion estimates of these models at the timescale of rare, large earthquakes; this lack of validation causes great uncertainty in ground-motion estimates. Here, we address this issue and validate ground-motion estimates for southern California utilizing the unexceeded ground motions recorded by 20 precariously balanced rocks. We used cosmogenic 10Be exposure dating to model the age of the precariously balanced rocks, which ranged from ca. 1 ka to ca. 50 ka, and calculated their probability of toppling at different ground-motion levels. With this rock data, we then validated the earthquake ground motions estimated by the Uniform California Earthquake Rupture Forecast, Version 3 (UCERF3) seismic-source characterization and the Next Generation Attenuation (NGA)-West2 ground-motion models. We found that no ground-motion model estimated levels of earthquake ground shaking consistent with the observed continued existence of all 20 precariously balanced rocks. The ground-motion model I14 estimated ground-motion levels that were inconsistent with the most rocks; therefore, I14 was invalidated and removed. At a 2475 year mean return period, the removal of this invalid ground-motion model resulted in a 2−7% reduction in the mean and a 10−36% reduction in the 5th−95th fractile uncertainty of the ground-motion estimates. Our findings demonstrate the value of empirical data from precariously balanced rocks as a validation tool for removing invalid ground-motion models and, in turn, reducing the uncertainty in earthquake ground-motion estimates.

Geology↗
DOE OSTI2025

Using a Large Language Model as a Building Block to Generate Usable Validation and Verification Suite for OpenMP

In the HPC area, both hardware and software move quickly. Often new hardware is developed and deployed, the corresponding software stack, including compilers and other tools, are under active development while leading edge software developers are working to port and tune their applications, all at the same time. While the software ecosystem is in flux, one of the key challenges for users is obtaining insight into the state of implementation of key features in the programming languages and models their applications are using – whether they have been implemented, and whether the implementation conforms to the specification, especially for newly implemented features (less tested by widespread use). OpenMP is one of the most prominent shared memory programming models used for on-node programming in HPC. With the shift towards accelerators (such as GPUs and FPGAs) and heterogeneous programming OpenMP features are getting more complex. It is natural to ask whether generative AI approaches, and large language models (LLMs) in particular, can help in producing validation and verification test suites to allow users better and faster insights into the availability and correctness of OpenMP features of interest. In this work, we explore the use of ChatGPT-4 to generate a suite of tests for OpenMP features. We have chosen a set of directives and clauses, a total of 78 combinations, which first appeared in OpenMP 3.0 (released in May 2008) but are also relevant for accelerators. We prompted ChatGPT to generate tests in the C and Fortran languages, for both host (CPU) and device (accelerator). On the Summit super-computer using the GNU implementation, we found that, of the 78 generated tests 67 C tests and 43 Fortran tests compiled successfully and fewer than those executed to completion. On further analysis we show that not all generated tests are valid. We document the process, results, and provide detailed analysis regarding the quality of tests generated. With the aim of providing input to a production quality validation and verification suite, we manually implement the corrections required to make the tests valid according to the current OpenMP specification. We quantify this effort as small, medium, or large, and record the lines of code changed to correct the invalid tests. With the corrected tests we validate recent implementations from HPE, AMD, and GNU on the Frontier supercomputer. Our experiment and subsequent analysis show that although LLMs are capable of producing HPC specific codes, they are limited by their understanding of the deeper semantics and restrictions of programming models such as OpenMP. Unsurprisingly more commonly used features have better support, while some OpenMP 3.0 directives such as sections and tasking are not universally supported on accelerators. We demonstrate that successful compilation and execution to completion are inadequate metrics for evaluating generated code and that, at this time, commodity LLMs require expert intervention for code verification. This points to gaps in the training data that is currently available for HPC. We demonstrate that with "small" effort 37% of generated invalid C tests and 63% of generated invalid Fortran tests could be corrected. This improves productivity of test generation as we circumvent writing from scratch and the common programming errors associated with it.

Pophale, Swaroop [ORNL] (ORCID:0000000185446367)↗
DOE OSTI2022

Design and execution of a verification, validation, and uncertainty quantification plan for a numerical model of left ventricular flow after LVAD implantation

Left ventricular assist devices (LVADs) are implantable pumps that act as a life support therapy for patients with severe heart failure. Despite improving the survival rate, LVAD therapy can carry major complications. Particularly, the flow distortion introduced by the LVAD in the left ventricle (LV) may induce thrombus formation. While previous works have used numerical models to study the impact of multiple variables in the intra-LV stagnation regions, a comprehensive validation analysis has never been executed. The main goal of this work is to present a model of the LV-LVAD system and to design and follow a verification, validation and uncertainty quantification (VVUQ) plan based on the ASME V&V40 and V&V20 standards to ensure credible predictions. The experiment used to validate the simulation is the SDSU cardiac simulator, a bench mock-up of the cardiovascular system that allows mimicking multiple operation conditions for the heart-LVAD system. The numerical model is based on Alya, the BSC’s in-house platform for numerical modelling. Alya solves the Navier-Stokes equation with an Arbitrary Lagrangian-Eulerian (ALE) formulation in a deformable ventricle and includes pressure-driven valves, a 0D Windkessel model for the arterial output and a LVAD boundary condition modeled through a dynamic pressure-flow performance curve. The designed VVUQ plan involves: (a) a risk analysis and the associated credibility goals; (b) a verification stage to ensure correctness in the numerical solution procedure; (c) a sensitivity analysis to quantify the impact of the inputs on the four quantities of interest (QoIs) (average aortic root flow $Q^{avg}_{Ao}$, maximum aortic root flow $Q^{max}_{Ao}$, average LVAD flow $Q^{avg}_{VAD}$, and maximum LVAD flow $Q^{max}_{VAD}$; (d) an uncertainty quantification using six validation experiments that include extreme operating conditions. Numerical code verification tests ensured correctness of the solution procedure and numerical calculation verification showed a grid convergence index (GCI)95% <3.3%. The total Sobol indices obtained during the sensitivity analysis demonstrated that the ejection fraction, the heart rate, and the pump performance curve coefficients are the most impactful inputs for the analysed QoIs. The Minkowski norm is used as validation metric for the uncertainty quantification. It shows that the midpoint cases have more accurate results when compared to the extreme cases. The total computational cost of the simulations was above 100 [core-years] executed in around three weeks time span in Marenostrum IV supercomputer. This work details a novel numerical model for the LV-LVAD system, that is supported by the design and execution of a VVUQ plan created following recognised international standards. We present a methodology demonstrating that stringent VVUQ according to ASME standards is feasible but computationally expensive.

59 BASIC BIOLOGICAL SCIENCES↗