Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “VALID”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Using a Large Language Model as a Building Block to Generate Usable Validation and Verification Suite for OpenMP

In the HPC area, both hardware and software move quickly. Often new hardware is developed and deployed, the corresponding software stack, including compilers and other tools, are under active development while leading edge software developers are working to port and tune their applications, all at the same time. While the software ecosystem is in flux, one of the key challenges for users is obtaining insight into the state of implementation of key features in the programming languages and models their applications are using – whether they have been implemented, and whether the implementation conforms to the specification, especially for newly implemented features (less tested by widespread use). OpenMP is one of the most prominent shared memory programming models used for on-node programming in HPC. With the shift towards accelerators (such as GPUs and FPGAs) and heterogeneous programming OpenMP features are getting more complex. It is natural to ask whether generative AI approaches, and large language models (LLMs) in particular, can help in producing validation and verification test suites to allow users better and faster insights into the availability and correctness of OpenMP features of interest. In this work, we explore the use of ChatGPT-4 to generate a suite of tests for OpenMP features. We have chosen a set of directives and clauses, a total of 78 combinations, which first appeared in OpenMP 3.0 (released in May 2008) but are also relevant for accelerators. We prompted ChatGPT to generate tests in the C and Fortran languages, for both host (CPU) and device (accelerator). On the Summit super-computer using the GNU implementation, we found that, of the 78 generated tests 67 C tests and 43 Fortran tests compiled successfully and fewer than those executed to completion. On further analysis we show that not all generated tests are valid. We document the process, results, and provide detailed analysis regarding the quality of tests generated. With the aim of providing input to a production quality validation and verification suite, we manually implement the corrections required to make the tests valid according to the current OpenMP specification. We quantify this effort as small, medium, or large, and record the lines of code changed to correct the invalid tests. With the corrected tests we validate recent implementations from HPE, AMD, and GNU on the Frontier supercomputer. Our experiment and subsequent analysis show that although LLMs are capable of producing HPC specific codes, they are limited by their understanding of the deeper semantics and restrictions of programming models such as OpenMP. Unsurprisingly more commonly used features have better support, while some OpenMP 3.0 directives such as sections and tasking are not universally supported on accelerators. We demonstrate that successful compilation and execution to completion are inadequate metrics for evaluating generated code and that, at this time, commodity LLMs require expert intervention for code verification. This points to gaps in the training data that is currently available for HPC. We demonstrate that with "small" effort 37% of generated invalid C tests and 63% of generated invalid Fortran tests could be corrected. This improves productivity of test generation as we circumvent writing from scratch and the common programming errors associated with it.

Pophale, Swaroop [ORNL] (ORCID:0000000185446367)↗

Design and execution of a verification, validation, and uncertainty quantification plan for a numerical model of left ventricular flow after LVAD implantation

Left ventricular assist devices (LVADs) are implantable pumps that act as a life support therapy for patients with severe heart failure. Despite improving the survival rate, LVAD therapy can carry major complications. Particularly, the flow distortion introduced by the LVAD in the left ventricle (LV) may induce thrombus formation. While previous works have used numerical models to study the impact of multiple variables in the intra-LV stagnation regions, a comprehensive validation analysis has never been executed. The main goal of this work is to present a model of the LV-LVAD system and to design and follow a verification, validation and uncertainty quantification (VVUQ) plan based on the ASME V&V40 and V&V20 standards to ensure credible predictions. The experiment used to validate the simulation is the SDSU cardiac simulator, a bench mock-up of the cardiovascular system that allows mimicking multiple operation conditions for the heart-LVAD system. The numerical model is based on Alya, the BSC’s in-house platform for numerical modelling. Alya solves the Navier-Stokes equation with an Arbitrary Lagrangian-Eulerian (ALE) formulation in a deformable ventricle and includes pressure-driven valves, a 0D Windkessel model for the arterial output and a LVAD boundary condition modeled through a dynamic pressure-flow performance curve. The designed VVUQ plan involves: (a) a risk analysis and the associated credibility goals; (b) a verification stage to ensure correctness in the numerical solution procedure; (c) a sensitivity analysis to quantify the impact of the inputs on the four quantities of interest (QoIs) (average aortic root flow $Q^{avg}_{Ao}$, maximum aortic root flow $Q^{max}_{Ao}$, average LVAD flow $Q^{avg}_{VAD}$, and maximum LVAD flow $Q^{max}_{VAD}$; (d) an uncertainty quantification using six validation experiments that include extreme operating conditions. Numerical code verification tests ensured correctness of the solution procedure and numerical calculation verification showed a grid convergence index (GCI)95% <3.3%. The total Sobol indices obtained during the sensitivity analysis demonstrated that the ejection fraction, the heart rate, and the pump performance curve coefficients are the most impactful inputs for the analysed QoIs. The Minkowski norm is used as validation metric for the uncertainty quantification. It shows that the midpoint cases have more accurate results when compared to the extreme cases. The total computational cost of the simulations was above 100 [core-years] executed in around three weeks time span in Marenostrum IV supercomputer. This work details a novel numerical model for the LV-LVAD system, that is supported by the design and execution of a VVUQ plan created following recognised international standards. We present a methodology demonstrating that stringent VVUQ according to ASME standards is feasible but computationally expensive.

59 BASIC BIOLOGICAL SCIENCES↗

Validating Synthetic Galaxy Catalogs for Dark Energy Science in the LSST Era

Large simulation efforts are required to provide synthetic galaxy catalogs for ongoing and upcoming cosmology surveys. These extragalactic catalogs are being used for many diverse purposes covering a wide range of scientific topics. In order to be useful, they must offer realistically complex information about the galaxies they contain. Hence, it is critical to implement a rigorous validation procedure that ensures that the simulated galaxy properties faithfully capture observations and delivers an assessment of the level of realism attained by the catalog. We present here a suite of validation tests that have been developed by the Rubin Observatory Legacy Survey of Space and Time (LSST) Dark Energy Science Collaboration (DESC). We discuss how the inclusion of each test is driven by the scientific targets for static ground-based dark energy science and by the availability of suitable validation data. The validation criteria that are used to assess the performance of a catalog are flexible and depend on the science goals. We illustrate the utility of this suite by showing examples for the validation of cosmoDC2, the extragalactic catalog recently released for the LSST DESC second Data Challenge.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Development and Validation of a Two-Phase Thermal-Hydraulic CFD Code NEK-2P

A project is underway to develop, verify and validate an advanced two-phase flow modeling capability for the highly-scalable, high-performance Computational Fluid Dynamics (CFD) code NEK5000. The goal of this work is to verify and validate the two-phase version of the NEK5000 code, named NEK-2P, to simulate the two-phase flow and heat transfer phenomena that occur in a Boiling Water Reactor (BWR) fuel bundle under various operating conditions. The NEK-2P two-phase flow models follow the approach used for the Extended Boiling Framework (EBF) previously developed at Argonne but include more fundamental physical models of boiling phenomena and advanced numerical algorithms for improved computational accuracy, robustness, and computational speed. The development of the NEK-2P two-phase solver and the implementation of the Extended Boiling Framework two-phase models were initially supported by Argonne National Laboratory (Argonne) through a Laboratory Directed Research and Development (LDRD) project during FY2014-2016. The development and validation of the two-phase models through analyses of selected two-phase boiling flow experiments was supported by the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program in FY2017-2020. This report focuses on verification and validation of the water-steam boiling model NEK-2P Two-Phase, CFD code. The NEK-2P was validated with Nuclear Power Engineering Corporation (NUPEC) Pressurized Water Reactor (PWR) Sub-channel and Bundle Test (PSBT) void distribution benchmark. Three different simulations were performed and analyzed for various operating conditions such as wall-heat flux and sub-cooled inlet temperatures. Reasonably good agreement with measured data was obtained in predicting the measured void distributions. Simulations were performed for Virginia Tech. (VT) 3x3 rod bundle geometry with and without spacers. The preliminary results were presented for Simplified Spacer Grid (SSG). In addition, the implementation of interface reconstruction model was tested with one of the Becker benchmark Critical Heat Flux (CHF) experiments.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Verification and Validation Activities for the Multi-Fidelity Toolkit

The Multi-Fidelity Toolkit (MFTK) is a simulation tool being developed at Sandia National Laboratories for aerodynamic predictions of compressible flows over a range of physics fidelities and computational speeds. These models include the Reynolds-Averaged-Navier-Stokes (RANS) equations, the Euler equations, and modified Newtonian aerodynamics (MNA) equations, and they can be invoked independently or coupled with hierarchical Kriging to interpolate between high-fidelity simulations using lower-fidelity data. However, as with any new simulation capability, verification and validation are necessary to gather credibility evidence. This work describes formal code- and solution-verification activities as well as model validation with uncertainty considerations. Code verification is performed on the MNA model by comparing with an analytical solution for flat-plate and inclined-plate geometries. Solution-verification activities include grid-refinement studies of HIFiRE-1 wind tunnel measurements, which are used for validation, for all model fidelities. A thorough treatment of the validation comparison with prediction error and validation uncertainty is also presented.

42 ENGINEERING↗

FY2021 Improvements to the New CTH Code Verification & Validation Test Suite

Over the past few years, the CTH multiphysics hydrocode has overhauled its software quality and testing processes, implementing current best practices in software quality and building a robust V&V test suite comprised of traditional hydrocode verification problems, including ASC Tri-Lab Test Suite and Enhanced Tri-Lab Test Suite problems, as well as validation problems for some of CTH’s most frequently used equations of state, materials models, and other key capabilities. Substantial progress towards building this new test suite was made in FY19 and FY20. In FY21, the test suite has been expanded to include verification and validation tests of the Steinberg-Guinan-Lund (ST) viscoplastic model and the Johnson Cook (JFRAC) fracture model. Additionally, two new verification tests were added, covering hydrodynamics and high explosive (HE) modeling capabilities: the Kidder Gaussian density problem and the Escape of HE Products (EHEP) problem from the Tri-Lab Test Suite. This report discusses each of these test problems in detail. Verification test results are compared to analytic solutions. Validation test results are compared to experimental data. Wherever possible, convergence or mesh refinement studies are included. Additionally, while implementing the Kidder verification problem, a bug was identified that affects the use of tables to initialize pressure or density in 1D or 2D calculations. A brief discussion of the bug and its fix is included. CTH demonstrates good performance overall on the new test suite problems. Simulation results showed good agreement with analytic solutions for the Kidder problem, with convergence rates ranging between 1.8 and sub-linear, and relatively good agreement for the EHEP problem, though convergence rates for pressure and density were nearly 0. The ST and JFRAC strain rate loading verification tests show good agreement with analytic solutions. Likewise, CTH simulation results show good agreement with experimental validation data, including Taylor rod impact testing, for the materials tested. Future V&V work will focus on adding 2D and 3D versions of existing verification tests as well as adding validation tests of other frequently used capabilities such as other fracture models.

42 ENGINEERING↗

A Summary of Validation Studies for the Integrated TIGER Series Performed on ACORN Plus-up 218468/99

The Integrated TIGER Series (ITS) transport code is a valuable tool for photon-electron transport. A seven-problem validation suite exists to make sure that the ITS transport code works as intended. It is important to ensure that data from benchmark problems is correctly compared to simulated data. Additionally, the validation suite did not previously make use of a consistent quantitative metric for comparing experimental and simulated datasets. To this end, the goal of this long-term project was to expand the validation suite both in problem type and in the quality of the error assessment. To accomplish that, the seven validation problems in the suite were examined for potential drawbacks. When a drawback was identified, the problems were ranked based on severity of the drawback and approachability of a solution. We determined that meaningful improvements could be made to the validation suite by improving the analysis for the Lockwood Albedo problem and by introducing the Ross dataset as an eighth problem to the suite. The Lockwood error analysis has been completed and will be integrated in the future. The Ross data is unfinished, but significant progress has been made towards analysis.

97 MATHEMATICS AND COMPUTING↗

Expanding Benchmarks for Nuclear Data Validation [Slides]

The presentation discusses benchmarking in comparison to experimental truth, the integral experiments that were performed, and that benchmarks are evaluated experiments. It also discusses validation testing, and that the ultimate goal of the validation end product is to improve evaluated nuclear data for applications It does state that validation highlights errors in the Nuclear Data Pipeline that affect applications, for example: Missing Cd Capture Gammas in ENDF/B-VII.1. It acknowledges that additional types of experiments are needed to test data used in applications, and that validation experiments do not have to be complicated and expensive. The presentation also discusses different types of measurements including activation foil and fission chamber measurements, reactor kinetics measurements, and subcritical measurements. The presentation concludes with an experiment summary and states that all applications need validation.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Final Design for Thermal/Epithermal eXperiments (TEX) with Chloride Absorbers to Provide Validation Benchmarks for Y-12 Electrorefining Facility

Uranium electrorefining operations at Y-12 require validation for chlorine absorption and reflection. Plutonium chloride solution operations at Los Alamos National Laboratory require chlorine absorption validation. The growing need for chlorine validation is evident to the wider criticality safety community, with multiple attendees at the recent TEX 2.0 meeting at Lawrence Livermore National Laboratory (May 2023) requesting validation for chlorine (Idaho National Laboratory (INL), Institute de radioprotection et de surete nucleaire (IRSN), Savannah River Nuclear Site (SRNS), LANL, and Y-12). Los Alamos National Laboratory has recently performed, and benchmarked, an experiment titled Chlorine Worth Study (CWS) for the internal operations at the lab, but due to the difficulties in precisely characterizing the material compositions of the chlorine absorbers it is advantageous to perform a complimentary study with a different chlorine-based absorber material. Furthermore, having a uranium-based vs plutonium-based experiment provides a separate and important validation basis for criticality safety and nuclear data evaluation. The original final design report for the study of chlorine absorption using the TEX-HEU experimental base was presented in 2022, but used the same chlorine-bearing materials that were found to be difficult to characterize in the LANL benchmark. A complete redesign of the experiment has been performed looking at alternative absorber materials in various forms to produce an experiment that is fully characterizable. This report presents five novel chlorine experiments using the TEX-HEU test bed which provides direct comparison to the Y-12 and INL/Terrapower application needs, utilizing sodium chloride (NaCl) absorber plates. The absorber plates will consist of granulated NaCl (≥99.5% pure), which will be fully encapsulated in aluminum tins, providing a simple but effective chlorine-based absorber material that can be completely characterized. Of the five configurations presented in this report, it is expected that two or three configurations will be down selected for the actual experiment, with the other configurations being alternates. Three of the configurations are in the standard configuration, where the absorber is placed directly on the HEU fuel plates, and two in the sandwich configuration, where the absorber is surrounded by polyethylene moderators to force additional neutron thermalization prior to reaching the absorber. There are two thicknesses of NaCl absorber plates: 3/16” and 1/4” active thicknesses (i.e. not including the encapsulation). Both variations of the absorbers have an active absorber radius of 6” and a total radius of 7.5” to match the diameter of the HEU plates, with the outer 1.5” being aluminum encapsulation. The high-density polyethylene (HDPE) moderators are of the thicknesses: 27/16”, 7/4”, 1/8”, 11/16”, and 3/4”. The final configurations have six (one sandwich and one standard configuration), eight (one sandwich and one standard configuration), and 18 total fuel layers (standard configuration). The standard and sandwich configurations were designed such that the differences in moderator thicknesses are 1” HDPE, which were already procured for the original CED-2. The proposed configurations were precisely tuned to closely match the sensitivity profiles and neutron spectra of the Y-12 upset cases and were also compared to the INL/Terrapower upset cases. The assessment of experimental uncertainties of the non-absorber components was predicted to be 0.00114 Δk eff . The assessment of uncertainties resulting from the absorbers was predicted to be 0.00029 Δk eff . This results in a total uncertainty of 0.00118 Δk eff . Many of the largest uncertainties, namely the moderator densities, may be reduced with precision dimensional inspection of the components. The 1” HDPE moderators as well as the HDPE reflectors from the original CED-2 were incorporated in the final designs presented here. Additional HDPE moderator plates must be fabricated to complete the configurations. NaCl absorber plates will by fabricated at LLNL. The total additional cost is expected to be $\$$54,250 for the remaining components. Precise inspection, including dimensional, mass, density, and impurity, is recommended for all components. LLNL estimates that these costs are around $\$$12,000. It is expected, based on previous TEX-HEU experiments, that three weeks of experimental facility time is needed to complete the experiments.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Expanded verification and validation studies of hypersonic aerodynamics with multiple physics-fidelity models

Hypersonic aerothermodynamics is an important domain of modern multiphysics simulation. The Multi-Fidelity Toolkit is a simulation tool being developed at Sandia National Laboratories to predict aerodynamic properties for compressible flows from a range of physics fidelities and computational speeds. These models include the Reynolds-averaged Navier–Stokes (RANS) equations, the Euler equations with momentum-energy integral technique (MEIT), and modified Newtonian aerodynamics with flat-plate boundary layer (MNA+FPBL) equations, and they can be invoked independently or coupled with hierarchical Kriging to interpolate between high-fidelity simulations using lower-fidelity data. However, as with any new simulation capability, verification and validation are necessary to gather credibility evidence. This work describes formal code- and solution-verification activities, as well as model validation with uncertainty considerations. Code verification activities on the MNA+FPBL model build on previous work by focusing on the viscous portion of the model. Viscous quantities of interest are compared against those from an analytical solution for flat-plate, inclined-plate, and cone geometries. The code verification methodology for the MEIT model is also presented. Test setup and results of code verification tests on the laminar and turbulent models within MEIT are shown. Solution-verification activities include grid-refinement studies on simulations that model the HIFiRE-1 wind tunnel experiments. These experiments are used for validation of all model fidelities. A thorough validation comparison with prediction error and uncertainty is also presented. Three additional HIFiRE-1 experimental runs are simulated in this study, and the solution verification and validation work examines the effects of the associated parameter changes on model performance. Finally, a study is presented that compares the computational costs and fidelities from each of the different models.

42 ENGINEERING↗

Validation of HyRAM+ Version 5.1 Physics Models

The Hydrogen Plus Other Alternative Fuels Risk Assessment Models (HyRAM+) software has seen various improvements and additional physics capabilities since validation against experimental data was last published for HyRAM v3.1. Notably, HyRAM+ now includes four models allowing for the calculation of overpressure resulting from vapor cloud explosions from unconfined jet releases. As with the previous HyRAM validation report, validation data was gathered from available published literature and tested against HyRAM+ capabilities. The validation comparisons include tank blowdown, unignited dispersion jet plume, ignited jet flame, and enclosed accumulation and overpressure. The unconfined overpressure calculations in HyRAM+ v5.1.1 generally show good agreement with many of the experimental data sets for all four unconfined overpressure models, though HyRAM+ overpredicts the experimental data for small and cryogenic hydrogen releases. The comparisons for the other HyRAM+ physics models are largely unchanged from the previously published validation report.

08 HYDROGEN↗

Cyber-Informed Engineering Validation Methods and Guidance

Validation is an important step in any systems engineering process to ensure the correct system was made to fulfill stakeholders’ needs, goals, and expectations. In the context of Cyber-Informed Engineering (CIE), validation ensures cyber impact is reduced through implemented design choices and CIE requirements. This document details a process in validating CIE-based design choices relative to their effectiveness at mitigating high consequence events. The document includes a case study to illustrate the CIE validation process. The case study explores the implementation of CIE validation within the engineering lifecycle of a chemical mixing plant.

42 ENGINEERING↗

Calibration and Validation of the SAIL Radar

Calibration of a weather radar is not a simple process, as is well described and documented in several articles (Chandrasekar, V, L Baldini, N Bharadwaj, and PL Smith. 2015. "Calibration procedures for global precipitation-measurement ground-validation radars." URSI Radio Science Bulletin 2015(355): 45–73, https://10.23919/URSIRSB.2015.7909473.). Direct hardware-based characterization is called calibration whereas indirect check with other sources such as disdrometer, or comparison with other radars or indirect means, is called validation. The validation process has its own measurement error and the comparison should fall within its limit. In the following we describe calibration and validation processes for the SAIL radar. Based on the comparison of calibration and validation, an addition of 2 dB is suggested for the SAIL radar observations, with a nuanced Z dr calibration correction, as presented. If a fixed Z dr calibration is preferred, a bias addition of 0.5 dB is suggested.

54 ENVIRONMENTAL SCIENCES↗

Dark Energy Survey: Modeling strategy for multiprobe cluster cosmology and validation for the Full Six-year Dataset

We introduce an updated To&Krause2021 model for joint analyses of cluster abundances and large-scale two-point correlations of weak lensing and galaxy and cluster clustering (termed CL+3x2pt analysis) and validate that this model meets the systematic accuracy requirements of analyses with the statistical precision of the final Dark Energy Survey (DES) Year 6 (Y6) dataset. The validation program consists of two distinct approaches, (1) identification of modeling and parameterization choices and impact studies using simulated analyses with each possible model misspecification (2) end-to-end validation using mock catalogs from customized Cardinal simulations that incorporate realistic galaxy populations and DES-Y6-specific galaxy and cluster selection and photometric redshift modeling, which are the key observational systematics. In combination, these validation tests indicate that the model presented here meets the accuracy requirements of DES-Y6 for CL+3x2pt based on a large list of tests for known systematics. In addition, we also validate that the model is sufficient for several other data combinations: the CL+GC subset of this data vector (excluding galaxy--galaxy lensing and cosmic shear two-point statistics) and the CL+3x2pt+BAO+SN (combination of CL+3x2pt with the previously published Y6 DES baryonic acoustic oscillation and Y5 supernovae data).

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Why Lady Godiva Should be Replaced as the Default Validation Experiment for U-235 Nuclear Data

For the past seven decades the Lady Godiva benchmark (HEU-MET-FAST-001) has been the primary experiment used for 235 U nuclear data validation. The papers associated with large nuclear data library releases such as ENDF/B-VII.1 and ENDF/B-VIII.0 refer to it frequently. The reasons why HEU-MET-FAST-001 has been used as the primary validation experiment for 235 U nuclear data validation will be discussed in the following section. However, as discussed among the benchmark community, the standards associated with International Criticality Safety Benchmark Evaluation Project (ICSBEP) evaluations have changed throughout time; this is subject of the OECD/NEA WPEC (Working Party on Nuclear Criticality Safety) Subgroup 8. HEU-MET-FAST-001 is an older benchmark (issued during the inaugural year of ICSBEP in 1996 with only minor revisions occurring since then) and (along with many of the other benchmarks from this era) does not meet the standards for a modern benchmark. This work explores why HEU-MET-FAST-001 is useful for 235 U nuclear data validation and discusses other alternative validation experiments.

07 ISOTOPE AND RADIATION SOURCES↗

Data Validation for Hosting Capacity Analyses

The usefulness of Hosting Capacity Analysis (HCA) is dependent on users' confidence that the results accurately reflect grid conditions. This report provides the findings and recommendations from research, conducted by The National Renewable Energy Lab (NREL) and The Interstate Renewable Energy Council (IREC), into HCA data validation best practices. The goal is to provide utilities, regulators, and stakeholders best practices for HCA data validation procedures so that future HCA deployments avoid uncertainties and potential mistakes from earlier rollouts and provide useful and accurate data from the day they are published. Utilities can use this report to develop or refine their HCA data validation procedures. Regulators can use the report to inform their oversight of utilities' HCA data validation practices, while stakeholders can use it to evaluate the effectiveness of utility efforts.

14 SOLAR ENERGY↗

Analysis of ZPPR-15 experimental data for VTR software validation

As part of the Versatile Test Reactor (VTR) program, extensive validation work is being performed to demonstrate the fidelity of the Argonne Reactor Code (ARC) software package presently used for the core design studies. It is anticipated that this software will be also used for initial operations although additional software may be introduced at a later time to supplement or replace some components. The validation work was focused on accumulating reactor models that are consistent with the VTR and thus can be used to validate the accuracy of predictions made by the software used to design and operate the VTR. The U.S. does not have any active experimental facilities that can neutronically mockup the VTR core design. However, in the past, the U.S. had extensive experimental facilities for fast reactor neutronics. In that regard, the ZPPR-15 experiments carried out at ANL during the 1980s work best because the fuel form is closest to the VTR design, there is a considerable amount of processed data available for use, and existing staff are already familiar with the experimental machine and measurements. Because of previous collaborative work, many of the ZPPR-15 loadings of interest have already been processed into MCNP and preliminary ARC models, and a full uncertainty quantification has already been completed for many of the ZPPR-15 measurements. This manuscript covers the recent analysis work on the ZPPR-15 experiments and compares it with the experimental results. With respect to the ARC software components, this manuscript focuses on validation of the MC 2 , DIF3D and GAMSOR using the ZPPR-15 experimental data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Verification and validation of the open-source plasma fluid code: Zapdos

Zapdos is an open-source finite element plasma fluid solver based on the MOOSE multiphysics framework. This paper outlines Zapdos verification, benchmarking, and validation efforts for 1D and 2D RF capacitively coupled plasma discharge models for mid-range pressures (0.1 - 1 Torr). The verification process involved using the method of manufactured solutions to assess Zapdos spatial and temporal error convergence. L2 errors ranged from 10 -2 to 10 -4 , while the convergence’s slope were in agreement with the predicted slopes for the tested variable and time integration orders. The benchmarking process involved comparisons to previously results from the validated finite element code, LSODI. These works included 1D and 2D simulations for a range of plasma parameters (densities, temperatures, voltage, etc.). For the 1D cases, Zapdos and LSODI results were in very good agreement. In the 2D cases, variable behaviors matched, with slight discrepancies in peak values. The validation process involved comparisons to experimental works including electron density measurements by microwave interferometry and metastable density measurements by planar laser-induced fluorescence imaging. Results shown reasonable agreement at higher pressure, with results starting to diverge at low pressures. Furthermore, probable causes for this diverges are the limitation of the fluid assumption for plasmas at low pressure, or the need for more robust boundary conditions. Overall, Zapdos shown reasonable results for the verification, benchmarking, and validation efforts, and Zapdos can be downloaded at https://github.com/shannon-lab/zapdos.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗