Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “V&V Test Suites”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Improved Verification and Validation Testing and Tools [Slides]

All MCNP team supported V&V test suites are now developed in a separate repository from the MCNP source code within a Python-based framework. This entire framework will be distributed with the upcoming MCNP6.3 release. Most V&V test suites distributed with MCNP6.2 will be distributed in new framework. New V&V test suites are done or being worked on for the MCNP6.3 release.

97 MATHEMATICS AND COMPUTING↗

Improved Verification and Validation Testing and Tools including Nuclear Criticality Safety Applications with the MCNP6.3® Code [Abstract]

A new Python-based framework has been developed to enable a more consistent layout with automatable setup, execution, and documentation of all verification and validation (V&V) test suites previously established for use with the MCNP code. In this paper, the new general framework for the V&V test suites is discussed, including information on all of the current capabilities and plans for future capabilities. For nuclear criticality safety applications, the existing V&V benchmark problems within the criticality, extended criticality, and analytic k-effective test suites have been ported into this new framework. In addition, the status and updates to the Rossi-alpha and subcritical multiplicationtest suites will be discussed. Some V&V results exercising new MCNP6.3 capabilities will be demonstrated.

97 MATHEMATICS AND COMPUTING↗

Verification and validation testing and tools: comparison between MCNP code versions and nuclear data libraries [Slides]

This presentation discusses the primary goal of software testing which is to test the code for correctness. It also discusses the results for individual suites and the role of validation and verification also referred to in the presentation as V&V. In summation, the V&V framework enables easy comparison between calculations performed with different code versions and/or nuclear data libraries. This entire framework will be distributed with the upcoming MCNP6.3 release. V&V test suites shown and several that were not (Criticality, LAQGSM, Lockwood) will be distributed in the new framework.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

FY2021 Improvements to the New CTH Code Verification & Validation Test Suite

Over the past few years, the CTH multiphysics hydrocode has overhauled its software quality and testing processes, implementing current best practices in software quality and building a robust V&V test suite comprised of traditional hydrocode verification problems, including ASC Tri-Lab Test Suite and Enhanced Tri-Lab Test Suite problems, as well as validation problems for some of CTH’s most frequently used equations of state, materials models, and other key capabilities. Substantial progress towards building this new test suite was made in FY19 and FY20. In FY21, the test suite has been expanded to include verification and validation tests of the Steinberg-Guinan-Lund (ST) viscoplastic model and the Johnson Cook (JFRAC) fracture model. Additionally, two new verification tests were added, covering hydrodynamics and high explosive (HE) modeling capabilities: the Kidder Gaussian density problem and the Escape of HE Products (EHEP) problem from the Tri-Lab Test Suite. This report discusses each of these test problems in detail. Verification test results are compared to analytic solutions. Validation test results are compared to experimental data. Wherever possible, convergence or mesh refinement studies are included. Additionally, while implementing the Kidder verification problem, a bug was identified that affects the use of tables to initialize pressure or density in 1D or 2D calculations. A brief discussion of the bug and its fix is included. CTH demonstrates good performance overall on the new test suite problems. Simulation results showed good agreement with analytic solutions for the Kidder problem, with convergence rates ranging between 1.8 and sub-linear, and relatively good agreement for the EHEP problem, though convergence rates for pressure and density were nearly 0. The ST and JFRAC strain rate loading verification tests show good agreement with analytic solutions. Likewise, CTH simulation results show good agreement with experimental validation data, including Taylor rod impact testing, for the materials tested. Future V&V work will focus on adding 2D and 3D versions of existing verification tests as well as adding validation tests of other frequently used capabilities such as other fracture models.

42 ENGINEERING↗

Qualification of System-Level Advanced Reactor Safety Analysis Software for Lead Systems: Final CRADA Report

SAS4A/SASSYS-1 is a simulation tool used to perform deterministic analysis of anticipated events as well as design basis and beyond design basis accidents for advanced liquid-metal-cooled nuclear reactors. With its origin as SAS1A in the late 1960s, the SAS series of codes has been under continuous use and development for over forty-five years and represents a critical investment in safety analysis capabilities for the U.S. Department of Energy. Although SAS4A/SASSYS-1 was developed to support the analysis of any liquid-metal-cooled nuclear reactor, it has primarily been utilized to design and analyze Sodium Fast Reactors (SFRs). As a result, most of the qualification basis for SAS4A/SASSYS-1 has utilized sodium as a coolant and geometry descriptions that are prototypic of SFR configurations. In this project, which partnered with Westinghouse Electric Company, LLC, the initial foundation for a qualification basis centered on prototypic pool-type lead-cooled systems has been established, where the end goal is to extend support for utilization of SAS4A/SASSYS-1 in Lead Fast Reactor (LFR) licensing or authorization. This project included three fundamental technical tasks: LFR V&V test suite development (Task 1); qualification support for LFRs (Task 2); and LFR modeling capabilities evaluation and improvement (Task 3)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Verification and Validation of the Stakeholder Tool for Assessing Radioactive Transportation (START) – 22323

The U.S. Department of Energy (DOE) Office of Integrated Waste Management is planning for the eventual transportation, storage, and disposal of spent nuclear fuel (SNF) and high-level radioactive waste (HLW) from nuclear power plant and DOE sites. The Stakeholder Tool for Assessing Radioactive Transportation (START) is a web-based, geospatial decision-support tool developed for evaluating routing options and other aspects of transporting SNF and HLW, covering rail, truck, barge, and intermodal infrastructure and operations in the continental United States. The verification and validation (V&V) process is intended to independently assess START to provide confidence in the ability of START to accurately provide intended results. The V&V process checks the START tool using a variety of methods, ranging from independent hand calculations to comparison of START performance and results to those of other codes. The V&V activity was conducted independently from the START development team with opportunities to provide feedback and collaborate throughout the process. The V&V analyzed attributes of transportation routes produced by START, including route distance and both population and population density captured within buffer zones around routes. Population in the buffer zone, population density in the buffer zone, and route distance were all identified as crucial outputs of the START code and were subject to V&V tasks. Some of the improvements identified through the V&V process were standardizing the underlying population data in START, changing the projection of the population raster data, and changes to the methodology used for population density to improve its applicability for expected users. This collaboration also led to suggested improvements to some of the underlying shape file segments within START. A formal series of test routes went through the V&V process from START version 3.2.1 following the implementation of the recommended improvements to START. The V&V of the buffer zone population and distance reported in START were achieved by utilizing a custom workflow developed in QGIS. This platform was chosen because it is fully independent of START. The buffer zone population and route distances in START showed excellent agreement to independent V&V test results. Over 200 route test cases were run; in all cases, the percent difference in the population within the buffer zone was less than +/- 5%, and the majority of cases were below +/- 1%. These cases were also duplicated in ArcMap, which is Environmental Systems Research Institute’s (ESRI) GIS desktop application. The ArcMap results also show good agreement; however, they cannot be considered independent of START because START also uses ESRI software. The V&V tasks are currently addressing population density and estimated radiation dose in START as well as implementing further automation of the V&V process to allow larger suites of test routes to be run more easily and quickly by less experienced GIS users. These improvements to the V&V process will make it a valuable tool for the development team and the stakeholders so that each new iteration of START can easily be checked for quality and consistency. This paper and presentation will describe the V&V process, findings and implications, and ongoing V&V activities.

START, DOE, Transporation, dose, GIS↗

MCNP6 Developments: A 2022-23 Year in Review [Slides]

A separate MCNP6.3 V&V document reports on all the default calculations for all test suites is touched on. This report does not include the subcritical multiplication benchmark suite. After some additional clean-up and finalizing the post-processing and documentation steps, the subcritical multiplication benchmark suite will be released in the next version of our vnvstats repository. We tested the new HDF5 PTRAC feature in MCNP6.3 and found encouraging outcomes. Identical results coming out of the simulation with respect to the legacy PTRAC results. The overall runtime for all simulations is reduced by ~20% with the new HDF5 PTRAC capability. We consider giving the new HDF5 PTRAC features a try and using it for all subcritical multiplication and any other relevant (PTRAC) calculations.

97 MATHEMATICS AND COMPUTING↗

Validation of New MCNP6.3 Features for Critical and Subcritical Benchmark Simulations [Slides]

A separate MCNP6.3 V&V document reports on all the default calculations for all test suites was introduced. Here, we look at new optional features of the MCNP6.3 code. Then, Fission-matrix-based options with Convergence and population testing and Automated acceleration of the fission source and Doppler Broadening Resonance Correction and HDF5 Particle Track Output (PTRAC) and Validation benchmarks: criticality, Rossi-α, and subcritical multiplication. All the new MCNP6.3 options give statistically equivalent results and should be considered for default usage in criticality and subcritical multiplication calculation work. Discussed are two separate papers at the upcoming 2023 International Conference on Nuclear Criticality Safety (ICNC 2023) that give more details on the results presented here.

97 MATHEMATICS AND COMPUTING↗

Verification and Validation of the New MCNP6.3 Criticality Features [Slides]

This presentation touches on a separate MCNP6.3 V&V document reports on all the default calculations for all test suites. Here, we look at new optional features of the MCNP6.3 code with Fission-matrix-based options, Convergence and population testing, and Automated acceleration of the fission source additionally Doppler Broadening Resonance Correction. Also touched on are validation benchmarks: criticality, crit_expanded, and Rossi-α. All the new MCNP6.3 options give statistically equivalent results and either provide a reduction or no change in computational cost. We consider giving these new features a try and using them for all criticality calculations.

97 MATHEMATICS AND COMPUTING↗

Verification and Performance Impact of the New Parallel MCNP6.3 Particle Track Output Capability for Subcritical Multiplication Simulations [Slides]

A separate MCNP6.3 V&V document reports on all the default calculations for all test suites. This report does not include the subcritical multiplication benchmark suite. After some additional clean-up and finalizing the post-processing and documentation steps, the subcritical multiplication benchmark suite will be released in the next version of our vnvstats repository. We tested the new HDF5 PTRAC feature in MCNP6.3 and found encouraging outcomes. Identical results coming out of the simulation with respect to the legacy PTRAC results. The overall runtime for all simulations is reduced by ~20% with the new HDF5 PTRAC capability. We consider giving the new HDF5 PTRAC features a try and using it for all subcritical multiplication and any other relevant (PTRAC) calculations.

97 MATHEMATICS AND COMPUTING↗

Sierra/Aria Verification Manual (V. 5.22)

Presented in this document is a portion of the tests that exist in the Sierra Thermal/Fluids verification test suite. Each of these tests is run nightly with the Sierra/TF code suite and the results of the test checked under mesh refinement against the correct analytic result. For each of the tests presented in this document the test setup, derivation of the analytic solution, and comparison of the code results to the analytic solution is provided.

97 MATHEMATICS AND COMPUTING↗

Three-dimensional diagnostics and measurements of inertial confinement fusion plasmas

Recent inertial confinement fusion measurements have highlighted the importance of 3D asymmetry effects on implosion performance. One prominent example is the bulk drift velocity of the deuterium–tritium plasma undergoing fusion (“hotspot”), v HS . Upgrades to the National Ignition Facility neutron time-of-flight diagnostics now provide v HS to better than 1 part in 10 4 and enable cross correlations with other measurements. Here we present the impact of v HS on the neutron yield, downscatter ratio, apparent ion temperature, electron temperature, and 2D x-ray emission. The necessary improvements to diagnostic suites to take these measurements are also detailed. The benefits of using cross-diagnostic analysis to test hotspot models and theory are discussed, and cross-shot trends are shown.

47 OTHER INSTRUMENTATION↗

symfind : Addressing the Fragility of Subhalo Finders and Revealing the Durability of Subhalos

Abstract A major question in ΛCDM is what this theory actually predicts for the properties of subhalo populations. Subhalos are difficult to accurately simulate and to find within simulations, and this propagates into uncertainty in theoretical predictions for satellite galaxies. We present Symfind , a new particle-tracking-based subhalo finder, and demonstrate that it can track subhalos to orders-of-magnitude lower masses than commonly used halo-finding tools, with a focus on Rockstar and consistent-trees . These longer survival times mean that at a fixed peak subhalo mass, we find ≈ 15%–40% more subhalos within the virial radius, R vir , and ≈35%–120% more subhalos within R vir /4 in the Symphony dark-matter-only simulation suite. More subhalos are found as the resolution is increased, in contrast to the Rockstar halo finder, which appears to be converged at smaller subhalo counts. We perform extensive numerical testing. In agreement with idealized simulations, we show that the v max , the maximum circular velocity, is systematically biased low until high resolutions ( n peak ≳ 3 × 10 4 ) are achieved, but that mass loss itself can be resolved at much more modest resolutions ( n peak ≳ 4 × 10 3 ). We show that Rockstar converges to false solutions for the mass function, radial distribution, and disruption masses of subhalos. We argue that our new method can trace resolved subhalos until the point of typical galaxy disruption without invoking post hoc orphan modeling. We outline a concrete set of steps for determining whether other subhalo finders meet the same criteria. We publicly release Symfind catalogs and particle data for the Symphony simulation suite at http://web.stanford.edu/group/gfc/symphony .

79 ASTRONOMY AND ASTROPHYSICS↗

FAST-1.2 User Installation and Verification Guide: Developed Under NQA-1-2017

The purpose of this document is to provide the user information about the installation of Fuel Analysis for Steady state and Transient (FAST)-1.2 on their computers or servers. General information about the code and supported operating systems is described in Section 1.0. Self-service oriented FAST-1.2 software licensing steps are described in Section 2.0. An installation verification test suite is provided with FAST-1.2 and described in Section 3.0. A convenience script for converting Fuel Rod Analysis Program – Constant (FRAPCON) to FAST inputs is discussed in Section 4.0. FAST-1.2 was developed and released under a software quality assurance program based upon NQA-1-2017 at Pacific Northwest National Laboratory (PNNL). FAST-1.2 is the latest baseline code. The installation verification test suite contains both steady state and transient Anticipated Operation Occurrences (AOOs), accident conditions, such as Reactivity Initiated Accidents (RIAs) and Loss of Coolant Accidents (LOCAs).

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Combining genome-wide association studies and expression quantitative trait nucleotide mapping with molecular and genetic validations to identify transcriptional networks regulating drought tolerance in Populus

Objectives: (i). To deploy a large-scale experimental drought trial for up to 1000 unique genotypes of Populus equipping the sites with controlled irrigation and drought treatments that are fully automated and monitored. FULLY COMPLETED (ii) To test the hypothesis that a suite of traits identified for drought tolerance in P. nigra can be measured in drought and control treatments in the wide germplasm collection of P. trichocarpa. FULLY COMPLETED (iii) To use established and novel GWAS model approaches to identify gene loci linked to drought tolerance traits on interest in P. trichocarpa. FULLY COMPLETED (iv) To undertake comparative analysis of GWAS results for drought tolerance traits in P. nigra and P. trichocarpa. PARTIALLY COMPLETED – remains active (v) Using RNAseq in P. trichocarpa, in droughted and control treatments to identify cis- and trans-regulated eQTN. FULLY COMPLETED (vi) Validate up to 50 cis-QTNs, from network hubs using transient protoplast assays. FULLY COMPLETED (vii) To establish Agrobacterium-based gene editing protocols in Populus. FULLY COMPLETED (viii) To utilize early leads from previous research to investigate at least 6 candidate genes for drought tolerance in Populus. FULLY COMPLETED (ix) To validate up to 20 candidate genes for drought tolerance in P. trichocarpa refined from the long-list tested in the transient assays for cis-acting hub gene targets. PARTIALLY COMPLETED- remains active.

60 APPLIED LIFE SCIENCES↗

Multiscale Characterization of Photovoltaic Modules—Case Studies of Contact and Interconnect Degradation

The current popularity of photovoltaic (PV) systems is due in large part to their exceptional reliability and significantly lower cost than other energy sources. Studying cell and module degradation is key to promote further development in the state of the art. Fielded or accelerated aged modules exhibit different failure modes, of which metallization degradation (contacts and interconnections) is prevalent. In this work, we discuss how multiscale characterization methods can be applied to a variety of module technologies that have been field exposed and have undergone accelerated age testing. These methods include performing characterization on the module level, cell level, and finally the materials level. The observed performance losses from the module- and cell-level characterization can be correlated with materials properties to find out the root cause of degradation. We recommend an initial nondestructive characterization suite, including module- and cell-level current-voltage ( I--V ), Suns-V OC , photoluminescence and electroluminescence imaging, quantum efficiency, ultraviolet fluorescence imaging, and thermal infrared imaging. Samples are then extracted from particularly degraded regions of the module and prepared for materials characterization techniques, such as top-down and cross-sectional scanning electron microscopy, energy-dispersive X-ray spectroscopy, X-ray photoelectron spectroscopy, secondary ion mass spectrometry, Raman spectroscopy, and transmission electron microscopy, allowing a deeper look into the mechanism behind the metallization degradation. This article serves as an instructional review to introduce the different multiscale characterization methods and how they can be effectively applied to perform PV degradation studies. Furthermore, we also share some of our examples and discuss the strengths, limitations, and best practices for each of the characterization techniques.

14 SOLAR ENERGY↗

FAST-1.0.1 User Installation and Verification Guide

The purpose of this document is to provide the user information about the installation of FAST-1.0.1 on their computers or servers. General information about the code and supported operating systems is described in Section 1.0.1. Self-service oriented FAST-1.0.1 software licensing steps are described in Section 2.0. An installation verification test suite is provided with FAST-1.0.1 and described in Section 3.0. A convenience script for converting FRAPCON to FAST inputs is discussed in Section 4.0. FAST-1.0.1 was developed and released under a software quality assurance program based upon NQA-1-2017. FAST-1.0.1 is the latest baseline code and the result of a bug fixes to FAST-1.0 with other software and methodology developments. The installation verification test suite contains both steady state and transient Anticipated Operation Occurrences (AOOs). Capability to model accident conditions, such as Reactivity Initiated Accidents (RIAs) and Loss Of Coolant Accidents (LOCAs), are targeted for a later release of FAST. FRAPTRAN-2.0 will continue to be used for accident conditions until the release of FAST with accident condition modeling capabilities.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Testbed and Experiments for Quantum-Conventional Networking

The realization of quantum networks requires the development of devices and methods unprecedented in conventional networks, and yet they critically depend on the latter for implementing foundational blocks and essential operations. We describe a testbed to support the development and testing of their functionality and performance by providing quantum and conventional data planes and devices, together with a secure conventional control plane. It incorporates a variety of entangled photon sources, qubit technologies, detector technologies, photonic components, and supporting conventional switches and workstations. It implements a novel fiber telescoping scheme that provides suites of connections using fiber spools and inground-aerial fiber loops. We briefly summarize a variety of experiments conducted over this testbed including: (i) flex-grid quantum connection experiments, (ii) quantum state and channel tomography, (iii) utilization of quantum key distribution keys to secure conventional encryption and firewall devices, (iv) comparative study of analytical capacity estimates and entanglement throughput, (v) deployed squeezing coexisting with conventional communications, and (iv) measurement of polarization time variation.

Rao, Nageswara [ORNL] (ORCID:0000000234085941)↗