Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Software Verification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Verification and validation testing and tools: comparison between MCNP code versions and nuclear data libraries [Slides]

This presentation discusses the primary goal of software testing which is to test the code for correctness. It also discusses the results for individual suites and the role of validation and verification also referred to in the presentation as V&V. In summation, the V&V framework enables easy comparison between calculations performed with different code versions and/or nuclear data libraries. This entire framework will be distributed with the upcoming MCNP6.3 release. V&V test suites shown and several that were not (Criticality, LAQGSM, Lockwood) will be distributed in the new framework.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Verification of iterative matrix solutions for multipoint kinetics equations

Multipoint kinetic equation systems have been solved numerically using matrix algebra software and 1st to 4th order implicit schemes based on single-step matrix propagators. These matrix schemes have been validated successfully on demanding point kinetics benchmarks with various prescribed reactivity insertions. Verification tests have also been performed on a simple 3-region fast reactor core model with asymmetric step or ramp reactivity insertions and cross-checked with the multipoint kinetics SACRE code developed at INL and based on existing and validated stiff ODE solver packages. Accurate results can be obtained at a limited time expense. The reason for intriguing results obtained in some transients has been elucidated and linked to the multipoint matrix coefficient interpolation method during the transient.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

SU-E-T-465: Implementation of An Automated Collision Detection Program Using Open Source Software for the Pinnacle Treatment Planning System

Purpose: Potential collisions between the gantry head and the patient or table assembly are difficult to detect in most treatment planning systems. We have developed and implemented a novel software package for the representation of potential gantry collisions with the couch assembly at the time of treatment planning. Methods: Physical dimensions of the Varian Edge linear accelerator treatment head were measured and reproduced using the Visual Python display package. A script was developed for the Pinnacle treatment planning system to generate a file with the relevant couch, gantry, and isocenter positions for each beam in a planning trial. A python program was developed to parse the information from the TPS and produce a representative model of the couch/gantry system. Using the model and the Visual Python libraries, a rendering window is generated for each beam that allows the planner to evaluate the possibility of a collision. Results: Comparison against heuristic methods and direct verification on the machine validated the collision model generated by the software. Encounters of <1 cm between the gantry treatment head and table were visualized as collisions in our virtual model. Visual windows were created depicting the angle of collision for each beam, including the anticipated table coordinates. Visual rendering of a 6 arc trial with multiple couch positions was completed in under 1 minute, with network bandwidth being the primary bottleneck. Conclusion: The developed software allows for quick examination of possible collisions during the treatment planning process and helps to prevent major collisions prior to plan approval. The software can easily be implemented on future planning systems due to the versatility and platform independence of the Python programming language. Further integration of the software with the treatment planning system will allow the possibility of patient-gantry collision detection for a range of treatment machines.

60 APPLIED LIFE SCIENCES↗

MCNP Progress for the Nuclear Criticality Safety Program

The DOE/NNSA Nuclear Criticality Safety Program (NCSP) supports research, development, maintenance, and verification and validation of the MCNP{sup R} Monte Carlo radiation transport software package for nuclear criticality safety (NCS) customers within DOE/NNSA. The MCNP Monte Carlo code has been used for high-fidelity analyses of criticality safety problems since the 1970's. This paper summarizes MCNP progress during FY 2015 and early FY 2016. Activities and accomplishments are summarized in five major areas: - MCNP6 status, - Whisper status, - Verification and validation testing, - User support and training, - Work in progress. (authors)

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Reactor Subsystem Simulation for Nuclear Hybrid Energy Systems

Nuclear Hybrid Energy Systems (NHES) could be a key part of the solution to achieving energy security, may provide reliable power availability even with increasing renewable energy penetration into the power grid, and may allow repurposing excess electricity in times of low demand. Incorporating a fission-based power source in a multi-output system (electricity and process heat) can offer significant advantages over carbon-based production sources, such as coal or natural gas, including reduction in atmospheric carbon emissions. In an integrated multi-output system, thermal energy from the nuclear reactor subsystem can be diverted to industrial applications in times of low electricity demand. High temperature, high quality heat from advanced reactor designs might be used for hydrogen production or synthetic fuel production (coal-to-liquid or natural gas-to-liquid processes). Low temperature heat from advanced reactor designs or the current and future fleet of light water reactors (LWRs) might be applied to desalination processes or be stored for later use in low temperature ammonia or hydrocarbon-based thermal cycles. The NHES research team is currently developing a dynamic simulation of an integrated hybrid energy system. A detailed simulation of proposed NHES architectures will allow initial computational demonstration of a tightly coupled NHES to identify key reactor subsystem requirements, identify candidate reactor technologies for a hybrid system, and identify key challenges to operation of the coupled system. This work will provide a baseline for later coupling of design-specific reactor models through industry collaboration. The modeling capability addressed in this report focuses on the reactor subsystem simulation. Many computational tools and methods are available for modeling a nuclear reactor, power conversion systems and associated process applications. One method is to develop a single program capable of modeling the entire system. Another is to combine two or more existing computer programs, each modeling a portion of the system for which it is validated, where the programs exchange information to compute the solution. The former method requires a lengthy development and verification and validation process. The latter method leverages industry standard software to reduce development and funding requirements. Preliminary system models have been developed by Idaho National Laboratory researchers and are currently being enhanced to assess integrated system performance given multiple sources (e.g., nuclear + wind) and multiple applications (i.e., electricity + process heat). Initial efforts to integrate a Fortran-based simulation of a small modular reactor (SMR) with the balance of plant model have been completed in FY12. This initial effort takes advantage of an existing SMR model developed at North Carolina State University to provide initial integrated system simulation for a relatively low cost. The SMR subsystem simulation details are discussed in this report.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Advanced Test Reactor Core Modeling Update Project: Annual Report for Fiscal Year 2014

Legacy computational reactor physics software tools and protocols currently used for support of Advanced Test Reactor (ATR) core fuel management and safety assurance, and to some extent, experiment management, are inconsistent with the state of modern nuclear engineering practice, and are difficult, if not impossible, to verify and validate (V&V) according to modern standards. Furthermore, the legacy staff knowledge required for effective application of these tools and protocols from the 1960s and 1970s is rapidly being lost due to staff turnover and retirements. In late 2009, the Idaho National Laboratory (INL) initiated a focused effort, the ATR Core Modeling Update Project, to address this situation through the introduction of modern high-fidelity transport theory based computational software and models to replace the legacy methods, with appropriate verification and validation (V&V) protocols according to applicable national standards. The project has now completed its fifth, and last, full year of development activity, and has entered an accelerated deployment phase that is expected to run through 2015.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Airside HVAC BESTEST. Adaptation of ASHRAE RP 865 Airside HVAC Equipment Modeling Test Cases for ASHRAE Standard 140. Volume 1, Cases AE101-AE445

This report documents a set of diagnostic analytical verification cases for testing the ability of whole building simulation software to model the air distribution side of typical heating, ventilating and air conditioning (HVAC) equipment. These cases complement the unitary equipment cases included in American National Standards Institute (ANSI)/American Society of Heating, Refrigerating, and Air-Conditioning Engineers (ASHRAE) Standard 140, Standard Method of Test for the Evaluation of Building Energy Analysis Computer Programs, which test the ability to model the heat-transfer fluid side of HVAC equipment.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Verification and Regression Testing of a Physically Stabilized Layered Solid Element Formulation in DYNA3D/Paradyn

Recent modeling of filament-wound composite structures drove the need for a new element type within the finite element code DYNA3D/Paradyn. This new layered solid element was implemented and designed to capture the kinematics and constitutive be havior of various lamina layers defined with arbitrary orientations and volume fractions within the element to accurately model a laminated composite material. The new el ement uses a single integration point in each of the lamina layers defined to capture the constitutive behavior, and a novel physical stabilization routine is used to prevent hourglassing while mitigating shear and volumetric locking. This report documents the verification testing and the regression tests added to the DYNA3D/Paradyn software quality assurance test suite to assess the proper implementation of the new layered solid element. There were a total of 27 tests added the DYNA3D test suite, which consist of problems using the layered solid element with a single layer or multiple layers for isotropic and orthotropic material models. These tests are a combination of simple kinematically driven patch tests, beam bending tests, plate bending tests, and more complicated problems. Ultimately, the testing done verifies that the element behaves as expected and is implemented correctly.

42 ENGINEERING↗

Verification Testing of Body Forces due to a Prescribed Angular Velocity in DYNA3D/Paradyn

This report documents the verification testing and regression testing done on a new feature in DYNA3D/Paradyn, which allows users to prescribe body force loads based upon an angular velocity. This feature is unique in that the direction of the angular velocity vector follows the unit vector formed by two coordinate points associated with two nodes or the average coordinates of two separate small collection of nodes. The angular velocity direction will follow the directional vector defined by these nodes while the angular velocity magnitude is defined by a load curve. A simple single element verification test was performed to determine the correct implementation of this feature, and two separate regression tests were added to the DYNA3D Software Quality Assur ance test suite. The nodal positions, velocities, and accelerations from the solution of the single element verification test compare well to analytically derived values of those nodal quantities. The regression tests serve as good examples of this new feature’s use case and were consequently added to the SQA test suite to ensure that further modifications of the DYNA3D source code do not unintentionally change the generated baseline answers.

42 ENGINEERING↗

Validation of ORIGEN for VVER-440 Spent Fuel with Application to Fork Detector Safeguards Measurements

The US Department of Energy National Nuclear Security Administration and the European Atomic Energy Community (Euratom) are collaborating with the Radiation and Nuclear Safety Authority in Finland to assess spent fuel verification methods for potential application to measurements at the planned spent fuel encapsulation plant and geological repository prior to final disposal in Finland. The fork detector (FDET) used to measure the neutron and gamma radiation from a given spent fuel assembly is an existing technology widely used by the International Atomic Energy Agency (IAEA) and Euratom for the safeguards verification of spent fuel operator declaration. Recently, an FDET data analysis software, referred to as the ORIGEN module, was developed and incorporated into the IAEA/Euratom Integrated Review and Analysis Program. This module uses the ORIGEN burnup code to calculate the nuclide concentrations and the neutron and gamma source terms in the spent fuel based on operator declarations. Then, to predict the expected FDET signals for a given fuel assembly, the module combines the source terms calculated by ORIGEN with FDET response functions that were pre-generated using MCNP models. The inspector can compare the calculated signals to the measured values in real time to identify possible anomalies in fuel assembly’s operator declaration, integrity, or measurement. In this work, the capability of the ORIGEN module was extended from application to typical light water reactor fuels to use for VVER-440 assembly types. The accuracy of ORIGEN for this type of fuel assembly calculations was assessed by comparing calculated nuclide concentrations against destructive assay measurements for VVER-440 spent fuel. The performance of the ORIGEN module for FDET safeguards verification in routine inspections was assessed using FDET measurement data for 13 spent VVER-440 assemblies that were measured at the Loviisa Nuclear Power Plant in Finland, by comparing the calculated signals to the measured quantities. The results show that the calculated FDET neutron and gamma detector signals are generally within 12% of the measurements except for one assembly. Thus, these results are applicable to future safeguards verification in the planned Finland encapsulation plant, such as for passive neutron albedo reactivity safeguards measurements.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Network Architecture Verification & Validation Tool

The NAVV Tool is an automation of Linux commands run Zeek IDS software on a packet capture to create a Microsoft Excel spreadsheet table breaking down network traffic observed. The tool automates the Zeek software analysis, the collation of logs, and then the dissection of the Conn.log and DNS.logs to create a summary table within a Excel. This spreadsheet can then be updated with network segments using CIDR formatting and labels along with inventory information including name and IP address. Using the tool again will integrate these label and color coding into the existing analysis table to aid in conducting an evaluation of the network traffic.

Nichols, DonovanW↗

Verification of Floating Offshore Wind Linearization Functionality in OpenFAST

The wind engineering community relies on multiphysics engineering software to run nonlinear time-domain simulations, e.g., for design standards-based loads analysis. Although most physics involved in wind energy are nonlinear, linearization of the underlying nonlinear system equations is often advantageous to understand the system properties and exploit well-established methods and tools for analyzing linear systems. Previous work in this area has focused on the development of the new linearization functionality of the open-source engineering tool OpenFAST for floating offshore wind turbines, as well as the concepts and mathematical background needed to understand and apply it correctly. This paper focuses on the verification of this new linearization functionality, which is carried out by comparing results to previous stable versions of FAST. A nonlinear time-domain simulation for a floating offshore platform is also compared to the time-domain response of the linearized state-space model. The linearized results show good alignment between OpenFAST and previous versions of FAST, as well as with the time-domain simulations, thereby showing the accuracy of the new features in OpenFAST.

17 WIND ENERGY↗

Improvements to the New CTH Code Verification & Validation Test Suite (FY2020)

The CTH multiphysics hydrocode, which is used for a wide range of important calculations, has undertaken in recent years to overhaul its software quality and testing processes. A key part of this effort entailed building a new, robust V&V test suite made up of traditional hydrocode verification problems, such as those listed in the ASC Tri-Lab Test Suite and the Enhanced Tri-Lab Test Suite, as well as validation problems for some of CTHs most frequently used equations of state, materials models, and other key capabilities. Substantial progress towards this goal was made in FY19. In FY20, this test suite has been expanded to include verification and validation tests of the Sesame and JWL equation of state models as well as the Mader verification problem from the Tri-Lab Test Suite and the Blake verification problem - a linear elastic analog to the Hunter problem from the Enhanced Tri-Lab Test Suite. This report documents CTH performance on the new test suite problems. Verification test results are compared to analytic solutions and, for most tests, convergence results are presented. Validation test results are compared to experimental data and mesh refinement studies are included. CTH performs well overall on the new test problems. Convergence rates for the Blake and Mader problems are comparable to those for similar ASC codes. The JWL and Sesame verification tests show good agreement with analytic solutions. Likewise, CTH simulation results show good agreement with experimental validation data for the Sesame and JWL equations of state for the materials tested. Future V&V work will focus on adding tests for other key capabilities like fracture and high explosive models.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Independent calculation-based verification of IMRT plans using a 3D dose-calculation engine

Independent monitor unit verification of intensity-modulated radiation therapy (IMRT) plans requires detailed 3-dimensional (3D) dose verification. The aim of this study was to investigate using a 3D dose engine in a second commercial treatment planning system (TPS) for this task, facilitated by in-house software. Our department has XiO and Pinnacle TPSs, both with IMRT planning capability and modeled for an Elekta-Synergy 6 MV photon beam. These systems allow the transfer of computed tomography (CT) data and RT structures between them but do not allow IMRT plans to be transferred. To provide this connectivity, an in-house computer programme was developed to convert radiation therapy prescription (RTP) files as generated by many planning systems into either XiO or Pinnacle IMRT file formats. Utilization of the technique and software was assessed by transferring 14 IMRT plans from XiO and Pinnacle onto the other system and performing 3D dose verification. The accuracy of the conversion process was checked by comparing the 3D dose matrices and dose volume histograms (DVHs) of structures for the recalculated plan on the same system. The developed software successfully transferred IMRT plans generated by 1 planning system into the other. Comparison of planning target volume (TV) DVHs for the original and recalculated plans showed good agreement; a maximum difference of 2% in mean dose, − 2.5% in D95, and 2.9% in V95 was observed. Similarly, a DVH comparison of organs at risk showed a maximum difference of +7.7% between the original and recalculated plans for structures in both high- and medium-dose regions. However, for structures in low-dose regions (less than 15% of prescription dose) a difference in mean dose up to +21.1% was observed between XiO and Pinnacle calculations. A dose matrix comparison of original and recalculated plans in XiO and Pinnacle TPSs was performed using gamma analysis with 3%/3 mm criteria. The mean and standard deviation of pixels passing gamma tolerance for XiO-generated IMRT plans was 96.1 ± 1.3, 96.6 ± 1.2, and 96.0 ± 1.5 in axial, coronal, and sagittal planes respectively. Corresponding results for Pinnacle-generated IMRT plans were 97.1 ± 1.5, 96.4 ± 1.2, and 96.5 ± 1.3 in axial, coronal, and sagittal planes respectively.

61 RADIATION PROTECTION AND DOSIMETRY↗

Verification and Large Deformation Analysis Using the Reproducing Kernel Particle Method

The reproducing kernel particle method (RKPM) is a meshless method used to solve general boundary value problems using the principle of virtual work. RKPM corrects the kernel approximation by introducing reproducing conditions which force the method to be complete to arbritrary order polynomials selected by the user. Effort in recent years has led to the implementation of RKPM within the Sierra/SM physics software framework. The purpose of this report is to investigate convergence of RKPM for verification and validation purposes as well as to demonstrate the large deformation capability of RKPM in problems where the finite element method is known to experience difficulty. Results from analyses using RKPM are compared against finite element analysis. A host of issues associated with RKPM are identified and a number of potential improvements are discussed for future work.

97 MATHEMATICS AND COMPUTING↗

BISON: A Flexible Code for Advanced Simulation of the Performance of Multiple Nuclear Fuel Forms

BISON is a nuclear fuel performance application built using the Multiphysics Object-Oriented Simulation Environment (MOOSE) finite element library. One of its major goals is to have a great amount of flexibility in how it is used, including in the types of fuel it can analyze, the geometry of the fuel being modeled, the modeling approach employed, and the dimensionality and size of the models. Fuel forms that can be modeled include standard light water reactor fuel, emerging light water reactor fuels, tri-structural isotropic fuel particles, and metallic fuels. BISON is a platform for research in nuclear fuel performance modeling while simultaneously serving as a tool for the analysis of nuclear fuel designs. Recent research in BISON includes techniques such as the extended finite element method for fuel cracking, exploration of high-burnup light water reactor fuel behavior, swelling behavior of metallic fuels, and central void formation in mixed-oxide fuel. BISON includes integrated documentation for each of its capabilities, follows rigorous software quality assurance procedures, and has a growing set of rigorous verification and validation tests.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

High-Fidelity Numerical Investigation on Elucidating Sodium Heat Transfer Characteristics for 37-Pin Wire-Wrapped Fuel Bundle in the PLANDTL Facility

This study involved a Reynolds-averaged Navier-Stokes- (RANS-) based computational fluid dynamics (CFD) analysis of the 37-pin wire-wrapped fuel bundle of the PNC Plant dynamics test loop (PLANDTL) facility. Previously, mainly the hydrodynamic phenomena of the wire-wrapped fuel bundle were analyzed, but the present study additionally included heat transfer analysis through conjugate heat transfer. The main purpose of the study was to benchmark the experimental data of the PLANDTL 37-pin wire-wrapped fuel bundle to investigate the heat transfer phenomena. In addition, the aim was to verify the accuracy of the RANS-based CFD analysis method using the STAR-CCM+ simulation software in comparison with the experimental data. The grid used for verification was an innovative grid system consisting of hexahedra using Fortran-based code. The development of the RANS-based CFD methodology included grid sensitivity analysis, turbulence model sensitivity analysis, and turbulent Prandtl number sensitivity analysis. Information on the temperature, mass flow rate, and area of the CFD results for each subchannel was provided for the top of the heated section and is expected to serve as a reference for future studies aiming to perform the validation and verification of a PLANDTL facility. In addition, the dependence of the peak temperature on the azimuth angle of each pin was analyzed.

97 MATHEMATICS AND COMPUTING↗

PRAQTICE

PRAQTICE (Python Repository for Advanced QCVV Tutorials and Interesting Characterization Experiments) is a software package containing advanced demonstrations of the implementation of quantum characterization, verification and validation protocols.

Ostrove, Corey [Sandia National Lab. (SNL-NM), Alb↗