Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “verification & validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49

Planar Richtmyer-Meshkov instabilities and transition to turbulence

Extensive recent work has demonstrated that predictive under-resolved simulations of the velocity fields in turbulent flows are possible without resorting to explicit subgrid models. When using a class of physics-capturing high-resolution finite-volume numerical algorithms. This strategy is denoted implicit large eddy simulation (ILES, MILES). The performance of ILES in the substantially more difficult problem of under-resolved material mixing driven by under-resolved velocity fields and initial conditions (ICs) is a focus of the present work. Progress is presented in analyzing the effects of IC combined spectral content and thickness parametrizations. In the large eddy simulation (LES). the large energy containing structures are resolved, the smaller, presumably more isotropic, structures are filtered out, and effects of subgrid scales (SGS) are modeled. ILES effectively addresses the seemingly insurmountable issues posed to LES by under-resolution. by relying on the use of SGS modeling and filtering provided implicitly by a class of physics capturing numerics; extensive verification and validation in areas of engineering. geophysics. and astrophysics has been reported. In many areas of interest such as. inertial confinement fusion. understanding the collapse of the outer cores of supernovas. and supersonic combustion engines, vorticity is introduced at material interfaces by the impulsive loading of shock waves. and turbulence is generated via Richtmyer-Meshkov instabilities (RMI). Given that ILES is based on locally-adaptive, non-oscillatory. finite-volume methods it is naturally suited to emulate shock physics. The unique combination of shock and turbulence emulation capabilities supports direct use of ILES as an effective simulation anzatz for RMI. Here, we further test this approach using a particular strategy based on a nominally-inviscid, Schmidt number {approx} 1, simulation model that uses the LANL RAGE code to investigate planar RMI. Issues of initial material interface characterization and modeling difficulties, and effects of IC resolved spectral content on transitional and late-time turbulent mixing were examined in our previous work. The focus here is to carry out a systematic analysis of effects of combined IC spectral content and thickness.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Development and Assessment of CTF for Pin-resolved BWR Modeling

CTF is the modernized and improved version of the subchannel code, COBRA-TF. It has been adopted by the Consortium for Advanced Simulation for Light Water Reactors (CASL) for subchannel analysis applications and thermal hydraulic feedback calculations in the Virtual Environment for Reactor Applications Core Simulator (VERA-CS). CTF is now jointly developed by Oak Ridge National Laboratory and North Carolina State University. Until now, CTF has been used for pressurized water reactor modeling and simulation in CASL, but in the future it will be extended to boiling water reactor designs. This required development activities to integrate the code into the VERA-CS workflow and to make it more ecient for full-core, pin resolved simulations. Additionally, there is a significant emphasis on producing high quality tools that follow a regimented software quality assurance plan in CASL. Part of this plan involves performing validation and verification assessments on the code that are easily repeatable and tied to specific code versions. This work has resulted in the CTF validation and verification matrix being expanded to include several two-phase flow experiments, including the General Electric 3 3 facility and the BWR Full-Size Fine Mesh Bundle Tests (BFBT). Comparisons with both experimental databases is reasonable, but the BFBT analysis reveals a tendency of CTF to overpredict void, especially in the slug flow regime. The execution of these tests is fully automated, analysis is documented in the CTF Validation and Verification manual, and the tests have become part of CASL continuous regression testing system. This paper will summarize these recent developments and some of the two-phase assessments that have been performed on CTF.

Salko, Robert K↗

VARS Framework

The Verification and Validation Assuring Reliability and Security (VARS) project team has developed the proof-of-concept VARS framework which will be implemented in the form of a software tool called Risk-Informed Verification and Validation Recommendation (RIVVR). The framework will provide Energy Delivery System (EDS) stakeholders with cybersecurity focused verification and validation (V&V) approach which includes list of potentially relevant vulnerabilities to test or address, pre-procurement guidance, and separate lists of relevant standards, tools, and techniques (ST2) to be considered by utilities and vendors

Pal, Seemita↗

Verification issues for rule-based expert systems

Verification and validation of expert systems is very important for the future success of this technology. Software will never be used in non-trivial applications unless the program developers can assure both users and managers that the software is reliable and generally free from error. Therefore, verification and validation of expert systems must be done. The primary hindrance to effective verification and validation is the use of methodologies which do not produce testable requirements. An extension of the flight technique panels used in previous NASA programs should provide both documented requirements and very high levels of verification for expert systems.

Culbert, Chris↗

Optimizing IV and V for Mature Organizations

NASA is intending for its future software development agencies to have at least a Level 3 rating in the Carnegie Mellon University Capability Maturity Model (CMM). The CMM has built-in Verification and Validation (V&V) processes that support higher software quality. Independent Verification and Validation (IV&V) of software developed by mature agencies can be therefore more effective than for software developed by less mature organizations. How is Independent V&V different with respect to the maturity of an organization? Knowing a priori the maturity of an organization's processes, how can IV&V planners better identify areas of need choose IV&V activities, etc? The objective of this research is to provide a complementary set of guidelines and criteria to assist the planning of IV&V activities on a project using a priori knowledge of the measurable levels of maturity of the organization developing the software.

Fuhman, Christopher↗

Development of MELCOR 2.1 Guidance Report for LPF Applications

A complex nuclear facility includes several pathways that can transport accidentally released materials throughout the facility and potentially to the exterior environment. To model and estimate material transport and possible release as a source term from a U.S. Department of Energy (DOE) nuclear facility requires proficiency in applying simulation tools, such as the MELCOR code. DOE has designated MELCOR version 1.8.5, an obsolete version, as a DOE Tool Box code in its Central Registry. A leak path factor (LPF) guidance report written in 2004 did not include experimental validation data. Using an obsolete version of MELCOR requires additional verification and validations, which may be cost prohibitive. Without any developer support and lack of experimental data validation, it is difficult to justify to regulators that the calculated source term with the obsolete version of MELCOR from the facility is accurate and defensible. The goal of this work is to replace the obsolete guidance report with MELCOR 2.1 with experimental validations. In this paper, we will present our approach to develop a MELCOR 2.1 guidance report for LPF applications. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Credible Computations: Standard and Uncertainty

The discipline of computational fluid dynamics (CFD) is at a crossroad. Most of the significant advances related to computational methods have taken place. The emphasis is now shifting from methods to results. Significant efforts are made in applying CFD to solve design problems. The value of CFD results in design depends on the credibility of computed results for the intended use. The process of establishing credibility requires a standard so that there is a consistency and uniformity in this process and in the interpretation of its outcome. The key element for establishing the credibility is the quantification of uncertainty. This paper presents salient features of a proposed standard and a procedure for determining the uncertainty. A customer of CFD products - computer codes and computed results - expects the following: A computer code in terms of its logic, numerics, and fluid dynamics and the results generated by this code are in compliance with specified requirements. This expectation is fulfilling by verification and validation of these requirements. The verification process assesses whether the problem is solved correctly and the validation process determines whether the right problem is solved. Standards for these processes are recommended. There is always some uncertainty, even if one uses validated models and verified computed results. The value of this uncertainty is important in the design process. This value is obtained by conducting a sensitivity-uncertainty analysis. Sensitivity analysis is generally defined as the procedure for determining the sensitivities of output parameters to input parameters. This analysis is a necessary step in the uncertainty analysis, and the results of this analysis highlight which computed quantities and integrated quantities in computations need to be determined accurately and which quantities do not require such attention. Uncertainty analysis is generally defined as the analysis of the effect of the uncertainties involved in all stages of a process on the final responses. There are two approaches for conducting the uncertainty analysis: experimental and computational. These analyses and approaches are briefly described.

Mehta, Unmeel B.↗

ARC Software Validation Work for the FFTF Reactor

Extensive efforts have been carried out at ANL for the verification and validation of the Argonne Reactor Codes (ARC) software package currently used for the design of Versatile Test Reactor (VTR). The ARC software package consists of steady state neutronics and thermal hydraulics modeling capabilities which are being used by the VTR program to develop most of the VTR reactor design details which will be part of the licensing application. It is anticipated that this software will continue to be used for the design work and for initial operations although additional software may be introduced at a later time. The validation work was focused primarily on obtaining validation data consistent with VTR and usable for the ARC software. Because no critical facilities or operating fast spectrum reactors are available to do experiments for the VTR, the next best option is to identify historical experimental data that can be used as validation data. Early on in VTR, the ZPPR-15 set of experiments was identified as good validation data because of 1) the availability and quality of the data, 2) existing staff that are already familiar with the experimental machine and measurements, 3) most of the ZPPR-15 loadings of interest have already been processed into ARC models, and 4) a full uncertainty quantification has already been done for several loadings of ZPPR-15. The FFTF startup and operations data was identified as the most consistent reactor type that has validation data usable for VTR. Finally, the EBR-II fuel depletion measurements were identified as the best available validation data for VTR. It is important to note that both the FFTF and EBR-II reactors typically come with higher uncertainties than the ZPPR. In the frame of the discussed verification and validation efforts, the present document discusses the analysis of selected FFTF measurements included in the benchmark specifications of the International Reactor Physics Experiment (IRPhE) handbook. The FFTF reactor core configurations from the benchmark specification are presented in Section 2. The analysis is performed with the use of the ARC code suite available at ANL for fast reactor studies and is discussed in Section 3. The reactor parameters from the benchmark include criticality, neutron spectra, effective delayed neutron spectra, control rod worth, isothermal temperature coefficient and low energy gamma-ray spectra. The calculated values and the comparison with the experimental data is discussed in Sections 4 to 9 for each considered reactor parameter. Finally, conclusions are presented in Section 10.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Modeling and Simulation Credibility Assessment of Finite Element Models for Fall From Heights Injury Scenarios

Finite element (FE) computational models of the whole human body are being used to investigate the injury modalities and mechanisms arising from suited astronauts’ ExtraVehicular Activities (EVAs). These FE whole body models – simplified Elemance and THUMS pedestrian versions – have undergone a series of verification and validation (V&V) assessments for applications in automotive, domestic, and contact sports arenas. However, the FE models’ Modeling and Simulation (M&S) credibility assessments for simulating suited astronaut injuries due to fall from heights in altered gravity environments are limited. The current study evaluates the M&S credibility of simplified Elemance and THUMS pedestrian FE models based on eight credibility factors – data pedigree, input pedigree, code verification, solution verification, conceptual validation, referent validation, results uncertainty, and results robustness – as per NASA-STD-7009A [1]. These credibility factors were assigned ordinal scores ranging between 0 to 4, with a score of 0 in the case of insufficient evidence and 4 when all data for the model is known, used appropriately, and traceable to the Real-World System (RWS) with acceptable accuracy, precision, and uncertainty. The credibility factor sufficiency thresholds were assigned upon guidance from NASA EVA subject matter experts. The factor scores were ascertained through the evaluation of M&S credibility assessment procedures described in the published literature and FE model reports. The M&S credibility scores for the Elemance and THUMS FE models vary between 1 and 3 for data pedigree, input pedigree, and referent validation credibility factors, and between 0 and 1 for code verification, solution verification, conceptual validation, results uncertainty and results robustness. The results show that these FE models are credible for simulating fall from heights injury scenarios in specific kinematic and kinetic ranges that correlate with highway and contact sports-related external conditions. Multiple credibility elevation strategies are prescribed to improve the Elemance and THUMS models’ credibility for use in the EVA fall from height injury scenarios.

R A Perkins↗

CFD Validation with Experiment and Verification with Physics of a Propellant Damping Device

This paper will document our effort in validating a coupled fluid-structure interaction CFD tool in predicting a damping device performance in the laboratory condition. Consistently good comparisons of "blind" CFD predictions against experimental data under various operation conditions, design parameters, and cryogenic environment will be presented. The power of the coupled CFD-structures interaction code in explaining some unexpected phenomena of the device observed during the technology development will be illustrated. The evolution of the damper device design inside the LOX tank will be used to demonstrate the contribution of the tool in understanding, optimization and implementation of LOX damper in Ares I vehicle. It is due to the present validation effort, the LOX damper technology has matured to TRL 5. The present effort has also contributed to the transition of the technology from an early conceptual observation to the baseline design of thrust oscillation mitigation for the Ares I within a 10 month period.

Yang, H. Q.↗

Development and Use of Engineering Standards for Computational Fluid Dynamics for Complex Aerospace Systems

Computational fluid dynamics (CFD) and other advanced modeling and simulation (M&S) methods are increasingly relied on for predictive performance, reliability and safety of engineering systems. Analysts, designers, decision makers, and project managers, who must depend on simulation, need practical techniques and methods for assessing simulation credibility. The AIAA Guide for Verification and Validation of Computational Fluid Dynamics Simulations (AIAA G-077-1998 (2002)), originally published in 1998, was the first engineering standards document available to the engineering community for verification and validation (V&V) of simulations. Much progress has been made in these areas since 1998. The AIAA Committee on Standards for CFD is currently updating this Guide to incorporate in it the important developments that have taken place in V&V concepts, methods, and practices, particularly with regard to the broader context of predictive capability and uncertainty quantification (UQ) methods and approaches. This paper will provide an overview of the changes and extensions currently underway to update the AIAA Guide. Specifically, a framework for predictive capability will be described for incorporating a wide range of error and uncertainty sources identified during the modeling, verification, and validation processes, with the goal of estimating the total prediction uncertainty of the simulation. The Guide's goal is to provide a foundation for understanding and addressing major issues and concepts in predictive CFD. However, this Guide will not recommend specific approaches in these areas as the field is rapidly evolving. It is hoped that the guidelines provided in this paper, and explained in more detail in the Guide, will aid in the research, development, and use of CFD in engineering decision-making.

Lee, Hyung B.↗

Deployment of the Finite Volume Method in Pronghorn for Gas and Salt cooled Pebble Bed Reactors

This report summarizes the activities related to ”Complete FHR and HTGR pebble bed simulator, including initial validation” funded by the NEAMS thermal-hydraulics focus area. The activity revolves around the coarse-mesh thermal-hydraulics code Pronghorn and its application to gas and salt cooled Pebble bed reactor (PBR). The main difference between gas and salt cooled PBR from a thermal-hydraulics perspective is the fluid. To address the difference in fluid behavior, two separate approaches are implemented in the MOOSE Navier Stokes module: 1) a Boussinesq approximation and 2) a fully compressible formulation. The developed finite volume method capabilities are used for improving pre-existing gas-cooled and salt-cooled pebble-bed reactor models. A steady-state, multiphysics gas-cooled pebble-bed reactor model is created that couples the equilibrium core depletion capability developed in previous work, and the finite volume method capability developed for this report. The salt-cooled pebble-bed reactor model is upgraded to use the incompressible finite volume method capability and then extended to three spatial dimensions. Finally, several verification-and-validation exercises performed with Pronghorn are documented using the verification-and-validation report of the MooseDoc system. The goal of this effort to document the verification-and-validation level of Pronghorn and improve stakeholder confidence in the results obtained with Pronghorn.

97 MATHEMATICS AND COMPUTING↗

Human factors case study: An iterative approach to verifying and validating a new suite of reactor inspection and maintenance tooling - 177

An iterative approach was taken to perform the HF Verification and Validation (V and V) activities for a complex set of reactor inspection and maintenance tooling equipment known as the Bruce Reactor Inspection and Maintenance System (BRIMS). This paper is divided into the verification activities (of Human System Information Task Support and Design verifications) and the validation activities. The validation method used a graded approach by breaking validation activities into early usability testing and high fidelity validations. Early usability testing, allowed for issues and design concepts to be identified and explored. High fidelity validation activities tested that the final design requirements and operational goals of the system were met in the production equipment. The validation method has been described in detail by depicting the following: task selection criteria, tools, performance measures and data collection. Validation results demonstrate the benefits of the graded approach as issues were to be identified early in the design process, improvements were made during detailed design and additional testing could confirm that issues were resolved prior to commissioning. To capture and share the success of this iterative V and V approach lessons learned have been created for use in future V and V projects. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Analytical Formulation for Sizing and Estimating the Dimensions and Weight of Wind Turbine Hub and Drivetrain Components

This report summarizes the theory, verification, and validation of a new sizing tool for wind turbine drivetrain components, the Drivetrain Systems Engineering (DriveSE) tool. DriveSE calculates the dimensions and mass properties of the hub, main shaft, main bearing(s), gearbox, bedplate, transformer if up-tower, and yaw system. The level of fi¬ delity for each component varies depending on whether semiempirical parametric or physics-based models are used. The physics-based models have internal iteration schemes based on system constraints and design criteria. Every model is validated against available industry data or finite-element analysis. The verification and validation results show that the models reasonably capture primary drivers for the sizing and design of major drivetrain components.

17 WIND ENERGY↗

Some guidance on preparing validation plans for the DART Full System Models.

Planning is an important part of computational model verification and validation (V&V) and the requisite planning document is vital for effectively executing the plan. The document provides a means of communicating intent to the typically large group of people, from program management to analysts to test engineers, who must work together to complete the validation activities. This report provides guidelines for writing a validation plan. It describes the components of such a plan and includes important references and resources. While the initial target audience is the DART Full System Model teams in the nuclear weapons program, the guidelines are generally applicable to other modeling efforts. Our goal in writing this document is to provide a framework for consistency in validation plans across weapon systems, different types of models, and different scenarios. Specific details contained in any given validation plan will vary according to application requirements and available resources.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Verification of High-Fidelity Neutronics Code PROTEUS for C5G7 Benchmark Problems

Under the DOE Nuclear Energy Advanced Modeling and Simulation (NEAMS) program, the 3D whole core transport code PROTEUS has been developed at Argonne National Laboratory to perform the detailed 3D transport calculation for various reactor types including irregular or complex geometric reactors. PROTEUS includes two distinct transport solvers: SN and MOC. Among them, the MOC solver based on the extruded geometry, thus named MOCEX, can produce the faithful 3-D transport solutions by employing the rigorous and robust 2D/3D MOC formulation. This formulation overcomes the drawbacks of a full 3D MOC method requiring enormous memory and computational resources and resolves the instability issues of the 2D/1D method as well. The solution of MOCEX converges to that of a Monte Carlo code as the discretization of angle, space and energy is refined, unlike the 2D/1D method. As a verification and validation (V and V) effort of PROTEUS-MOCEX, this paper presents verification test results using the well-known 3D C5G7 benchmark problems by solving and comparing eigenvalues and pin powers with MCNP solutions.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Third Annual Workshop on Space Operations Automation and Robotics (SOAR 1989)

Papers presented at the Third Annual Workshop on Space Operations Automation and Robotics (SOAR '89), hosted by the NASA Lyndon 8. Johnson Space Center at Houston, Texas, on July 25-27, 1989, are documented herein. During the three days, approximately 100 technical papers wer3 presented by experts from NASA, the USAF, universities, and technical companies. Also held were panel discussions on Air Force/NASA AI Overview and Expert System Verification and Validation. Tutorial sessions included Neural Networks; Theory and Application of Back Propagation; Verification and Validation of Expert Systems/ Evaluation of Expert System Tools; and Technical Environment for Modular Architectures for Robotics in Space; and are not documented herein. Technical topics addressed included intelligent systems, robotics, human factors, and environment.

Knowledge representation↗