Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “verification & validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
NASA NTRS1997

A Framework for Performing Verification and Validation in Reuse Based Software Engineering

Verification and Validation (V&V) is currently performed during application development for many systems, especially safety-critical and mission- critical systems. The V&V process is intended to discover errors, especially errors related to critical processing, as early as possible during the development process. The system application provides the context under which the software artifacts are validated. This paper describes a framework that extends V&V from an individual application system to a product line of systems that are developed within an architecture-based software engineering environment. This framework includes the activities of traditional application-level V&V, and extends these activities into domain engineering and into the transition between domain engineering and application engineering. The framework includes descriptions of the types of activities to be performed during each of the life-cycle phases, and provides motivation for the activities.

Addy, Edward A.↗
NASA NTRS1994

A process improvement model for software verification and validation

We describe ongoing work at the NASA Independent Verification and Validation (IV&V) Facility to establish a process improvement model for software verification and validation (V&V) organizations. This model, similar to those used by some software development organizations, uses measurement-based techniques to identify problem areas and introduce incremental improvements. We seek to replicate this model for organizations involved in V&V on large-scale software development projects such as EOS and Space Station. At the IV&V Facility, a university research group and V&V contractors are working together to collect metrics across projects in order to determine the effectiveness of V&V and improve its application. Since V&V processes are intimately tied to development processes, this paper also examines the repercussions for development organizations in large-scale efforts.

Callahan, John↗
NASA NTRS1994

A process improvement model for software verification and validation

We describe ongoing work at the NASA Independent Verification and Validation (IV&V) Facility to establish a process improvement model for software verification and validation (V&V) organizations. This model, similar to those used by some software development organizations, uses measurement-based techniques to identify problem areas and introduce incremental improvements. We seek to replicate this model for organizations involved in V&V on large-scale software development projects such as EOS and space station. At the IV&V Facility, a university research group and V&V contractors are working together to collect metrics across projects in order to determine the effectiveness of V&V and improve its application. Since V&V processes are intimately tied to development processes, this paper also examines the repercussions for development organizations in large-scale efforts.

Callahan, John↗
DOE OSTI2016

CASL Verification and Validation Plan

This report documents the Consortium for Advanced Simulation of LWRs (CASL) verification and validation plan. The document builds upon input from CASL subject matter experts, most notably the CASL Challenge Problem Product Integrators, CASL Focus Area leaders, and CASL code development and assessment teams. This document will be a living document that will track progress on CASL to do verification and validation for both the CASL codes (including MPACT, CTF, BISON, MAMBA) and for the CASL challenge problems (CIPS, PCI, DNB). The CASL codes and the CASL challenge problems are at differing levels of maturity with respect to validation and verification. The gap analysis will summarize additional work that needs to be done. Additional VVUQ work will be done as resources permit. This report is prepared for the Department of Energy’s (DOE’s) CASL program in support of milestone CASL.P13.02.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2015

Approaching the investigation of plasma turbulence through a rigorous verification and validation procedure: A practical example

In the present work, a Verification and Validation procedure is presented and applied showing, through a practical example, how it can contribute to advancing our physics understanding of plasma turbulence. Bridging the gap between plasma physics and other scientific domains, in particular, the computational fluid dynamics community, a rigorous methodology for the verification of a plasma simulation code is presented, based on the method of manufactured solutions. This methodology assesses that the model equations are correctly solved, within the order of accuracy of the numerical scheme. The technique to carry out a solution verification is described to provide a rigorous estimate of the uncertainty affecting the numerical results. A methodology for plasma turbulence code validation is also discussed, focusing on quantitative assessment of the agreement between experiments and simulations. The Verification and Validation methodology is then applied to the study of plasma turbulence in the basic plasma physics experiment TORPEX [Fasoli et al., Phys. Plasmas 13, 055902 (2006)], considering both two-dimensional and three-dimensional simulations carried out with the GBS code [Ricci et al., Plasma Phys. Controlled Fusion 54, 124047 (2012)]. The validation procedure allows progress in the understanding of the turbulent dynamics in TORPEX, by pinpointing the presence of a turbulent regime transition, due to the competition between the resistive and ideal interchange instabilities.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Non-Nuclear Test Facility Development to Support Verification and Validation Needs

This study focuses on developing a non-nuclear test facility to help meet the verification and validation (V&V) requirements of a water-cooled small modular reactor (SMR) system. The scaling analysis necessary for reactor system experimentation and assessment model V&V considers various reactor system accident scenarios such as main steam line break (MSLB), steam generator tube rupture (SGTR), and containment condensation and heat transfer. The goal is to identify key physics based phenomena of interest (POI), specific figures of merit (FOMs), and the state of knowledge (SOK) by employing phenomena identification and ranking table (PIRT) studies. Important physics phenomena such as heat transfer, fluid dynamics, structural integrity, and material selection must be addressed when scaling a thermal-hydraulics system. Alongside these considerations, modifications to the facility may be needed to align the scaled system with the available footprint (height and space) of the facility. These modifications may include infrastructure upgrades, changes to the piping layout, implementation of safety measures, and installation of new instrumentation and control systems. The test facility aims to provide a scaled-down version of prototypic facilities for comprehensive V&V activities by overcoming these challenges and making the necessary modifications. This approach minimizes scaling distortion, simulates prototypic plant conditions, and accurately models accident event progressions. Thus, the facility will be capable of adequately modeling a scaled SMR system to support the design, development and licensing needs.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2016

Integrated Disposal Facility FY 2016: ILAW Verification and Validation of the eSTOMP Simulator

This document describes two sets of simulations carried out to further verify and validate the eSTOMP simulator. In this report, a distinction is made between verification and validation, and the focus is on verifying eSTOMP through a series of published benchmarks on cementitious wastes, and validating eSTOMP based on a lysimeter experiment for the glassified waste. These activities are carried out within the context of a scientific view of validation that asserts that models can only be invalidated, and that model validation (and verification) is a subjective assessment.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2016

FAST v8 Verification and Validation for a Megawatt-Scale Wind Turbine with Aeroelastically Tailored Blades: Preprint

This paper presents findings from a verification and validation exercise on the latest version of the U.S. Department of Energy/National Renewable Energy Laboratory's in-house wind turbine aeroelastic design code FAST v8. Results from a set of 1141 FAST simulations were compared to those from Siemens' BHawC design code results, as well as experimental data from a heavily instrumented 2.3-MW Siemens wind turbine located at the National Wind Technology Center. The code validation was performed following the IEC-61400-13 standard, where a set of select quantities of interest from simulations at various wind speed and atmospheric turbulence conditions were used for a three-way comparison between FAST, BHawC, and the measurements. Results highlight many improvements of the latest version of FAST over its previous versions. This paper also provides comments from the authors on the data quality, and avenues for potential future work using these results.

17 WIND ENERGY↗
DOE OSTI2016

The 2014 Sandia Verification and Validation Challenge: Problem statement

This paper presents a case study in utilizing information from experiments, models, and verification and validation (V&V) to support a decision. It consists of a simple system with data and models provided, plus a safety requirement to assess. The goal is to pose a problem that is flexible enough to allow challengers to demonstrate a variety of approaches, but constrained enough to focus attention on a theme. This was accomplished by providing a good deal of background information in addition to the data, models, and code, but directing the participants' activities with specific deliverables. In this challenge, the theme is how to gather and present evidence about the quality of model predictions, in order to support a decision. This case study formed the basis of the 2014 Sandia V&V Challenge Workshop and this resulting special edition of the ASME Journal of Verification, Validation, and Uncertainty Quantification.

42 ENGINEERING↗
DOE OSTI2011

Development, Verification, and Validation of Multiphase Models for Polydisperse Flows

This report describes in detail the technical findings of the DOE Award entitled 'Development, Verification, and Validation of Multiphase Models for Polydisperse Flows.' The focus was on high-velocity, gas-solid flows with a range of particle sizes. A complete mathematical model was developed based on first principles and incorporated into MFIX. The solid-phase description took two forms: the Kinetic Theory of Granular Flows (KTGF) and Discrete Quadrature Method of Moments (DQMOM). The gas-solid drag law for polydisperse flows was developed over a range of flow conditions using Discrete Numerical Simulations (DNS). These models were verified via examination of a range of limiting cases and comparison with Discrete Element Method (DEM) data. Validation took the form of comparison with both DEM and experimental data. Experiments were conducted in three separate circulating fluidized beds (CFB's), with emphasis on the riser section. Measurements included bulk quantities like pressure drop and elutriation, as well as axial and radial measurements of bubble characteristics, cluster characteristics, solids flux, and differential pressure drops (axial only). Monodisperse systems were compared to their binary and continuous particle size distribution (PSD) counterparts. The continuous distributions examined included Gaussian, lognormal, and NETL-provided data for a coal gasifier.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2017

International Energy Agency Ocean Energy Systems Task 10 Wave Energy Converter Modeling Verification and Validation: Preprint

This is the first joint reference paper for the Ocean Energy Systems (OES) Task 10 Wave Energy Converter modeling verification and validation group. The group is established under the OES Energy Technology Network program under the International Energy Agency. OES was founded in 2001 and Task 10 was proposed by Bob Thresher (National Renewable Energy Laboratory) in 2015 and approved by the OES Executive Committee EXCO in 2016. The kickoff workshop took place in September 2016, wherein the initial baseline task was defined. Experience from similar offshore wind validation/verification projects (OC3-OC5 conducted within the International Energy Agency Wind Task 30) [1], [2] showed that a simple test case would help the initial cooperation to present results in a comparable way. A heaving sphere was chosen as the first test case. The team of project participants simulated different numerical experiments, such as heave decay tests and regular and irregular wave cases. The simulation results are presented and discussed in this paper.

16 TIDAL AND WAVE POWER↗
NASA NTRS1987

Using Colored Stochastic Petri Net (CS-PN) software for protocol specification, validation, and evaluation

The specification, verification, validation, and evaluation, which make up the different steps of the CS-PN software are outlined. The colored stochastic Petri net software is applied to a Wound/Wait protocol decomposable into two principal modules: request or couple (transaction, granule) treatment module and wound treatment module. Each module is specified, verified, validated, and then evaluated separately, to deduce a verification, validation and evaluation of the complete protocol. The colored stochastic Petri nets tool is shown to be a natural extension of the stochastic tool, adapted to distributed systems and protocols, because the color conveniently takes into account the numerous sites, transactions, granules and messages.

Zenie, Alexandre↗
DOE OSTI2020

Verification and Validation of MFiX-PIC

This work is aimed at verification and validation (V&V) of particle-in-cell (PIC) approach in the National Energy Technology Laboratory’s (NETL) Multiphase Flow with Interphase eXchanges (MFiX-PIC) which was officially released in April 2019. Under verification, the results from MFiX-PIC are compared with exact or analytical solutions, while experimental results are used for benchmarking under validation. The test suite consists of the following cases: Terminal velocity. Particle advection in time-varying flow field. Particle settling in a dense medium. Evaporation. Rayleigh-Taylor instability. Minimum fluidization. Mini-circulating fluidized bed. The cases reported in a format consistent with the existing Verification and Validation Manual (Musser et al., 2018) explore a wide range of flow velocities and concentration regimes. Only one case considered in this work verifies the implementation of heat and mass transfer routines in MFiX-PIC, while a few other studies are currently underway to further expand the validation space in reacting flows. This study highlights the need for a rigorous analysis to objectively quantify the effect of model parameters. In addition, there is a scarcity of high-quality experimental data in the literature suitable for validating PIC methodology. Future efforts would include performing experiments which provide results for a valuable database. While designing such experiments, particle count should be significant to have sufficient particles per parcel while maintaining an optimal parcel to cell volume ratio. Also, datasets should have objectively assessed experimental uncertainty whereby confidence interval in those measurements become more explicit.

42 ENGINEERING↗
NASA NTRSDate not supplied

Verification and Validation of Safety-Critical Aircraft Systems Operating under Off-Nominal, Contingency, and Emergency Conditions

Verification and validation (V&V) of safety-critical technologies developed for loss of control (LOC) prevention and recovery and other aviation safety concerns pose significant challenges. Aircraft LOC can result from a wide spectrum of hazards, often occurring in combination, which cannot be fully replicated during evaluation. Technologies developed for LOC prevention and recovery must therefore be effective under a wide variety of hazardous and uncertain conditions, and the verification and validation of these technologies must provide some measure of assurance that the new vehicle safety technologies do no harm (i.e., that they themselves do not introduce new safety risks). V&V technologies must also enable the identification of system limitations and constraints, as well as enable the identification of safe and unsafe operating conditions (and their boundaries). Additionally, the V&V of complex, increasingly autonomous systems is a fundamental concern. Scalable, reproducible and cost-effective techniques for the assurance of safety critical systems during their design and operation is a key barrier to fielding new systems or updating current systems. Moreover, these techniques need to provide artifacts that enable a comprehensive evidence-based approach to certification. This briefing summarizes research performed under NASA’s Aviation Safety Program and follow-on research for the V&V of safety-critical aircraft system technologies developed for LOC prevention and recovery and increasingly autonomous systems, and for a broad assurance capability in both current and emerging aviation applications. Note that, in this briefing, the term “validation” refers to a confirmation that the system implementation (e.g., algorithms etc.) is performing the intended function(s), as well as an affirmation of effectiveness in these functions. “Verification” refers to a confirmation that the system implementation in the software and hardware meets its (hopefully validated) specifications (e.g., correctly executes algorithms as designed).

Validation↗
DOE OSTI2024

Implementation of a Drift Flux Model into SAM with Development of a Verification and Validation Test Suite for Modeling of Noncondensable Gas Mixtures

The advanced thermal-hydraulic system code, System Analysis Module (SAM), was originally developed for the modeling of single-phase flow in advanced reactors. It has since been expanded to include a four-equation drift flux model for the modeling of two-phase flows containing a noncondensable gas. The model was expanded to support the modeling of molten salt reactor (MSR) designs in which the fuel is directly dissolved in the circulating coolant. These designs have shown that circulating gas bubbles can play an important role in the management of fission products and the operational behavior of the reactor. A drift flux model was implemented to more accurately capture the localized behavior of the void in the core and its impact on the mass transfer of fission products. A thorough assessment of the new model was performed by developing a verification and validation test suite. Verification problems were designed to test all major terms in the new governing equations. The new model converged to the correct solution at the expected order of accuracy for all verification cases. The validation cases included a wide range of flow and void conditions in different pipe geometries. Although higher void experiments show a slight underprediction of void by the drift flux model, experiments that aim to reproduce Molten Salt Reactor Experiment (MSRE) experimental conditions show good agreement with the model. The gas transport model was activated for a SAM model of the MSRE to demonstrate that it can be used in a more complex model. Finally, this gas transport model will be used along with an interfacial area transport equation being implemented in SAM for the prediction of mass transport behavior in MSR conditions.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2019

Verification and Validation of the FLAG Hydrocode for Impact Cratering Simulations

Verification and validation (V&V) are necessary processes to ensure accuracy of the computational methods used to solve problems key to vast numbers of applications and industries. Simulations are essential for addressing impact cratering problems, because these problems often exceed experimental capabilities. We show that the free Lagrange (FLAG) hydrocode, developed at Los Alamos National Laboratory (Los Alamos, NM), can be used for impact cratering simulations by verifying FLAG against two analytical models of aluminum-on-aluminum impacts at different impact velocities and validating FLAG against a glass-into-water laboratory impact experiment. Our verification results show good agreement with the theoretical maximum pressures, with relative errors as low in magnitude as 1.00%. Our validation results demonstrate FLAG's ability to model various stages of impact cratering, with crater radius relative errors as low as 3.48% and crater depth relative errors as low as 0.79%. Our mesh resolution study shows that FLAG converges at resolutions low enough to reduce the required computation time from about 28 h to about 25 min. We anticipate that FLAG can be used to model larger impact cratering problems with increased accuracy and decreased computational cost on current systems relative to other hydrocodes tested by Pierazzo et al. (2008, “Validation of Numerical Codes for Impact and Explosion Cratering: Impacts on Strengthless and Metal Targets,” MAPS, 43(12), pp. 1917–1938).

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Verification and Validation of a Modified Numerical Algorithm for Simulation of Transient Unconfined Groundwater Flow

This report extends verification and validation testing of the NUFT package of codes (Nitao 2000a,b) to the US1P module of code designed for simulation of single-phase mixed or “coupled” saturated and unsaturated (or “variably saturated”) groundwater flow. Importantly, the verification and validation testing of US1P in this report includes performance evaluation of a modified numerical algorithm that was not included in prior quality assurance (QA) of the NUFT package by Carle et al. (2014) for Underground Test Area (UGTA) project activities, which are directed at assessment of radionuclide contamination in groundwater sourced from underground nuclear test locations at the Nevada National Security Site (NNSS). An immediate purpose of this report is to provide QA for ongoing large-scale, three-dimensional (3-D) groundwater flow modeling of transient water levels associated with longterm water supply pumping and underground nuclear testing at the NNSS (Jackson and Fenelon, 2018; Jackson et al., 2021). For UGTA activities, the QA refers to the standards of ASTM (1996) for verification and validation testing of groundwater modeling codes.

54 ENVIRONMENTAL SCIENCES↗