Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “verification & validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47

NASA Data for Water Resources Applications

Water Management Applications is one of twelve elements in the Earth Science Enterprise National Applications Program. NASA Goddard Space Flight Center is supporting the Applications Program through partnering with other organizations to use NASA project results, such as from satellite instruments and Earth system models to enhance the organizations critical needs. The focus thus far has been: 1) estimating water storage including snowpack and soil moisture, 2) modeling and predicting water fluxes such as evapotranspiration (ET), precipitation and river runoff, and 3) remote sensing of water quality, including both point source (e.g., turbidity and productivity) and non-point source (e.g., land cover conversion such as forest to agriculture yielding higher nutrient runoff). The objectives of the partnering cover three steps of: 1) Evaluation, 2) Verification and Validation, and 3) Benchmark Report. We are working with the U.S. federal agencies including the Environmental Protection Agency (EPA), the Bureau of Reclamation (USBR) and the Department of Agriculture (USDA). We are using several of their Decision Support Systems (DSS) tools. This includes the DSS support tools BASINS used by EPA, Riverware and AWARDS ET ToolBox by USBR and SWAT by USDA and EPA. Regional application sites using NASA data across the US. are currently being eliminated for the DSS tools. The current NASA data emphasized thus far are from the Land Data Assimilation Systems WAS) and MODIS satellite products. We are currently in the first two steps of evaluation and verification validation. Water Management Applications is one of twelve elements in the Earth Science Enterprise s National Applications Program. NASA Goddard Space Flight Center is supporting the Applications Program through partnering with other organizations to use NASA project results, such as from satellite instruments and Earth system models to enhance the organizations critical needs. The focus thus far has been: 1) estimating water storage including snowpack and soil moisture, 2) modeling and predicting water fluxes such as evapotranspiration (ET), precipitation and river runoff, and 3) remote sensing of water quality, including both point source (e.g., turbidity and productivity) and non-point source (e.g., land cover conversion such as forest to agriculture yielding higher nutrient runoff). The objectives of the partnering cover three steps of 1) Evaluation, 2) Verification and Validation, and 3) Benchmark Report. We are working with the U.S. federal agencies the Environmental Protection Agency (EPA), the Bureau of Reclamation (USBR) and the Department of Agriculture (USDA). We are using several of their Decision Support Systems (DSS) tools. T us includes the DSS support tools BASINS used by EPA, Riverware and AWARDS ET ToolBox by USBR and SWAT by USDA and EPA. Regional application sites using NASA data across the US. are currently being evaluated for the DSS tools. The current NASA data emphasized thus far are from the Land Data Assimilation Systems (LDAS) and MODIS satellite products. We are currently in the first two steps of evaluation and verification and validation.

Toll, David↗

MCNP ® Code V.6.3.0 Release Notes

The Monte Carlo N-Particle ® (MCNP ® ) code is a general-purpose, continuous-energy, generalized geometry, time-dependent, radiation transport code developed by the MCNP development team. The MCNP calculations provide predictive capabilities that can replace expensive or impossible-to perform experiments. Specific application problems include simulations of experimental diagnostics, intrinsic radiation, radiation detection and measurement, criticality safety, nuclear threat reduction and response, radiation health protection, nuclear weapons effects, and nuclear forensics. This MCNP code, version 6.3.0, follows the MCNP6.2.0 version. Since the release of MCNP6.2.0, many changes have been made to the MCNP code. These changes include new or improved features, a new build system, code enhancement and modernization, and bug fixes. The MCNP code, version 6.3.0, theory and user input information is documented in MCNP ® Code Version 6.3.0 Theory & User Manual, the build guidance for various platforms is documented in MCNP ® Code Version 6.3.0 Build Guide, and the verification and validation testing for various application benchmark test suites is documented in MCNP ® Code Version 6.3.0 Verification & Validation Testing.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Modeling Interfacial Fracture in Sierra

This report summarizes computational efforts to model interfacial fracture using cohesive zone models in the SIERRA/SolidMechanics (SIERRA/SM) finite element code. Cohesive surface elements were used to model crack initiation and propagation along predefined paths. Mesh convergence was observed with SIERRA/SM for numerous geometries. As the funding for this project came from the Advanced Simulation and Computing Verification and Validation (ASC V&V) focus area, considerable effort was spent performing verification and validation. Code verification was performed to compare code predictions to analytical solutions for simple three-element simulations as well as a higher-fidelity simulation of a double-cantilever beam. Parameter identification was conducted with Dakota using experimental results on asymmetric double-cantilever beam (ADCB) and end-notched-flexure (ENF) experiments conducted under Campaign-6 funding. Discretization convergence studies were also performed with respect to mesh size and time step and an optimization study was completed for mode II delamination using the ENF geometry. Throughout this verification process, numerous SIERRA/SM bugs were found and reported, all of which have been fixed, leading to over a 10-fold increase in convergence rates. Finally, mixed-mode flexure experiments were performed for validation. One of the unexplained issues encountered was material property variability for ostensibly the same composite material. Since the variability is not fully understood, it is difficult to accurately assess uncertainty when performing predictions.

Brown, Arthur A.↗

Fault Management Architectures and the Challenges of Providing Software Assurance

The satellite systems Fault Management (FM) is focused on safety, the preservation of assets, and maintaining the desired functionality of the system. How FM is implemented varies among missions. Common to most is system complexity due to a need to establish a multi-dimensional structure across hardware, software and operations. This structure is necessary to identify and respond to system faults, mitigate technical risks and ensure operational continuity. These architecture, implementation and software assurance efforts increase with mission complexity. Because FM is a systems engineering discipline with a distributed implementation, providing efficient and effective verification and validation (VV) is challenging. A breakout session at the 2012 NASA Independent Verification Validation (IVV) Annual Workshop titled VV of Fault Management: Challenges and Successes exposed these issues in terms of VV for a representative set of architectures. NASA's IVV is funded by NASA's Software Assurance Research Program (SARP) in partnership with NASA's Jet Propulsion Laboratory (JPL) to extend the work performed at the Workshop session. NASA IVV will extract FM architectures across the IVV portfolio and evaluate the data set for robustness, assess visibility for validation and test, and define software assurance methods that could be applied to the various architectures and designs. This work focuses efforts on FM architectures from critical and complex projects within NASA. The identification of particular FM architectures, visibility, and associated VVIVV techniques provides a data set that can enable higher assurance that a satellite system will adequately detect and respond to adverse conditions. Ultimately, results from this activity will be incorporated into the NASA Fault Management Handbook providing dissemination across NASA, other agencies and the satellite community. This paper discusses the approach taken to perform the evaluations and preliminary findings from the research including identification of FM architectures, visibility observations, and methods utilized for VVIVV.

Fault Management↗

OECD-NEA HTTF Benchmark Progress and Updates

General slides discussing High Temperature Test Facility benchmark progress, Prismatic HTGR deployment, modeling and simulation tools for validating systems, and verification and validation issues. Also discuss collaboration and conclusions of RELAP5-3D validation activities based on HTTF with trends in data and international impact to accelerate deployment of prismatic HTGR microreactors by providing an opportunity for designers to assess their codes against experimental data and solutions from other codes.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Fault Management Architectures and the Challenges of Providing Software Assurance

Fault Management (FM) is focused on safety, the preservation of assets, and maintaining the desired functionality of the system. How FM is implemented varies among missions. Common to most missions is system complexity due to a need to establish a multi-dimensional structure across hardware, software and spacecraft operations. FM is necessary to identify and respond to system faults, mitigate technical risks and ensure operational continuity. Generally, FM architecture, implementation, and software assurance efforts increase with mission complexity. Because FM is a systems engineering discipline with a distributed implementation, providing efficient and effective verification and validation (V&V) is challenging. A breakout session at the 2012 NASA Independent Verification & Validation (IV&V) Annual Workshop titled "V&V of Fault Management: Challenges and Successes" exposed this issue in terms of V&V for a representative set of architectures. NASA's Software Assurance Research Program (SARP) has provided funds to NASA IV&V to extend the work performed at the Workshop session in partnership with NASA's Jet Propulsion Laboratory (JPL). NASA IV&V will extract FM architectures across the IV&V portfolio and evaluate the data set, assess visibility for validation and test, and define software assurance methods that could be applied to the various architectures and designs. This SARP initiative focuses efforts on FM architectures from critical and complex projects within NASA. The identification of particular FM architectures and associated V&V/IV&V techniques provides a data set that can enable improved assurance that a system will adequately detect and respond to adverse conditions. Ultimately, results from this activity will be incorporated into the NASA Fault Management Handbook providing dissemination across NASA, other agencies and the space community. This paper discusses the approach taken to perform the evaluations and preliminary findings from the research.

Fault Management↗

Methodology for Validating Building Energy Analysis Simulations

The objective of this report was to develop a validation methodology for building energy analysis simulations, collect high-quality, unambiguous empirical data for validation, and apply the validation methodology to the DOE-2.1, BLAST-2MRT, BLAST-3.0, DEROB-3, DEROB-4, and SUNCAT 2.4 computer programs. This report covers background information, literature survey, validation methodology, comparative studies, analytical verification, empirical validation, comparative evaluation of codes, and conclusions.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

The overview in safety review of human factors engineering and control room design in chinese AP1000 nuclear power plant - 174

The first AP1000 nuclear power plant is constructed in Sanmen county in Zhejiang Province in China, which has creative and distinctive design characteristics. Human factors engineering disciplines are applied to the design of the AP1000. In addition to the elements of the program review model(including human factors engineering program management, operating experience review, functional requirements analysis and allocation, task analysis, staffing, integration of human reliability analysis with human factors engineering, human system interface design, procedure development, training program development, human system interface verification and validation, design implementation, human performance monitoring),the minimum inventory of controls, displays, and alarms present in the main control room and at the remote shutdown workstation. These contents mentioned above are reviewed according to standards, rules and regulations. This article introduces review process, and several important issues during the reviewing are described in detail. These issues include many elements, such as operating experience review, task analysis, human system interface design, verification and validation,and so on. This paper emphasizes on the main control room design(including environment and layout). Background noise in the actual main control room may exceed too much to design value. Another important issue is about main control room habitability systems(VES) changes to satisfy post-actuation performance requirements in AP1000 design change proposal. All the wall panel displays will be closed in this design change proposal. Review process and proposal are described in the paper. Since the AP1000 unit in China is the first constructed all over the world, verification and validation are especially important and necessary. The plan of verification and validation, the results summary report of verification and validation, the report of human engineering discrepancies are focus attention. Verification and validation in human factors engineering include HSI task support verification, HFE design verification and integrated system validation. This paper introduces the review process of verification and validation, the issues found in verification and validation. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

MCNP® Code Version 6.3.1 Release Notes

The Monte Carlo N-Particle® (MCNP® ) code is a general-purpose, continuous-energy, generalized-geometry, time-dependent, radiation transport code developed by the MCNP development team. MCNP calculations provide predictive capabilities that can replace expensive or impossible-to-perform experiments. Specific application problems include simulations of experimental diagnostics, intrinsic radiation, radiation detection and measurement, criticality safety, nuclear threat reduction and response, radiation health protection, nuclear weapons effects, and nuclear forensics. This MCNP code, version 6.3.1, follows the MCNP6.3.0 version. Since the release of MCNP6.3.0, a variety of bug fixes and code enhancements have been completed for MCNP6.3.1. A few new features have also been added to this release to support both ongoing research and the release of the latest ENDF/B-VIII.1 nuclear data library. The MCNP code, version 6.3.1, theory and user input information is documented in MCNP® Code Version 6.3.1 Theory & User Manual, the build guidance for various platforms is documented in MCNP® Code Version 6.3.1 Build Guide, and the verification and validation testing for various application benchmark test suites is documented in MCNP® Code Version 6.3.1 Verification & Validation Testing.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Strategic Plan for Nuclear Energy -- Knowledge Base for Advanced Modeling and Simulation (NE-KAMS)

The Nuclear Energy Computational Fluid Dynamics Advanced Modeling and Simulation (NE-CAMS) system is being developed at the Idaho National Laboratory (INL) in collaboration with Bettis Laboratory, Sandia National Laboratory (SNL), Argonne National Laboratory (ANL), Utah State University (USU), and other interested parties with the objective of developing and implementing a comprehensive and readily accessible data and information management system for computational fluid dynamics (CFD) verification and validation (V&V) in support of nuclear energy systems design and safety analysis. The two key objectives of the NE-CAMS effort are to identify, collect, assess, store and maintain high resolution and high quality experimental data and related expert knowledge (metadata) for use in CFD V&V assessments specific to the nuclear energy field and to establish a working relationship with the U.S. Nuclear Regulatory Commission (NRC) to develop a CFD V&V database, including benchmark cases, that addresses and supports the associated NRC regulations and policies on the use of CFD analysis. In particular, the NE-CAMS system will support the Department of Energy Office of Nuclear Energy Advanced Modeling and Simulation (NEAMS) Program, which aims to develop and deploy advanced modeling and simulation methods and computational tools for reliable numerical simulation of nuclear reactor systems for design and safety analysis. Primary NE-CAMS Elements There are four primary elements of the NE-CAMS knowledge base designed to support computer modeling and simulation in the nuclear energy arena as listed below. Element 1. The database will contain experimental data that can be used for CFD validation that is relevant to nuclear reactor and plant processes, particularly those important to the nuclear industry and the NRC. Element 2. Qualification standards for data evaluation and classification will be incorporated and applied such that validation data sets will result in well-defined, well-characterized data. Element 3. Standards will be established for the design and operation of experiments for the generation of new validation data sets that are to be submitted to NE-CAMS that addresses the completeness and characterization of the dataset. Element 4. Standards will be developed for performing verification and validation (V&V) to establish confidence levels in CFD analyses of nuclear reactor processes; such processes will be acceptable and recognized by both CFD experts and the NRC.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Pronghorn Porous Media Model Validation with Pressure Drop Measurements

The verification and validation (V &V) of Pronghorn is imperative to assert its accuracy when predicting the fluid velocity, temperature, and pressure in high temperature gas-cooled reactors. This paper focuses on the validation of the Pronghorn implementation of the incompressible and compressible Navier-Stokes equations using the pressure drop measurements in the engineering-scale pebble bed facility at the Texas A &M university.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Pronghorn Porous Media Model Validation with Pressure Drop Measurements

The verification and validation (V&V) of Pronghorn is imperative to assert its accuracy when predicting the fluid velocity, temperature, and pressure in high temperature gas-cooled reactors. Pronghorn is a coarse-mesh, intermediate-fidelity, and multidimensional thermal-hydraulics (TH) code developed by the Idaho National Laboratory (INL). New pebble bed experiments are used to observe the details of the fluid motion and pressure drop in the porous bed under the reactor normal operation. This paper focuses on the validation of the Pronghorn compressible and incompressible Navier-Stokes equations using the pressure drop measurements performed at the engineering-scale pebble bed facility at the Texas A&M university (TAMU). Various pressure drop correlations and porosity functions are implemented in both Pronghorn and STAR-CCM+ to compare the pressure drop due to the combined viscous and inertial resistances in the porous bed. The correlations accounting for the near-wall effect are also utilized to observe if the pressure drop estimates can be improved. Pronghorn porous media models predict the pressure drop well relative to the STAR-CCM+ simulation results and 1D correlations, and both the finite element method (FEM) and finite volume method (FVM) perform accurately. Pronghorn models are also validated with the experimental measurements given the different Reynolds number ranges and specific aspect ratios. The likelihood of the statistical significance between the pressure drop measurements and specific correlations or simulations is low provided that the overlap of their confidence intervals is more than the half of a single arm. Several validation metrics are reasonable in regard to the similar studies from other literature. The precise average pebble bed porosity estimation has much impact on the pressure drop, and the Foumeny and Montillet (dense packing) models carry out the accurate pressure drop prediction by considering the near-wall effect.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Evaluating wind speed and power forecasts for wind energy applications using an open-source and systematic validation framework

Building on the verification and validation work developed under the Second Wind Forecast Improvement Project, this work exhibits the value of a consistent procedure to evaluate wind power forecasts. We established an open-source Python code base tailored for wind speed and wind power forecast validation, WE-Validate. The code base can evaluate model forecasts with observations in a coherent manner. To demonstrate the systematic validation framework of WE-Validate, we designed and hosted a forecast evaluation benchmark exercise. We invited forecast providers in industry and academia to participate and submit forecasts for two case studies. We then evaluated the submissions with WE-Validate. Our findings suggest that ensemble means have reasonable skills in time series forecasting, whereas they are often inferior to single ensemble members in wind ramp forecasting. Adopting a voting scheme in ramp forecasting that allows ensemble members to detect ramps independently leads to satisfactory skill scores. Throughout this document, we also emphasize the importance of using statistically robust and resistant metrics as well as equitable skill scores in forecast evaluation.

17 WIND ENERGY↗

Baseline Assessment and Prioritization Framework for IVHM Integrity Assurance Enabling Capabilities

Fundamental to vehicle health management is the deployment of systems incorporating advanced technologies for predicting and detecting anomalous conditions in highly complex and integrated environments. Integrated structural integrity health monitoring, statistical algorithms for detection, estimation, prediction, and fusion, and diagnosis supporting adaptive control are examples of advanced technologies that present considerable verification and validation challenges. These systems necessitate interactions between physical and software-based systems that are highly networked with sensing and actuation subsystems, and incorporate technologies that are, in many respects, different from those employed in civil aviation today. A formidable barrier to deploying these advanced technologies in civil aviation is the lack of enabling verification and validation tools, methods, and technologies. The development of new verification and validation capabilities will not only enable the fielding of advanced vehicle health management systems, but will also provide new assurance capabilities for verification and validation of current generation aviation software which has been implicated in anomalous in-flight behavior. This paper describes the research focused on enabling capabilities for verification and validation underway within NASA s Integrated Vehicle Health Management project, discusses the state of the art of these capabilities, and includes a framework for prioritizing activities.

Cooper, Eric G.↗

BISON Software V&V Plan

The primary vision for the BISON development team is to deliver a nuclear fuel performance simulation tool that is used to provide a researcher or fuel designer with best estimate calculations of the highly coupled and nonlinear phenomena that govern nuclear fuel behavior. Accurately simulating nuclear fuel behavior is a challenging computational undertaking and verification and validation (V&V) play an important role in realizing this vision. The purpose of this V&V plan is to express the BISON team’s definition of the terms verification and validation, document what we have done regarding V&V, and outline what we plan to do.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Phenomena Identification and Ranking Table (PIRT) for Fluoride High-Temperature Reactor (FHR) Neutronics

The deployment of Fluoride (salt-cooled) High Temperature Reactors (FHRs) has many potential benefits such as improved safety, improved economics, and a diversification of the energy portfolio because of its capability to supply industrial process heat. However, significant challenges remain before this class of reactors can be deployed, mostly related to its technology readiness. A recent study identified several areas in need of further development in order to advance the technology. These include the verification and validation of neutronics and thermal hydraulics modeling and simulation tools in support of design, safety analysis and licensing. The focus of this paper is to summarize the issues for verification and validation of neutronics tools. Current tools for neutronics analysis of LWRs are inadequate for the simulation of salt cooled reactors. The methodologies developed for the high temperature gas cooled reactors (HTGRs) have some relevance for FHRs because of the similarities between the two reactors such as graphite block structure, encapsulated fuel particles, and high operating temperatures. However, they are not sufficient for the accuracy desired of a code for licensing as they have a number of important differences neutronically, such as the use of liquid salt containing beryllium as a coolant and their unique fuel configuration. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

FY2012 summary of tasks completed on PROTEUS-thermal work

PROTEUS is a suite of the neutronics codes, both old and new, that can be used within the SHARP codes being developed under the NEAMS program. Discussion here is focused on updates and verification and validation activities of the SHARP neutronics code, DeCART, for application to thermal reactor analysis. As part of the development of SHARP tools, the different versions of the DeCART code created for PWR, BWR, and VHTR analysis were integrated. Verification and validation tests for the integrated version were started, and the generation of cross section libraries based on the subgroup method was revisited for the targeted reactor types.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗