Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “verification & validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

Scalable analysis tools for sensitivity analysis and UQ (3160) results.

The 9/30/2009 ASC Level 2 Scalable Analysis Tools for Sensitivity Analysis and UQ (Milestone 3160) contains feature recognition capability required by the user community for certain verification and validation tasks focused around sensitivity analysis and uncertainty quantification (UQ). These feature recognition capabilities include crater detection, characterization, and analysis from CTH simulation data; the ability to call fragment and crater identification code from within a CTH simulation; and the ability to output fragments in a geometric format that includes data values over the fragments. The feature recognition capabilities were tested extensively on sample and actual simulations. In addition, a number of stretch criteria were met including the ability to visualize CTH tracer particles and the ability to visualize output from within an S3D simulation.

97 MATHEMATICS AND COMPUTING↗

SciDAC GSEP: Gyrokinetic Simulation of Energetic Particle Turbulence and Transport

Energetic particle (EP) confinement is a key physics issue for burning plasma experiment ITER, the crucial next step in the quest for clean and abundant energy, since ignition relies on self-heating by energetic fusion products (α-particles). Due to the strong coupling of EP with burning thermal plasmas, plasma confinement property in the ignition regime is one of the most uncertain factors when extrapolating from existing fusion devices to the ITER tokamak. EP population in current tokamaks are mostly produced by auxiliary heating such as neutral beam injection (NBI) and radio frequency (RF) heating. Remarkable progress in developing comprehensive EP simulation codes and understanding basic EP physics has been made by two concurrent SciDAC EP projects GSEP funded by the Department of Energy (DOE) Office of Fusion Energy Science (OFES), which have successfully established gyrokinetic turbulence simulation as a necessary paradigm shift for studying the EP confinement in burning plasmas. Verification and validation have rapidly advanced through close collaborations between simulation, theory, and experiment. Furthermore, productive collaborations with computational scientists have enabled EP simulation codes to effectively utilize current petascale computers and emerging exascale computers. We review here key physics progress in the GSEP projects regarding verification and validation of gyrokinetic simulations, nonlinear EP physics, EP coupling with thermal plasmas, and reduced EP transport models. Advances in high performance computing through collaborations with computational scientists that enable these large scale electromagnetic simulations are also highlighted. These results have been widely disseminated in numerous peer-reviewed publications including many Phys. Rev. Lett. papers and many invited presentations at prominent fusion conferences such as the biennial International Atomic Energy Agency (IAEA) Fusion Energy Conference and the annual meeting of the American Physics Society, Division of Plasma Physics (APS-DPP).

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Methods Data Qualification Interim Report

The overall goal of the Next Generation Nuclear Plant (NGNP) Data Management and Analysis System (NDMAS) is to maintain data provenance for all NGNP data including the Methods component of NGNP data. Multiple means are available to access data stored in NDMAS. A web portal environment allows users to access data, view the results of qualification tests and view graphs and charts of various attributes of the data. NDMAS also has methods for the management of the data output from VHTR simulation models and data generated from experiments designed to verify and validate the simulation codes. These simulation models represent the outcome of mathematical representation of VHTR components and systems. The methods data management approaches described herein will handle data that arise from experiment, simulation, and external sources for the main purpose of facilitating parameter estimation and model verification and validation (V&V). A model integration environment entitled ModelCenter is used to automate the storing of data from simulation model runs to the NDMAS repository. This approach does not adversely change the why computational scientists conduct their work. The method is to be used mainly to store the results of model runs that need to be preserved for auditing purposes or for display to the NDMAS web portal. This interim report demonstrates the currently development of NDMAS for Methods data and discusses data and its qualification that is currently part of NDMAS.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

System diagnostic builder

The System Diagnostic Builder (SDB) is an automated software verification and validation tool using state-of-the-art Artificial Intelligence (AI) technologies. The SDB is used extensively by project BURKE at NASA-JSC as one component of a software re-engineering toolkit. The SDB is applicable to any government or commercial organization which performs verification and validation tasks. The SDB has an X-window interface, which allows the user to 'train' a set of rules for use in a rule-based evaluator. The interface has a window that allows the user to plot up to five data parameters (attributes) at a time. Using these plots and a mouse, the user can identify and classify a particular behavior of the subject software. Once the user has identified the general behavior patterns of the software, he can train a set of rules to represent his knowledge of that behavior. The training process builds rules and fuzzy sets to use in the evaluator. The fuzzy sets classify those data points not clearly identified as a particular classification. Once an initial set of rules is trained, each additional data set given to the SDB will be used by a machine learning mechanism to refine the rules and fuzzy sets. This is a passive process and, therefore, it does not require any additional operator time. The evaluation component of the SDB can be used to validate a single software system using some number of different data sets, such as a simulator. Moreover, it can be used to validate software systems which have been re-engineered from one language and design methodology to a totally new implementation.

Nieten, Joseph L.↗

Energy deposition validation results for the evaluated electron data library in FRENSIE - 25357

The Framework for Research in Nuclear Science and Engineering (FRENSIE) is a collection of packages written in C++ that are designed primarily to aid in methods development. A recent development in FRENSIE is the modeling of single scattering electron interactions using the data in the Evaluated Electron Data Library (EEDL) from Lawrence Livermore National Laboratory (LLNL). Preliminary verification and validation (V and V) results using the well-known Lockwood energy deposition experiment and a comparison with MCNP6.2 were performed using several bivariate grid policies (Unit-base, Correlated, Unit-base Correlated), interpolation schemes (lin-lin, log-log, lin-log), and physics options (Coupled and Decoupled Elastic Scattering). The results show an agreement to within 0.5% between MCNP6.2 and FRENSIE when using the same bivariate grid policy (Correlated) and interpolation scheme (log-log). When compared to the experimental results of the Lockwood experiment, it was found that a Unit-base bivariate grid policy, lin-lin interpolation scheme, and lin-log interpolation scheme did not produce accurate results for the energy deposition in test problems. The log-log Correlated and Unit-base Correlated results showed the greatest agreement with the Lockwood experiment. The total energy deposition matched the experimental data to within 3%. Both the Correlated and Unit-base Correlated results had a tendency to estimate a higher energy deposition near the peaks and a lower energy deposition near the tails. The differences between coupled elastic scattering and decoupled scattering models were shown to be more prominent at higher energies with the results of the coupled elastic scattering being more accurate for the peak and less accurate for the tail of the energy deposition profiles. (authors)

61 RADIATION PROTECTION AND DOSIMETRY↗

AMR-Wind: A Performance-Portable, High-Fidelity Flow Solver for Wind Farm Simulations

We present AMR-Wind, a verified and validated high-fidelity computational-fluid-dynamics code for wind farm flows. AMR-Wind is a block-structured, adaptive-mesh, incompressible-flow solver that enables predictive simulations of the atmospheric boundary layer and wind plants. It is a highly scalable code designed for parallel high-performance computing with a specific focus on performance portability for current and future computing architectures, including graphical processing units (GPUs). In this paper, we detail the governing equations, the numerical methods, and the turbine models. Establishing a foundation for the correctness of the code, we present the results of formal verification and validation. The verification studies, which include a novel actuator line test case, indicate that AMR-Wind is spatially and temporally second-order accurate. The validation studies demonstrate that the key physics capabilities implemented in the code, including actuator disk models, actuator line models, turbulence models, and large eddy simulation (LES) models for atmospheric boundary layers, perform well in comparison to reference data from established computational tools and theory. We conclude with a demonstration simulation of a 12-turbine wind farm operating in a turbulent atmospheric boundary layer, detailing computational performance and realistic wake interactions.

17 WIND ENERGY↗

Executive Summary: Special Section on Credible Computational Fluid Dynamics Simulations

This summary presents the motivation for the Special Section on the credibility of computational fluid dynamics (CFD) simulations, its objective, its background and context, its content, and its major conclusions. Verification and validation (V&V) are the processes for establishing the credibility of CFD simulations. Validation assesses whether correct things are performed and verification assesses whether they are performed correctly. Various aspects of V&V are discussed. Progress is made in verification of simulation models. Considerable effort is still needed for developing a systematic validation method that can assess the credibility of simulated reality.

Mehta, Unmeel B.↗

Validation Of Critical Knowledge-Based Systems

Report discusses approach to verification and validation of knowledge-based systems. Also known as "expert systems". Concerned mainly with development of methodologies for verification of knowledge-based systems critical to flight-research systems; e.g., fault-tolerant control systems for advanced aircraft. Subject matter also has relevance to knowledge-based systems controlling medical life-support equipment or commuter railroad systems.

Duke, Eugene L.↗

V and V techniques for FPGA-based I and C systems - How do they compare with techniques for microprocessors? - 355

We compare verification and validation (V and V) techniques for FPGA and microprocessor-based instrumentation and control (I and C) systems from the point of view of standards compliance, an approach based on behavioural properties, and the analysis of vulnerabilities. We found that the non-technology-specific elements of the standards considered are very similar. Differences are more marked when considering behavioural properties and vulnerabilities: the amount of effort required and confidence level obtained depend on a number of properties of the particular design under verification. (authors)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Gasification Studies: Task 4 Topical Report, Utah Clean Coal Program

A key objective of the Task 4 activities has been to develop simulation tools to support development, troubleshooting and optimization of pressurized entrained-flow coal gasifiers. The overall gasifier models (Subtask 4.1) combine submodels for fluid flow (Subtask 4.2) and heat transfer (Subtask 4.3) with fundamental understanding of the chemical processes (Subtask 4.4) processes that take place as coal particles are converted to synthesis gas and slag. However, it is important to be able to compare predictions from the models against data obtained from actual operating coal gasifiers, and Subtask 4.6 aims to provide an accessible, non-proprietary system, which can be operated over a wide range of conditions to provide well-characterized data for model validation. Highlights of this work include: (1) Verification and validation activities performed with the Arches coal gasification simulation tool on experimental data from the CANMET gasifier (Subtask 4.1). (2) The simulation of multiphase reacting flows with coal particles including detailed gas-phase chemistry calculations using an extension of the one-dimensional turbulence model’s capability (Subtask 4.2). (3) The demonstration and implementation of the Reverse Monte Carlo ray tracing (RMCRT) radiation algorithm in the ARCHES code (Subtask 4.3). (4) Determination of steam and CO 2 gasification kinetics of bituminous coal chars at high temperature and elevated pressure under entrained-flow conditions (Subtask 4.4). In addition, attempts were made to gain insight into the chemical structure differences between young and mature coal soot, but both NMR and TEM characterization efforts were hampered by the highly reacted nature of the soot. (5) The development, operation, and demonstration of in-situ gas phase measurements from the University of Utah’s pilot-scale entrained-flow coal gasifier (EFG) (Subtask 4.6). This subtask aimed at acquiring predictable, consistent performance and characterizing the environment within the gasifier.

01 COAL, LIGNITE, AND PEAT↗

NASA Stennis Space Center V and V Capabilities Overview

The objective are provide independent field measurement ground capability for satellite and aircraft mounted in-flight sensor validation. NASA Stennis is considering expanding its Verification and Validation (V&V) range to support LIDAR and digital camera characterization. Soliciting input for requirements and suggestion.

Ryan, Robert↗

A Comprehensive Validation Methodology for Sparse Experimental Data

A comprehensive program of verification and validation has been undertaken to assess the applicability of models to space radiation shielding applications and to track progress as models are developed over time. The models are placed under configuration control, and automated validation tests are used so that comparisons can readily be made as models are improved. Though direct comparisons between theoretical results and experimental data are desired for validation purposes, such comparisons are not always possible due to lack of data. In this work, two uncertainty metrics are introduced that are suitable for validating theoretical models against sparse experimental databases. The nuclear physics models, NUCFRG2 and QMSFRG, are compared to an experimental database consisting of over 3600 experimental cross sections to demonstrate the applicability of the metrics. A cumulative uncertainty metric is applied to the question of overall model accuracy, while a metric based on the median uncertainty is used to analyze the models from the perspective of model development by analyzing subsets of the model parameter space.

Norman, Ryan B.↗

VALIDATION OF ANALYTICAL METHODS AND INSTRUMENTATION FOR BERYLLIUM MEASUREMENT: REVIEW AND SUMMARY OF AVAILABLE GUIDES, PROCEDURES, AND PROTOCOLS

This document proposes to provide a listing of available sources which can be used to validate analytical methods and/or instrumentation for beryllium determination. A literature review was conducted of available standard methods and publications used for method validation and/or quality control. A comprehensive listing of the articles, papers, and books reviewed is given in Appendix 1. Available validation documents and guides are listed in the appendix; each has a brief description of application and use. In the referenced sources, there are varying approaches to validation and varying descriptions of validation at different stages in method development. This discussion focuses on validation and verification of fully developed methods and instrumentation that have been offered up for use or approval by other laboratories or official consensus bodies such as ASTM International, the International Standards Organization (ISO) and the Association of Official Analytical Chemists (AOAC). This review was conducted as part of a collaborative effort to investigate and improve the state of validation for measuring beryllium in the workplace and the environment. Documents and publications from the United States and Europe are included. Unless otherwise specified, all documents were published in English.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Status of the framework for research in nuclear science and engineering - 25460

The Framework for Research in Nuclear Science and Engineering (FRENSIE) is a collection of packages written in C++ that are designed primarily to aid in methods development. New features are continually being added to the various packages and as a result, the Forward Adjoint Continuous Energy Monte Carlo (FACEMC) tool provided by FRENSIE continues to undergo verification and validation. While FRENSIE is not currently open source, the ultimate goal is for it to be released as such. A few of the more recent developments in FRENSIE include the addition of combinatorial geometry capabilities using ROOT, tet and hex meshing, support for thermal neutron S (α; β) data, photon Doppler broadening, electron interactions using basic analog electron physics models as well as an elastic moment-preserving model, and atomic relaxation. Preliminary verification results for much of the newly added physics models show good agreement between FACEMC and MCNP6. (authors)

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

V & V of A Spacecrafts Autonomous Planner Through Extended Automation

We have introduced and used significant automation during the verification and validation (V & V) of a spacecraft's autonomous planner. This paper describes the problem we faced, the solution we employed, and the applicability of our approach in a general V & V setting.

planning↗

Design and performance of a scalable, parallel statistics toolkit.

Most statistical software packages implement a broad range of techniques but do so in an ad hoc fashion, leaving users who do not have a broad knowledge of statistics at a disadvantage since they may not understand all the implications of a given analysis or how to test the validity of results. These packages are also largely serial in nature, or target multicore architectures instead of distributed-memory systems, or provide only a small number of statistics in parallel. This paper surveys a collection of parallel implementations of statistics algorithm developed as part of a common framework over the last 3 years. The framework strategically groups modeling techniques with associated verification and validation techniques to make the underlying assumptions of the statistics more clear. Furthermore it employs a design pattern specifically targeted for distributed-memory parallelism, where architectural advances in large-scale high-performance computing have been focused. Moment-based statistics (which include descriptive, correlative, and multicorrelative statistics, principal component analysis (PCA), and k-means statistics) scale nearly linearly with the data set size and number of processes. Entropy-based statistics (which include order and contingency statistics) do not scale well when the data in question is continuous or quasi-diffuse but do scale well when the data is discrete and compact. We confirm and extend our earlier results by now establishing near-optimal scalability with up to 10,000 processes.

99 GENERAL AND MISCELLANEOUS↗

The Influences of Neutron Irradiation on Aggregate Induced Degradation of Concrete

Reactor cavity concrete, the primary support structure for the reactor pressure vessel (RPV), is exposed to chronic neutron/gamma radiation during normal operation. During long term operation, the interaction of neutron irradiation with the concrete’s constituents may cause premature degradation of the concrete structure, as highlighted by a review of concrete properties in nuclear power plant environments. At high fluence levels, as in biological shielding, neutron irradiation may cause amorphization of the crystalline components of concrete, i.e., mineral aggregates, and volume changes, which are typically expansive in nature. Volume expansion can generate tensile stresses within concrete which can induce microcracking and/or result in debonding of aggregate with the matrix. On the other hand, structural disordering can result in changes in the stability of the phase in aqueous environments. This report presents the findings of investigations performed over 3 years through the collaboration of researchers from University of California, Los Angeles, Arizona State University, and Oak Ridge National Laboratory. The first part of the study addresses the effect of neutron irradiation on the durability of aggregates. Comparisons of aqueous dissolution rates, as a function of pH and temperature, were performed for aggregates that are either pristine (i.e., non-irradiated) or exposed to Ar+ ion irradiation at specified doses. These experimental results were coupled with molecular dynamics simulations of atomic scale changes in the crystallographic structure of the mineral and any resulting changes in physical properties (e.g., density) that result. The second section focuses on macroscopic effects of such changes in aggregate behavior in concrete degradation, primarily through changes in the concrete’s microstructure. Particularly, the effects akin to those originating from alkali-silica reaction (ASR) were evaluated. The project is structured to encompass 6 main tasks, as follows: Task 1: Selection of aggregates in relation to their abundance and mineralogy, and their irradiation Task 2: Molecular dynamics (MD): The effects of irradiation on the atomic disordering of aggregates Task 3: The influences of irradiation on aggregate reactivity Task 4: Reactive-transport simulation of expansive product formation in concrete microstructures Task 5: X-FEM-based modeling of damage evolution due to irradiation-induced aggregates reactions Task 6: Benchmarking, verification and validation of the simulation modules Thus, a rigorous understanding of irradiation-assisted mineral alterations was used to develop a mechanistic degradation model for concrete exposed to neutrons, while considering aspects of: chemical reaction (dissolution and precipitation), mass and ion transport, and damage evolutions. The models developed were embedded in a multi-physics aging code for nuclear components and structures called Grizzly, which allows for benchmarking, verification, and validation against expansion data acquired on concrete undergoing alkali-silica reaction, a physically/chemically equivalent form of degradation that develops in the absence of radiation. These findings provide insight into the sensitivities of minerals to irradiation, by highlighting characteristics of concretes and power plants subject to such risks. The research will aid the nuclear power industry to anticipate and mitigate such risks in light of second license renewals.

36 MATERIALS SCIENCE↗