Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “verification & validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

Zero power experiment for molten salt reactor - code verification and validation request

Molten Salt Reactors (MSRs) are one of the six perspective Generation IV nuclear technologies that should fulfil sustainability, economics, safety, and proliferation resistance goals. In recent years these concepts have attracted increased interest in research as well as in industry. In the context of developing new, innovative technology, a zero-power experiment would be an ideal option for improving the understanding of MSR systems under low-risk and low-cost conditions. The given research was focused on cross-verification of the nuclear codes for MSR modelling and simulations as required for the development of the first design of a potential facility and a draft of an experimental programme. The analysis included the evaluation of lattice and Monte Carlo codes. The study showed that all considered nuclear tools were in good agreement with each other. Although this does not mean the results will match the real experimental data, which is essential for the regulatory approval of a novel technology. Currently, experimental data is almost absent for MSR technology. Hence, a zero power experiment is needed to assure we can rely on modelling and simulation studies for further development of MSR technology and deliver real-world experiments to support the licensing of future MSRs. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Validation and Verification of Operational Land Analysis Activities at the Air Force Weather Agency

The NASA developed Land Information System (LIS) is the Air Force Weather Agency's (AFWA) operational Land Data Assimilation System (LDAS) combining real time precipitation observations and analyses, global forecast model data, vegetation, terrain, and soil parameters with the community Noah land surface model, along with other hydrology module options, to generate profile analyses of global soil moisture, soil temperature, and other important land surface characteristics. (1) A range of satellite data products and surface observations used to generate the land analysis products (2) Global, 1/4 deg spatial resolution (3) Model analysis generated at 3 hours. AFWA recognizes the importance of operational benchmarking and uncertainty characterization for land surface modeling and is developing standard methods, software, and metrics to verify and/or validate LIS output products. To facilitate this and other needs for land analysis activities at AFWA, the Model Evaluation Toolkit (MET) -- a joint product of the National Center for Atmospheric Research Developmental Testbed Center (NCAR DTC), AFWA, and the user community -- and the Land surface Verification Toolkit (LVT), developed at the Goddard Space Flight Center (GSFC), have been adapted to operational benchmarking needs of AFWA's land characterization activities.

Shaw, Michael↗

User Guidelines and Best Practices for CASL VUQ Analysis Using Dakota

In general, Dakota is the Consortium for Advanced Simulation of Light Water Reactors (CASL) delivery vehicle for verification, validation, and uncertainty quantification (VUQ) algorithms. It permits ready application of the VUQ methods described above to simulation codes by CASL researchers, code developers, and application engineers. More specifically, the CASL VUQ Strategy [33] prescribes the use of Predictive Capability Maturity Model (PCMM) assessments [37]. PCMM is an expert elicitation tool designed to characterize and communicate completeness of the approaches used for computational model definition, verification, validation, and uncertainty quantification associated with an intended application. Exercising a computational model with the methods in Dakota will yield, in part, evidence for a predictive capability maturity model (PCMM) assessment. Table 1.1 summarizes some key predictive maturity related activities (see details in [33]), with examples of how Dakota fits in. This manual offers CASL partners a guide to conducting Dakota-based VUQ studies for CASL problems. It motivates various classes of Dakota methods and includes examples of their use on representative application problems. On reading, a CASL analyst should understand why and how to apply Dakota to a simulation problem.

97 MATHEMATICS AND COMPUTING↗

Verification and Validation of High-Fidelity Multi-Physics Simulation Codes for Advanced Nuclear Reactors (Year 2)

The project objective is to verify and validate a suite of high-fidelity multi-physics simulation methods and codes developed during the previous I-NERI projects, against Monte Carlo solutions and experimental measurements for LWR and VHTR cores. Using benchmark problems developed during the previous year, ANL and KAERI continued to work on verifying the neutronics code DeCART and associated cross section libraries. Initial progress was also made on validating the code against experimental data. KAERI focused on verifying the DeCART code against numerical benchmark problems such as a PMR200 2-D pin cell/core and a HTTR 2-D block/core as well as improving DeCART capabilities such as the cross-section library group structure optimization, the fundamental and generalized adjoint equation solver, cylindrical boundary treatment, improved ray tracing, and implementing the direct resonance integral table method for resonance treatment. Verification test results for the updated capabilities showed substantial improvements in the estimation of eigenvalue and reaction rates.

Lee, C. H.↗

A Tool for Verification and Validation of Neural Network Based Adaptive Controllers for High Assurance Systems

High reliability of mission- and safety-critical software systems has been identified by NASA as a high-priority technology challenge. We present an approach for the performance analysis of a neural network (NN) in an advanced adaptive control system. This problem is important in the context of safety-critical applications that require certification, such as flight software in aircraft. We have developed a tool to measure the performance of the NN during operation by calculating a confidence interval (error bar) around the NN's output. Our tool can be used during pre-deployment verification as well as monitoring the network performance during operation. The tool has been implemented in Simulink and simulation results on a F-15 aircraft are presented.

Gupta, Pramod↗

Recommendations for Radiological Data Assessment Implementation

Since thorough verification, validation, and data quality assessment (DQA) processes may delay incident commanders and elected and appointed officials from making key decisions, the U.S. Department of Homeland Security (DHS) National Urban Security Technology Laboratory (NUSTL) tasked Pacific Northwest National Laboratory (PNNL) to develop tools and guidance for the federal, state, local, tribal, and territorial (FSLTT) responders using research, discussions with select FSLTT responders, and the experiences of subject matter experts in incident response. This report provides NUSTL with recommendations on best practices for verification, validation, and data quality assessment for the data collected by responders during a radiological or nuclear event. The purpose of this report is to inform the development of a DQA toolkit aimed at the needs of data assessors during the response to a radiological incident.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

CTF Validation and Verification: Version 4.3

Coolant-Boiling in Rod Arrays- Two Fluids (COBRA-TF) is a thermal/hydraulic (T/H) simulation code designed for light water reactor (LWR) analysis. It uses a two-fluid, three-field (i.e., fluid film, fluid drops, and vapor) modeling approach. Both subchannel and 3D Cartesian forms of nine conservation equations are available for LWR modeling. The code was originally developed by Pacific Northwest Laboratory in 1980 and has been used and modified by several institutions over the last several decades. COBRA-TF is also used at the Pennsylvania State University (PSU) by the Reactor Dynamics and Fuel Modeling Group (RDFMG) and has been improved, updated, and subsequently became the CTF. One part of the improvement process includes validating the methods in CTF. This document seeks to provide a certain level of certainty and confidence in the predictive capabilities of the code for the scenarios it was designed to model—rod bundle geometries with operating conditions that are representative of prototypical pressurized water reactor (PWR)s and boiling water reactor (BWR)s in both normal and accident conditions. This is done by modeling a variety of experiments that simulate these scenarios and then presenting a qualitative and quantitative analysis of the results that demonstrates the accuracy to which CTF is capable of capturing specific quantities of interest.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

CTF Validation and Verification: Version 4.4

Coolant-Boiling in Rod Arrays- Two Fluids (COBRA-TF) is a thermal/hydraulic (T/H) simulation code designed for light water reactor (LWR) analysis. It uses a two-fluid, three-field (i.e., fluid film, fluid drops, and vapor) modeling approach. Both subchannel and 3D Cartesian forms of nine conservation equations are available for LWR modeling. The code was originally developed by Pacific Northwest Laboratory in 1980 and has been used and modified by several institutions over the last several decades. COBRA-TF is also used at the Pennsylvania State University (PSU) by the Reactor Dynamics and Fuel Modeling Group (RDFMG) and has been improved, updated, and subsequently became the CTF. One part of the improvement process includes validating the methods in CTF. This document seeks to provide a certain level of certainty and confidence in the predictive capabilities of the code for the scenarios it was designed to model—rod bundle geometries with operating conditions that are representative of prototypical pressurized water reactor (PWR)s and boiling water reactor (BWR)s in both normal and accident conditions. This is done by modeling a variety of experiments that simulate these scenarios and then presenting a qualitative and quantitative analysis of the results that demonstrates the accuracy to which CTF is capable of capturing specific quantities of interest.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

CTF 4.0 Validation and Verification

Coolant-Boiling in Rod Arrays- Two Fluids (COBRA-TF) is a Thermal/Hydraulic (T/H) simulation code designed for Light Water Reactor (LWR) analysis. It uses a two-fluid, three-field (i.e. fluid film, fluid drops, and vapor) modeling approach. Both sub-channel and 3D Cartesian forms of nine conservation equations are available for LWR modeling. The code was originally developed by Pacific Northwest Laboratory in 1980 and has been used and modified by several institutions over the last several decades. COBRA-TF is also used at the Pennsylvania State University (PSU) by the Reactor Dynamics and Fuel Modeling Group (RDFMG) and has been improved, updated, and subsequently became the PSU RDFMG version of COBRA-TF (CTF). One part of the improvement process includes validating the methods in CTF. This document seeks to provide a certain level of certainty and confidence in the predictive capabilities of the code for the scenarios it was designed to model—rod bundle geometries with operating conditions that are representative of prototypical Pressurized Water Reactor (PWR)s and Boiling Water Reactor (BWR)s in both normal and accident conditions. This is done by modeling a variety of experiments that simulate these scenarios and then presenting a qualitative and quantitative analysis of the results that demonstrates the accuracy to which CTF is capable of capturing specific quantities of interest.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

CTF Validation and Verification Manual

Coolant-Boiling in Rod Arrays- Two Fluids (COBRA-TF) is a Thermal/Hydraulic (T/H) simulation code designed for Light Water Reactor (LWR) analysis. It uses a two-fluid, three-field (i.e. fluid film, fluid drops, and vapor) modeling approach. Both sub-channel and 3D Cartesian forms of nine conservation equations are available for LWR modeling. The code was originally developed by Pacific Northwest Laboratory in 1980 and has been used and modified by several institutions over the last several decades. COBRA-TF is also used at the Pennsylvania State University (PSU) by the Reactor Dynamics and Fuel Management Group (RDFMG), and has been improved, updated, and subsequently became the PSU RDFMG version of COBRA-TF (CTF). One part of the improvement process includes validating the methods in CTF. This document seeks to provide a certain level of certainty and confidence in the predictive capabilities of the code for the scenarios it was designed to model--rod bundle geometries with operating conditions that are representative of prototypical Pressurized Water Reactor (PWR)s and Boiling Water Reactor (BWR)s in both normal and accident conditions. This is done by modeling a variety of experiments that simulate these scenarios and then presenting a qualitative and quantitative analysis of the results that demonstrates the accuracy to which CTF is capable of capturing specific quantities of interest.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

CTF Validation and Verification (V.4.2)

Coolant-Boiling in Rod Arrays- Two Fluids (COBRA-TF) is a thermal/hydraulic (T/H) simulation code designed for Light Water Reactor (LWR) analysis. It uses a two-fluid, three-field (i.e. fluid film, fluid drops, and vapor) modeling approach. Both sub-channel and 3D Cartesian forms of nine conservation equations are available for LWR modeling. The code was originally developed by Pacific Northwest Laboratory in 1980 and has been used and modified by several institutions over the last several decades. COBRA-TF is also used at the Pennsylvania State University (PSU) by the Reactor Dynamics and Fuel Modeling Group (RDFMG) and has been improved, updated, and subsequently became the PSU RDFMG version of COBRA-TF (CTF). One part of the improvement process includes validating the methods in CTF. This document seeks to provide a certain level of certainty and confidence in the predictive capabilities of the code for the scenarios it was designed to model-rod bundle geometries with operating conditions that are representative of prototypical Pressurized Water Reactor (PWR)s and Boiling Water Reactor (BWR)s in both normal and accident conditions. This is done by modeling a variety of experiments that simulate these scenarios and then presenting a qualitative and quantitative analysis of the results that demonstrates the accuracy to which CTF is capable of capturing specific quantities of interest.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Validation and Verification of Multi-Material Split Rings

Process induced residual stresses commonly occur in composite structures composed of dissimilar materials. These residual stresses form due to differences in the composite materials coefficients of thermal expansion as well as the shrinkage upon cure exhibited by most thermoset polymer matrix materials. Depending upon the specific geometric details of the composite structure and the materials curing parameters, it is possible that these residual stresses can result in interlaminar delamination and fracture within the composite as well as plastic deformation in the structures metallic materials. It is important to consider potential residual stresses when designing composite parts and their manufacturing processes. However, the experimental determination of residual stresses in prototype parts can be prohibitive, both in terms of financial and temporal costs. As an alternative to physical measurement, it is possible for computational tools to be used to quantify potential residual stresses in composite prototype parts. A simplified method for simulating residual stresses was previously validated with two simple bi-material structures. Continuing on, the objective of this study is to further validate the simplified method for simulating residual stresses for bi-material split rings of different composites and layup variations. The validation process uses uncertainty quantification to develop a distribution of possible simulated residual stress states that are compared to experimentally measured residual stress states of fabricated structures similar to those simulated. The results of the comparisons indicate that the proposed finite element modeling approach is capable of accurately simulating the formation of residual stresses in composite structures and a temperature independent material model is adequate within the composites glassy region.

36 MATERIALS SCIENCE↗

FreeMHD: Validation and verification of the open-source, multi-domain, multi-phase solver for electrically conductive flows

The extreme heat fluxes in the divertor region of tokamaks may require an alternative to solid plasma-facing components, for the extraction of heat and the protection of the surrounding walls. Flowing liquid metals are proposed as an alternative, but raise additional challenges that require investigation and numerical simulations. Free surface designs are desirable for plasma-facing components, but steady flow profiles and surface stability must be ensured to limit undesirable interactions with the plasma. Previous studies have mainly used steady-state, 2D, or simplified models for internal flows and have not been able to adequately model free-surface liquid metal (LM) experiments. Therefore, FreeMHD has been recently developed as an open-source magnetohydrodynamics (MHD) solver for free-surface electrically conductive flows subject to a strong external magnetic field. The FreeMHD solver computes incompressible free-surface flows with multi-region coupling for the investigation of MHD phenomena involving fluid and solid domains. The model utilizes the finite-volume OpenFOAM framework under the low magnetic Reynolds number approximation. FreeMHD is validated using analytical solutions for the velocity profiles of closed channel flows with various Hartmann numbers and wall conductance ratios. Next, experimental measurements are then used to verify FreeMHD, through a series of cases involving dam breaking, 3D magnetic fields, and free-surface LM flows. These results demonstrate that FreeMHD is a reliable tool for the design of LM systems under free surface conditions at the reactor scale. Furthermore, it is flexible, computationally inexpensive, and can be used to solve fully 3D transient MHD flows.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

The Preliminary Validation and Verification of GSM

The Generalized Spallation Model, or GSM, simulates hadron-nucleus and nucleus-nucleus collisions at intermediate to high incident energies. It is recommended that use of GSM be limited to interactions for particles and nuclei with kinetic energies greater than ~ 100 MeV, up to ~ 1 T eV/A. GSM was developed to investigate the deprecation of the Los Alamos Quark-Gluon String Model (LAQGSM), as implemented in the event generator LAQGSM03.03. The deprecation of LAQGSM will allow for a simplification of the high energy physics models utilized within the Monte Carlo N-Particle® (MCNP®) transport code1 . MCNP applies simulated data from the Cascade Exciton Model (CEM), as implemented in the CEM03.03 event generator, and the LAQGSM event generator for most high energy reactions, by default, for its simulations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Mesoscale to microscale wind farm flow modeling and evaluation

The increasing size of wind turbines, with rotors already spanning more than 150 m diameter and hub heights above 100 m, requires proper modeling of the atmospheric boundary layer (ABL) from the surface to the free atmosphere. Furthermore, large wind farm arrays create their own boundary layer structure with unique physics. This poses significant challenges to traditional wind engineering models that rely on surface-layer theories and engineering wind farm models to simulate the flow in and around wind farms. However, adopting an ABL approach offers the opportunity to better integrate wind farm design tools and meteorological models. The challenge is how to build the bridge between atmospheric and wind engineering model communities and how to establish a comprehensive evaluation process that identifies relevant physical phenomena for wind energy applications with modeling and experimental requirements. A framework for model verification, validation, and uncertainty quantification is established to guide this process by a systematic evaluation of the modeling system at increasing levels of complexity. In terms of atmospheric physics, ‘building the bridge’ means developing models for the so-called ‘terra incognita,’ a term used to designate the turbulent scales that transition from mesoscale to microscale. This range of scales within atmospheric research deals with the transition from parameterized to resolved turbulence and the improvement of surface boundary-layer parameterizations. The coupling of meteorological and wind engineering flow models and the definition of a formal model evaluation methodology, is a strong area of research for the next generation of wind conditions assessment and wind farm and wind turbine design tools. Some fundamental challenges are identified in order to direct future research in this area.

17 WIND ENERGY↗

A program to generate simulated radioxenon beta–gamma data for concentration verification and validation and training exercises

Abstract Several hundred simulated radioxenon beta-gamma data files were developed to assist in evaluating the performance and results from radioxenon concentration calculation analysis at the International Data Center (IDC) and other National Data Centers (NDC). PNNL developed a Beta-Gamma Simulator (BGSim) that incorporated GEANT-modeled data sets from radioxenon decay chains, as well as functionality to use nuclear detector-acquired data sets to create new beta-gamma spectra with varying amounts of background, 133Xe, 131mXe, 133mXe, 135Xe, and 222Rn and its decay products. The program has been implemented on a web-based applications platform and allows the user to create very specific data sets that incorporate most of the operational parameters for the current beta-gamma systems deployed in the International Monitoring System (IMS) and the On-site Inspection (OSI) equipment. After an initial beta-gamma simulations program was developed, additional uses began to be identified for the program output: training sets of two-dimensional spectra for data analysts at the IDC and other NDC, spectra for exercises such as the Integrated Field Exercise 2014 (IFE14) held in Jordan at the Dead Sea, and testing new analysis methods and algorithms

custom datasets↗

Verification and validation of residual stresses in composite structures

Process-induced residual stresses occur in composite structures composed of dissimilar materials. As these residual stresses could result in fracture, their consideration when designing composite parts is necessary. However, the experimental determination of residual stresses in prototype parts can be time and cost prohibitive. Alternatively, it is possible for computational tools to predict potential residual stresses. Therefore, the objectives of the presented work are to demonstrate an efficient method for simulating residual stresses in composite parts, as well as the potential value of statistical methods during analyses for which material properties are unknown. Specifically, a simplified residual stress modeling approach is implemented within Sandia National Laboratories’ SIERRA/SolidMechanics code. Concurrent with the model development, bi-material composite structures are designed and manufactured to exhibit significant residual stresses. Then, the presented modeling approach is rigorously verified and validated through simulations of the bi-material composite structures’ manufacturing processes, including a mesh convergence study, sensitivity analysis, and uncertainty quantification. The simulations’ final results show adequate agreement with the experimental measurements, indicating the validity of a simple modeling approach, as well as a necessity for the inclusion of material parameter uncertainty in the final residual stress predictions.

42 ENGINEERING↗