Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “verification & validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

The NETL MFiX Suite of multiphase flow models: A brief review and recent applications of MFiX-TFM to fossil energy technologies

Here, the MFiX suite of multiphase computational fluid dynamics (CFD) codes is being developed at U.S. Department of Energy's National Energy Technology Laboratory (NETL). It includes several different approaches to multiphase simulation: MFiX-TFM, a two-fluid (Eulerian–Eulerian) model; MFiX-DEM, an Eulerian fluid model with a Lagrangian Discrete Element Model for the solids phase; and MFiX-PIC, Eulerian fluid model with Lagrangian particle ‘parcels’ representing particle groups. These models are undergoing continuous development and application, with verification, validation, and uncertainty quantification (VV&UQ) as integrated activities. After a brief summary of recent progress in the verification, validation and uncertainty quantification (VV&UQ), this article highlights two recent accomplishments in the application of MFiX-TFM to fossil energy technology development. First, recent application of MFiX to the pilot-scale KBR TRIG™ Transport Gasifier located at DOE's National Carbon Capture Center (NCCC) is described. Gasifier performance over a range of operating conditions was modeled and compared to NCCC operational data to validate the ability of the model to predict parametric behavior. Second, comparison of code predictions at a detailed fundamental scale is presented studying solid sorbents for the post-combustion capture of CO 2 from flue gas. Specifically designed NETL experiments are being used to validate hydrodynamics and chemical kinetics for the sorbent-based carbon capture process.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Formal verification and validation of run-to-completion style state charts using Event-B

State chart notations with ‘run to completion’ semantics are popular with engineers for designing controllers that react to environment events with a sequence of state transitions but lack formal refinement and rigorous verification methods. State chart models are typically used to design complex control systems that respond to environmental triggers with a sequential process. The model is usually constructed at a concrete level and verified and validated using animation techniques relying on human judgement. Event-B, on the other hand, is based on refinement from an initial abstraction and is designed to make formal verification by automatic theorem provers feasible. Abstraction and formal verification provide greater assurance that critical (e.g. safety or security) properties are not violated by the control system. In this paper, we introduce a notion of refinement into a ‘run to completion’ state chart modelling notation and leverage Event-B’s tool support for theorem proving. We describe the difficulties in translating ‘run to completion’ semantics into Event-B refinements and suggest a solution. We illustrate our approach and show how models can be validated at different refinement levels using our scenario checker animation tools. We show how critical invariant properties can be verified by proof despite the reactive nature of the system and how behavioural aspects of the system can be verified by testing the expected reactions using a temporal logic, model checking approach. To verify liveness, we outline a proof that the run to completion is deadlock-free and converges to complete the run.

97 MATHEMATICS AND COMPUTING↗

Europa Clipper Magnetometer Thermal Design Evolution, Validation, and Verification

Europa Clipper Spacecraft is exposed to a high radiation environment and is limited with power. This makes the thermal design of Europa Clipper magnetometer more challenging. The design is required to be highly insulated and at the same time magnetically clean. This paper describes the thermal design evolution of Europa Clipper Magnetometer. A thermal vacuum test is conducted in Europa Clipper orbit’s relevant environment to characterize the requirements and estimate the power consumption. A flight-like engineering model magnetometer from the University of California at Los Angeles (UCLA) is used for this test. Magnetically clean Cernox temperature measurement sensors with the accuracy of ±0.1ºC are used to measure the temperature value inside the sensor head and across the main frame interfaces. This level of accuracy in temperature measurement is required to capture the temperature gradient across the sensor head in a relevant environment which impacts the magnetometer measurement accuracy. Test data is used to correlate the thermal model and characterize the heat leak across the interfaces. Validated thermal model is used as a verification tool for power consumption and thermal requirements.

Caron, Ryan↗

Nuclear Energy Advanced Modeling and Simulation (NEAMS) Waste Integrated Performance and Safety Codes (IPSC) : FY10 development and integration.

This report describes the progress in fiscal year 2010 in developing the Waste Integrated Performance and Safety Codes (IPSC) in support of the U.S. Department of Energy (DOE) Office of Nuclear Energy Advanced Modeling and Simulation (NEAMS) Campaign. The goal of the Waste IPSC is to develop an integrated suite of computational modeling and simulation capabilities to quantitatively assess the long-term performance of waste forms in the engineered and geologic environments of a radioactive waste storage or disposal system. The Waste IPSC will provide this simulation capability (1) for a range of disposal concepts, waste form types, engineered repository designs, and geologic settings, (2) for a range of time scales and distances, (3) with appropriate consideration of the inherent uncertainties, and (4) in accordance with robust verification, validation, and software quality requirements. Waste IPSC activities in fiscal year 2010 focused on specifying a challenge problem to demonstrate proof of concept, developing a verification and validation plan, and performing an initial gap analyses to identify candidate codes and tools to support the development and integration of the Waste IPSC. The current Waste IPSC strategy is to acquire and integrate the necessary Waste IPSC capabilities wherever feasible, and develop only those capabilities that cannot be acquired or suitably integrated, verified, or validated. This year-end progress report documents the FY10 status of acquisition, development, and integration of thermal-hydrologic-chemical-mechanical (THCM) code capabilities, frameworks, and enabling tools and infrastructure.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Verification and Validation Data for Computational Unsteady Aerodynamics

Computational Unsteady Aerodynamics computer codes are being increasingly used. In order to validate their results they must be tested against valid experimental data. The present report aims at collecting reliable experimental data on unsteady aerodynamics and presenting them in a form which permits use for verification of codes. For ease of handling, the data are also presented in machine readable form (CD-ROM). Data on increasingly complex generic forms were selected and the following categories are covered: flutter, buffet, stability and control, dynamic stall, cavity flows, store separation. Computational solutions are included in order to permit evaluation of codes and analysis of solutions which differ from experimental data.

Applied Vehicle Technology Panel (AVT)Task Group↗

Verification and validation of a rapid heat transfer calculation methodology for transient melt pool solidification conditions in powder bed metal additive manufacturing

A fundamental understanding of spatial and temporal thermal distributions is crucial for predicting solidification and solid-state microstructural development in parts made by additive manufacturing. While sophisticated numerical techniques that are based on finite element or finite volume methods are useful for gaining insight into these phenomena at the length scale of the melt pool (100 - 500 µm), they are ill-suited for predicting engineering trends over full part cross-sections (> 10 x 10 cm) or many layers over long process times (> many days) due to the necessity of fully resolving the heat source characteristics. On the other hand, it is extremely difficult to resolve the highly dynamic nature of the process using purely in-situ characterization techniques. This article proposes a pragmatic alternative based on a semi-analytical approach to predicting the transient heat conduction during powder bed metal additive manufacturing process. The model calculations were theoretically verified for selective laser melting of AlSi10Mg and electron beam melting of IN718 powders for simple cross-sectional geometries and the transient results are compared to steady state predictions from the Rosenthal equation. It is shown that the transient effects of the scan strategy create significant variations in the melt pool geometry and solid-liquid interface velocity, especially as the thermal diffusivity of the material decreases and the pre-heat of the process increases. With positive verification of the strategy, the model was then experimentally validated to simulate two point-melt scan strategies during electron beam melting of IN718, one intended to produce a columnar and one an equiaxed grain structure. Lastly, through comparison of the solidification conditions (i.e. transient and spatial variations of thermal gradient and liquid-solid interface velocity) predicted by the model to phenomenological CET theory, the model accurately predicted the experimental grain structures.

36 MATERIALS SCIENCE↗

Verification and validation of the Alternative Nonlinear Two-phase Subchannel (ANTS) code

The Alternative Nonlinear Two-phase Subchannel solver (ANTS) code was written to provide a fast-running, steady-state, pin-resolved modeling and simulation tool for analysis of common boiling water reactor (BWR) geometry and common operating conditions. ANTS has been integrated into the Virtual Environment for Reactor Application (VERA) core simulator software, where it can be used to provide a thermal/hydraulic (T/H) subchannel solution that is then used to provide neutronic feedback as well as perform the fuel depletion and temperature solution. Herein, this paper presents the rigorous analysis performed on the ANTS code, which includes both code and solution verification testing, benchmarking with the existing two-phase subchannel capability in VERA, CTF, and validation testing using popular two-phase experiments such as PWR Sub-channel and Bundle Tests (PSBT), BWR Full-size Fine-mesh Bundle Tests (BFBT), Risø, and FRIGG. This assessment was used to qualify ANTS for its intended applications before its use for core-scale, multiphysics BWR simulations. In general, it was found that agreement with experimental data was good; errors were within the range of experimental data uncertainty. Furthermore, code and solution verification confirmed that the governing equations and the most important closure terms were correctly implemented and behaving as expected.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Verification and Validation of High Explosive Reactive Burn Models Implemented in LANL's EAP and LAP Code Base (FY2020 L2 Milestone MRT 7129) [Slides]

Advanced reactive burn models enable phenomena to be modeled that aren’t possible with programmed burn. Programmed burn propagates a burn front at a prescribed speed from a prescribed initiation point. Reactive burn uses the hydro variables (pressure, temperature, etc.) to determine when, how rapidly, and to what extent a zone detonates. This enables a completely new set of problems to be simulated. Our goal in this milestone has been to improve the usability of reactive burn modes. Thus, the closure criteria are: 1. Perform code and solution verification of the reactive burn models using appropriate solutions and simplified HE setups. 2. Perform validation assessments using small-scale experiments. 3. Evaluate sensitivities and quantify uncertainties due to model form variations and mesh dependencies.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

OSIRIS Validation and Verification Report

The On-Site Inspection RadioIsotopic Spectroscopy (OSIRIS) system is a gamma-ray spectroscopy instrument for on-site inspections conducted under the Comprehensive Nuclear-Test-Ban Treaty (CTBT). The OSIRIS software filters spectral analysis data, revealing information to users on only 17 CTBT-relevant fission-product isotopes. In this report, we review the CTBT requirements for on-site inspection radionuclide identifiers, plus additional requirements imposed by the design team. Then a series of validation tests conducted during OSIRIS development are described. The validation tests were designed to gauge if the nascent OSIRIS system met those requirements. We conclude with a set of recommended verification tests to ensure that newly-manufactured OSIRIS systems also will meet the requirements.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

(Doublon) Benchmarking of Different Inverse Point Kinetics Implementations for an Autocorrected Reactimeter Algorithm

In November 2017, the Transient Reactor Test Facility returned to operation. Since that time, many transient test series have been completed, such as the Transient Heatsink Overpower Response capsule (THOR), the Transient Water Irradiation System for TREAT (TWIST), and Sirius. Each has provided valuable data for materials performance and reactor safety that can be applied in future designs. During each experimental series, detector count rates provided important information on the core behavior during transients. However, a limitation of these data is that variations in the neutron distribution during experiments can cause errors when attempting to infer reactivity evolution from detector signals. Neutron physics codes can be used to compute the flux shape variations. However, this is a poor solution when the experimental data is used for code verification, validation and uncertainty quantification. Indeed, if the output of the code is used both as a reference and to correct what the reference is compared to, the circular dependency limits the quality of the verification, validation and uncertainty quantification approach. To overcome this problem, the autocorrected reactimeter algorithm (ACRA) has been developed. This approach infers a time-dependent reactivity evolution by testing different spatial corrections and selecting the one that minimizes reactivity variations when the core is in a frozen configuration (i.e., when there is no variation in parameters affecting reactivity). However, the scope of this method was limited to transients where there were negligible thermal feedback. Indeed, the core is never in a frozen configuration when the fuel temperature varies during the whole transient. This is our motivation for developing an improved version of the ACRA that does not require frozen configurations. To develop this new algorithm, we need a precise and unbiased implementation of the inverse point kinetic equations (IPKEs) as any error in the reactivity evaluation will be propagated into the choice of the optimal spatial correction. Indeed, the previous reactimeter algorithm would use approximations, such as a negligible flux amplitude derivative, to focus on rapidity. For the numerical validation of ACRA, we aim at absolute error under for reactivity derived from signals similar to the one of this study. In this summary, we test eight different IPKE implementations. Each will process a mockup signal built for this study, similar to those that the future ACRA will process. Each reactivity output will be compared to the reference reactivity that has been used to generate the mockup signal. The implementation minimizing the difference with the reference reactivity will be used in the development of a new ACRA formulation.

73 - NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Preliminary Verification and Validation of WEC-Sim, an Open-Source Wave Energy Converter Design Tool: Preprint

To promote and support the wave energy industry, a wave energy converter (WEC) design tool, WEC-Sim, is being developed by Sandia National Laboratories and the National Renewable Energy Laboratory. In this paper, the WEC-Sim code is used to model a point absorber WEC designed by the U.S. Department of Energy's reference model project. Preliminary verification was performed by comparing results of the WEC-Sim simulation through a code-to-code comparison, utilizing the commercial codes ANSYS-AQWA, WaveDyn, and OrcaFlex. A preliminary validation of the code was also performed by comparing WEC-Sim simulation results to experimental wave tank tests.

16 TIDAL AND WAVE POWER↗

A Transient Reactor Physics Experiment with High-Fidelity, 3-D Flux Measurements for Validation and Verification

This project led to the design and construction of a system of novel micro-pocket fission detectors (MPFDs) and their deployment as part of a series of steady-state and transient experiments at the University of Wisconsin Nuclear Reactor (UWNR). The data acquired during these experiments is intended for use in validation of reactor-physics models, including those developed as part of the NEAMS Toolkit (e.g., PROTEUS) and others. Part of the work led to a completely new computational model of UWNR based on Python-automated input generation for both MCNP and Serpent, and preliminary efforts have been made to develop a mesh for models in PROTEUS and other deterministic tools.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Development, Verification and Validation of Parallel, Scalable Volume of Fluid CFD Program for Propulsion Applications

There are many instances involving liquid/gas interfaces and their dynamics in the design of liquid engine powered rockets such as the Space Launch System (SLS). Some examples of these applications are: Propellant tank draining and slosh, subcritical condition injector analysis for gas generators, preburners and thrust chambers, water deluge mitigation for launch induced environments and even solid rocket motor liquid slag dynamics. Commercially available CFD programs simulating gas/liquid interfaces using the Volume of Fluid approach are currently limited in their parallel scalability. In 2010 for instance, an internal NASA/MSFC review of three commercial tools revealed that parallel scalability was seriously compromised at 8 cpus and no additional speedup was possible after 32 cpus. Other non-interface CFD applications at the time were demonstrating useful parallel scalability up to 4,096 processors or more. Based on this review, NASA/MSFC initiated an effort to implement a Volume of Fluid implementation within the unstructured mesh, pressure-based algorithm CFD program, Loci-STREAM. After verification was achieved by comparing results to the commercial CFD program CFD-Ace+, and validation by direct comparison with data, Loci-STREAM-VoF is now the production CFD tool for propellant slosh force and slosh damping rate simulations at NASA/MSFC. On these applications, good parallel scalability has been demonstrated for problems sizes of tens of millions of cells and thousands of cpu cores. Ongoing efforts are focused on the application of Loci-STREAM-VoF to predict the transient flow patterns of water on the SLS Mobile Launch Platform in order to support the phasing of water for launch environment mitigation so that vehicle determinantal effects are not realized.

West, Jeff↗

Verification and Validation of CFD Simulations involving Twin Rectangular Jets using Steady RANS in Star-CCM+

Analyses such as component design and safety analysis can be conducted through careful application of computational fluid dynamics (CFD) codes. Before these codes can be considered ready for specific analysis, benchmarking (validation) against applicable datasets is needed. The twin jet water facility (TJWF) developed originally at the University of Tennessee, Knoxville has been purposed for aiding in this type of work. The TJWF allows for large data sets to be created using state of the art non-invasive measurement techniques within a mostly transparent testing volume. Utilizing velocity data collected in the TJWF by Wang et. al., the Star-CCM+ code was benchmarked a using steady Reynolds averaged Navier Stokes (RANS) framework for a combining two jet case. Careful efforts to properly conduct verification of the numerical work was undertaken with a sample reported in this summary. The computational results were validated against the experimental work and found to be within acceptable limits. The parameters of interest were the merging and combining points (MP and CP) of the twin jets, and the velocity profiles at increasing heights after injection. Fig.1 provides a graphical depiction of the twin jets combining within a free shear volume with key geometric factors included. The MP and velocity profiles were predicted with reasonable agreement. Whereas, the combining point of the twin jets was found to be over-predicted by {approx}24% difference. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Uncertainty quantification's role in modeling and simulation planning, and credibility assessment through the predictive capability maturity model

The importance of credible, trustworthy numerical simulations is obvious especially when using the results for making high-consequence decisions. Determining the credibility of such numerical predictions is much more difficult and requires a systematic approach to assessing predictive capability, associated uncertainties and overall confidence in the computational simulation process for the intended use of the model. This process begins with an evaluation of the computational modeling of the identified, important physics of the simulation for its intended use. This is commonly done through a Phenomena Identification Ranking Table (PIRT). Then an assessment of the evidence basis supporting the ability to computationally simulate these physics can be performed using various frameworks such as the Predictive Capability Maturity Model (PCMM). There were several critical activities that follow in the areas of code and solution verification, validation and uncertainty quantification, which will be described in detail in the following sections. Here, we introduce the subject matter for general applications but specifics are given for the failure prediction project. In addition, the first task that must be completed in the verification & validation procedure is to perform a credibility assessment to fully understand the requirements and limitations of the current computational simulation capability for the specific application intended use. The PIRT and PCMM are tools used at Sandia National Laboratories (SNL) to provide a consistent manner to perform such an assessment. Ideally, all stakeholders should be represented and contribute to perform an accurate credibility assessment. PIRTs and PCMMs are both described in brief detail below and the resulting assessments for an example project are given.

97 MATHEMATICS AND COMPUTING↗

Dosimetric Verification and Validation of Conformal and IMRT Treatments Fields with an Ionization Chamber 2D-Array

A three-dimensional treatment planning system requires comparisons of calculated and measured dose distributions. It is necessary to confirm by means of patient specific QA that the dose distributions are correctly calculated, and that the patient data is correctly transferred to and delivered by the treatment machine. We used an analysis software for bi-dimensional dosimetric verification of conformal treatment and IMRT fields using as objective criterion the gamma index. An ionization chamber bi-dimensional array was used for absolute dose measurement in the complete field area.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Investigation of a Verification and Validation Tool with a Turbofan Aircraft Engine Application

The development of more advanced control architectures for turbofan aircraft engines can yield gains in performance and efficiency over the lifetime of an engine. However, the implementation of these increasingly complex controllers is contingent on their ability to provide safe, reliable engine operation. Therefore, having the means to verify the safety of new control algorithms is crucial. As a step towards this goal, CoCoSim, a publicly available verification tool for Simulink, is used to analyze C-MAPSS40k, a 40,000 lbf class turbo-fan engine model developed at NASA for testing new control algorithms. Due to current limitations of the verification software, several modifications are made to C-MAPSS40k to achieve compatibility with CoCoSim. Some of these modifications sacrifice fidelity to the original model. Several safety and performance requirements typical for turbofan engines are identified and constructed into a verification framework. Preliminary results using an industry standard baseline controller for these requirements are presented. While verification capabilities are demonstrated, a truly comprehensive analysis will require further development of the verification tool.

V&↗