Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “verification & validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44

How to Build a Rover: An Overview of the Mars 2020 Mission’s Vehicle System Testbed

While NASA’s Mars rover Perseverance continues to make groundbreaking achievements on the Red Planet, its twin is hard at work here on Earth. The Operational Perseverance Twin for the Integration of Mechanisms and Instruments Sent to Mars, or OPTIMISM, is the Mars 2020 Vehicle System Testbed (VSTB) rover operated by NASA Jet Propulsion Laboratory (JPL) in Pasadena, California. OPTIMISM’s home is the JPL Mars Yard; an outdoor field with red soil that simulates the terrain encountered by Perseverance. The VSTB is a full-scale engineering model of the flight rover, serving a number of functions to ensure mission operations can continue smoothly and on schedule. The VSTB possesses instrumentation, computers, mechanisms, cameras, and a Mobility subsystem that are nearly identical to its extraterrestrial twin. Its high fidelity allows the rover to be a highly effective tool to fully test system functionality and performance prior to commanding the flight rover. The early stages of building OPTIMISM began a few months prior to Perseverance departing JPL for Cape Canaveral, FL in early 2020. Electrical integration of the flight system avionics, and compatibility checkouts of the electrical ground support equipment ensured that the foundation of the electrical system was operational and in place. Next, the internal harnessing was installed and compatibility checks of the rover instrumentation and mechanisms were performed to confirm the system was prepared for full buildup. Finally, mechanical assembly of the rover chassis with its external components completed the integration of the system before it was moved to the Mars Yard for its initial phase of testing to perform verification & validation (V&V) of the Mobility subsystem requirements. By the time Perseverance landed at Jezero Crater in February 2021, the first phase of VSTB operations was underway. Surface guidance, navigation, and control (SGNC) testing for the Mobility subsystem ensured functionality and performance requirements were met for various capabilities such as visual odometry (VO), mapping, and automatic navigation (AutoNav). Subsequent integration of the robotic arm (RA) onto the VSTB enabled the V&V campaign for surface sampling operations (SSO) to commence. As the mission’s engineering operations (EO) have gotten underway, the VSTB has been utilized for an array of purposes including troubleshooting software anomalies, and performing dry-runs for first time activities (FTAs) prior to sending the commands to Perseverance. OPTIMISM will continue to serve mission critical functions as long as Perseverance is roving the Red Planet.

Rojas, Jose Trujillo↗

Modeling and Simulation Credibility Assessments of Whole-Body Finite Element Computational Models for Use in NASA Extravehicular Activity Applications

Computational finite element (FE) models are used in suited astronaut injury risk assessments; however, these models’ verification, validation, and credibility (VV&C) procedures for simulating injuries in altered gravity environments are limited. Our study conducts VV&C assessments of THUMS and Elemance whole-body FE models for predicting suited astronaut injury biomechanics using eight credibility factors, as per NASA-STD-7009A. Credibility factor ordinal scores are assigned by reviewing existing documentation describing VV&C practices, and credibility sufficiency thresholds are assigned based on input from subject matter experts. Our results show the FE models are credible for suited astronaut injury investigation in specific ranges of kinematic and kinetic conditions correlating to highway and contact sports events. Nevertheless, these models are deficient when applied outside these ranges. Several credibility elevation strategies are prescribed to improve models’ credibility for the NASA-centric application domain.

Finite Element↗

Modeling and simulation credibility assessments of whole-body finite element computational models for use in NASA extravehicular activity applications

Computational finite element (FE) models are used in suited astronaut injury risk assessments; however, these models’ verification, validation, and credibility (VV&C) procedures for simulating injuries in altered gravity environments are limited. Our study conducts VV&C assessments of THUMS and Elemance whole-body FE models for predicting suited astronaut injury biomechanics using eight credibility factors, as per NASA-STD-7009A. Credibility factor ordinal scores are assigned by reviewing existing documentation describing VV&C practices, and credibility sufficiency thresholds are assigned based on input from subject matter experts. Our results show the FE models are credible for suited astronaut injury investigation in specific ranges of kinematic and kinetic conditions correlating to highway and contact sports events. Nevertheless, these models are deficient when applied outside these ranges. Several credibility elevation strategies are prescribed to improve models’ credibility for the NASA-centric application domain.

Finite Element↗

We underestimate uncertainties in our predictions.

Prediction is defined in the American Heritage Dictionary as follows: 'To state, tell about, or make known in advance, especially on the basis of special knowledge.' What special knowledge do we demand of modeling and simulation to assert that we have a predictive capability for high consequence applications? The 'special knowledge' question can be answered in two dimensions: the process and rigor by which modeling and simulation is executed and assessment results for the specific application. Here we focus on the process and rigor dimension and address predictive capability in terms of six attributes: (1) geometric and representational fidelity, (2) physics and material model fidelity, (3) code verification, (4) solution verification, (5) validation, and (6) uncertainty quantification. This presentation will demonstrate through mini-tutorials, simple examples, and numerous case studies how each attribute creates opportunities for errors, biases, or uncertainties to enter into simulation results. The demonstrations will motivate a set of practices that minimize the risk in using modeling and simulation for high-consequence applications while defining important research directions. It is recognized that there are cultural, technical, infrastructure, and resource barriers that prevent analysts from performing all analyses at the highest levels of rigor. Consequently, the audience for this talk is (1) analysts, so they can know what is expected of them, (2) decision makers, so they can know what to expect from modeling and simulation, and (3) the R&D community, so they can address the technical and infrastructure issues that prevent analysts from executing analyses in a practical, timely, and quality manner.

97 MATHEMATICS AND COMPUTING↗

Air Ingress Analysis: Part 1 - Theoretical Approach

Idaho National Laboratory (INL), under the auspices of the U.S. Department of Energy (DOE), is performing research and development that focuses on key phenomena important during potential scenarios that may occur in very high temperature gas-cooled reactors (VHTRs). Phenomena identification and ranking studies to date have ranked an air ingress event, following on the heels of a VHTR depressurization, as important with regard to core safety. Consequently, the development of advanced air-ingress-related models and verification and validation data are a very high priority. Following a loss of coolant and system depressurization incident, air will enter the core of the VHTR through the break, possibly causing oxidation of the graphite core and reflector graphite structure. Simple core and plant models indicate that, under certain circumstances, the oxidation may proceed at an elevated rate with additional heat generated from the oxidation reaction itself. Under postulated conditions of fluid flow and temperature, excessive degradation of lower plenum graphite caused by graphite oxidation can lead to a loss of mechanical strength. Excessive oxidation of core graphite can also lead to a release of fission products into the confinement, which could be detrimental to reactor safety. Analytical models developed in this study will improve our understanding of this phenomenon. This paper presents two sets of analytical models for the qualitative assessment of the air ingress phenomena. The results from the analytical models are compared with results of the computational fluid dynamic models (CFD) in the subsequent paper. The analytical models agree well with those CFD results.

99 GENERAL AND MISCELLANEOUS↗

Development of a propulsion system and component test facility for advanced radioisotope powered Mars Hopper platforms

Verification and validation of design and modeling activities for radioisotope powered Mars Hopper platforms undertaken at the Center for Space Nuclear Research is essential for proof of concept. Previous research at the center has driven the selection of advanced material combinations; some of which require specialized handling capabilities. The development of a closed and contained test facility to forward this research is discussed within this paper.

33 ADVANCED PROPULSION SYSTEMS↗

Development and Testing of the VITAMIN-B7/BUGLE-B7 Coupled Neutron-Gamma Multigroup Cross-Section Libraries

The U.S. Nuclear Regulatory Commission s Regulatory Guide 1.190 states that calculational methods used to estimate reactor pressure vessel (RPV) fluence should use the latest version of the Evaluated Nuclear Data File (ENDF). The VITAMIN-B6 fine-group library and BUGLE-96 broad-group library, which are widely used for RPV fluence calculations, were generated using ENDF/B-VI data, which was the most current data when Regulatory Guide 1.190 was issued. We have developed new fine-group (VITAMIN-B7) and broad-group (BUGLE-B7) libraries based on ENDF/B-VII. These new libraries, which were processed using the AMPX code system, maintain the same group structures as the VITAMIN-B6 and BUGLE-96 libraries. Verification and validation of the new libraries was accomplished using diagnostic checks in AMPX, unit tests for each element in VITAMIN-B7, and a diverse set of benchmark experiments including critical evaluations for fast and thermal systems, a set of experimental benchmarks that are used for SCALE regression tests, and three RPV fluence benchmarks. The benchmark evaluation results demonstrate that VITAMIN-B7 and BUGLE-B7 are appropriate for use in LWR shielding applications, and meet the calculational uncertainty criterion in Regulatory Guide 1.190.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Why Models Don%3CU%2B2019%3Et Forecast.

The title of this paper, Why Models Don't Forecast, has a deceptively simple answer: models don't forecast because people forecast. Yet this statement has significant implications for computational social modeling and simulation in national security decision making. Specifically, it points to the need for robust approaches to the problem of how people and organizations develop, deploy, and use computational modeling and simulation technologies. In the next twenty or so pages, I argue that the challenge of evaluating computational social modeling and simulation technologies extends far beyond verification and validation, and should include the relationship between a simulation technology and the people and organizations using it. This challenge of evaluation is not just one of usability and usefulness for technologies, but extends to the assessment of how new modeling and simulation technologies shape human and organizational judgment. The robust and systematic evaluation of organizational decision making processes, and the role of computational modeling and simulation technologies therein, is a critical problem for the organizations who promote, fund, develop, and seek to use computational social science tools, methods, and techniques in high-consequence decision making.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

STUDY ON AIR INGRESS MITIGATION METHODS IN THE VERY HIGH TEMPERATURE GAS COOLED REACTOR (VHTR)

An air-ingress accident followed by a pipe break is considered as a critical event for a very high temperature gas-cooled reactor (VHTR). Following helium depressurization, it is anticipated that unless countermeasures are taken, air will enter the core through the break leading to oxidation of the in-core graphite structure. Thus, without mitigation features, this accident might lead to severe exothermic chemical reactions of graphite and oxygen. Under extreme circumstances, a loss of core structural integrity may occur along with excessive release of radiological inventory. Idaho National Laboratory under the auspices of the U.S. Department of Energy is performing research and development (R&D) that focuses on key phenomena important during challenging scenarios that may occur in the VHTR. Phenomena Identification and Ranking Table (PIRT) studies to date have identified the air ingress event, following on the heels of a VHTR depressurization, as very important (Oh et al. 2006, Schultz et al. 2006). Consequently, the development of advanced air ingress-related models and verification and validation (V&V) requirements are part of the experimental validation plan. This paper discusses about various air-ingress mitigation concepts applicable for the VHTRs. The study begins with identifying important factors (or phenomena) associated with the air-ingress accident by using a root-cause analysis. By preventing main causes of the important events identified in the root-cause diagram, the basic air-ingress mitigation ideas can be conceptually derived. The main concepts include (1) preventing structural degradation of graphite supporters; (2) preventing local stress concentration in the supporter; (3) preventing graphite oxidation; (4) preventing air ingress; (5) preventing density gradient driven flow; (4) preventing fluid density gradient; (5) preventing fluid temperature gradient; (6) preventing high temperature. Based on the basic concepts listed above, various air-ingress mitigation methods are proposed in this study. Among them, the following two mitigation ideas are extensively investigated using computational fluid dynamic codes (CFD): (1) helium injection in the lower plenum, and (2) reactor enclosure opened at the bottom. The main idea of the helium injection method is to replace air in the core and the lower plenum upper part by buoyancy force. This method reduces graphite oxidation damage in the severe locations of the reactor inside. To validate this method, CFD simulations are addressed here. A simple 2-D CFD model is developed based on the GT-MHR 600MWt design. The simulation results showed that the helium replace the air flow into the core and significantly reduce the air concentration in the core and bottom reflector potentially protecting oxidation damage. According to the simulation results, even small helium flow was sufficient to remove air in the core, mitigating the air-ingress successfully. The idea of the reactor enclosure with an opening at the bottom changes overall air-ingress mechanism from natural convection to molecular diffusion. This method can be applied to the current system by some design modification of the reactor cavity. To validate this concept, this study also uses CFD simulations based on the simplified 2-D geometry. The simulation results showed that the enclosure open at the bottom can successfully mitigate air-ingress into the reactor even after on-set natural circulation occurs.

99 GENERAL AND MISCELLANEOUS↗

2010 Criticality Accident Alarm System Benchmark Experiment at the CEA Valduc SILENE Facility

Several experiments were performed at the CEA Valduc SILENE reactor facility, which are intended to be published as evaluated benchmark experiments in the ICSBEP Handbook. These evaluated benchmarks will be useful for the verification and validation of radiation transport codes and evaluated nuclear data, particularly those that are used in the analysis of CAASs. During these experiments SILENE was operated in pulsed mode in order to be representative of a criticality accident, which is rare among shielding benchmarks. Measurements of the neutron flux were made with neutron activation foils and measurements of photon doses were made with TLDs. Also unique to these experiments was the presence of several detectors used in actual CAASs, which allowed for the observation of their behavior during an actual critical pulse. This paper presents the preliminary measurement data currently available from these experiments. Also presented are comparisons of preliminary computational results with Scale and TRIPOLI-4 to the preliminary measurement data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Resonance Self-Shielding Methodologies in SCALE 6

SCALE 6 includes several problem-independent multigroup (MG) libraries that were processed from the evaluated nuclear data file ENDF/B using a generic flux spectrum. The library data must be self-shielded and corrected for problem-specific spectral effects for use in MG neutron transport calculations. SCALE 6 computes problem-dependent MG cross sections through a combination of the conventional Bondarenko shielding-factor method and a deterministic continuous-energy (CE) calculation of the fine-structure spectra in the resolved resonance and thermal energy ranges. The CE calculation can be performed using an infinite medium approximation, a simplified two-region method for lattices, or a one-dimensional discrete ordinates transport calculation with pointwise (PW) cross-section data. This paper describes the SCALE-resonance self-shielding methodologies, including the deterministic calculation of the CE flux spectra using PW nuclear data and the method for using CE spectra to produce problem-specific MG cross sections for various configurations (including doubly heterogeneous lattices). It also presents results of verification and validation studies.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

An Investigation of Digital Instrumentation and Control System Failure Modes

A study sponsored by the Nuclear Regulatory Commission study was conducted to investigate digital instrumentation and control (DI&C) systems and module-level failure modes using a number of databases both in the nuclear and non-nuclear industries. The objectives of the study were to obtain relevant operational experience data to identify generic DI&C system failure modes and failure mechanisms, and to obtain generic insights, with the intent of using results to establish a unified framework for categorizing failure modes and mechanisms. Of the seven databases studied, the Equipment Performance Information Exchange database was found to contain the most useful data relevant to the study. Even so, the general lack of quality relative to the objectives of the study did not allow the development of a unified framework for failure modes and mechanisms of nuclear I&C systems. However, an attempt was made to characterize all the failure modes observed (i.e., without regard to the type of I&C equipment under consideration) into common categories. It was found that all the failure modes identified could be characterized as (a) detectable/preventable before failures, (b) age-related failures, (c) random failures, (d) random/sudden failures, or (e) intermittent failures. The percentage of failure modes characterized as (a) was significant, implying that a significant reduction in system failures could be achieved through improved online monitoring, exhaustive testing prior to installation, adequate configuration control or verification and validation, etc.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

RELAP5-3D Results for Phase I (Exercise 2) of the OECD/NEA MHTGR-350 MW Benchmark

The coupling of the PHISICS code suite to the thermal hydraulics system code RELAP5-3D has recently been initiated at the Idaho National Laboratory (INL) to provide a fully coupled prismatic Very High Temperature Reactor (VHTR) system modeling capability as part of the NGNP methods development program. The PHISICS code consists of three modules: INSTANT (performing 3D nodal transport core calculations), MRTAU (depletion and decay heat generation) and a perturbation/mixer module. As part of the verification and validation activities, steady state results have been obtained for Exercise 2 of Phase I of the newly-defined OECD/NEA MHTGR-350 MW Benchmark. This exercise requires participants to calculate a steady-state solution for an End of Equilibrium Cycle 350 MW Modular High Temperature Reactor (MHTGR), using the provided geometry, material, and coolant bypass flow description. The paper provides an overview of the MHTGR Benchmark and presents typical steady state results (e.g. solid and gas temperatures, thermal conductivities) for Phase I Exercise 2. Preliminary results are also provided for the early test phase of Exercise 3 using a two-group cross-section library and the Relap5-3D model developed for Exercise 2.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Coarse-grained simulations of vortex dynamics and transition in complex high-Re flows

Turbulent flow complexity in applications in engineering, geophysics and astrophysics typically requires achieving accurate and dependable large scale predictions of highly nonlinear processes with under-resolved computer simulation models. Laboratory observations typically demonstrate the end outcome of complex non-linear three-dimensional physical processes with many unexplained details and mechanisms. Carefully controlled computational experiments based on the numerical solution of the conservation equations for mass, momentum, and energy, provide insights into the underlying flow dynamics. Relevant computational fluid dynamics issues to be addressed relate to the modeling of the unresolved tlow conditions at the subgrid scale (SGS) level - within a computational cell, and at the supergrid (SPG) scale - at initialization and beyond computational boundaries. SGS and SPG information must be prescribed for closure of the equations solved numerically. SGS models appear explicitly or implicitly as additional source tenns in the modified flow equations solved by the numerical solutions being calculated, while SPG models provide the necessary set of initial and boundary conditions that must be prescribed to ensure unique well-posed solutions. From this perspective, it is clear that the simulation process is inherently determined by the SGS and SPG information prescription process. On the other hand, observables in laboratory experiments are always characterized by the finite scales of the instrumental resolution of measuring/visualizing devices, and subject as well to SPG issues. It is thus important to recognize the inherently intrusive nature of observations based on numerical or laboratory experiments. Ultimately, verification and validation (V & V) frameworks and appropriate metrics for the specific problems at hand are needed to establish predictability of the simulation model. Direct numerical simulation (DNS) - resolving all relevant space/time scales, is prohibitively expensive in the foreseeable future for most practical flows of interest at moderate-to-high Reynolds number (Re). On the other end of the simulation spectrum are the Reynolds-Averaged Navier-Stokes (RANS) approaches - which model the turbulent effects. In the coarsegrained large eddy simulation (LES) strategies, the large energy containing structures are resolved, the smaller structures are filtered out, and unresolved SGS effects are modeled. By necessity - rather than choice, LES effectively becomes the intermediate approach between DNS and RANS. Extensive work has demonstrated that predictive simulations of turbulent velocity fields are possible using a particular LES denoted implicit LES (ILES), using the class of nonoscillatory finite-volume (NFV) numerical algorithms. Use of the modified equation as framework for theoretical analysis, demonstrates that leading truncation tenns associated with NFV methods provide implicit SGS models of mixed anisotropic type and regularized motion of discrete observables. Tests in fundamental applications ranging from canonical to very complex flows indicate that ILES is competitive with conventional LES in the LES realm proper - flows driven by large scale features. High-Re flows are vortex dominated and governed by short convective timescales compared to those of diffusion, and kinematically characterized at the smallest scales by slender worm vortices with insignificant internal structure. This motivates nominally inviscid ILES methods capable of capturing the high-Re dissipation dynamics and of handling vortices as shocks in shock capturing schemes. Depending on flow regimes, initial conditions, and resolution, additional modeling may be needed to emulate SGS driven physics, such as backscatter, chemical reaction, material mixing, and near-wall flow-dynamics - where typically-intertwined SGS/SPG issues need to be addressed. A major research focus is recognizing when additional explicit models and/or numerical treatments are needed and ensuring that mixed explicit and implicit SGS models can effectively act in collaborative rather than interfering fashion. We survey our present understanding of the theoretical basis of lLES, including connections with the classical LES and finite-scale dynamics perspectives. Examples from recent lLES studies are presented, including canonical turbulence test cases and shock driven turbulence; relevant V & V issues are demonstrated in this context.

58 GEOSCIENCES↗

Potential Collaborative Research topics with Korea’s Agency for Defense Development

This presentation provides a high level summary of current research activities at the Los Alamos National Laboratory (LANL)-University of California Jacobs School of Engineering (UCSD) Engineering Institute that will be presented at Korea's Agency for Defense Development (ADD). These research activities are at the basic engineering science level with different level of maturity ranging from initial concepts to field proof-of-concept demonstrations. We believe that all of these activities are appropriate for collaborative research activities with ADD subject to approval by each institution. All the activities summarized herein have the common theme that they are multi-disciplinary in nature and typically involved the integration of high-fidelity predictive modeling, advanced sensing technologies and new development in information technology. These activities include: Wireless Sensor Systems, Swarming Robot sensor systems, Advanced signal processing (compressed sensing) and pattern recognition, Model Verification and Validation, Optimal/robust sensor system design, Haptic systems for large-scale data processing, Cyber-physical security for robots, Multi-source energy harvesting, Reliability-based approaches to damage prognosis, SHMTools software development, and Cyber-physical systems advanced study institute.

42 ENGINEERING↗

Computational Tools to Accelerate Commercial Development

The goals of the work reported are: to develop new computational tools and models to enable industry to more rapidly develop and deploy new advanced energy technologies; to demonstrate the capabilities of the CCSI Toolset on non-proprietary case studies; and to deploy the CCSI Toolset to industry. Challenges of simulating carbon capture (and other) processes include: dealing with multiple scales (particle, device, and whole process scales); integration across scales; verification, validation, and uncertainty; and decision support. The tools cover: risk analysis and decision making; validated, high-fidelity CFD; high-resolution filtered sub-models; process design and optimization tools; advanced process control and dynamics; process models; basic data sub-models; and cross-cutting integration tools.

54 ENVIRONMENTAL SCIENCES↗

Computational Tools for Accelerating Carbon Capture Process Development

The goals of the work reported are: to develop new computational tools and models to enable industry to more rapidly develop and deploy new advanced energy technologies; to demonstrate the capabilities of the CCSI Toolset on non-proprietary case studies; and to deploy the CCSI Toolset to industry. Challenges of simulating carbon capture (and other) processes include: dealing with multiple scales (particle, device, and whole process scales); integration across scales; verification, validation, and uncertainty; and decision support. The tools cover: risk analysis and decision making; validated, high-fidelity CFD; high-resolution filtered sub-models; process design and optimization tools; advanced process control and dynamics; process models; basic data sub-models; and cross-cutting integration tools.

54 ENVIRONMENTAL SCIENCES↗

EARLY-STAGE DESIGN AND EVALUATION FOR NUCLEAR POWER PLANT CONTROL ROOM UPGRADES

As control rooms are modernized with new digital systems at nuclear power plants, it is necessary to evaluate operator performance with these systems as part of a verification and validation process. While there is regulatory and industry guidance for some modernization activities, there are no well defined standard processes or predefined metrics available for assessing what is satisfactory operator interaction with new systems, especially during the early design stages. This paper proposes a framework defining the design process and metrics for evaluating human system interfaces as part of control room modernization. The process and metrics are generalizable to other applications and serve as a guiding template for utilities undertaking their own control room modernization activities.

99 GENERAL AND MISCELLANEOUS↗