Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “verifications”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,243 records · Page 69

Test Verification of the Cassini Spacecraft Dynamic Model

The Cassini spacecraft mission to Saturn will be launched in October 1997, on a Titan IV/Centaur launch vehicle. Cassini is the largest interplanetary spacecraft ever developed. Before launch approval can be obtained, a test verified finite element model of the Cassini spacecraft must be completed and approved by NASA. The correctness of this model is critical to the final verification coupled loads analysis and margin of safety assessments.

Cassini↗

Verification and Validation of Elastodynamic Simulation Software for Aerospace Research

Physics-based simulation of nondestructive evaluation (NDE) inspection can help to advance the inspectability and reliability of mechanical systems. However, NDE simulations applicable to non-idealized mechanical components often require large compute domains and long run times. This has prompted development of custom NDE simulation software tailored to high performance computing (HPC) hardware. Verification and validation (V&V) is an integral part of developing this software to ensure implementations are robust and applicable to inspection problems, producing tools and simulations suitable for computational NDE research. This presentation addresses factors common to V&V of several elastodynamic simulation codes applicable to ultrasonic NDE. Examples are drawn from in-house simulation software at NASA Langley Research Center, ranging from ensuring reliability in a 1D heterogeneous media wave equation solver to the V&V needs of 3D cluster-parallel elastodynamic software. Factors specific to a research environment are addressed, where individual simulation results can be as relevant as the software product itself. Distinct facets of V&V are discussed including testing to establish software reliability, employing systematic approaches for consistency with fundamental conservation laws, establishing the numerical stability of algorithms, and demonstrating concurrence with empirical data. This talk also addresses V&V practices for small groups of researchers. This includes establishing resources (e.g. time and personnel) for V&V during project planning to mitigate and control the risk of setbacks. Similarly, we identify ways for individual researchers to use V&V during simulation software development itself to both speed up the development process and reduce incurred technical debt.

NDE↗

Concurrent Runtime Verification of Data Rich Events

This paper presents the open source runtime verification tool MESA (MEssage-based System Analysis), implemented in Scala, which supports concurrent monitors using the Actor model. Furthermore, the tool supports indexing (slicing) on the data values occurring in data-carrying events, for each individual monitor. The tool is generic in the sense that any monitoring system can be used for creating monitors. In this paper, we use the internal Scala DSL Daut for programming such in data parameterized state machines and temporal logic. To illustrate MESA/Daut, we present a case study that monitors flights from live U.S. airspace data streams, verifying that they conform to planned routes. With base in the case study, we then perform an extensive empirical study of the potential benefits from monitoring slices of a single property in concurrently executing actors. Due to the overhead of scheduling “small” actors (one for each slice or a small number of slices), it is not obvious that concurrent execution of such is beneficial. However, as a main result, we demonstrate that concurrent monitoring of slices to handle data-carrying events can provide considerable speed gains.

finite state machines↗

NASA Engineering and Safety Center Technical Bulletin No. 21-04: Evaluating Appropriateness of LEFM Tools for COPV and Metal Pressure Vessel Damage Tolerance Life Verification

Human spaceflight composite overwrapped pressure vessels (COPVs) and metal pressure vessels can use linear elastic fracture mechanics (LEFM) analysis to demonstrate damage tolerance life per ANSI/AIAA-S-081 for COPVs and ANSI/AIAA-S-080 for metal pressure vessels. LEFM analysis assumptions require that the crack tip plastic zone is small relative to the crack size and is completely surrounded by elastically responding material. Test and analysis have shown that LEFM tools (i.e., NASGRO*) can provide unconservative crack growth predictions for cracks in COPV liners that violate LEFM assumptions. COPV and metal pressure vessel designers should evaluate and address the violation of LEFM plasticity assumptions before using LEFM analysis tools for damage tolerance life verification.

COPV↗

Swarm Mentality: Toward Automatic Swarm State Awareness with Runtime Verification

Cyber-Physical Systems (CPSs) already exhibit impressive performance in all areas of human life, and swarms of CPSs promise to increase their capabilities even further. However, to effectively utilize CPS swarms their complexity of operation has to scale sub-linearly with the number of swarm members. Presenting the swarm to an operator as a single entity almost eliminates the additional per-member overhead entirely. To operate a swarm as one entity, and/or to increase the swarm’s autonomy, the operator and the swarm members need to reason and communicate at the same level of abstraction, i.e. the swarm needs a sense of “self.” Therefore, we require the ability to specify whole swarm properties yet monitor them at the member level. We examine one architecture for achieving this awareness by: 1) Defining a taxonomy for comparing techniques that synthesize this belief-state 2) Propose use of the Runtime Verification formal method to fill this role 3) Present preliminary designs for extending and embedding such a system in the Distributed Spacecraft Autonomy architecture to generate per-member monitors from swarm level specification.

Runtime Verification↗

Implementation and Verification of the SST-𝜸 and SA-AFT Transition Models in FUN3D

The transition modeling capability in the NASA unstructured FUN3D suite of codes has been augmented by incorporating two additional transport-equation-based transition models, namely, the 𝜸 transition model coupled with Menter’s 2003 Shear-Stress Transport (SST) turbulence model and Coder’s Amplification Factor Transport (AFT) transition model combined with the Spalart-Allmaras (SA) turbulence model. Both of these models, SST-𝜸 and SA-AFT, are used to compute transition characteristics of several test cases from the literature. The selected test cases cover a range of transition scenarios including bypass transition over a flat plate (ERCOFTAC T3A and T3A- flow configurations), transition in the presence of separation bubbles (NLF-0416 airfoil at selected angles of attack), and natural transition due to Tollmien-Schlichting instabilities (flat-plate experiment by Schubauer and Klebanoff). To address the urgent need for model verification as highlighted in recent workshops on transition modeling, the drag, lift, surface pressure, and skin-friction coefficients from the FUN3D solutions for a sequence of meshes are compared with the results obtained with the same models implemented in the NASA structured grid flow solver OVERFLOW. Comparisons between the local and global surface coefficients from the FUN3D and OVERFLOW solvers for all test cases resulted in good agreement for the finest meshes.

Verification↗

Verification and Validation of a Conceptual Model of the Auto-Rigging Payload Handling and Off-Loading System Using LEGO Technic System and Three-Dimensional Printed Parts

A conceptual model (CM) can be used to validate a concept in modeling and simulation life cycles. During the 2020-2022 Coronavirus disease 2019 (COVID-19) pandemic, for employee safety NASA implemented center closures and mandatory telework for the entire workforce. During this challenging time, engineers and researchers at NASA Langley Research Center (LaRC) looked for safe and innovative approaches and methods to continue the development of CMs for various projects. Engineers and researchers at LaRC researched Auto-Rigging Payload Handling and Off-Loading System (ARPHOLS) for payload handing and off-loading a system on an inclined lunar lander deck. In this paper, the development of a CM and the verification and validation of a conceptual idea for ARPHOLS using a LEGO Technic system and three-dimensional printed parts is presented.

Design↗

Verification of the Generalized Aerospace Simulation in Simulink (R)

NASA uses six-degrees-of-freedom (6-DOF) simulations tools to design, test, develop Guidance Navigation and Control (GN&C) software, and certify vehicle performance prior to flight. Therefore, it is critical that the 6-DOF tools used for vehicle design and certification are validated. The focus of this work is the vali-dation of the NASA Marshall Space Flight Center 6-DOF “GeneraLized Aero-space Simulation in Simulink” (GLASS) framework tool. The GLASS tool framework is currently used to support NASA GN&C insight for the Human Landing System (HLS) project, simulating vehicle dynamics during lunar descent and as-cent. The GLASS framework utilizes the off-the-shelf Mathworks ® Simscape Multibody® toolbox to model vehicle multi-body dynamics. NASA’s Engineering and Safety Center (NESC) provides a set of 6-DOF simulation verification “check cases” that are available to any user needing to verify 6-DOF tools. The check cases contain seventeen atmospheric and twenty-six orbital test scenarios are provided to validate equations of motion, environmental models (e.g., atmosphere, gravitation, and geodesy) and tool propagators. This paper compares GLASS 6-DOF simulation results against the NESC check cases’ results via simulation-to-simulation comparisons. The comparisons demonstrate that GLASS simulation results are “in family” with the outputs of the applicable NASA NESC check cases and verifies the GLASS core framework dynamics and the correct implementation of the check case scenario models.

6-Dof↗

Verification of the Generalized Aerospace Simulation in Simulink

NASA uses six-degrees-of-freedom (6-DOF) simulations tools to design, test, develop Guidance Navigation and Control (GN&C) software, and certify vehicle performance prior to flight. Therefore, it is critical that the 6-DOF tools used for vehicle design and certification are validated. The focus of this work is the validation of the NASA Marshall Space Flight Center 6-DOF “GeneraLized Aerospace Simulation in Simulink” (GLASS) framework tool. The GLASS tool framework is currently used to support NASA GN&C insight for the Human Landing System (HLS) project, simulating vehicle dynamics during lunar descent and ascent. The GLASS framework utilizes the off-the-shelf Mathworks (R) Simscape (TM) Multibody (TM) toolbox to model vehicle multi-body dynamics. NASA’s Engineering and Safety Center (NESC) provides a set of 6-DOF simulation verification “check cases” that are available to any user needing to verify 6-DOF tools. The check cases contain seventeen atmospheric and twenty-six orbital test scenarios are provided to validate equations of motion, environmental models (e.g., atmosphere, gravitation, and geodesy) and tool propagators. This paper compares GLASS 6-DOF simulation results against the NESC check cases’ results via simulation-to-simulation comparisons. The comparison demonstrates that GLASS simulation results are “in family” with the outputs of the applicable NASA NESC check-cases and verify the GLASS core framework dynamics and the implementation of the check case scenario models.

6-Dof↗

Optimizing Urban Air Mobility Research Through Bi-Directional Integration Processes for Effective Verification and Validation

Urban Air Mobility (UAM), a subset of Advanced Air Mobility (AAM), aims to revolutionize metropolitan transportation. This paper explores an engineering process framework within National Aeronautics and Space Administration (NASA)’s Air Mobility Pathfinders (AMP) project, which is focused on the safe scaling and seamless integration of UAM operations within the National Airspace System (NAS). Progressing through three phases — Initial, Midterm, and Mature — the Federal Aviation Administration (FAA)’s UAM Concept of Operations (ConOps) describes a proposed path for the evolution of UAM operations, presenting multifaceted challenges in technology, regulation, and stakeholder engagement. With this ConOps as a basis, the AMP project is executing research, development, test, and evaluation activities aimed at delivering validated reference architectures for the Midterm phase. This paper illuminates the pivotal role of the systems engineering process in managing these technical efforts. Robust verification and validation methods, along with systematic bi-directional integration process, enhance the ability to conduct research into the design and evolution of safe, efficient, and reliable UAM systems. In this paper a systematic framework will be presented and shown to facilitate interactions between UAM stakeholders and to effectively manage the complex architecture of UAM operations in the NAS.

National Airspace System↗

A Multitier System for the Verification, Visualization and Management of CHIMERA

CHIMERA is a multi-dimensional radiation hydrodynamics code designed to study core-collapse supernovae. The code is made up of three essentially independent parts: a hydrodynamics module, a nuclear burning module, and a neutrino transport solver combined within an operator-split approach. Given CHIMERA s complexity and pace of ongoing development, a new support system, Bellerophon, has been designed and implemented to perform automated verification, visualization and management tasks while integrating with other workflow systems utilized by CHIMERA s development group. In order to achieve these goals, a multitier approach has been adopted. By integrating supercomputing platforms, visualization clusters, a dedicated web server and a client-side desktop application, this system attempts to provide an encapsulated, end-to-end solution to these needs.

code verification↗

Initial measurements of BN-350 spent fuel in dry storage casks using the dual slab verification detonator

The Dual Slab Verification Detector (DSVD) has been developed, built, and characterized by Los Alamos National Laboratory in cooperation with the International Atomic Energy Agency (IAEA) as part of the dry storage safeguards system for the spent fuel from the BN-350 fast reactor. The detector consists of two rows of 3He tubes embedded in a slab of polyethylene which has been designed to be placed on the outer surface of the dry storage cask. By performing DSVD measurements at several different locations around the outer surface of the DUC, a signature 'fingerprint' can be established for each DUC based on the neutron flux emanating from inside the dry storage cask. The neutron fingerprint for each individual DUC will be dependent upon the spatial distribution of nuclear material within the cask, thus making it sensitive to the removal of a certain amount of material from the cask. An initial set of DSVD measurements have been performed on the first set of dry storage casks that have been loaded with canisters of spent fuel and moved onto the dry storage pad to both establish an initial fingerprint for these casks as well as to quantify systematic uncertainties associated with these measurements. The results from these measurements will be presented and compared with the expected results that were determined based on MCNPX simulations of the dry storage facility. The ability to safeguard spent nuclear fuel is strongly dependent on the technical capabilities of establishing and maintaining continuity of knowledge (COK) of the spent fuel as it is released from the reactor core and either reprocessed or packaged and stored at a storage facility. While the maintenance of COK is often done using continuous containment and surveillance (C/S) on the spent fuel, it is important that the measurement capabilities exist to re-establish the COK in the event of a significant gap in the continuous CIS by performing measurements that independently confirm the presence and content of Plutonium (Pu) in the spent fuel. The types of non-destructive assay (NDA) measurements that can be performed on the spent fuel are strongly dependent on the type of spent fuel that is being safeguarded as well as the location in which the spent fuel is being stored. The BN-350 Spent Fuel Disposition Project was initiated to improve the safeguards and security of the spent nuclear fuel from the BN-350 fast-breeder reactor and was developed cooperatively to meet the requirements of the International Atomic Energy Agency (IAEA) as well as the terms of the 1993 CTR and MPC&A Implementing Agreements. The unique characteristics of fuel from the BN-350 fast-breeder reactor have allowed for the development of an integrated safeguards measurement program to inventory, monitor, and if necessary, re-verify Pu content of the spent fuel throughout the lifetime of the project. This approach includes the development of a safeguards measurement program to establish and maintain the COK on the spent fuel during the repackaging and eventual relocation of the spent-fuel assemblies to a long-term storage site. As part of the safeguards measurement program, the Pu content of every spent-fuel assembly from the BN-350 reactor was directly measured and characterized while the spent-fuel assemblies were being stored in the spent-fuel pond at the BN-350 facility using the Spent Fuel Coincidence Counter (SFCC). Upon completion of the initial inventory of the Pu content of the individual spent-fuel assemblies, the assemblies were repackaged into welded steel canisters that were filled with inert argon gas and held either four or six individual spent-fuel assemblies depending on the type of assembly that was being packaged. This repackaging of the spent-fuel assemblies was performed in order to improve the stability of the spent-fuel assemblies for long-term storage and increase the proliferation resistance of the spent fuel. To maintain the capability of verifying the presence of the spent-fuel assemblies inside the welded steel canisters, measurements were performed on the canisters using the Spent Fuel Attribute Monitor (SPAM), which was a neutron coincidence counter very similar in design to the SFCC, but with a larger operational volume to accommodate the canisters. The analysis of the neutron coincidence data from the measurements of the welded steel canisters using SP AM yielded a Canister Attribute (CA) that was shown to be proportional to the total amount of Pu mass that was present inside the canister and comparable to the CA values that were calculated based on the previous SFCC measurements. The next step in securing the spent fuel from the BN-350 reactor is the packaging of the steel canisters into Dual-Use Casks (DUCs) and the transportation of the DUCs to a remote dry storage site.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

QUALIFICATION OF THE SAVANNAH RIVER SITE 252CF SHUFFLER FOR RECEIPT VERIFICATION MEASUREMENTS OF MIXED U-PU OXIDES STORED IN 9975 SHIPPING CONTAINERS

To extend their ability to perform accountability and verification measurements of {sup 235}U in a U-Pu oxide matrix, the K-Area Material Storage facility commissioned the development and construction of a Passive/Active {sup 252}Cf Shuffler. A series of {sup 252}Cf, PuO{sub 2}, and U-Pu oxide standards, in addition to a single U{sub 3}O{sub 8} standard, were measured to characterize and calibrate the shuffler. Accompanying these measurements were simulations using MCNP5/MCNPX, aimed at isolating the neutron countrate contributions for each of the isotopes present. Two calibration methods for determining the {sup 235}U content in mixed UPu oxide were then developed, yielding comparable results. The first determines the {sup 235}U mass by estimating the {sup 239}Pu/{sup 235}U ratio-dependent contributions from the primary delayed neutron contributors. The second defines an average linear response based on the {sup 235}U and {sup 239}Pu mass contents. In each case, it was observed that self-shielding due to {sup 235}U mass has a large influence on the observed rates, requiring bounds on the applicable limits of each calibration method.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Systematic approach to verification and validation: High explosive burn models

Most material models used in numerical simulations are based on heuristics and empirically calibrated to experimental data. For a specific model, key questions are determining its domain of applicability and assessing its relative merits compared to other models. Answering these questions should be a part of model verification and validation (V and V). Here, we focus on V and V of high explosive models. Typically, model developers implemented their model in their own hydro code and use different sets of experiments to calibrate model parameters. Rarely can one find in the literature simulation results for different models of the same experiment. Consequently, it is difficult to assess objectively the relative merits of different models. This situation results in part from the fact that experimental data is scattered through the literature (articles in journals and conference proceedings) and that the printed literature does not allow the reader to obtain data from a figure in electronic form needed to make detailed comparisons among experiments and simulations. In addition, it is very time consuming to set up and run simulations to compare different models over sufficiently many experiments to cover the range of phenomena of interest. The first difficulty could be overcome if the research community were to support an online web based database. The second difficulty can be greatly reduced by automating procedures to set up and run simulations of similar types of experiments. Moreover, automated testing would be greatly facilitated if the data files obtained from a database were in a standard format that contained key experimental parameters as meta-data in a header to the data file. To illustrate our approach to V and V, we have developed a high explosive database (HED) at LANL. It now contains a large number of shock initiation experiments. Utilizing the header information in a data file from HED, we have written scripts to generate an input file for a hydro code, run a simulation, and generate a comparison plot showing simulated and experimental velocity gauge data. These scripts are then applied to several series of experiments and to several HE burn models. The same systematic approach is applicable to other types of material models; for example, equations of state models and material strength models.

36 MATERIALS SCIENCE↗

Applying the neutron scatter camera to treaty verification and warhead monitoring.

The neutron scatter camera was originally developed for a range of SNM detection applications. We are now exploring the feasibility of applications in treaty verification and warhead monitoring using experimentation, maximum likelihood estimation method (MLEM), detector optimization, and MCNP-PoliMi simulations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

NUMERICAL VERIFICATION OF EQUILIBRIUM CHEMISTRY

A numerical tool is in an advanced state of development to compute the equilibrium compositions of phases and their proportions in multi-component systems of importance to the nuclear industry. The resulting software is being conceived for direct integration into large multi-physics fuel performance codes, particularly for providing boundary conditions in heat and mass transport modules. However, any numerical errors produced in equilibrium chemistry computations will be propagated in subsequent heat and mass transport calculations, thus falsely predicting nuclear fuel behaviour. The necessity for a reliable method to numerically verify chemical equilibrium computations is emphasized by the requirement to handle the very large number of elements necessary to capture the entire fission product inventory. A simple, reliable and comprehensive numerical verification method is presented which can be invoked by any equilibrium chemistry solver for quality assurance purposes.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗