SEARCH · Engineering Papers

Results for “verification and validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

All sources NASA NTRS DOE OSTI

NASA NTRS2020

Europa Clipper Mission: Onward to Implementation!

Europa, the fourth largest moon of Jupiter, is believed to be one of the best places in the solar system to look for extant life beyond Earth, and the Europa Clipper Mission is preparing to investigate. Now entering the fifth year of life as a formal project, the Europa Clipper Mission has completed its major design phase and is preparing for implementation. The mission envisions sending a flight system, consisting of a spacecraft equipped with a payload of NASA-selected scientific instruments, to execute numerous flybys of Europa while in Jupiter orbit. The mission is being formulated and implemented by a joint Jet Propulsion Laboratory (JPL) and Applied Physics Laboratory (APL) Project team. At the Project Preliminary Design Review (PDR) in August 2018, it was determined that the unique integration of the REASON instrument’s antennas with the spacecraft’s solar arrays required additional time for maturity and review. The required maturity was demonstrated, and in June 2019 the Clipper Mission passed its Delta Preliminary Design Review, and formal confirmation for entry into Phase C was announced by NASA in August 2019. The earliest launch opportunity is now in July 2023, one year later than originally planned. The Project is now working toward its Critical Design Review in May 2020. This paper will describe the progress of the Europa Clipper Mission since January 2019, including maturation of the spacecraft, subsystem and instrument designs, the beginning of fabrication of engineering models and the first flight models, planning for the verification & validation phase, and planning for operations.

Jackson, Maddalena↗

NASA NTRS2020

Establishing Launch Readiness of NASA ISS Payload OCO-3

The Orbiting Carbon Observatory – 3 (OCO-3) is a NASA Earth-monitoring payload, designed and built by the Jet Propulsion Laboratory (JPL) to perform space-based observation of variations of global carbon dioxide (CO2) by sampling its emission sources and gradients from the unique vantage point of the International Space Station (ISS). This paper describes the development and results of the end-to-end verification, validation and calibration activities that were performed to meet OCO-3's science measurement, functional and performance requirements prior to launch. The pre-launch activities encompassed a suite of tests and analyses that were performed after payload integration and during launch vehicle integration that helped the OCO-3 project demonstrate its launch and mission readiness in terms of ISS compatibility, ground-based instrument calibrations, flight dynamics and environmental integrity and pointing knowledge and accuracy.

Srivastava, Priyanka↗

NASA NTRSDate not supplied

Applications of Advanced Perception and Distributed Sensing Technology towards Autonomous Advanced Air Mobility Applications

Emerging concepts for Advanced Air Mobility (AAM) envisions responsive air transportation capabilities that can safely move people and cargo between places - including local, regional, intraregional, and urban - previously not served or underserved by aviation. Expanding traditional aviation services to these environments, particularly when autonomous operations are involved, face a number of challenges that will require advances beyond the state-of-the-art techniques for airborne sensing and perception, which goes beyond the limits of scalability and applicability of the current air transportation system infrastructure. Additionally, the emerging field of distributed sensing and ‘smart spaces’– where sensing, processing, communication, and actuation are embedded in the environment in which agents are acting and can be exploited by the agents through real-time wireless communication – may provide realistic near-time solutions to limitations imposed by traditional aviation techniques. This paper outlines the needs, challenges, and opportunities for advanced perception and distributed sensing techniques to meet the emerging needs for advanced AAM operations in the national airspace. A general roadmap for research, development, and maturation of perception and distributed sensing (P&DS) technologies is proposed to guide future development through verification, validation, certification into airborne systems. Through this analysis of challenges and the proposed roadmap for technology maturation, we hope to accelerate transition of advanced research techniques from other disciplines into this domain.

Autonomy↗

NASA NTRSDate not supplied

Sensitivity Analysis of the Human Research Program’s Impact 1.0 Model

Sensitivity analysis estimates the relative contribution of the uncertainty in input values to the uncertainty of model outputs. Partial Rank Correlation Coefficient (PRCC) and Leave One Out (LOO) are methods of conducting sensitivity analysis on non-linear simulation models like the IMPACT Model. The PRCC method estimates the sensitivity using partial correlation of the ranks of the generated input values to each generated output value. The “partial” part is due to the adjustments made for the linear effects of all the other input values in the calculation of correlation between a particular input and each output. LOO removes a medical condition from test suite and calculates the change in the outcome. This is used to identify the influence of the condition input in the model The inputs to the sensitivity procedures include the number of occurrences of each of the one hundred plus IMPACT medical conditions generated over the simulations, and the IMPACT outputs from the MEDPRAT mathematical model. The outputs total task time lost (TTL), number of return to definitive care (RTDC), and number of loss of crew lives (LOCL). The IMPACT team will report the results of using PRCC and LOO on IMPACT 1.0. Tornado plots will assist in the visualization of the condition-related input sensitivities to each of the main outcomes. The outcomes of this sensitivity analysis will drive review focus by identifying conditions where changes in uncertainty, and input values could drive changes in overall model output uncertainty. These efforts are an integral part of the overall verification, validation, and credibility review of IMPACT 1.0.

Sensitivity Anaylsis↗

NASA NTRSDate not supplied

Quantification of Numerical Uncertainty via Nonlinear Dynamical Approach

Motivations (Ensure a Higher Level of Confidence in the Predictability & Reliability of Numerical Simulation for Multiscale Complex Nonlinear Fluid Problems) - The last two decades have been an era when computation is ahead of analysis & when very large scale practical computations are increasingly used in poorly understood multiscale complex nonlinear physical problems & non-traditional fields (Especially when computations offer the ONLY way of generating this type of data limited simulations). - At present some of the numerical uncertainties can be explained and minimized by traditional numerical analysis and standard CFD practices. However, such practices, usually based on linearized analysis, MIGHT NOT be sufficient for strongly nonlinear and/or stiff problems. - We need a good understanding of the nonlinear behavior of numerical schemes being used as an integral part of code verification, validation and certification.

HEC↗

NASA NTRS2022

How to Build a Rover: An Overview of the Mars 2020 Mission’s Vehicle System Testbed

While NASA’s Mars rover Perseverance continues to make groundbreaking achievements on the Red Planet, its twin is hard at work here on Earth. The Operational Perseverance Twin for the Integration of Mechanisms and Instruments Sent to Mars, or OPTIMISM, is the Mars 2020 Vehicle System Testbed (VSTB) rover operated by NASA Jet Propulsion Laboratory (JPL) in Pasadena, California. OPTIMISM’s home is the JPL Mars Yard; an outdoor field with red soil that simulates the terrain encountered by Perseverance. The VSTB is a full-scale engineering model of the flight rover, serving a number of functions to ensure mission operations can continue smoothly and on schedule. The VSTB possesses instrumentation, computers, mechanisms, cameras, and a Mobility subsystem that are nearly identical to its extraterrestrial twin. Its high fidelity allows the rover to be a highly effective tool to fully test system functionality and performance prior to commanding the flight rover. The early stages of building OPTIMISM began a few months prior to Perseverance departing JPL for Cape Canaveral, FL in early 2020. Electrical integration of the flight system avionics, and compatibility checkouts of the electrical ground support equipment ensured that the foundation of the electrical system was operational and in place. Next, the internal harnessing was installed and compatibility checks of the rover instrumentation and mechanisms were performed to confirm the system was prepared for full buildup. Finally, mechanical assembly of the rover chassis with its external components completed the integration of the system before it was moved to the Mars Yard for its initial phase of testing to perform verification & validation (V&V) of the Mobility subsystem requirements. By the time Perseverance landed at Jezero Crater in February 2021, the first phase of VSTB operations was underway. Surface guidance, navigation, and control (SGNC) testing for the Mobility subsystem ensured functionality and performance requirements were met for various capabilities such as visual odometry (VO), mapping, and automatic navigation (AutoNav). Subsequent integration of the robotic arm (RA) onto the VSTB enabled the V&V campaign for surface sampling operations (SSO) to commence. As the mission’s engineering operations (EO) have gotten underway, the VSTB has been utilized for an array of purposes including troubleshooting software anomalies, and performing dry-runs for first time activities (FTAs) prior to sending the commands to Perseverance. OPTIMISM will continue to serve mission critical functions as long as Perseverance is roving the Red Planet.

Rojas, Jose Trujillo↗

NASA NTRS2023

Modeling and Simulation Credibility Assessments of Whole-Body Finite Element Computational Models for Use in NASA Extravehicular Activity Applications

Computational finite element (FE) models are used in suited astronaut injury risk assessments; however, these models’ verification, validation, and credibility (VV&C) procedures for simulating injuries in altered gravity environments are limited. Our study conducts VV&C assessments of THUMS and Elemance whole-body FE models for predicting suited astronaut injury biomechanics using eight credibility factors, as per NASA-STD-7009A. Credibility factor ordinal scores are assigned by reviewing existing documentation describing VV&C practices, and credibility sufficiency thresholds are assigned based on input from subject matter experts. Our results show the FE models are credible for suited astronaut injury investigation in specific ranges of kinematic and kinetic conditions correlating to highway and contact sports events. Nevertheless, these models are deficient when applied outside these ranges. Several credibility elevation strategies are prescribed to improve models’ credibility for the NASA-centric application domain.

Finite Element↗

NASA NTRS2023

Modeling and simulation credibility assessments of whole-body finite element computational models for use in NASA extravehicular activity applications

Finite Element↗

DOE OSTI2024

Benchmarking of Different Inverse Point Kinetics Implementations for an Autocorrected Reactimeter Algorithm

In November 2017, the Transient Reactor Test Facility returned to operation. Since that time, many transient test series have been completed; each has provided valuable data for materials performance, reactor safety that can be applied in future designs. During each experimental series, detector count rates provided important information on the core behavior during transients. However, a limitation of these data is that variations in the neutron distribution during experiments cause errors when attempting to infer reactivity evolution from detector signals. Neutron physics codes can be used to compute the flux shape variations. However, this is a poor solution when the experimental data is used to do verification, validation and uncertainty quantification (VVUQ) on codes. Indeed, if the output of the code is used both as a reference and to correct what the reference is compared to, the circular dependency limits the quality of the VVUQ approach. To overcome this problem, an Autocorrected Reactimeter Algorithm (ACRA) has been developed. This approach infers time-dependent reactivity evolution by testing different spatial corrections and selecting the one that minimizes reactivity variations when the core is in a frozen configuration (i.e. when there is no variation in parameters affecting reactivity). However, the scope of this method was limited to transients where there were negligible thermal feedback. Indeed, the core is never in a frozen configuration when the fuel temperature varies during the whole transient. This is our motivation for the development of an improved version of the ACRA which does not require frozen configurations

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

NASA NTRS2019

Verification Benchmarks and Validation of MAT261 for High Energy Dynamic Impact Applications

Advanced computational methods for composite structures can enable smarter testing and potentially certification by analysis. These methods, known as progressive damage and failure analysis (PDFA) methods, can predict lamina level mechanics including failure and subsequent propagation. When introduced into a commercial off the shelf finite element solver such as ABAQUS, LS-DYNA, or ANSYS, it enables end users to effectively exercise PDFA methods; however, it requires an understanding of the assumed mechanics and underlying coded response. In this paper, verification benchmarks developed under the NASA Advanced Composite Consortium for a class of PDFA methods known as continuum damage mechanics approaches are applied to the native LS-DYNA material model MAT261. As a result of the verification, an instability was discovered and subsequently corrected with an engineering solution. The results of the preliminary MAT261 simulations for high energy dynamic impact and the engineering solution are compared and a discussion about the significance is presented.

Molitor, Matthew↗

NASA NTRS2004

NASA Data for Water Resources Applications

Water Management Applications is one of twelve elements in the Earth Science Enterprise National Applications Program. NASA Goddard Space Flight Center is supporting the Applications Program through partnering with other organizations to use NASA project results, such as from satellite instruments and Earth system models to enhance the organizations critical needs. The focus thus far has been: 1) estimating water storage including snowpack and soil moisture, 2) modeling and predicting water fluxes such as evapotranspiration (ET), precipitation and river runoff, and 3) remote sensing of water quality, including both point source (e.g., turbidity and productivity) and non-point source (e.g., land cover conversion such as forest to agriculture yielding higher nutrient runoff). The objectives of the partnering cover three steps of: 1) Evaluation, 2) Verification and Validation, and 3) Benchmark Report. We are working with the U.S. federal agencies including the Environmental Protection Agency (EPA), the Bureau of Reclamation (USBR) and the Department of Agriculture (USDA). We are using several of their Decision Support Systems (DSS) tools. This includes the DSS support tools BASINS used by EPA, Riverware and AWARDS ET ToolBox by USBR and SWAT by USDA and EPA. Regional application sites using NASA data across the US. are currently being eliminated for the DSS tools. The current NASA data emphasized thus far are from the Land Data Assimilation Systems WAS) and MODIS satellite products. We are currently in the first two steps of evaluation and verification validation. Water Management Applications is one of twelve elements in the Earth Science Enterprise s National Applications Program. NASA Goddard Space Flight Center is supporting the Applications Program through partnering with other organizations to use NASA project results, such as from satellite instruments and Earth system models to enhance the organizations critical needs. The focus thus far has been: 1) estimating water storage including snowpack and soil moisture, 2) modeling and predicting water fluxes such as evapotranspiration (ET), precipitation and river runoff, and 3) remote sensing of water quality, including both point source (e.g., turbidity and productivity) and non-point source (e.g., land cover conversion such as forest to agriculture yielding higher nutrient runoff). The objectives of the partnering cover three steps of 1) Evaluation, 2) Verification and Validation, and 3) Benchmark Report. We are working with the U.S. federal agencies the Environmental Protection Agency (EPA), the Bureau of Reclamation (USBR) and the Department of Agriculture (USDA). We are using several of their Decision Support Systems (DSS) tools. T us includes the DSS support tools BASINS used by EPA, Riverware and AWARDS ET ToolBox by USBR and SWAT by USDA and EPA. Regional application sites using NASA data across the US. are currently being evaluated for the DSS tools. The current NASA data emphasized thus far are from the Land Data Assimilation Systems (LDAS) and MODIS satellite products. We are currently in the first two steps of evaluation and verification and validation.

Toll, David↗

DOE OSTI2023

MCNP ® Code V.6.3.0 Release Notes

The Monte Carlo N-Particle ® (MCNP ® ) code is a general-purpose, continuous-energy, generalized geometry, time-dependent, radiation transport code developed by the MCNP development team. The MCNP calculations provide predictive capabilities that can replace expensive or impossible-to perform experiments. Specific application problems include simulations of experimental diagnostics, intrinsic radiation, radiation detection and measurement, criticality safety, nuclear threat reduction and response, radiation health protection, nuclear weapons effects, and nuclear forensics. This MCNP code, version 6.3.0, follows the MCNP6.2.0 version. Since the release of MCNP6.2.0, many changes have been made to the MCNP code. These changes include new or improved features, a new build system, code enhancement and modernization, and bug fixes. The MCNP code, version 6.3.0, theory and user input information is documented in MCNP ® Code Version 6.3.0 Theory & User Manual, the build guidance for various platforms is documented in MCNP ® Code Version 6.3.0 Build Guide, and the verification and validation testing for various application benchmark test suites is documented in MCNP ® Code Version 6.3.0 Verification & Validation Testing.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

NASA NTRS2015

Fault Management Architectures and the Challenges of Providing Software Assurance

The satellite systems Fault Management (FM) is focused on safety, the preservation of assets, and maintaining the desired functionality of the system. How FM is implemented varies among missions. Common to most is system complexity due to a need to establish a multi-dimensional structure across hardware, software and operations. This structure is necessary to identify and respond to system faults, mitigate technical risks and ensure operational continuity. These architecture, implementation and software assurance efforts increase with mission complexity. Because FM is a systems engineering discipline with a distributed implementation, providing efficient and effective verification and validation (VV) is challenging. A breakout session at the 2012 NASA Independent Verification Validation (IVV) Annual Workshop titled VV of Fault Management: Challenges and Successes exposed these issues in terms of VV for a representative set of architectures. NASA's IVV is funded by NASA's Software Assurance Research Program (SARP) in partnership with NASA's Jet Propulsion Laboratory (JPL) to extend the work performed at the Workshop session. NASA IVV will extract FM architectures across the IVV portfolio and evaluate the data set for robustness, assess visibility for validation and test, and define software assurance methods that could be applied to the various architectures and designs. This work focuses efforts on FM architectures from critical and complex projects within NASA. The identification of particular FM architectures, visibility, and associated VVIVV techniques provides a data set that can enable higher assurance that a satellite system will adequately detect and respond to adverse conditions. Ultimately, results from this activity will be incorporated into the NASA Fault Management Handbook providing dissemination across NASA, other agencies and the satellite community. This paper discusses the approach taken to perform the evaluations and preliminary findings from the research including identification of FM architectures, visibility observations, and methods utilized for VVIVV.

Fault Management↗

DOE OSTI2023

OECD-NEA HTTF Benchmark Progress and Updates

General slides discussing High Temperature Test Facility benchmark progress, Prismatic HTGR deployment, modeling and simulation tools for validating systems, and verification and validation issues. Also discuss collaboration and conclusions of RELAP5-3D validation activities based on HTTF with trends in data and international impact to accelerate deployment of prismatic HTGR microreactors by providing an opportunity for designers to assess their codes against experimental data and solutions from other codes.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

NASA NTRS2015

Fault Management Architectures and the Challenges of Providing Software Assurance

Fault Management (FM) is focused on safety, the preservation of assets, and maintaining the desired functionality of the system. How FM is implemented varies among missions. Common to most missions is system complexity due to a need to establish a multi-dimensional structure across hardware, software and spacecraft operations. FM is necessary to identify and respond to system faults, mitigate technical risks and ensure operational continuity. Generally, FM architecture, implementation, and software assurance efforts increase with mission complexity. Because FM is a systems engineering discipline with a distributed implementation, providing efficient and effective verification and validation (V&V) is challenging. A breakout session at the 2012 NASA Independent Verification & Validation (IV&V) Annual Workshop titled "V&V of Fault Management: Challenges and Successes" exposed this issue in terms of V&V for a representative set of architectures. NASA's Software Assurance Research Program (SARP) has provided funds to NASA IV&V to extend the work performed at the Workshop session in partnership with NASA's Jet Propulsion Laboratory (JPL). NASA IV&V will extract FM architectures across the IV&V portfolio and evaluate the data set, assess visibility for validation and test, and define software assurance methods that could be applied to the various architectures and designs. This SARP initiative focuses efforts on FM architectures from critical and complex projects within NASA. The identification of particular FM architectures and associated V&V/IV&V techniques provides a data set that can enable improved assurance that a system will adequately detect and respond to adverse conditions. Ultimately, results from this activity will be incorporated into the NASA Fault Management Handbook providing dissemination across NASA, other agencies and the space community. This paper discusses the approach taken to perform the evaluations and preliminary findings from the research.

Fault Management↗

DOE OSTI2025

MCNP® Code Version 6.3.1 Release Notes

The Monte Carlo N-Particle® (MCNP® ) code is a general-purpose, continuous-energy, generalized-geometry, time-dependent, radiation transport code developed by the MCNP development team. MCNP calculations provide predictive capabilities that can replace expensive or impossible-to-perform experiments. Specific application problems include simulations of experimental diagnostics, intrinsic radiation, radiation detection and measurement, criticality safety, nuclear threat reduction and response, radiation health protection, nuclear weapons effects, and nuclear forensics. This MCNP code, version 6.3.1, follows the MCNP6.3.0 version. Since the release of MCNP6.3.0, a variety of bug fixes and code enhancements have been completed for MCNP6.3.1. A few new features have also been added to this release to support both ongoing research and the release of the latest ENDF/B-VIII.1 nuclear data library. The MCNP code, version 6.3.1, theory and user input information is documented in MCNP® Code Version 6.3.1 Theory & User Manual, the build guidance for various platforms is documented in MCNP® Code Version 6.3.1 Build Guide, and the verification and validation testing for various application benchmark test suites is documented in MCNP® Code Version 6.3.1 Verification & Validation Testing.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2021

Pronghorn Porous Media Model Validation with Pressure Drop Measurements

The verification and validation (V &V) of Pronghorn is imperative to assert its accuracy when predicting the fluid velocity, temperature, and pressure in high temperature gas-cooled reactors. This paper focuses on the validation of the Pronghorn implementation of the incompressible and compressible Navier-Stokes equations using the pressure drop measurements in the engineering-scale pebble bed facility at the Texas A &M university.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2022

Pronghorn Porous Media Model Validation with Pressure Drop Measurements

The verification and validation (V&V) of Pronghorn is imperative to assert its accuracy when predicting the fluid velocity, temperature, and pressure in high temperature gas-cooled reactors. Pronghorn is a coarse-mesh, intermediate-fidelity, and multidimensional thermal-hydraulics (TH) code developed by the Idaho National Laboratory (INL). New pebble bed experiments are used to observe the details of the fluid motion and pressure drop in the porous bed under the reactor normal operation. This paper focuses on the validation of the Pronghorn compressible and incompressible Navier-Stokes equations using the pressure drop measurements performed at the engineering-scale pebble bed facility at the Texas A&M university (TAMU). Various pressure drop correlations and porosity functions are implemented in both Pronghorn and STAR-CCM+ to compare the pressure drop due to the combined viscous and inertial resistances in the porous bed. The correlations accounting for the near-wall effect are also utilized to observe if the pressure drop estimates can be improved. Pronghorn porous media models predict the pressure drop well relative to the STAR-CCM+ simulation results and 1D correlations, and both the finite element method (FEM) and finite volume method (FVM) perform accurately. Pronghorn models are also validated with the experimental measurements given the different Reynolds number ranges and specific aspect ratios. The likelihood of the statistical significance between the pressure drop measurements and specific correlations or simulations is low provided that the overlap of their confidence intervals is more than the half of a single arm. Several validation metrics are reasonable in regard to the similar studies from other literature. The precise average pebble bed porosity estimation has much impact on the pressure drop, and the Foumeny and Montillet (dense packing) models carry out the accurate pressure drop prediction by considering the near-wall effect.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗