SEARCH · Engineering Papers

Results for “verification and validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

All sources NASA NTRS DOE OSTI

NASA NTRSDate not supplied

Space Launch System: CLVTOPS Toolchain for SLS Liftoff Separation Analysis

This presentation showcases the unique technical capabilities of the CLVTOPS multi-body flight dynamics tool chain developed by Marshall Space Flight Center (MSFC) for analyzing NASA’s Space Launch System (SLS) liftoff events. The CLVTOPS tool chain integrates high-fidelity simulations, geometric algorithms, advanced data analytics, and post-flight telemetry to demonstrate positive clearance between separating bodies and inform design decisions that enhance mission reliability. Proper liftoff separation is crucial to the success of the launch vehicle’s mission; vehicle impacts with the launch tower and supporting components incur a heightened risk of mission failure. For liftoff analysis, the CLVTOPS tool chain enables the integration of vehicle, launch pad, and environmental input models for the investigation of key clearance effectors. Furthermore, a novel capability of the CLVTOPS tool chain allows for verification and validation of trajectory reconstruction via photogrammetric imagery analysis. The following sections will walk through the tool chain, SLS liftoff ground rules and assumptions, model integration, pre-flight verification, and post-flight validation of the Artemis I mission liftoff event.

CLVTOPS↗

NASA NTRS2004

Validation of Orthorectified Interferometric Radar Imagery and Digital Elevation Models

This work was performed under NASA's Verification and Validation (V&V) Program as an independent check of data supplied by EarthWatch, Incorporated, through the Earth Science Enterprise Scientific Data Purchase (SDP) Program. This document serves as the basis of reporting results associated with validation of orthorectified interferometric interferometric radar imagery and digital elevation models (DEM). This validation covers all datasets provided under the first campaign (Central America & Virginia Beach) plus three earlier missions (Indonesia, Red River: and Denver) for a total of 13 missions.

Smith Charles M.↗

DOE OSTI2021

Hanford Waste Treatment Plant LAB Facility Stack Effluent Monitoring: Sampling Probe Location Qualification Evaluation

The WTP LAB stack monitor locations were qualified using scale model stacks to mitigate the risk of identifying that sampling locations do not meet the qualification criteria on the full-scale stack. As required by the ANSI/HPS N13.1-1999 standard, the scale model and its sampling location were geometrically similar to the actual stack and the Reynolds numbers for both the actual and model stacks were >10,000. An additional criterion is that the DV of the full-scale stack must be between 1/6 DV and 6 DV of the scale model stack tests. Verification tests of the LAB stacks were performed at normal operating conditions. The maximum 6 DV value from the scale model testing determines the maximum conditions for which the full-scale stack may be operated and remain in compliance with the stack verification criterion. The remaining criteria for the stack verification to be considered valid involve the flow angle and velocity uniformity results. First, the flow angle at the full-scale stack must be = 20°. Second, the velocity uniformity at the full-scale stack must be = 20% COV. Finally, the velocity uniformity results for the actual and scale model stacks must agree within 5% COV. In general, these criteria were met through the full-scale stack tests at the LAB facility. Some specific items for each scale model and full-scale stack comparison should be noted in assessing the validity of the verification tests. The LB-C2 scale model stacks were performed with single fan operations at then-minimum flow conditions. These conditions resulted in DV values that were too low to meet the DV range criterion, and therefore are unable to be used in qualifying single fan operations on the full-scale stack. However, the single fan operations demonstrated COV values for velocity uniformity as well as flow angles that were comparable to the dual-fan operations at high flows. Overall, the test conditions and test results were within the range of acceptable values based on current design flow rates. Single fan operations are expected to only occur infrequently for maintenance needs and is therefore not a planned operating condition at this time. The LB-S1 scale model stacks were performed at three fan combinations, and in each combination, at least one test was performed at the then-minimum flow conditions as well as at then-maximum flow conditions. While the then-minimum flow conditions result in a DV range that is lower than the verification test DV value, and therefore does not meet the criterion, these tests are un-necessary for the verification test acceptance. The normal and maximum flow conditions from the scale model stack tests meet the DV range criterion, and the velocity uniformity test results compare favorably with the full-scale stack results. The LB-S2 scale model stacks were performed at nominally the same maximum flow condition; however, the 6 DV value for Fan A operation was slightly lower than the full-scale stack test DV. The COV values from the scale model stacks were comparable between the Fan A and Fan B results, and the overall test conditions are within the range of acceptable values. The stack verification is therefore considered acceptable for both Fan A and Fan B operations. The verification tests were performed at flows that were appreciably higher than the design conditions, and further elevated flow rates would be beyond the range of acceptable DV. Based on these stack verification test results, the three LAB filtered exhaust stacks meet the qualification criteria provided in the ANSI/HPS N13.1-1999 standard. Further changes to the system configuration or operating conditions that are outside the bounds described in this and the scale model test reports (Glissmeyer, Flaherty, and Piepel (2001), Glissmeyer and Geeting (2013)) may require additional tests and additional analyses to determine compliance with the standard.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

NASA NTRS2008

Space Computing Systems Validation Challenges

To examine the challenges of spaceborne computing systems and the past, present and future approaches to verification and validation in hardware and software systems.

Commercial Orbital Transportation Services (COTS)↗

NASA NTRS1997

Hyper-X: Flight Validation of Hypersonic Airbreathing Technology

This paper provides an overview of NASA's focused hypersonic technology program, i.e. the Hyper-X program. This program is designed to move hypersonic, air breathing vehicle technology from the laboratory environment to the flight environment, the last stage preceding prototype development. This paper presents some history leading to the flight test program, research objectives, approach, schedule and status. Substantial experimental data base and concept validation have been completed. The program is concentrating on Mach 7 vehicle development, verification and validation in preparation for wind tunnel testing in 1998 and flight testing in 1999. It is also concentrating on finalization of the Mach 5 and 10 vehicle designs. Detailed evaluation of the Mach 7 vehicle at the flight conditions is nearing completion, and will provide a data base for validation of design methods once flight test data are available.

Rausch, Vincent L.↗

NASA NTRS2007

Integrating Human Factors into Crew Exploration Vehicle Design

With NASA's new Vision for Exploration to send humans beyond Earth orbit, it is critical to consider the human as a system that demands early and continuous user involvement, and an iterative prototype/test/redesign process. Addressing human-system interface issues early on can be very cost effective even cost reducing when performed early in the design and development cycle. To achieve this goal within Crew Exploration Vehicle (CEV) Project Office, human engineering (HE) team is formed. Key tasks are to apply HE requirements and guidelines to hardware/software, and provide HE design, analysis and evaluation of crew interfaces. Initial activities included many practice-orientated evaluations using low-fidelity CEV mock-ups. What follows is a description of such evaluations that focused on a HE requirement regarding Net Habitable Volume (NHV). NHV is defined as the total remaining pressurized volume available to on-orbit crew after accounting for the loss of volume due to deployed hardware and structural inefficiencies which decrease functional volume. The goal of the NHV evaluations was to develop requirements providing sufficient CEV NHV for crewmembers to live and perform tasks in support of mission goals. Efforts included development of a standard NHV calculation method using computer models and physical mockups, and crew/ stakeholder evaluations. Nine stakeholders and ten crewmembers participated in the unsuited evaluations. Six crewmembers also participated in a suited evaluation. The mock-up was outfitted with volumetric representation of sub-systems such as seats, and stowage bags. Thirteen scenarios were developed to represent mission/crew tasks and considered to be primary volume drivers (e.g., suit donning) for the CEV. Unsuited evaluations included a structured walkthrough of these tasks. Suited evaluations included timed donning of the existing launch and entry suit to simulate a contingency scenario followed by doffing/ stowing of the suits. All mockup evaluations were videotaped. Structured questionnaires were used to document user interface issues and volume impacts of layout configuration. Computer model and physical measures of the NHV agreed within 1 percent. This included measurement of the gross habitable volume, subtraction of intrusive volumes, and other non-habitable spaces. Calculation method developed was validated as a standard means of measuring NHV, and was recommended as a verification method for the NHV requirements. Evaluations confirmed that there was adequate volume for unsuited scenarios and suit donning/ doffing activity. Seats, suit design stowage and waste hygiene system noted to be critical volume drivers. The low-fidelity mock-up evaluations along with human modeling analysis generated discussions that will lead to high-level systems requirements and human-centered design decisions. This approach allowed HE requirements and operational concepts to evolve in parallel with engineering system concepts and design requirements. As the CEV design matures, these evaluations will continue and help with design decisions, and assessment, verification and validation of HE requirements.

Whitmore, Mihriban↗

DOE OSTI2024

Latent Pitfalls in Microstructure-Based Modeling for Thermally Aged 9Cr-1Mo-V Steel (Grade 91)

A case study was conducted on a mechanistic model development that predicted tensile strength deterioration with thermal aging of 9Cr-1Mo-V steel in supporting the 60-year design life expected for advanced nuclear reactors. For property prediction beyond practical testing times, mechanistic modeling is highly desired, as it taps into the physics of structure–property relationships and therefore can generate reliable results for extrapolation. Meanwhile, as mechanistic models are often complicated, reflecting the intricacy of microstructure and strengthening mechanisms, pitfalls that are difficult to detect often exist. Here, this paper discusses latent pitfalls that are common in mechanistic modeling or specific in this 9Cr-1Mo-V case development through using the American Society of Mechanical Engineers verification and validation in computational solid mechanics (ASME V&V 10) standard for evaluating credibility of modeling in materials engineering. Suggestions are also made for enhancing reliability of microstructure-based modeling.

36 MATERIALS SCIENCE↗

NASA NTRS1990

Application of industry-standard guidelines for the validation of avionics software

The application of industry standards to the development of avionics software is discussed, focusing on verification and validation activities. It is pointed out that the procedures that guide the avionics software development and testing process are under increased scrutiny. The DO-178A guidelines, Software Considerations in Airborne Systems and Equipment Certification, are used by the FAA for certifying avionics software. To investigate the effectiveness of the DO-178A guidelines for improving the quality of avionics software, guidance and control software (GCS) is being developed according to the DO-178A development method. It is noted that, due to the extent of the data collection and configuration management procedures, any phase in the life cycle of a GCS implementation can be reconstructed. Hence, a fundamental development and testing platform has been established that is suitable for investigating the adequacy of various software development processes. In particular, the overall effectiveness and efficiency of the development method recommended by the DO-178A guidelines are being closely examined.

Hayhurst, Kelly J.↗

DOE OSTI2024

Heat Pipe Cooled Microreactors

Microreactor technologies are required to provide reliable carbon-free power generation in remote applications. The heat pipe cooled microreactor concept in particular offers notable advantages due to the passive operation of heat pipes enabling increased reliability and simplicity in a more compact form factor. There is a significant need for experimental work to aid and expedite the deployment of heat pipe microreactors due to their unique technological characteristics. Thus, there has been increased interest in heat pipe experiments by numerous institutions in order to support these efforts. The present work is a comprehensive review of heat pipe experiments, describing instrumentation, methods, phenomena of interest, and recent developments. In addition, legacy work on the operation of high-temperature heat pipes under irradiation is reviewed and discussed. Furthermore, the verification and validation efforts for the flagship heat pipe simulation code Sockeye are reviewed and requirements for future experiments are outlined. Lastly, future directions are proposed for heat pipe experimentation.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2022

WBS 2.2.1.402 - Wave-SPARC: Systematic Process & Analysis for Reaching Commercialization

Wave-SPARC is empowering the marine energy community with the tools necessary to achieve a significant improvement in techno-economic performance of wave generated grid power. A detailed systems engineering approach simultaneously balances around 100 cost and performance drivers (functional requirements and capabilities) of wave energy converters (WECs). Publicly accessible technology innovation and assessment methods and tools (new to the wave energy sector) have been delivered. They guide technology development trajectories to successful outcomes in less time, at less overall cost, and with less encountered risk. Through the use of these methods and tools along with proven structured inventive techniques the project continues to deliver high potential novel wave energy technology concepts for validation and subsequent development by industry. The intended outcomes are: (1) Invention, assessment, identification, verification and validation of novel and high techno-economic-potential WEC technology concepts to deliver high-confidence "seeds" for subsequent industrial development to full commercial application and economic viability (2) Development and delivery of WEC technology innovation and assessment methodologies and tools and provision of these as services and for free use by industry and the entire sector (3) International collaboration for global best practice alignment of assessment and innovation methods.

innovation↗

NASA NTRS2014

Rapid State Space Modeling Tool for Rectangular Wing Aeroservoelastic Studies

This paper introduces a modeling and simulation tool for aeroservoelastic analysis of rectangular wings with trailing edge control surfaces. The inputs to the code are planform design parameters such as wing span, aspect ratio and number of control surfaces. A doublet lattice approach is taken to compute generalized forces. A rational function approximation is computed. The output, computed in a few seconds, is a state space aeroservoelastic model which can be used for analysis and control design. The tool is fully parameterized with default information so there is little required interaction with the model developer. Although, all parameters can be easily modified if desired.The focus of this paper is on tool presentation, verification and validation. This process is carried out in stages throughout the paper. The rational function approximation is verified against computed generalized forces for a plate model. A model composed of finite element plates is compared to a modal analysis from commercial software and an independently conducted experimental ground vibration test analysis. Aeroservoelastic analysis is the ultimate goal of this tool. Therefore the flutter speed and frequency for a clamped plate are computed using V-g and V-f analysis. The computational results are compared to a previously published computational analysis and wind tunnel results for the same structure. Finally a case study of a generic wing model with a single control surface is presented. Verification of the state space model is presented in comparison to V-g and V-f analysis. This also includes the analysis of the model in response to a 1-cos gust.

Modeling and Simulation↗

NASA NTRS2015

Rapid State Space Modeling Tool for Rectangular Wing Aeroservoelastic Studies

This paper introduces a modeling and simulation tool for aeroservoelastic analysis of rectangular wings with trailing-edge control surfaces. The inputs to the code are planform design parameters such as wing span, aspect ratio, and number of control surfaces. Using this information, the generalized forces are computed using the doublet-lattice method. Using Roger's approximation, a rational function approximation is computed. The output, computed in a few seconds, is a state space aeroservoelastic model which can be used for analysis and control design. The tool is fully parameterized with default information so there is little required interaction with the model developer. All parameters can be easily modified if desired. The focus of this paper is on tool presentation, verification, and validation. These processes are carried out in stages throughout the paper. The rational function approximation is verified against computed generalized forces for a plate model. A model composed of finite element plates is compared to a modal analysis from commercial software and an independently conducted experimental ground vibration test analysis. Aeroservoelastic analysis is the ultimate goal of this tool, therefore, the flutter speed and frequency for a clamped plate are computed using damping-versus-velocity and frequency-versus-velocity analysis. The computational results are compared to a previously published computational analysis and wind-tunnel results for the same structure. A case study of a generic wing model with a single control surface is presented. Verification of the state space model is presented in comparison to damping-versus-velocity and frequency-versus-velocity analysis, including the analysis of the model in response to a 1-cos gust.

Modeling and Simulation↗

NASA NTRS2015

Rapid State Space Modeling Tool for Rectangular Wing Aeroservoelastic Studies

This report introduces a modeling and simulation tool for aeroservoelastic analysis of rectangular wings with trailing-edge control surfaces. The inputs to the code are planform design parameters such as wing span, aspect ratio, and number of control surfaces. Using this information, the generalized forces are computed using the doublet-lattice method. Using Roger's approximation, a rational function approximation is computed. The output, computed in a few seconds, is a state space aeroservoelastic model which can be used for analysis and control design. The tool is fully parameterized with default information so there is little required interaction with the model developer. All parameters can be easily modified if desired. The focus of this report is on tool presentation, verification, and validation. These processes are carried out in stages throughout the report. The rational function approximation is verified against computed generalized forces for a plate model. A model composed of finite element plates is compared to a modal analysis from commercial software and an independently conducted experimental ground vibration test analysis. Aeroservoelastic analysis is the ultimate goal of this tool, therefore, the flutter speed and frequency for a clamped plate are computed using damping-versus-velocity and frequency-versus-velocity analysis. The computational results are compared to a previously published computational analysis and wind-tunnel results for the same structure. A case study of a generic wing model with a single control surface is presented. Verification of the state space model is presented in comparison to damping-versus-velocity and frequency-versus-velocity analysis, including the analysis of the model in response to a 1-cos gust.

Verification and Validation↗

NASA NTRS2024

NASA Space Observatory Precision Pointing Benchmark Problem Development

An interagency workshop in May 2021 on guidance, navigation, and control (GNC) verification and validation (V&V) methods and techniques identified needs for the formulation and public release of relevant V&V benchmark problems as a practical way forward for the discipline. A decision was made by the NASA Technical Fellow for GNC and the NASA Engineering and Safety Center (NESC) GNC Technical Discipline Team (TDT) to produce a benchmark problem focusing on the problem of space observatory precision pointing. This report contains the results of the NESC assessment.

NASA Engineering and Safety Center↗

DOE OSTI2025

Leveraging interpolation models and error bounds for verifiable scientific machine learning

Effective verification and validation techniques for modern scientific machine learning workflows are challenging to devise. Statistical methods are abundant and easily deployed, but often rely on speculative assumptions about the data and methods involved. Error bounds for classical interpolation techniques can provide mathematically rigorous estimates of accuracy, but often are difficult or impractical to determine computationally. Here, in this work, we present a best-of-both-worlds approach to verifiable scientific machine learning by demonstrating that (1) multiple standard interpolation techniques have informative error bounds that can be computed or estimated efficiently; (2) comparative performance among distinct interpolants can aid in validation goals; (3) deploying interpolation methods on latent spaces generated by deep learning techniques enables some interpretability for black-box models. We present a detailed case study of our approach for predicting lift-drag ratios from airfoil images. Code developed for this work is available in a public Github repository.

97 MATHEMATICS AND COMPUTING↗

NASA NTRSDate not supplied

Assessment of Sensor Data Accuracy within Gazebo/ROS for High-Precision Autonomous In-Space Robotic Operations

Modeling high-precision in-space servicing, assembly, and manufacturing operations in a simulated environment is a critical step in the development of robotic systems that will be used to autonomously assemble large-scale structures in space. Limited facility size and high costs for manufacturing prototypes make it challenging to conduct full-scale operational testing under appropriate environmental conditions; therefore, testing in a modular, high-fidelity simulation environment is necessary for verification and validation of technology and architecture designs prior to launch. Several modeling and simulation environments exist both within NASA and industry that can be used to test robotic system design and operations, including the widely used commercial tool Gazebo integrated with Robotic Operating System software. Because the performance of autonomous robotic systems relies heavily on the quality of sensor input data, this paper focuses on assessing the accuracy of pose data from an optical sensor model in the Gazebo environment against the behavior of real hardware. The results of the tests will help developers using Gazebo for large-scale, high-precision simulation to account for modeling inaccuracies within their robotic control system algorithms.

simulation↗

NASA NTRSDate not supplied

Operational Modal Analysis of the Artemis I Dynamic Rollout Test and Wet Dress Rehearsal

NASA has developed an expendable heavy lift launch vehicle capability, the Space Launch System (SLS), to support lunar and deep space exploration. The uncrewed Artemis I was the first flight of this new launch vehicle and tested critical systems for the upcoming crewed Artemis II flight to the moon. Accelerations were recorded at a multitude of locations on Artemis, the Mobile Launcher (ML), and the Crawler Transporter (CT)during the rollout of Artemis I from the Vehicle Assembly Building (VAB) to Launch Pad 39B March 2022 and is referred to as the Artemis I Dynamic Rollout Test (DRT). While Artemis I was at Launch Pad 39B, the Wet Dress Rehearsal (WDR) was performed to demonstrate launch readiness and acceleration measurements were also recorded. Finally, Artemis I rolled back from Launch Pad 39B to the VAB in April 2022, where acceleration measurements were also recorded and is referred to as the rollback portion of DRT. Because the forces during rollout and at the launch pad acting on Artemis I, the ML, and the CT are not directly measurable, Operational Modal Analysis (OMA) techniques, instead of traditional Experimental Modal Analysis (EMA) techniques, were used to identify modal characteristics. The OMA analysis of DRT and WDR directly builds upon the lessons learned from the OMA analysis of an earlier rollout of the ML from the VAB. DRT and WDR dynamic characteristics will be used to support SLS Integrated Modal Test finite element model correlation efforts and Exploration Ground System ML and CT finite element model verification and validation, which are part of the Building Block approach the Space Launch System program has implemented. The dynamic characteristics extracted from DRT as well as the rollout acceleration time histories themselves will be used in the development of generic rollout forcing functions that will provide refined estimates of the Artemis IV rollout forces, which will have the heavier and larger SLS Block 1B launch vehicle and Mobile Launcher 2 (ML-2). This paper briefly describes Artemis I, the ML, and the CT physical characteristics, DRT rollout/rollback and WDR data collection, the challenges in implementing OMA techniques due in part to the CT harmonics, and how these challenges were overcome to obtain the Artemis I DRT configuration and WDR configuration modal characteristics.

Apollo↗

NASA NTRSDate not supplied

Operational Modal Analysis of the Artemis I Dynamic Rollout Test and Wet Dress Rehearsal

Apollo↗