Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “verification and validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49

Comparing the Electrical Modeling and Thermal Analysis Toolbox Simulation Data to Electrified Aircraft Propulsion Test Hardware Data

A model using the Electrical Modeling and Thermal Analysis Toolbox (EMTAT), a National Aeronautics and Space Administration (NASA)-developed Simulink® model block library of electrical components, was developed to mirror the Hybrid Propulsion Emulation Rig (HyPER) hardware, a laboratory focused on Electrified Aircraft Propulsion (EAP) hardware tests. The goal of the model was to demonstrate the utility of the library by comparing the accuracy of the library models to the performance of real hardware, with the primary metrics being the simulation outputs matching physical test hardware data within 5 percent of full scale. The objective of this paper is to present the background, setup, testing and results of this comparison. It describes some of the adjustments that were necessary to match the system hardware, as well as next steps in verification and validation. The outputs of the model were compared to the results of several tests in HyPER, and in the process captured an additional torque loss that is still being analyzed for the root cause but has been confirmed in the hardware. Across all the test series, only one key model parameter was outside the target 5 percent full scale matching, and nearly 70 percent were within 1 percent.

Mark E. Bell↗

Systems Engineering with a Focus on Failure Prevention

A discussion of Systems Engineering principles as related to failure prevention methodologies and technologies. The presentation outlines requirements development, design reviews, verification and validation, and finally risk management prectices.

Systems Engineering, Failure Prevention↗

Copernicus-LinCov (COPCOV) Software Integration in Support of Robust Trajectory Optimization

Robust trajectory optimization is the process of optimizing a trajectory while accounting for system uncertainty due to a variety of potential error sources. This work highlights the development and features of a novel tool known as CopCov to support robust trajectory optimization efforts. CopCov acts as an interface between Copernicus, a generalized trajectory design and optimization tool, and LinCov, a linear covariance analysis tool. By having a direct interface between these two software packages, Copernicus can receive covariance information from LinCov through a direct feedback loop, thus enabling optimization of a trajectory that is robust to trajectory dispersions and navigation errors. This paper details the architecture of CopCov and its flexibility to operate under varying configurations, including with both tools running locally or alternatively with the tools communicating via a remote connection. Additionally, the CopCov tool is demonstrated on a simple Hohmann transfer reference trajectory with varying numbers of Trajectory Correction Maneuvers (TCMs) and varying problem formulations. This example scenario is used to highlight how the inclusion of the CopCov interface affects burn placement of both major burns and minor burns (i.e., TCMs) in the optimized solution. Results are compared against analytical solutions and against a Genetic Algorithm (GA) optimizer for independent verification and validation.

Copernicus↗

The Digital Astronaut Simulation

The Digital Astronaut Simulation provides a human biomechanics modeling, simulation, and analysis capability that is enabling spaceflight hardware design to incorporate the human dynamic input early in development cycles as well as characterize performance after prototypes are built. The enhanced toolset includes a modified multibody model, updated motion capture marker sets, and refined methods for scaling and inverse kinematics. These provide increased accuracy for applications in exercise and extravehicular tasks in reduced gravity, especially where upper extremity motion is involved. A core capability highlighted is the calculation of ground reaction forces, moments, and center of pressure based on motion capture. Verification and validation efforts include comparison with force platform measurements.

Human Spaceflight↗

Critical Progressive Damage Analysis Model Features for Low-Velocity Impact on Thermoset and Thermoplastic Panels

A previous verification and validation framework evaluated the ability of various progressive damage analysis (PDA) tools to predict the mechanical response and damage state in post-buckled stiffened aerospace structures composed of fiber-reinforced thermoset composite materials. Herein, the ability of PDA tools to predict damage in thermoplastic composite materials subject to low-velocity impact (LVI) loading has been assessed. LVI tests and analyses have been conducted for similar panels, comprising thermoset or thermoplastic composite materials. Preliminary test/analysis correlations revealed that using the same combination of PDA model features and finite element model-building guidelines for the thermoset and thermoplastic LVI specimens resulted in underprediction of matrix crack lengths and delaminated area in the thermoplastic analyses despite yielding good correlations for the thermoset specimens. In this paper, the quality of the test/analysis correlations for analyses of thermoplastic LVI specimens performed with different combinations of PDA model features using the NASA CompDam material model are presented. Model features that were assessed in terms of effect on the quality of the test/analysis correlation include the representation of damageable interfaces, residual thermal stresses, and fiber damage.

Frank Leone↗

Hardware-in-the-Loop Simulation of Modular Antenna Assembly

Robots are playing an increasing role in space exploration and in-space servicing. Robotic arms are good for performing in-space tasks such as modular assembly. The SPIDER arm (SPace Infrastructure Dexterous Robot) of the OSAM-1 mission represents an example of a system that can perform modular antenna assembly tasks in environmental conditions that would be dangerous for astronauts. One of the WVRTC activities is to perform independent verification and validation of the SPIDER assembly operations. Space robotic systems adopting large manipulators such as the SPIDER arm are complex to test and verify under normal 1-G conditions. Our work involves proof-of-principle testing of a hardware-inthe-loop (HIL) simulator operating in 1-g conditions, which replicates the motion of the space robot end-effector under the same geometric, kinematic and dynamic conditions, and in response to externally applied forces from its space environment. In particular, our software simulates in real-time the robot dynamics inclusive of flexibility, an important aspect in case of a long robotic arms operating in 0-G conditions. For example, the same oscillatory motions of the space manipulator’s end-effector can be mimicked on ground through our industrial manipulator, allowing us to test the feasibility of complex operation such as assembling modular components.

Robotic Assembly↗

Hardware-in-the-Loop Simulation of Modular Antenna Assembly

Robots are playing an increasing role in space exploration and in-space servicing. Robotic arms are good for performing in-space tasks such as modular assembly. The SPIDER arm (SPace Infrastructure Dexterous Robot) of the OSAM-1 mission represents an example of a system that can perform modular antenna assembly tasks in environmental conditions that would be dangerous for astronauts. One of the WVRTC activities is to perform independent verification and validation of the SPIDER assembly operations.

Space Assembly↗

Recent Updates to the Object Reentry Survival Analysis Tool (ORSAT) Version 7.1

The Object Reentry Survival Analysis Tool (ORSAT) code is maintained and used by the NASA Orbital Debris Program Office (ODPO) and has been under continuous development and improvement since the mid-1990s. ORSAT is an object-oriented reentry simulation tool; it models a satellite as a collection of discrete components that follow independent trajectories upon the breakup of the parent object. Version 7.1 of the tool incorporates five years of new thermal and aerodynamic model development, multi-processor parametric study capability, codebase upgrades, and numerous bug-fixes. The thermal demise model was completely rewritten using a forward-time/central-space numerical stencil and incorporating a new pyrolysis model for fiber-reinforced plastic (FRP) materials. New aerodynamic and aeroheating models for hollow cylinders and hollow square prisms were developed using a combination of flow simulations in the direct simulation Monte Carlo (DSMC) Analysis Code (DAC) and Data Parallel Line Relaxation (DPLR) code and free-flight tests in the University of Texas at San Antonio’s Hypersonic Wind Tunnel. The latest version also incorporates a mechanical, strength-based demise model for FRP materials. Minor improvements include an update to the Fortran 2018 codebase; improved integration and speed with the Python-based, multi-core, parametric study tool, AutoORSAT; and fixes for many minor bugs. This new version of ORSAT will enable more accurate reentry risk assessments for modern satellites. This paper presents an overview of these changes and a summary of the verification and validation performed on the final code.

Benton R. Greene↗

Transcriptomics Processing Pipelines for Space Biology: An Open Source and Consensus-Driven Approach

Transcriptomics holds significant value in elucidating the relationship between gene expression, experimental factors, biological factors, and various types of omics data. Enhancing our understanding of these connections is paramount for foundational biology, which plays a pivotal role in devising solutions for challenges pertinent to both space travel and terrestrial life. The NASA GeneLab project, part of the Open Science Data Repository (OSDR.nasa.gov), seeks to accelerate space biology research through cataloging and democratizing ‘omics data, including transcriptomics. Since raw omics data are largely inaccessible to non-bioinformaticians, GeneLab works with the scientific community via the Open Science Analysis Working Groups (AWGs) to develop standard processing pipelines to generate and publish processed data. Unlike raw data, processed data have greater immediate value to diverse users with varying technical backgrounds and computational capabilities. Standardizing processing workflows is essential to match the pace of raw data generation, ensure reproducibility, and enable standardized processed data for comparison across datasets. As of June 2023, transcriptomics studies comprise over half of GeneLab datasets hosted on the OSDR, including data from bulk RNA-seq and Affymetrix or Agilent 1-Channel DNA microarray assays. In collaboration with the AWGs, GeneLab developed consensus processing pipelines for these transcriptomics data types that includes quality control, background correction (microarray only), data normalization and quantification, culminating in the detection and annotation of differentially expressed genes. The work presented here describes Nextflow implementations of GeneLab’s consensus transcriptomics pipelines that automates and accelerates processing of these datasets. In addition to the core data processing, these workflows also include raw data staging and a robust verification and validation program to identify errors in real-time, stop additional downstream computation, and preserve computational resources. These workflows are used to generate GeneLab processed data hosted on the OSDR, and are publicly available as open source software for others to use at: https://github.com/nasa/GeneLab_Data_Processing.

Jonathan Oribello↗

The Troupe System: an Autonomous Multi-Agent Rover Swarm

Autonomous cooperative robotic systems are the future of space exploration. The complexity of such systems makes their development, verification and assurance challenging. The Robust Software Engineering group at NASA Ames has developed the Troupe project that aims to explore the design and development of a swarm of autonomous rovers tasked to perform autonomous exploration and mapping of an unknown terrain. In this paper, we showcase the system design, and accompanying verification and validation tools integrated in the Troupe system development life-cycle.

TROUPE↗

Population Accommodation for NASA Spacesuit and Hardware

The goal of this work is to review the population accommodation principles and methodologies NASA Johnson Space Center has developed for the spacesuit, vehicle hardware, and habitats. NASA has defined the target population characteristics in the Human-System Integration Requirements based on the US Army Anthropometric Survey (ANSUR) database. However, the data was screened to select the cases of 30-50 year old subjects, given the historical characteristics of the crew. Further, accommodation ranges were defined for critical body measurements, as NASA aims to accommodate 1st percentile female to 99th percentile male of the crew-like population. The historical truncation thresholds of 5-95th percentiles were not used. This ensured that the accommodation range was not limited and accounted for the current astronaut population. A simulation study also showed that less than 68% of the population may have remained after multiple measurement truncations due to the anthropometry covariance patterns if the narrower range was retained. The ranges were also adjusted for long-term trends of body shape changes as predicted by the US National Health and Nutrition Examination Survey. Overall, the requirements were deemed critical to ensure the fit and accommodation of the new suit and space hardware. The requirements have specifically defined boundary cases for verifications and validations, of which the details have proven useful as standards across the different space programs. The specific use and benefits will be further discussed through case studies at the presentation.

Han Kim↗

ARRISTOTLE Simulation Demo

NASA’s Katherine Johnson Independent Verification and Validation (NASA IV&V) Jon McBride Software Testing and Research (JSTAR) laboratory has developed the Advanced Risk Reduction Integrated Software Test and Operations Tri-program Lightweight Environment (ARRISTOTLE). ARRISTOTLE is a digital twin of NASA’s Artemis mission. ARRISTOLE executes the true SLS and Orion flight binaries integrated on a single laptop computer. This demo will showcase the execution of the full Artemis liftoff. Once airborne, an inflight anomaly will be injected, resulting in Orion detaching from the booster. The Launch Abort System (LAS) will safely bring Orion back to earth. The Unity game engine is used to visualize the flyout as flight software executes.

emulation↗

Seamless Integration of Multibody and Orbital Dynamics to Support Human Spaceflight Simulations

At the NASA Johnson Space Center (JSC), modeling capability requirements are often driven by the need to simulate upcoming mission scenarios for analysis, procedures development, and training. In preparation for free-flyer vehicle capture, maneuvers, and release, it was determined that the multibody dynamics capabilities provided by MBDyn and the orbital dynamics capabilities supplied by JEOD needed to be merged to properly simulate the dynamic behaviors expected on-orbit. After initial attempts to combine the two packages proved cumbersome, it was decided that a more refined solution was required to facilitate the interface between these two packages. The resulting interface software package was named MBJEOD. The primary design goals for this new package were to leave MBDyn and JEOD untouched, to simplify and clarify simulation initialization for users, and to support any topology or on-orbit operational scenario that future missions might require. This paper provides a detailed overview of MBJEOD and the approach taken to seamlessly integrate the multibody dynamics of MBDyn with the orbital dynamics of JEOD. Additional attention is given to the numerical considerations required for MBJEOD and the simplifying assumptions leveraged to provide for real-time simulation needs. Verification and validation are addressed and current MBJEOD applications at the NASA JSC are discussed.

modeling↗

Out of Plane Stresses Using a Beam-Based Elastic Foundation Bonded Joint Model

Efficient, semi-analytical models of bonded joints are utilized for initial joint design and sizing due to their convenience and speed. Many of these models are based on beam and plate theories, which are most applicable when in-plane stresses/strains dominate. While this can be a sensible assumption for obtaining the deformations of the joint, out of plane (transverse) stresses are often of critical importance for failure in bonded joints composed of fiber reinforced composite materials. Since through-thickness strains are neglected in these semi-analytical theories, the present study shows a method to back-calculate the out of plane stresses based on stress balance equations, which use the in-plane stresses and displacements that have already been obtained. The method was implemented within the Joint Element Designer (JED) software, and verification and validation examples have been shown. As is typical for these types of models, corner stress singularities are not captured by the JED model, but the general trends of the stress and deformation fields agreed with a higher fidelity finite element model. As such, this method for obtaining out of plane stresses, when coupled with the JED code, is very useful for the complete stress analysis of bonded composite joints.

composites↗

NASA’s Developments in Cryogenic Fluid Management Technology

NASA has been pursuing the development and demonstration of enabling and enhancing technologies for Cryogenic Fluid Management (CFM) in collaboration with the US industry. NASA’s vision for current and future space exploration requires high-performance chemical and nuclear propulsion solutions that utilize cryogens. The Agency will use cryogenic fluids for Earth-to-orbit transportation, human missions to the Moon and Mars, planetary exploration, and in-situ resource utilization (ISRU) production. All these architectures will require state-of-the-art long-duration storage on the surface and in-space transfer for refueling. This paper focuses on key CFM technology developments completed or ongoing by the Cryogenic Fluid Management Portfolio Office within NASA’s Space Technology Mission Directorate. The CFM Portfolio Office, partnered with US aerospace industry, has invested in CFM technology ground and flight demonstrations, focused on maturing CFM hardware and operations for Artemis and Moon to Mars activities. These demonstrations additionally provide NASA with data to inform numerical modeling activities for verification and validation of design tools and approaches for future missions. This paper includes discussion on remaining high-priority open CFM technology gaps for Mar-forward architectures and initiatives for closure.

Cryogenic Fluid Management↗

High-Rate Delay Tolerant Networking (HDTN) Software Requirements Analysis

This document serves as a detailed analysis of the main networking protocols implemented by HDTN. Sources of the protocol specifications include Internet Engineering Task Force (IETF) Request for Comments (RFC) and Consultative Committee for Space Data Systems (CCSDS) standards. The focus of this report is to derive software requirements suitable for NASA Procedural Requirements 7150.2D Class B compliance, including requirements traceability and software verification and validation, from the source specifications. This analysis will be incorporated into the finalized HDTN Software Requirements Specification (SRS) but does not encompass the full scope of the HDTN SRS. Requirements in this document are considered draft. The complete requirements will include bundle application requirements, interface requirements, computer resource requirements, software quality factors, and additional requirements as determined by the project. This document is publicly released to the greater community to receive feedback and foster collaboration opportunities.

Rachel Dudukovich↗

X-57 Flight Systems Integration Path

The foundation for a safe and successful flight test of the National Aeronautics and Space Administration (NASA) X-57 Maxwell all-electric experimental airplane, or any X-Plane, is comprehensive system testing on the ground. This test campaign includes verification and validation (V&V) that the integrated system operates as designed and expected, as well as understanding how the system reacts and responds to failures that can occur during flight by performing failure modes and effects testing (FMET). The aircraft should be in the final flight configuration for these test activities because any modifications, even those that appear insignificant, could affect test outcomes. Although the plan was to perform V&V and FMET testing once the airplane was in the flight configuration, due to multiple component redesigns, concurrent software development, and other problems with on-aircraft testing, the X-57 Maxwell never made it into a full-flight configuration. As a result, a build-up approach was followed to test software and hardware as they became ready in order to continue making progress wherever possible. Using this approach revealed problems with the hardware and software faster than waiting for a full-flight configuration, allowing solutions to be found more quickly and in parallel with other project tasks. Other than unloaded motor testing in a lab setting, the only other test setup was on the airplane itself. On-aircraft testing was preferrable in order to test things as close to a flight configuration as possible but was time consuming due to the requirements for testing on the airplane. To overcome some of the on-aircraft barriers, off-aircraft test configurations, such as the Systems Integration Laboratory (SIL) and hardware-in-the-loop (HIL) setups, were used, but each of these setups had limitations to be considered. As a result, solutions found in the SIL or HIL configurations did not always work as expected on the airplane, resulting in an iterative process between on- and off-aircraft testing to find the final solution. Having a dedicated test platform such as an iron bird that closely represents the aircraft - without flight hardware - would have been the most effective off-aircraft test setup, which could have allowed the project to save time and money and potentially reach flight. This paper will highlight the V&V and FMET considerations and testing prerequisites, the build-up approaches to both software and system testing, the benefits and drawbacks to different test configurations, as well as battery testing and operations.

Kassidy M. Mclaughlin↗