Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “system validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Analyzing Distributed Functions in an Integrated Hazard Analysis

Large scale integration of today's aerospace systems is achievable through the use of distributed systems. Validating the safety of distributed systems is significantly more difficult as compared to centralized systems because of the complexity of the interactions between simultaneously active components. Integrated hazard analysis (IHA), a process used to identify unacceptable risks and to provide a means of controlling them, can be applied to either centralized or distributed systems. IHA, though, must be tailored to fit the particular system being analyzed. Distributed systems, for instance, must be analyzed for hazards in terms of the functions that rely on them. This paper will describe systems-oriented IHA techniques (as opposed to traditional failure-event or reliability techniques) that should be employed for distributed systems in aerospace environments. Special considerations will be addressed when dealing with specific distributed systems such as active thermal control, electrical power, command and data handling, and software systems (including the interaction with fault management systems). Because of the significance of second-order effects in large scale distributed systems, the paper will also describe how to analyze secondary functions to secondary functions through the use of channelization.

Morris, A. Terry↗

A Reliable Earth Return System for Safe Recovery of Mars Samples

The objective of a Mars sample return mission is to bring selected Mars surface materials to Earth. Numerous approaches for the Earth-return segment have been analyzed including propulsive or aerocapture return to low-Earth orbit followed by Space Shuttle rendezvous and direct entry. Of these approaches, ballistic entry of a small capsule terminating in a ground landing has been shown to be the lowest risk strategy. Over the past two years, significant work has been performed towards development of a robust direct entry vehicle for Mars sample return. In June 1999, the NASA Planetary Protection Officer provided initial guidance to the former Mars Sample Return Project. The sample return phase of the mission was assigned a restricted Earth return planetary protection classification. The draft mission requirement states that the total mean probability of release of unsterilized Mars material into the Earth;s biosphere must be less than 1.0E-06 (1 in a million). This strict requirement drives the approach and design of the Earth return system. To meet this requirement, selection of the Earth return strategy and development of the Earth return system must be guided by risk, not performance, based decisions. An initial Probabilistic Risk Assessment (PRA) was performed to address the direct entry Earth return system containment assurance reliability and to identify high-risk elements of this system. The results of this PRA identified risk elements that include thermal protection system performance during entry, spin-eject orientation and aerodynamic stability during entry, structural integrity under atmospheric deceleration and impact loads, and tracking/recovery of this system. This initial probabilistic risk quantification demonstrates that, with the proper development program, a prototypical direct entry design can satisfy the containment assurance reliability requirement. Through the current Mars Sample Return Advanced Technology Development effort, an extensive design, analysis, and test program is presently proceeding with the aim of reducing the containment assurance risk of this system. This technology development effort, guided by a continuing PRA, focuses on key risk areas of a direct entry Earth return system including: the thermal protection system, impact dynamics, structural performance, aerodynamic stability, and ground recovery. This development program will culminate in a system validation flight test, 1-2 years prior to launch of the flight system. This flight test would include the launch, entry, and recovery of a full-scale Earth return system, as a scientific validation of the key risk elements to verify nominal design performance. The results of the initial PRA suggested several dominant failure sequences that can be validated in a flight test. These include: demonstrating the thermal protection system reliability and performance during entry, demonstrating the spin-eject orientation and aero-dynamic stability during entry, demonstrating the structural integrity under atmospheric deceleration and impact loads, and demonstrating tracking and recovery of the Earth return system. This single test will directly address over 50% of the total containment assurance risk elements. This presentation will begin by presenting the relative risk of various Earth return strategies. The results of the initial probabilistic risk assessment will be presented followed by a discussion of the development accomplishments and plans for demonstration of a highly reliable direct entry Earth return system.

Braun, R.↗

NASA scatterometer data processing system: Features for validation

The design of the N-ROSS scatterometer data system and the development of key processing algorithms are described. The data products and parts of the data system to be directly validated are listed. The main features of the Data Management Subsystem, which delivers data to science users and supports system validation are outlined.

Callahan, Philip S.↗

The GEOS Ozone Data Assimilation System: Design and Validation

An ozone data assimilation system has been developed at the Data Assimilation Office of the NASA/Goddard Space Flight Center to provide global three-dimensional analyzed ozone mixing ratio and total column ozone. The Total Ozone Mapping Spectrometer (TOMS) total column ozone and the Solar Backscatter Ultraviolet (SBUV) or SBUV/2 partial ozone profile data are assimilated. The analyzed winds from the Goddard Earth Observing System Data Assimilation System (GEOS-DAS) drive the ozone transport. Following every transport model timestep, the model prediction is combined with the observations using a global, physical-space based, statistical analysis scheme. Due to the smaller size of the ozone system than that of a global meteorological data assimilation system, new statistical analysis methodology, including anisotropic and flow-dependent forecast error correlation models, can be implemented and tested in the ozone system more easily. Sample results from the winter 1992 validation period are presented. There is a close agreement between the analyzed fields and the independent observations from ozone sondes and the Halogen Occultation Experiment (HALOE).

Stajner, I.↗

Verification and validation of rulebased systems for Hubble Space Telescope ground support

As rulebase systems become more widely used in operational environments, the focus is on the problems and concerns of maintaining expert systems. In the conventional software model, the verification and validation of a system have two separate and distinct meanings. To validate a system means to demonstrate that the system does what is advertised. The verification process refers to investigating the actual code to identify inconsistencies and redundancies within the logic path. In current literature regarding maintaining rulebased systems, little distinction is made between these two terms. In fact, often the two terms are used interchangeably. Verification and validation of rulebased systems are discussed as separate but equally important aspects of the maintenance phase. Also described are some of the tools and methods that were developed at the Space Telescope Science Institute to aid in the maintenance of the rulebased system.

Vick, Shon↗

Verifying Data Integrity of Electronically Scanned Pressure Systems at the NASA Glenn Research Center

The proper operation of the Electronically Scanned Pressure (ESP) System critical to accomplish the following goals: acquisition of highly accurate pressure data for the development of aerospace and commercial aviation systems and continuous confirmation of data quality to avoid costly, unplanned, repeat wind tunnel or turbine testing. Standard automated setup and checkout routines are necessary to accomplish these goals. Data verification and integrity checks occur at three distinct stages, pretest pressure tubing and system checkouts, daily system validation and in-test confirmation of critical system parameters. This paper will give an overview of the existing hardware, software and methods used to validate data integrity.

Panek, Joseph W.↗

MARGInS: Model-Based Analysis of Realizable Goals in Systems

Under NASAs Constellation effort, the Exploration Technology Development Program funded research toward a system validation capability that applied machine learning and test-case generation techniques to the analysis of black-box system behavior. The behavior analysis capability scaled to spaces of hundreds of input parameters and tens of thousands of test cases. Aerospace systems at the vehicle level, especially those systems which contain some level of autonomy, are best described by hybrid and non-linear mathematics. Even simplified models of such systems need parameter dimensionalities in the hundreds or thousands of parameters in order to capture sufficient fidelity. The System Safety Assessments (such as those described in the SAE ARP 4761A Safety Assessment Process guidelines) for these systems are prone to errorinteractions between the vehicles subsystems are complex, and can display emergent behaviors. NASA captured this new analysis in the Model-based Analysis of Realizable Goals in Systems (MARGInS) tool and applied it to the Pad Abort 1 (PA-1) simulation as part of the independent validation and verification cycle before the PA-1 flight test in May of 2010. MARGInS evaluated the adherence of the high-fidelity simulation to its requirements, and deter- mined the margins to failure from the expected nominal input conditions. Following the PA-1 test, the capabilities within the MARGInS framework have been extended with sophisticated statistical and white-box test case generation techniques and applied to other NASA missions. The frame- work now includes a critical factors analysis that was applied to NASAs Orion simulation and design. NASAs Aeronautics Research Mission Directorate (ARMD) leveraged the existing MARGInS framework for work on aviation safety for civil transport vehicles and for research on autonomy issues. The NASA ARMD effort created a time series output prediction capability that has been used to characterize trajectories for a plane with an adaptive control system, and a safety boundary detection capability that has been applied to an air traffic control concept of operation for the Federal Aviation Administration. The statistical and machine- learning based techniques within MARGInS have been successfully combined with concolic execution to improve the coverage of a critical unit by driving system-level inputs. The use case driving the concolic execution and MARGInS integration was inspired by the Air France 447 disaster in which the loss of a critical functionality (the airspeed calculation from the pitot tubes) led to loss of the entire plane with the people aboard. To illustrate capabilities and limitations, we will highlight the analyses for the applications listed above. We will then discuss the future plans for MARGInS and its interfaces with other tools.

Validation↗

An expert system development methodology which supports verification and validation

Expert systems have demonstrated commercial viability in a wide range of applications, but still face some obstacles to widespread use. A major stumbling block is the lack of well defined verification and validation (V and V) techniques. The primary difficulty with expert system V and V is the use of development methodologies which do not support V and V. As with conventional code, the key to effective V and V is the development methodology. An expert system development methodology is described which is based upon a panel review approach, that allows input from all parties concerned with the expert system.

Culbert, Chris↗

EOS Airborne Program for Validation Studies of EOS Data Products

An overview of the NASA EOS (Earth Observing System) Validation Program will be given with special emphasis on synergy of airborne field missions and EOS satellite missions. Presentation will describe objectives of program and recent field campaigns for validation of standard scientific data products from EOS Terra. Airborne simulators developed for Terra validation will also be described. Plans for future field activity and airborne simulators, especially for EOS Aqua validation and also encompassing EOS Aura validation, will also be briefly presented.

Starr, David OC.↗

Computers in Aerospace Conference, 5th, Long Beach, CA, October 21-23, 1985, Technical Papers

Among the topics discussed are: access control models for a distributed CAIS-conforming system; a knowledge-based advisory system for casualty procedures; and automated interactive simulation modeling system. Consideration is also given to: reusable software concepts and software development methodologies; the electronic device aspects of neutral network memories; an expert system for automated satellite anomaly resolution; and the use of automatic programming techniques for fault-tolerant computing systems. Among additional topics discussed are: systems approaches to software fault tolerance; a Space Shuttle navigation validation system; and a vision-based road following system for an autonomous land vehicle.

Source record↗

NASA Crew Launch Vehicle Flight Test Options

Options for development flight testing (DFT) of the Ares I Crew Launch Vehicle (CLV) are discussed. The Ares-I Crew Launch Vehicle (CLV) is being developed by the U.S. National Aeronautics and Space Administration (NASA) to launch the Crew Exploration Vehicle (CEV) into low Earth Orbit (LEO). The Ares-I implements one of the components of the Vision for Space Exploration (VSE), providing crew and cargo access to the International Space Station (ISS) after retirement of the Space Shuttle and, eventually, forming part of the launch capability needed for lunar exploration. The role of development flight testing is to demonstrate key sub-systems, address key technical risks, and provide flight data to validate engineering models in representative flight environments. This is distinguished from certification flight testing, which is designed to formally validate system functionality and achieve flight readiness. Lessons learned from Saturn V, Space Shuttle, and other flight programs are examined along with key Ares-I technical risks in order to provide insight into possible development flight test strategies. A strategy for the first test flight of the Ares I, known as Ares I-1, is presented.

Cockrell, Charles E., Jr.↗

Nemesis Autonomous Test System

A generalized framework has been developed for systems validation that can be applied to both traditional and autonomous systems. The framework consists of an automated test case generation and execution system called Nemesis that rapidly and thoroughly identifies flaws or vulnerabilities within a system. By applying genetic optimization and goal-seeking algorithms on the test equipment side, a "war game" is conducted between a system and its complementary nemesis. The end result of the war games is a collection of scenarios that reveals any undesirable behaviors of the system under test. The software provides a reusable framework to evolve test scenarios using genetic algorithms using an operation model of the system under test. It can automatically generate and execute test cases that reveal flaws in behaviorally complex systems. Genetic algorithms focus the exploration of tests on the set of test cases that most effectively reveals the flaws and vulnerabilities of the system under test. It leverages advances in state- and model-based engineering, which are essential in defining the behavior of autonomous systems. It also uses goal networks to describe test scenarios.

Barltrop, Kevin J.↗

NASA’s MBSE Approach for Advanced Air Mobility

NASA’s Aeronautics Research Mission Directorate (ARMD) has a significant research effort for advanced air mobility (AAM). AAM involves bringing aviation closer to where people live and work and offers the possibility of making aviation a normal part of everyday life. The scope of AAM is broad, including transformations in aircraft, airspace operations, and in how these new aviation capabilities will integrate into local communities. Due to the nature of AAM cutting across multiple aspects of the aircraft, airspace, and community domains, NASA is applying tools and techniques aligned with a model-based systems engineering approach. These are intended to capture and organize applicable system architectures and potential requirements in order to deliver a validated system architecture and recommended set of requirements that enable sustainable and scalable medium density AAM operations.

Advanced Air Mobility↗

Reliability techniques for computer executive programs

Computer techniques for increasing the stability and reliability of executive and supervisory systems were studied. Program segmentation characteristics are discussed along with a validation system which is designed to retain the natural top down outlook in coding. An analysis of redundancy techniques and roll back procedures is included.

Source record↗

Challenges in verification and validation of autonomous systems for space exploration

Space exploration applications offer a unique opportunity for the development and deployment of autonomous systems, due to limited communications, large distances, and great expense of direct operation. At the same time, the risk and cost of space missions leads to reluctance to taking on new, complex and difficult-to-understand technology. A key issue in addressing these concerns is the validation of autonomous systems. In recent years, higher-level autonomous systems have been applied in space applications. In this presentation, we will highlight those autonomous systems, and discuss issues in validating these systems. We will then look to future demands on validating autonomous systems for space, identify promising technologies and open issues.

Brat, Guillaume↗

Earth Science Enterprise Scientific Data Purchase Project: Verification and Validation

This paper presents viewgraphs on the Earth Science Enterprise Scientific Data Purchase Project's verification,and validation process. The topics include: 1) What is Verification and Validation? 2) Why Verification and Validation? 3) Background; 4) ESE Data Purchas Validation Process; 5) Data Validation System and Ingest Queue; 6) Shipment Verification; 7) Tracking and Metrics; 8) Validation of Contract Specifications; 9) Earth Watch Data Validation; 10) Validation of Vertical Accuracy; and 11) Results of Vertical Accuracy Assessment.

Jenner, Jeff↗

Validation of multiprocessor systems

Experiments that can be used to validate fault free performance of multiprocessor systems in aerospace systems integrating flight controls and avionics are discussed. Engineering prototypes for two fault tolerant multiprocessors are tested.

Siewiorek, D. P.↗