Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “system validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
NASA NTRS2007

A Concept for In-space, System-level Validation of Spacecraft Precision Formation Flying

A number of international space agencies and organizations, to include the National Aeronautics and Space Administration (NASA), the European Space Agency (ESA), and the Centre National d'Etudes Spatiales (CNES), to name a few, have embraced the concept of spacecraft formation flying to revolutionize the capabilities of astronomy and Earth remote sensing from space. The concept has been around well over a decade and a wide array of technologies and capabilities have been developed to enable multiple spacecraft to collaborate in a highly-coupled manner as would be required for a formation flying mission. Furthermore, many relevant capabilities for formation flying have been demonstrated in the area of rendezvous and docking, loosely-controlled formations, and in missions with collaborating spacecraft with very precise metrology. .However, in considering the case of precision formation flying (PFF), i.e, when the relative geometry of multiple vehicles must be controlled on-board in a continuous and precise manner, there have been several missions proposed, but the realization in space has not yet occurred due to a range of issues. This paper will briefly examine those issues and present a concept for demonstrating a core capability for performing PFF, necessary for virtually any PFF mission concept, that will help to overcome the problems encountered in prior attempts and help to allay the risks to enable future PFF science missions.

Leitner, Jesse↗
DOE OSTI2023

OECD-NEA HTTF Benchmark Progress and Updates

General slides discussing High Temperature Test Facility benchmark progress, Prismatic HTGR deployment, modeling and simulation tools for validating systems, and verification and validation issues. Also discuss collaboration and conclusions of RELAP5-3D validation activities based on HTTF with trends in data and international impact to accelerate deployment of prismatic HTGR microreactors by providing an opportunity for designers to assess their codes against experimental data and solutions from other codes.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
NASA NTRS2006

Overview of a Proposed Flight Validation of Aerocapture System Technology for Planetary Missions

Aerocapture System Technology for Planetary Missions is being proposed to NASA's New Millennium Program for flight aboard the Space Technology 9 (ST9) flight opportunity. The proposed ST9 aerocapture mission is a system-level flight validation of the aerocapture maneuver as performed by an instrumented, high-fidelity flight vehicle within a true in-space and atmospheric environment. Successful validation of the aerocapture maneuver will be enabled through the flight validation of an advanced guidance, navigation, and control system as developed by Ball Aerospace and two advanced Thermal Protection System (TPS) materials, Silicon Refined Ablative Material-20 (SRAM-20) and SRAM-14, as developed by Applied Research Associates (ARA) Ablatives Laboratory. The ST9 aerocapture flight validation will be sufficient for immediate infusion of these technologies into NASA science missions being proposed for flight to a variety of Solar System destinations possessing a significant planetary atmosphere.

Keys, Andrew S.↗
DOE OSTI2024

Offline Power Systems Applications Enabled by Phasor Measurement Units: Technical Assistance to the Power Sectors of Southeast Asia

This report provides a brief overview of several offline (non-real-time) applications facilitated by high-resolution time-synchronized measurements recorded by phasor measurement units (PMUs). The high reporting rate and time-synchronization of PMU records provide a detailed view of power system dynamics, enabling electric utilities to obtain a better understanding of their systems. In this report, the following applications have been reviewed: Power plant model validation, System model validation, Ringdown oscillation analysis, Frequency response analysis, Postmortem analysis of disturbance events Along with a brief technical background of the applications above, applicable North American Electric Reliability Corporation (NERC) standards have been discussed, and examples of implementation in North American organizations have been provided. Implementing several of the discussed applications may need a preliminary stage of data gathering from multiple entities, and several frameworks and process flows have been formulated by organizations around the world for this purpose. However, the data-gathering stage has not been considered in the scope of the present report.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
NASA NTRS1997

An Approach to Building a Traceability Tool for Software Development

It is difficult in a large, complex computer program to ensure that it meets the specified requirements. As the program evolves over time, a11 program constraints originally elicited during the requirements phase must be maintained. In addition, during the life cycle of the program, requirements typically change and the program must consistently reflect those changes. Imagine the following scenario. Company X wants to develop a system to automate its assembly line. With such a large system, there are many different stakeholders, e.g., managers, experts such as industrial and mechanical engineers, and end-users. Requirements would be elicited from all of the stake holders involved in the system with each stakeholder contributing their point of view to the requirements. For example, some of the requirements provided by an industrial engineer may concern the movement of parts through the assembly line. A point of view provided by the electrical engineer may be reflected in constraints concerning maximum power usage. End-users may be concerned with comfort and safety issues, whereas managers are concerned with the efficiency of the operation. With so many points of view affecting the requirements, it is difficult to manage them, communicate information to relevant stakeholders. and it is likely that conflicts in the requirements will arise. In the coding process, the implementors will make additional assumptions and interpretations on the design and the requirements of the system. During any stage of development, stakeholders may request that a requirement be added or changed. In such a dynamic environment, it is difficult to guarantee that the system will preserve the current set of requirements. Tracing, the mapping between objects in the artifacts of the system being developed, addresses this issue. Artifacts encompass documents such as the system definition, interview transcripts, memoranda, the software requirements specification, user's manuals, the functional specifications, design reports, and system code. Tracing helps 1) validate system features against, the requirement specification, 2) identify error sources and, most importantly, 3) manage change. With so many people involved in the development of the system, it becomes necessary to identify the reasons behind the design requirements or the implementation decisions. This paper is concerned with an approach that maps documents to constraints that capture properties of and relationships between the objects being modeled by the program. Section 2 provides the reader with a background on traceability tools. Section 3 gives a brief description of the context monitoring system on which the approach suggested in this paper is based. Section 4 presents an overview of our approach to providing traceability. The last section presents our future direction of research.

Delgado, Nelly↗
NASA NTRS2007

Reinforced Carbon-Carbon Subcomponent Flat Plate Impact Testing for Space Shuttle Orbiter Return to Flight

Following the tragedy of the Space Shuttle Columbia on February 1, 2003, a major effort commenced to develop a better understanding of debris impacts and their effect on the Space Shuttle subsystems. An initiative to develop and validate physics-based computer models to predict damage from such impacts was a fundamental component of this effort. To develop the models it was necessary to physically characterize Reinforced Carbon-Carbon (RCC) and various debris materials which could potentially shed on ascent and impact the Orbiter RCC leading edges. The validated models enabled the launch system community to use the impact analysis software LS DYNA to predict damage by potential and actual impact events on the Orbiter leading edge and nose cap thermal protection systems. Validation of the material models was done through a three-level approach: fundamental tests to obtain independent static and dynamic material model properties of materials of interest, sub-component impact tests to provide highly controlled impact test data for the correlation and validation of the models, and full-scale impact tests to establish the final level of confidence for the analysis methodology. This paper discusses the second level subcomponent test program in detail and its application to the LS DYNA model validation process. The level two testing consisted of over one hundred impact tests in the NASA Glenn Research Center Ballistic Impact Lab on 6 by 6 in. and 6 by 12 in. flat plates of RCC and evaluated three types of debris projectiles: BX 265 External Tank foam, ice, and PDL 1034 External Tank foam. These impact tests helped determine the level of damage generated in the RCC flat plates by each projectile. The information obtained from this testing validated the LS DYNA damage prediction models and provided a certain level of confidence to begin performing analysis for full-size RCC test articles for returning NASA to flight with STS 114 and beyond.

Melis, Matthew E.↗
NASA NTRS2009

Impact Testing on Reinforced Carbon-Carbon Flat Panels with Ice Projectiles for the Space Shuttle Return to Flight Program

Following the tragedy of the Orbiter Columbia (STS-107) on February 1, 2003, a major effort commenced to develop a better understanding of debris impacts and their effect on the space shuttle subsystems. An initiative to develop and validate physics-based computer models to predict damage from such impacts was a fundamental component of this effort. To develop the models it was necessary to physically characterize reinforced carbon-carbon (RCC) along with ice and foam debris materials, which could shed on ascent and impact the orbiter RCC leading edges. The validated models enabled the launch system community to use the impact analysis software LS-DYNA (Livermore Software Technology Corp.) to predict damage by potential and actual impact events on the orbiter leading edge and nose cap thermal protection systems. Validation of the material models was done through a three-level approach: Level 1--fundamental tests to obtain independent static and dynamic constitutive model properties of materials of interest, Level 2--subcomponent impact tests to provide highly controlled impact test data for the correlation and validation of the models, and Level 3--full-scale orbiter leading-edge impact tests to establish the final level of confidence for the analysis methodology. This report discusses the Level 2 test program conducted in the NASA Glenn Research Center (GRC) Ballistic Impact Laboratory with ice projectile impact tests on flat RCC panels, and presents the data observed. The Level 2 testing consisted of 54 impact tests in the NASA GRC Ballistic Impact Laboratory on 6- by 6-in. and 6- by 12-in. flat plates of RCC and evaluated three types of debris projectiles: Single-crystal, polycrystal, and "soft" ice. These impact tests helped determine the level of damage generated in the RCC flat plates by each projectile and validated the use of the ice and RCC models for use in LS-DYNA.

Melis, Matthew E.↗
NASA NTRS2009

Impact Testing on Reinforced Carbon-Carbon Flat Panels With BX-265 and PDL-1034 External Tank Foam for the Space Shuttle Return to Flight Program

Following the tragedy of the Orbiter Columbia (STS-107) on February 1, 2003, a major effort commenced to develop a better understanding of debris impacts and their effect on the space shuttle subsystems. An initiative to develop and validate physics-based computer models to predict damage from such impacts was a fundamental component of this effort. To develop the models it was necessary to physically characterize reinforced carbon-carbon (RCC) along with ice and foam debris materials, which could shed on ascent and impact the orbiter RCC leading edges. The validated models enabled the launch system community to use the impact analysis software LS-DYNA (Livermore Software Technology Corp.) to predict damage by potential and actual impact events on the orbiter leading edge and nose cap thermal protection systems. Validation of the material models was done through a three-level approach: Level 1-fundamental tests to obtain independent static and dynamic constitutive model properties of materials of interest, Level 2-subcomponent impact tests to provide highly controlled impact test data for the correlation and validation of the models, and Level 3-full-scale orbiter leading-edge impact tests to establish the final level of confidence for the analysis methodology. This report discusses the Level 2 test program conducted in the NASA Glenn Research Center (GRC) Ballistic Impact Laboratory with external tank foam impact tests on flat RCC panels, and presents the data observed. The Level 2 testing consisted of 54 impact tests in the NASA GRC Ballistic Impact Laboratory on 6- by 6-in. and 6- by 12-in. flat plates of RCC and evaluated two types of debris projectiles: BX-265 and PDL-1034 external tank foam. These impact tests helped determine the level of damage generated in the RCC flat plates by each projectile and validated the use of the foam and RCC models for use in LS-DYNA.

Melis, Matthew E.↗
NASA NTRS2010

Analyzing Distributed Functions in an Integrated Hazard Analysis

Large scale integration of today's aerospace systems is achievable through the use of distributed systems. Validating the safety of distributed systems is significantly more difficult as compared to centralized systems because of the complexity of the interactions between simultaneously active components. Integrated hazard analysis (IHA), a process used to identify unacceptable risks and to provide a means of controlling them, can be applied to either centralized or distributed systems. IHA, though, must be tailored to fit the particular system being analyzed. Distributed systems, for instance, must be analyzed for hazards in terms of the functions that rely on them. This paper will describe systems-oriented IHA techniques (as opposed to traditional failure-event or reliability techniques) that should be employed for distributed systems in aerospace environments. Special considerations will be addressed when dealing with specific distributed systems such as active thermal control, electrical power, command and data handling, and software systems (including the interaction with fault management systems). Because of the significance of second-order effects in large scale distributed systems, the paper will also describe how to analyze secondary functions to secondary functions through the use of channelization.

Morris, A. Terry↗
NASA NTRS2000

A Reliable Earth Return System for Safe Recovery of Mars Samples

The objective of a Mars sample return mission is to bring selected Mars surface materials to Earth. Numerous approaches for the Earth-return segment have been analyzed including propulsive or aerocapture return to low-Earth orbit followed by Space Shuttle rendezvous and direct entry. Of these approaches, ballistic entry of a small capsule terminating in a ground landing has been shown to be the lowest risk strategy. Over the past two years, significant work has been performed towards development of a robust direct entry vehicle for Mars sample return. In June 1999, the NASA Planetary Protection Officer provided initial guidance to the former Mars Sample Return Project. The sample return phase of the mission was assigned a restricted Earth return planetary protection classification. The draft mission requirement states that the total mean probability of release of unsterilized Mars material into the Earth;s biosphere must be less than 1.0E-06 (1 in a million). This strict requirement drives the approach and design of the Earth return system. To meet this requirement, selection of the Earth return strategy and development of the Earth return system must be guided by risk, not performance, based decisions. An initial Probabilistic Risk Assessment (PRA) was performed to address the direct entry Earth return system containment assurance reliability and to identify high-risk elements of this system. The results of this PRA identified risk elements that include thermal protection system performance during entry, spin-eject orientation and aerodynamic stability during entry, structural integrity under atmospheric deceleration and impact loads, and tracking/recovery of this system. This initial probabilistic risk quantification demonstrates that, with the proper development program, a prototypical direct entry design can satisfy the containment assurance reliability requirement. Through the current Mars Sample Return Advanced Technology Development effort, an extensive design, analysis, and test program is presently proceeding with the aim of reducing the containment assurance risk of this system. This technology development effort, guided by a continuing PRA, focuses on key risk areas of a direct entry Earth return system including: the thermal protection system, impact dynamics, structural performance, aerodynamic stability, and ground recovery. This development program will culminate in a system validation flight test, 1-2 years prior to launch of the flight system. This flight test would include the launch, entry, and recovery of a full-scale Earth return system, as a scientific validation of the key risk elements to verify nominal design performance. The results of the initial PRA suggested several dominant failure sequences that can be validated in a flight test. These include: demonstrating the thermal protection system reliability and performance during entry, demonstrating the spin-eject orientation and aero-dynamic stability during entry, demonstrating the structural integrity under atmospheric deceleration and impact loads, and demonstrating tracking and recovery of the Earth return system. This single test will directly address over 50% of the total containment assurance risk elements. This presentation will begin by presenting the relative risk of various Earth return strategies. The results of the initial probabilistic risk assessment will be presented followed by a discussion of the development accomplishments and plans for demonstration of a highly reliable direct entry Earth return system.

Braun, R.↗
NASA NTRS1986

NASA scatterometer data processing system: Features for validation

The design of the N-ROSS scatterometer data system and the development of key processing algorithms are described. The data products and parts of the data system to be directly validated are listed. The main features of the Data Management Subsystem, which delivers data to science users and supports system validation are outlined.

Callahan, Philip S.↗
NASA NTRS1999

The GEOS Ozone Data Assimilation System: Design and Validation

An ozone data assimilation system has been developed at the Data Assimilation Office of the NASA/Goddard Space Flight Center to provide global three-dimensional analyzed ozone mixing ratio and total column ozone. The Total Ozone Mapping Spectrometer (TOMS) total column ozone and the Solar Backscatter Ultraviolet (SBUV) or SBUV/2 partial ozone profile data are assimilated. The analyzed winds from the Goddard Earth Observing System Data Assimilation System (GEOS-DAS) drive the ozone transport. Following every transport model timestep, the model prediction is combined with the observations using a global, physical-space based, statistical analysis scheme. Due to the smaller size of the ozone system than that of a global meteorological data assimilation system, new statistical analysis methodology, including anisotropic and flow-dependent forecast error correlation models, can be implemented and tested in the ozone system more easily. Sample results from the winter 1992 validation period are presented. There is a close agreement between the analyzed fields and the independent observations from ozone sondes and the Halogen Occultation Experiment (HALOE).

Stajner, I.↗
NASA NTRS1988

Verification and validation of rulebased systems for Hubble Space Telescope ground support

As rulebase systems become more widely used in operational environments, the focus is on the problems and concerns of maintaining expert systems. In the conventional software model, the verification and validation of a system have two separate and distinct meanings. To validate a system means to demonstrate that the system does what is advertised. The verification process refers to investigating the actual code to identify inconsistencies and redundancies within the logic path. In current literature regarding maintaining rulebased systems, little distinction is made between these two terms. In fact, often the two terms are used interchangeably. Verification and validation of rulebased systems are discussed as separate but equally important aspects of the maintenance phase. Also described are some of the tools and methods that were developed at the Space Telescope Science Institute to aid in the maintenance of the rulebased system.

Vick, Shon↗
NASA NTRS2001

Verifying Data Integrity of Electronically Scanned Pressure Systems at the NASA Glenn Research Center

The proper operation of the Electronically Scanned Pressure (ESP) System critical to accomplish the following goals: acquisition of highly accurate pressure data for the development of aerospace and commercial aviation systems and continuous confirmation of data quality to avoid costly, unplanned, repeat wind tunnel or turbine testing. Standard automated setup and checkout routines are necessary to accomplish these goals. Data verification and integrity checks occur at three distinct stages, pretest pressure tubing and system checkouts, daily system validation and in-test confirmation of critical system parameters. This paper will give an overview of the existing hardware, software and methods used to validate data integrity.

Panek, Joseph W.↗
NASA NTRS2014

MARGInS: Model-Based Analysis of Realizable Goals in Systems

Under NASAs Constellation effort, the Exploration Technology Development Program funded research toward a system validation capability that applied machine learning and test-case generation techniques to the analysis of black-box system behavior. The behavior analysis capability scaled to spaces of hundreds of input parameters and tens of thousands of test cases. Aerospace systems at the vehicle level, especially those systems which contain some level of autonomy, are best described by hybrid and non-linear mathematics. Even simplified models of such systems need parameter dimensionalities in the hundreds or thousands of parameters in order to capture sufficient fidelity. The System Safety Assessments (such as those described in the SAE ARP 4761A Safety Assessment Process guidelines) for these systems are prone to errorinteractions between the vehicles subsystems are complex, and can display emergent behaviors. NASA captured this new analysis in the Model-based Analysis of Realizable Goals in Systems (MARGInS) tool and applied it to the Pad Abort 1 (PA-1) simulation as part of the independent validation and verification cycle before the PA-1 flight test in May of 2010. MARGInS evaluated the adherence of the high-fidelity simulation to its requirements, and deter- mined the margins to failure from the expected nominal input conditions. Following the PA-1 test, the capabilities within the MARGInS framework have been extended with sophisticated statistical and white-box test case generation techniques and applied to other NASA missions. The frame- work now includes a critical factors analysis that was applied to NASAs Orion simulation and design. NASAs Aeronautics Research Mission Directorate (ARMD) leveraged the existing MARGInS framework for work on aviation safety for civil transport vehicles and for research on autonomy issues. The NASA ARMD effort created a time series output prediction capability that has been used to characterize trajectories for a plane with an adaptive control system, and a safety boundary detection capability that has been applied to an air traffic control concept of operation for the Federal Aviation Administration. The statistical and machine- learning based techniques within MARGInS have been successfully combined with concolic execution to improve the coverage of a critical unit by driving system-level inputs. The use case driving the concolic execution and MARGInS integration was inspired by the Air France 447 disaster in which the loss of a critical functionality (the airspeed calculation from the pitot tubes) led to loss of the entire plane with the people aboard. To illustrate capabilities and limitations, we will highlight the analyses for the applications listed above. We will then discuss the future plans for MARGInS and its interfaces with other tools.

Validation↗