Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “verification and validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57

Connecting Research and Practice: An Experience Report on Research Infusion with SAVE

NASA systems need to be highly dependable to avoid catastrophic mission failures. This calls for rigorous engineering processes including meticulous validation and verification. However, NASA systems are often highly distributed and overwhelmingly complex, making the software portion of these systems challenging to understand, maintain, change, reuse, and test. NASA's systems are long-lived and the software maintenance process typically constitutes 60-80% of the total cost of the entire lifecycle. Thus, in addition to the technical challenges of ensuring high life-time quality of NASA's systems, the post-development phase also presents a significant financial burden. Some of NASA's software-related challenges could potentially be addressed by some of the many powerful technologies that are being developed in software research laboratories. Many of these research technologies seek to facilitate maintenance and evolution by for example architecting, designing and modeling for quality, flexibility, and reuse. Other technologies attempt to detect and remove defects and other quality issues by various forms of automated defect detection, architecture analysis, and various forms of sophisticated simulation and testing. However promising, most such research technologies nevertheless do not make the transition from the research lab to the software lab. One reason the transition from research to practice seldom occurs is that research infusion and technology transfer is difficult. For example, factors related to the technology are sometimes overshadowed by other types of factors such as reluctance to change and therefore prohibits the technology from sticking. Successful infusion might also take very long time. One famous study showed that the discrepancy between the conception of the idea and its practical use was 18 years plus or minus three. Nevertheless, infusing new technology is possible. We have found that it takes special circumstances for such research infusion to succeed: 1) there must be evidence that the technology works in the practitioner's particular domain, 2) there must be a potential for great improvements and enhanced competitive edge for the practitioner, 3) the practitioner has to have strong individual curiosity and continuous interest in trying out new technologies, 4) the practitioner has to have support on multiple levels (i.e. from the researchers, from management, from sponsors etc), and 5) to remain infused, the new technology has to be integrated into the practitioner's processes so that it becomes a natural part of the daily work. NASA IV&V's Research Infusion initiative sponsored by NASA's Office of Safety & Mission Assurance (OSMA) through the Software Assurance Research Program (SARP), strives to overcome some of the problems related to research infusion.

Lindvall, Mikael↗

Comparison of Transport Codes, HZETRN, HETC and FLUKA, Using 1977 GCR Solar Minimum Spectra

The HZETRN deterministic radiation transport code is one of several tools developed to analyze the effects of harmful galactic cosmic rays (GCR) and solar particle events (SPE) on mission planning, astronaut shielding and instrumentation. This paper is a comparison study involving the two Monte Carlo transport codes, HETC-HEDS and FLUKA, and the deterministic transport code, HZETRN. Each code is used to transport ions from the 1977 solar minimum GCR spectrum impinging upon a 20 g/cm2 Aluminum slab followed by a 30 g/cm2 water slab. This research is part of a systematic effort of verification and validation to quantify the accuracy of HZETRN and determine areas where it can be improved. Comparisons of dose and dose equivalent values at various depths in the water slab are presented in this report. This is followed by a comparison of the proton fluxes, and the forward, backward and total neutron fluxes at various depths in the water slab. Comparisons of the secondary light ion 2H, 3H, 3He and 4He fluxes are also examined.

Heinbockel, John H.↗

Solutions Network Formulation Report. Integration of OMI and TES Aerosol Products into the EPA Regional Planning Organizations' FASTNET Aerosol Tracking and Analysis Tool

Every year, more than 280 million visitors tour our Nation s most treasured parks and wilderness areas. Unfortunately, many visitors are unable to see the spectacular vistas they expect because of white or brown haze in the air. Most of this haze is not natural; it is air pollution, carried by the wind often hundreds of miles from its origin. Some of the pollutants have been linked to serious health problems, such as asthma and other lung disorders, and even premature death. In addition, nitrates and sulfates contribute to acid rain formation, which contaminates rivers and lakes and erodes buildings and historical monuments. The U.S. Environmental Protection Agency RPOs (Regional Planning Organizations) have been tasked with monitoring and determining the nature and origin of haze in Class I scenic areas, and finding ways to reduce haze in order to improve visibility in these areas. The RPOs have developed an Internet-based air quality DST (Decision Support Tool) called FASTNET (Fast Aerosol Sensing Tools for Natural Event Tracking). While FASTNET incorporates a few satellite datasets, most of the data utilized by this DST comes from ground-based instrument networks. The problem is that in many areas the sensors are sparsely located, with long distances between them, causing difficulties in tracking haze over the United States, determining its source, and analyzing its content. Satellite data could help to fill in the data gaps and to supplement and verify ground-recorded air quality data. Although satellite data are now being used for air quality research applications, such data are not routinely used for environmental decision support, in part because of limited resources, difficulties with interdisciplinary data interpretation, and the need for advanced inter-agency partnerships. As a result, the validation and verification of satellite data for air quality operational system applications has been limited This candidate solution evaluates the usefulness of OMI (Ozone Monitoring Instrument) and TES (Tropospheric Emission Spectrometer) air quality data for the RPOs by comparing OMI and TES data with ground-based data that are acquired during identified episodes of air pollution. The air quality data from OMI and TES are of different spectral ranges than data from satellites currently included in FASTNET, giving them potential advantages over the existing satellites. If the OMI and TES data are shown to be useful to the RPOs, they would then be integrated into the FASTNET DST for use on an operational basis.

Knowlton, Kelly↗

Systematic Benchmarking of Diagnostic Technologies for an Electrical Power System

Automated health management is a critical functionality for complex aerospace systems. A wide variety of diagnostic algorithms have been developed to address this technical challenge. Unfortunately, the lack of support to perform large-scale V&V (verification and validation) of diagnostic technologies continues to create barriers to effective development and deployment of such algorithms for aerospace vehicles. In this paper, we describe a formal framework developed for benchmarking of diagnostic technologies. The diagnosed system is the Advanced Diagnostics and Prognostics Testbed (ADAPT), a real-world electrical power system (EPS), developed and maintained at the NASA Ames Research Center. The benchmarking approach provides a systematic, empirical basis to the testing of diagnostic software and is used to provide performance assessment for different diagnostic algorithms.

Kurtoglu, Tolga↗

Overview of the Orion Thermal Protection System

The Orion spacecraft is being developed as part of the Constellation Exploration Program and will serve as the United States crewed transportation system to the International Space Station after the retirement of the Space Shuttle in 2010 and as the eventual means to return U.S. astronauts to the Moon. Therefore, Orion is being designed for reentry missions from both low Earth orbit and from Lunar-return trajectories. This presentation will provide an overview of the development of the Orion TPS, a critical component in the development of the spacecraft. The thermal protection system (TPS) that protects the crew module from the extreme environments associated with Earth atmospheric reentry consists of a forward heatshield and an aft backshell. The requirements that drive the design of the TPS will be discussed, including several key requirements that establish a precedent for U.S. human-rated spacecraft. For the first time in U.S. human spaceflight, a vehicle s TPS is being designed with a specific, derived requirement for reliability. Also, due to the increased presence of spacecraft in Earth s orbit in recent decades, requirements for micro-meteoroid/orbital debris damage tolerance are also a driving requirement that has affected the selection of portions of the TPS. The efforts to select materials and to define a preliminary design for both the heatshield and the backshell will be described. This will include a discussion of the design challenges presented by the numerous penetrations on both the backshell and the heatshield. Finally, the verification and validation plan which is currently under development to certify the TPS for human-rated missions will be outlined. To support the execution of this plan, a ground test campaign for both thermal and structural performance is being designed. This test campaign will directly support thermal and thermal/structural analyses that also are fundamental to the certification effort.

Kowal, T. John↗

Using Web 2.0 Techniques in NASA's Ares Engineering Operations Network (AEON) Environment - First Impressions

The Mission Operations Laboratory (MOL) at Marshall Space Flight Center (MSFC) is responsible for Engineering Support capability for NASA s Ares rocket development and operations. In pursuit of this, MOL is building the Ares Engineering and Operations Network (AEON), a web-based portal to support and simplify two critical activities: Access and analyze Ares manufacturing, test, and flight performance data, with access to Shuttle data for comparison Establish and maintain collaborative communities within the Ares teams/subteams and with other projects, e.g., Space Shuttle, International Space Station (ISS). AEON seeks to provide a seamless interface to a) locally developed engineering applications and b) a Commercial-Off-The-Shelf (COTS) collaborative environment that includes Web 2.0 capabilities, e.g., blogging, wikis, and social networking. This paper discusses how Web 2.0 might be applied to the typically conservative engineering support arena, based on feedback from Integration, Verification, and Validation (IV&V) testing and on searching for their use in similar environments.

Scott, David W.↗

SIM-PlanetQuest: Progress Report

SIM-PlanetQuest is a NASA astrophysics mission that is implementing the National Research Counsel's recommended Astrometric Interferometry Mission (AIM) to develop the first, in-space, optical, long-baseline Michelson Stellar Interferometer for performing micro-arcsecond-level astrometry. This level of astrometric precision will enable characterization of planetary systems around nearby stars and enable a number of key investigations in astrophysics including calibration of the cosmological distance scale, stellar and galactic structure and evolution, and dark matter/energy distribution. This paper provides an update on the SIM-PlanetQuest Mission covering the results of the 2005 mission redesign and the recent completion of the last in a series of technology "gates." The SIM-PlanetQuest mission redesign was directed by NASA to recover eroded mass and power margins and to meet specific implementation cost targets. The resulting mission redesign met all redesign objectives with minimal impact to mission science performance. This paper provides the mission redesign objectives and describes the resulting mission and system design including changes in science capability. SIM-PlanetQuest also completed the last of eight major technology development gates that were established in 2001 by NASA, completing the enabling technology development. The technology development program, the last gate, and its significance to the project's flight verification and validation (V&V) approach are briefly described (covered in more detail in a separate paper at this conference). An update on project programmatic status and plans is also provided.

astrometry↗

Ares I-X Post Flight Ignition Overpressure Review

Ignition Overpressure (IOP) is an unsteady fluid flow and acoustic phenomena caused by the rapid expansion of gas from the rocket nozzle within a ducted launching space resulting in an initially higher amplitude pressure wave. This wave is potentially dangerous to the structural integrity of the vehicle. An in-depth look at the IOP environments resulting from the Ares I-X Solid Rocket Booster configuration showed high correlation between the pre-flight predictions and post-flight analysis results. Correlation between the chamber pressure and IOP transients showed successful acoustic mitigation, containing the strongest IOP waves below the Mobile Launch Pad deck. The flight data allowed subsequent verification and validation of Ares I-X unsteady fluid ducted launcher predictions, computational fluid dynamic models, and strong correlation with historical Shuttle data.

Alvord, David A.↗

PRA in Design: Increasing Confidence in Pre-Operational Assessments of Risks (Results of a Joint NASA/NRC Workshop)

In late 2009, the National Aeronautics and Space Administration (NASA) and the U.S. Nuclear Regulatory Commission (NRC) jointly organized a workshop to discuss technical issues associated with application of risk assessments to early phases of system design. The workshop, which was coordinated by the Idaho National Laboratory, involved invited presentations from a number of PRA experts in the aerospace and nuclear fields and subsequent discussion to address the following questions: (a) What technical issues limit decision-makers' confidence in PRA results, especially at a pre-operational phase of the system life cycle? (b) What is being done to address these issues'? (c) What more can be done ? The workshop resulted in participant observations and suggestions on several technical issues, including the pursuit of non-traditional approaches to risk assessment and the verification and validation of risk models. The workshop participants also identified several important non-technical issues, including risk communication with decision makers, and the integration of PRA into the overall design process.

Youngblood, Robert↗

Software Health Management: A Short Review of Challenges and Existing Techniques

Modern spacecraft (as well as most other complex mechanisms like aircraft, automobiles, and chemical plants) rely more and more on software, to a point where software failures have caused severe accidents and loss of missions. Software failures during a manned mission can cause loss of life, so there are severe requirements to make the software as safe and reliable as possible. Typically, verification and validation (V&V) has the task of making sure that all software errors are found before the software is deployed and that it always conforms to the requirements. Experience, however, shows that this gold standard of error-free software cannot be reached in practice. Even if the software alone is free of glitches, its interoperation with the hardware (e.g., with sensors or actuators) can cause problems. Unexpected operational conditions or changes in the environment may ultimately cause a software system to fail. Is there a way to surmount this problem? In most modern aircraft and many automobiles, hardware such as central electrical, mechanical, and hydraulic components are monitored by IVHM (Integrated Vehicle Health Management) systems. These systems can recognize, isolate, and identify faults and failures, both those that already occurred as well as imminent ones. With the help of diagnostics and prognostics, appropriate mitigation strategies can be selected (replacement or repair, switch to redundant systems, etc.). In this short paper, we discuss some challenges and promising techniques for software health management (SWHM). In particular, we identify unique challenges for preventing software failure in systems which involve both software and hardware components. We then present our classifications of techniques related to SWHM. These classifications are performed based on dimensions of interest to both developers and users of the techniques, and hopefully provide a map for dealing with software faults and failures.

Pipatsrisawat, Knot↗

Applying Formal Methods to NASA Projects: Transition from Research to Practice

NASA project managers attempt to manage risk by relying on mature, well-understood process and technology when designing spacecraft. In the case of crewed systems, the margin for error is even tighter and leads to risk aversion. But as we look to future missions to the Moon and Mars, the complexity of the systems will increase as the spacecraft and crew work together with less reliance on Earth-based support. NASA will be forced to look for new ways to do business. Formal methods technologies can help NASA develop complex but cost effective spacecraft in many domains, including requirements and design, software development and inspection, and verification and validation of vehicle subsystems. To realize these gains, the technologies must be matured and field-tested so that they are proven when needed. During this discussion, current activities used to evaluate FM technologies for Orion spacecraft design will be reviewed. Also, suggestions will be made to demonstrate value to current designers, and mature the technology for eventual use in safety-critical NASA missions.

Othon, Bill↗

Formal Methods for Automated Diagnosis of Autosub 6000

This is a progress report on applying formal methods in the context of building an automated diagnosis and recovery system for Autosub 6000, an Autonomous Underwater Vehicle (AUV). The diagnosis task involves building abstract models of the control system of the AUV. The diagnosis engine is based on Livingstone 2, a model-based diagnoser originally built for aerospace applications. Large parts of the diagnosis model can be built without concrete knowledge about each mission, but actual mission scripts and configuration parameters that carry important information for diagnosis are changed for every mission. Thus we use formal methods for generating the mission control part of the diagnosis model automatically from the mission script and perform a number of invariant checks to validate the configuration. After the diagnosis model is augmented with the generated mission control component model, it needs to be validated using verification techniques.

Ernits, Juhan↗

X-Ray Computed Tomography Inspection of the Stardust Heat Shield

The "Stardust" heat shield, composed of a PICA (Phenolic Impregnated Carbon Ablator) Thermal Protection System (TPS), bonded to a composite aeroshell, contains important features which chronicle its time in space as well as re-entry. To guide the further study of the Stardust heat shield, NASA reviewed a number of techniques for inspection of the article. The goals of the inspection were: 1) to establish the material characteristics of the shield and shield components, 2) record the dimensions of shield components and assembly as compared with the pre-flight condition, 3) provide flight infonnation for validation and verification of the FIAT ablation code and PICA material property model and 4) through the evaluation of the shield material provide input to future missions which employ similar materials. Industrial X-Ray Computed Tomography (CT) is a 3D inspection technology which can provide infonnation on material integrity, material properties (density) and dimensional measurements of the heat shield components. Computed tomographic volumetric inspections can generate a dimensionally correct, quantitatively accurate volume of the shield assembly. Because of the capabilities offered by X-ray CT, NASA chose to use this method to evaluate the Stardust heat shield. Personnel at NASA Johnson Space Center (JSC) and Lawrence Livermore National Labs (LLNL) recently performed a full scan of the Stardust heat shield using a newly installed X-ray CT system at JSC. This paper briefly discusses the technology used and then presents the following results: 1. CT scans derived dimensions and their comparisons with as-built dimensions anchored with data obtained from samples cut from the heat shield; 2. Measured density variation, char layer thickness, recession and bond line (the adhesive layer between the PICA and the aeroshell) integrity; 3. FIAT predicted recession, density and char layer profiles as well as bondline temperatures Finally suggestions are made as to future uses of this technology as a tool for non-destructively inspecting and verifying both pre and post flight heat shields.

McNamara, Karen M.↗

NASA Aerospace Flight Battery Program: Recommendations for Technical Requirements for Inclusion in Aerospace Battery Procurements

This NASA Aerospace Flight Battery Systems Working Group was chartered within the NASA Engineering and Safety Center (NESC). The Battery Working Group was tasked to complete tasks and to propose proactive work to address battery related, agency-wide issues on an annual basis. In its first year of operation, this proactive program addressed various aspects of the validation and verification of aerospace battery systems for NASA missions. Studies were performed, issues were discussed and in many cases, test programs were executed to generate recommendations and guidelines to reduce risk associated with various aspects of implementing battery technology in the aerospace industry. This document contains Part 2 - Volume I: Recommendations for Technical Requirements for Inclusion in Aerospace Battery Procurements of the program's operations.

Jung, David S.↗

NASA Aerospace Flight Battery Program: Wet Life of Nickel-Hydrogen (Ni-H2) Batteries

This NASA Aerospace Flight Battery Systems Working Group was chartered within the NASA Engineering and Safety Center (NESC). The Battery Working Group was tasked to complete tasks and to propose proactive work to address battery related, agency-wide issues on an annual basis. In its first year of operation, this proactive program addressed various aspects of the validation and verification of aerospace battery systems for NASA missions. Studies were performed, issues were discussed and in many cases, test programs were executed to generate recommendations and guidelines to reduce risk associated with various aspects of implementing battery technology in the aerospace industry. This document contains Part 3 - Volume I: Wet Life of Nickel-Hydrogen (Ni-H2) Batteries of the program's operations.

Jung, David S.↗

NASA Aerospace Flight Battery Program: Generic Safety, Handling and Qualification Guidelines for Lithium-Ion (Li-Ion) Batteries; Availability of Source Materials for Lithium-Ion (Li-Ion) Batteries; Maintaining Technical Communications Related to Aerospace Batteries (NASA Aerospace Battery Workshop)

This NASA Aerospace Flight Battery Systems Working Group was chartered within the NASA Engineering and Safety Center (NESC). The Battery Working Group was tasked to complete tasks and to propose proactive work to address battery related, agency-wide issues on an annual basis. In its first year of operation, this proactive program addressed various aspects of the validation and verification of aerospace battery systems for NASA missions. Studies were performed, issues were discussed and in many cases, test programs were executed to generate recommendations and guidelines to reduce risk associated with various aspects of implementing battery technology in the aerospace industry. This document contains Part 1 - Volume I: Generic Safety, Handling and Qualification Guidelines for Lithium-Ion (Li-Ion) Batteries, Availability of Source Materials for Lithium-Ion (Li-Ion) Batteries, and Maintaining Technical Communications Related to Aerospace Batteries (NASA Aerospace Battery Workshop).

Manzo, Michelle A.↗

NASA Aerospace Flight Battery Program: Generic Safety, Handling and Qualification Guidelines for Lithium-Ion (Li-Ion) Batteries; Availability of Source Materials for Lithium-Ion (Li-Ion) Batteries; Maintaining Technical Communications Related to Aerospace Batteries (NASA Aerospace Battery Workshop)

This NASA Aerospace Flight Battery Systems Working Group was chartered within the NASA Engineering and Safety Center (NESC). The Battery Working Group was tasked to complete tasks and to propose proactive work to address battery related, agency-wide issues on an annual basis. In its first year of operation, this proactive program addressed various aspects of the validation and verification of aerospace battery systems for NASA missions. Studies were performed, issues were discussed and in many cases, test programs were executed to generate recommendations and guidelines to reduce risk associated with various aspects of implementing battery technology in the aerospace industry. This report contains the Appendices to the findings from the first year of the program's operations.

Manzo, Michelle A.↗

NASA Aerospace Flight Battery Program: Wet Life of Nickel-Hydrogen (Ni-H2) Batteries: Appendices - Volume 2, Part 3

This NASA Aerospace Flight Battery Systems Working Group was chartered within the NASA Engineering and Safety Center (NESC). The Battery Working Group was tasked to complete tasks and to propose proactive work to address battery related, agency-wide issues on an annual basis. In its first year of operation, this proactive program addressed various aspects of the validation and verification of aerospace battery systems for NASA missions. Studies were performed, issues were discussed and in many cases, test programs were executed to generate recommendations and guidelines to reduce risk associated with various aspects of implementing battery technology in the aerospace industry. This document contains Part 3 - Volume II Appendices to Part 3 - Volume I.

Jung, David S,↗