Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “reliability metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS2014

Long Term Performance Metrics of the GD SDR on the SCaN Testbed: The First Year on the ISS

The General Dynamics (GD) S-Band software defined radio (SDR) in the Space Communications and Navigation (SCaN) Testbed on the International Space Station (ISS) provides experimenters an opportunity to develop and demonstrate experimental waveforms in space. The SCaN Testbed was installed on the ISS in August of 2012. After installation, the initial checkout and commissioning phases were completed and experimental operations commenced. One goal of the SCaN Testbed is to collect long term performance metrics for SDRs operating in space in order to demonstrate long term reliability. These metrics include the time the SDR powered on, the time the power amplifier (PA) is powered on, temperature trends, error detection and correction (EDAC) behavior, and waveform operational usage time. This paper describes the performance of the GD SDR over the first year of operations on the ISS.

radio telemetry↗
NASA NTRS2001

A Synthetic Vision Preliminary Integrated Safety Analysis

This report documents efforts to analyze a sample of aviation safety programs, using the LMI-developed integrated safety analysis tool to determine the change in system risk resulting from Aviation Safety Program (AvSP) technology implementation. Specifically, we have worked to modify existing system safety tools to address the safety impact of synthetic vision (SV) technology. Safety metrics include reliability, availability, and resultant hazard. This analysis of SV technology is intended to be part of a larger effort to develop a model that is capable of "providing further support to the product design and development team as additional information becomes available". The reliability analysis portion of the effort is complete and is fully documented in this report. The simulation analysis is still underway; it will be documented in a subsequent report. The specific goal of this effort is to apply the integrated safety analysis to SV technology. This report also contains a brief discussion of data necessary to expand the human performance capability of the model, as well as a discussion of human behavior and its implications for system risk assessment in this modeling environment.

Hemm, Robert↗
NASA NTRS2017

Analyzing System on A Chip Single Event Upset Responses using Single Event Upset Data, Classical Reliability Models, and Space Environment Data

We are investigating the application of classical reliability performance metrics combined with standard single event upset (SEU) analysis data. We expect to relate SEU behavior to system performance requirements. Our proposed methodology will provide better prediction of SEU responses in harsh radiation environments with confidence metrics. single event upset (SEU), single event effect (SEE), field programmable gate array devises (FPGAs)

single event effect (SEE)↗
NASA NTRS2015

Reliability and Probabilistic Risk Assessment - How They Play Together

PRA methodology is one of the probabilistic analysis methods that NASA brought from the nuclear industry to assess the risk of LOM, LOV and LOC for launch vehicles. PRA is a system scenario based risk assessment that uses a combination of fault trees, event trees, event sequence diagrams, and probability and statistical data to analyze the risk of a system, a process, or an activity. It is a process designed to answer three basic questions: What can go wrong? How likely is it? What is the severity of the degradation? Since 1986, NASA, along with industry partners, has conducted a number of PRA studies to predict the overall launch vehicles risks. Planning Research Corporation conducted the first of these studies in 1988. In 1995, Science Applications International Corporation (SAIC) conducted a comprehensive PRA study. In July 1996, NASA conducted a two-year study (October 1996 - September 1998) to develop a model that provided the overall Space Shuttle risk and estimates of risk changes due to proposed Space Shuttle upgrades. After the Columbia accident, NASA conducted a PRA on the Shuttle External Tank (ET) foam. This study was the most focused and extensive risk assessment that NASA has conducted in recent years. It used a dynamic, physics-based, integrated system analysis approach to understand the integrated system risk due to ET foam loss in flight. Most recently, a PRA for Ares I launch vehicle has been performed in support of the Constellation program. Reliability, on the other hand, addresses the loss of functions. In a broader sense, reliability engineering is a discipline that involves the application of engineering principles to the design and processing of products, both hardware and software, for meeting product reliability requirements or goals. It is a very broad design-support discipline. It has important interfaces with many other engineering disciplines. Reliability as a figure of merit (i.e. the metric) is the probability that an item will perform its intended function(s) for a specified mission profile. In general, the reliability metric can be calculated through the analyses using reliability demonstration and reliability prediction methodologies. Reliability analysis is very critical for understanding component failure mechanisms and in identifying reliability critical design and process drivers. The following sections discuss the PRA process and reliability engineering in detail and provide an application where reliability analysis and PRA were jointly used in a complementary manner to support a Space Shuttle flight risk assessment.

Safie, Fayssal M.↗
NASA NTRS2012

Did Geomagnetic Activity Challenge Electric Power Reliability During Solar Cycle 23? Evidence from the PJM Regional Transmission Organization in North America

During solar cycle 22, a very intense geomagnetic storm on 13 March 1989 contributed to the collapse of the Hydro-Quebec power system in Canada. This event clearly demonstrated that geomagnetic storms have the potential to lead to blackouts. This paper addresses whether geomagnetic activity challenged power system reliability during solar cycle 23. Operations by PJM Interconnection, LLC (hereafter PJM), a regional transmission organization in North America, are examined over the period 1 April 2002 through 30 April 2004. During this time PJM coordinated the movement of wholesale electricity in all or parts of Delaware, Maryland, New Jersey, Ohio, Pennsylvania, Virginia, West Virginia, and the District of Columbia in the United States. We examine the relationship between a proxy of geomagnetically induced currents (GICs) and a metric of challenged reliability. In this study, GICs are proxied using magnetometer data from a geomagnetic observatory located just outside the PJM control area. The metric of challenged reliability is the incidence of out-of-economic-merit order dispatching due to adverse reactive power conditions. The statistical methods employed make it possible to disentangle the effects of GICs on power system operations from purely terrestrial factors. The results of the analysis indicate that geomagnetic activity can significantly increase the likelihood that the system operator will dispatch generating units based on system stability considerations rather than economic merit.

storms↗
NASA NTRS2002

Reliability and Productivity Modeling for the Optimization of Separated Spacecraft Interferometers

As technological systems grow in capability, they also grow in complexity. Due to this complexity, it is no longer possible for a designer to use engineering judgement to identify the components that have the largest impact on system life cycle metrics, such as reliability, productivity, cost, and cost effectiveness. One way of identifying these key components is to build quantitative models and analysis tools that can be used to aid the designer in making high level architecture decisions. Once these key components have been identified, two main approaches to improving a system using these components exist: add redundancy or improve the reliability of the component. In reality, the most effective approach to almost any system will be some combination of these two approaches, in varying orders of magnitude for each component. Therefore, this research tries to answer the question of how to divide funds, between adding redundancy and improving the reliability of components, to most cost effectively improve the life cycle metrics of a system. While this question is relevant to any complex system, this research focuses on one type of system in particular: Separate Spacecraft Interferometers (SSI). Quantitative models are developed to analyze the key life cycle metrics of different SSI system architectures. Next, tools are developed to compare a given set of architectures in terms of total performance, by coupling different life cycle metrics together into one performance metric. Optimization tools, such as simulated annealing and genetic algorithms, are then used to search the entire design space to find the "optimal" architecture design. Sensitivity analysis tools have been developed to determine how sensitive the results of these analyses are to uncertain user defined parameters. Finally, several possibilities for the future work that could be done in this area of research are presented.

Kenny, Sean↗
NASA NTRS2006

A Perspective on DSN System Performance Analysis

This paper discusses the performance analysis effort being carried out in the NASA Deep Space Network. The activity involves root cause analysis of failures and assessment of key performance metrics. The root cause analysis helps pinpoint the true cause of observed problems so that proper correction can be effected. The assessment currently focuses on three aspects: (1) data delivery metrics such as Quantity, Quality, Continuity, and Latency; (2) link-performance metrics such as antenna pointing, system noise temperature, Doppler noise, frequency and time synchronization, wide-area-network loading, link-configuration setup time; and (3) reliability, maintainability, availability metrics. The analysis establishes whether the current system is meeting its specifications and if so, how much margin is available. The findings help identify the weak points in the system and direct attention of programmatic investment for performance improvement.

Deep Space Network (DSN)↗
NASA NTRS2016

Synthetic Biologic Membrane

The International Space Station (ISS) is a test bed for the technologies that will be used to travel to Mars and beyond. The lessons learned from operating the ISS provide valuable direction to future research and technology development programs. One of the most critical and complicated subsystems on ISS is the life support system. The life support system keeps the crew alive by recycling both air and water. The ISS water recycling system has been operating since 2009 and one of the main lessons learned is that reliability is a key technology performance metric. In the long run reliability is a key cost driver and is a critical factor in insuring crew safety. For long duration missions such as the exploration of Mars, where resupply of spare parts from Earth is difficult if not impossible, reliability is even more important. This presentation will cover research into improving the reliability of ISS systems. It will discuss research into the development of a biomimetic membrane materials that provides self-regeneration capabilities for water recycling systems. It will also cover research into past failures of the ISS water recycling system caused by astronaut bone loss and the build-up of trace contaminates in the cabin.

Biology↗
NASA NTRS2016

EVA Health and Human Performance Benchmarking Study

Multiple HRP Risks and Gaps require detailed characterization of human health and performance during exploration extravehicular activity (EVA) tasks; however, a rigorous and comprehensive methodology for characterizing and comparing the health and human performance implications of current and future EVA spacesuit designs does not exist. This study will identify and implement functional tasks and metrics, both objective and subjective, that are relevant to health and human performance, such as metabolic expenditure, suit fit, discomfort, suited postural stability, cognitive performance, and potentially biochemical responses for humans working inside different EVA suits doing functional tasks under the appropriate simulated reduced gravity environments. This study will provide health and human performance benchmark data for humans working in current EVA suits (EMU, Mark III, and Z2) as well as shirtsleeves using a standard set of tasks and metrics with quantified reliability. Results and methodologies developed during this test will provide benchmark data against which future EVA suits, and different suit configurations (eg, varied pressure, mass, CG) may be reliably compared in subsequent tests. Results will also inform fitness for duty standards as well as design requirements and operations concepts for future EVA suits and other exploration systems.

Abercromby, A. F.↗
NASA NTRSDate not supplied

Development and Initial Validation of HFBP-EM Short-Form Surveys

The Human Factors and Behavioral Performance Exploration Measures (HFBP-EM) suite includes self-report surveys designed to assess Behavioral Medicine (BMed) and Team risks for future exploration class missions. Survey data was collected during the Human Exploration Research Analog (HERA) Campaign 4 (C4), HERA Campaign 5 (C5), and during SIRIUS19 missions in the Russian Ground Based Experiment Complex, NEK. Crew time in spaceflight analogs and in spaceflight is typically limited. Extensive self-report surveys can be a significant burden to participants and are not operationally acceptable for spaceflight. The purpose of this project was to comprehensively assess the reliability and validity of the standard-length HFBP-EM surveys, identify acceptable short forms to administer during HERA C6, examine initial validation evidence for the proposed short form measures, and identify key measurement gaps in HFBP-EM coverage. In this presentation, we will report reliability and validity metrics of standard form data, describe the proposed new short forms, and present initial psychometric analyses supporting the use of these short forms.

S T Bell↗
NASA NTRSDate not supplied

Oculometric Detection and Characterization of Sub-Clinical Visual/Visuomotor Impairment

It has long been known that qualitative abnormalities in eye movements can be used to diagnose overt brain pathologies (Diefendorf & Dodge, 1908; Fox & Holmes, 1926; Leigh & Zee, 2015). Here, we will examine the use of a set of quantitative measures of the human behavioral response (oculometrics) in a 5-minute radial ocular tracking task (Krukowski & Stone, 2005) with sufficient temporal, spatial, and directional uncertainty to minimize the contribution of a priori prediction or anticipation, and to emphasize the use of a posteriori visual processing of the stimulus trajectory (Liston & Stone, 2014). The derived oculometrics provide a largely independent, reliable set of metrics that are sensitive enough to detect mild sub-clinical impairment across a range of possible neural loci (Stone et al., 2019) with the pattern of impairment across the set providing specificity as to its nature (Tyson et al., 2023). We will review our earlier findings where oculometrics have been used to detect mild impairment due to traumatic brain injury, sleep loss, and low-dose alcohol (Liston et al., 2017; Stone et al., 2019; Tyson et al., 2021). We will also report on a recent clinical study of asymptomatic patients at risk of retinal pathology (Leung et al., 2022) and show that oculometrics can detect and characterize substantive loss of visual function in the absence of clinical indicators of pathology. We conclude that oculometric testing could be used as a routine non-invasive ophthalmological or neurological tool to aid in the early detection and diagnosis of neural injury, toxicity, or disease.

eye movements↗
NASA NTRS2024

Morphometric Characterization of Lunar Landing Sites

As ambitious surface exploration of the Moon commences in the 2020s, it is important to develop reliable and objective metrics for understanding the quality of future landing sites. A key prerequisite for any exploration and utilization of the lunar surface is a safe landing. One of the most important methods to provide understanding of potential metrics for landing site safety in the lunar context is the systematic comparison of candidate and historic landing sites. The goal of this project is to determine the morphometric parameters of the lunar surface at 16 successful lunar landing sites where adequate data exists to execute a quantitative comparison using various parameters. Quantitative analysis of Lunar Reconnaissance Orbiter (LRO) data should inform mission planning activities by providing morphologic metrics for landing sites including slope, Terrain Ruggedness Index (TRI), and rock abundance. These comparisons will assist mission planners and exploration scientists by providing “calibration points” for using Lunar Reconnaissance Orbiter (LRO) data to successfully plan and execute lunar powered descents in the future. The metrics included in this analysis describe the form of the terrain and can be calculated for any potential future landing site. Another objective of this project is to determine how the derived morphologic parameters for the same landing site change between common pixel scales. In ideal lighting conditions, 2m/px Narrow Angle Camera Digital Terrain Models (NAC DTMs) can be assembled using stereoscopic imagery from two or more concentric orbits of the LRO. However, due to low light conditions near the lunar poles, the highest quality data for many potential lunar landing sites comes from the Lunar Orbiter Laser Altimeter (LOLA). Therefore, we seek to assess how the derived slope and TRI values change as a function of changes in the DTM postings from 2m/px to 5m/px.

J M McCallion↗
NASA NTRSDate not supplied

Trends in Human Spaceflight: Analysis of Observed Propulsion Failure Modes Following NASA’s Artemis I Mission

In 2022, NASA’s Artemis program returned the agency to lunar space, propelled by the Orion European Service Module (ESM). Through rigorous ground test campaigns for Artemis I and II and the collection and transmission of operational data during the Artemis I flight, the Safety and Mission Assurance (S&MA) team created and maintained a robust database of component nonconformances. This study analyzes in-flight and ground processing findings on the Artemis ESM propulsion subsystem to track reliability and safety metrics, as well as comparing the data to that of previous human spaceflight programs, Apollo and Space Shuttle. In drawing a comparison to the Artemis I flight, recommendations can be made for the Artemis II crewed mission to ensure best practices for flight safety, including redundancy and failure tolerance in the system. The results reinforce a need for robust safety standards and caution against the complacency of a single successful test flight.

human spaceflight safety↗
NASA NTRSDate not supplied

Trends in Human Spaceflight: Analysis of Observed Propulsion Failure Modes Following NASA’s Artemis I Mission

In 2022, NASA’s Artemis program returned the agency to lunar space, propelled by the Orion European Service Module (ESM). Through rigorous ground test campaigns for Artemis I and II and the collection and transmission of operational data during the Artemis I flight, the Safety and Mission Assurance (S&MA) team created and maintained a robust database of component nonconformances. This study analyzes in-flight and ground processing findings on the Artemis ESM propulsion subsystem to track reliability and safety metrics, as well as comparing the data to that of previous human spaceflight programs, Apollo and Space Shuttle. In drawing a comparison to the Artemis I flight, recommendations can be made for the Artemis II crewed mission to ensure best practices for flight safety, including redundancy and failure tolerance in the system. The results reinforce a need for robust safety standards and caution against the complacency of a single successful test flight.

human spaceflight safety↗
NASA NTRSDate not supplied

Design for Reliability (DfR) in Space Life Support

The engineering process of Design for Reliability (DfR) is well established in the automotive and aerospace industries. DfR should be useful in the future development of space life support systems. DfR is a sequence of tasks that develop system requirements and plan reliability analysis and testing. First and fundamentally, the reliability requirement is defined. Next the system reliability model is developed, often using a reliability block diagram. The overall system reliability requirement is allocated to the subsystems and an estimate of the attainable reliability is made. This expected reliability can be improved by simplifying the design by removing components or by replacing less reliable components. Improving reliability can require difficult compromises, such as reducing performance requirements, increasing budget, or extending testing. The actual system reliability can be determined only by testing, which should continue long enough to provide the required confidence in the measured value. New systems often have unexpected design errors that cause failures in early testing. The usual reliability improvement process of testing, finding the failure modes, and redesigning to remove them reduces the failure rate and is referred to as “reliability growth.” After redesign has been completed, the system should be further tested to determine the actual achieved reliability more accurately. If the final system failure rate is too high, redundant systems can be used to improve overall operational reliability. Adding redundancy simply to increase the one- or two-fault tolerance metric may sometimes reduce reliability. Reliability can be improved in three ways: redesigning the system to include more reliable subsystems and components, reliability growth testing and failure mode removal, and by using parallel redundant systems. DfR should combine these approaches to achieve the required reliability while managing performance, cost, and schedule.

Reliability↗
NASA NTRSDate not supplied

Design for Reliability (DfR) in Space Life Support

The engineering process of Design for Reliability (DfR) is well established in the automotive and aerospace industries. DfR should be useful in the future development of space life support systems. DfR is a sequence of tasks that develop system requirements and plan reliability analysis and testing. First and fundamentally, the reliability requirement is defined. Next the system reliability model is developed, often using a reliability block diagram. The overall system reliability requirement is allocated to the subsystems and an estimate of the attainable reliability is made. This expected reliability can be improved by simplifying the design by removing components or by replacing less reliable components. Improving reliability can require difficult compromises, such as reducing performance requirements, increasing budget, or extending testing. The actual system reliability can be determined only by testing, which should continue long enough to provide the required confidence in the measured value. New systems often have unexpected design errors that cause failures in early testing. The usual reliability improvement process of testing, finding the failure modes, and redesigning to remove them reduces the failure rate and is referred to as “reliability growth.” After redesign has been completed, the system should be further tested to determine the actual achieved reliability more accurately. If the final system failure rate is too high, redundant systems can be used to improve overall operational reliability. Adding redundancy simply to increase the one- or two-fault tolerance metric may sometimes reduce reliability. Reliability can be improved in three ways: redesigning the system to include more reliable subsystems and components, reliability growth testing and failure mode removal, and by using parallel redundant systems. DfR should combine these approaches to achieve the required reliability while managing performance, cost, and schedule.

Reliability↗