Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Reliability assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

Stability, reliability and cross-mode correlations of tests in a recommended 8-minute performance assessment battery

A need exists for an automated performance test system to study drugs, agents, treatments, and stresses of interest to the aviation, space, and environmental medical community. The purpose of this present study is to evaluate tests for inclusion in the NASA-sponsored Automated Performance Test System (APTS). Twenty-one subjects were tested over 10 replications with tests previously identified as good candidates for repeated-measure research. The tests were concurrently administered in paper-and-pencil and microcomputer modes. Performance scores for the two modes were compared. Data from trials 1 to 10 were examined for indications of test stability and reliability. Nine of the ten APT system tests achieved stability. Reliabilities were generally high. Cross-correlation of microbased tests with traditional paper-and-pencil versions revealed similarity of content within tests in the different modes, and implied at least three cognition and two motor factors. This protable, inexpensive, rugged, computerized battery of tests is recommended for use in repeated-measures studies of environmental and drug effects on performance. Identification of other tests compatible with microcomputer testing and potentially capable of tapping previously unidentified factors is recommended. Documentation of APTS sensitivity to environmental agents is available for more than a dozen facilities and is reported briefly. Continuation of such validation remains critical in establishing the efficacy of APTS tests.

Wilkes, R. L.↗

Reliability of Space-Shuttle Pressure Vessels with Random Batch Effects

In this article we revisit the problem of estimating the joint reliability against failure by stress rupture of a group of fiber-wrapped pressure vessels used on Space-Shuttle missions. The available test data were obtained from an experiment conducted at the U.S. Department of Energy Lawrence Livermore Laboratory (LLL) in which scaled-down vessels were subjected to life testing at four accelerated levels of pressure. We estimate the reliability assuming that both the Shuttle and LLL vessels were chosen at random in a two-stage process from an infinite population with spools of fiber as the primary sampling unit. Two main objectives of this work are: (1) to obtain practical estimates of reliability taking into account random spool effects and (2) to obtain a realistic assessment of estimation accuracy under the random model. Here, reliability is calculated in terms of a 'system' of 22 fiber-wrapped pressure vessels, taking into account typical pressures and exposure times experienced by Shuttle vessels. Comparisons are made with previous studies. The main conclusion of this study is that, although point estimates of reliability are still in the 'comfort zone,' it is advisable to plan for replacement of the pressure vessels well before the expected Lifetime of 100 missions per Shuttle Orbiter. Under a random-spool model, there is simply not enough information in the LLL data to provide reasonable assurance that such replacement would not be necessary.

Feiveson, Alan H.↗

Assessing Engine Hot Fire Data for Human Spaceflight Applications

Development and certification of liquid engine systems for human spaceflight missions requires exhaustive analysis to meet the NASA’s requirements for engine health, reliability, and performance. The techniques used to assess requirement conformance and test-to-test engine health pose many unique challenges including the unusually large scale of data, complex component and system analysis, and rigorous engineering judgement standards. To address these challenges, NASA Marshall Space Flight Center’s Engine Systems branch has developed and maintained a robust software suite and operational processes that satisfy programmatic requirements levied on engines and the 7 Elements of Flight Rationale. Analysis at a systems level includes subsystem assessment of components such as turbomachinery and combustion devices as well as structural and fluid dynamics and transient and steady-state assessment at a systems level. Some of the most important tools to accomplish this analysis are automated script databases, creation of historical and statistical comparisons, and parameters calculated at the full data rate. These tools greatly simplify the crucial processes of anomaly investigation, limit monitoring, health assessment, and timely communication of key conclusions drawn from hot fire testing and flight data analysis.

Data Assessment↗

Assessing Engine Hot Fire Data for Human Spaceflight Applications

Development and certification of liquid engine systems for human spaceflight missions requires exhaustive analysis to meet the NASA’s requirements for engine health, reliability, and performance. The techniques used to assess requirement conformance and test-to-test engine health pose many unique challenges including the unusually large scale of data, complex component and system analysis, and rigorous engineering judgement standards. To address these challenges, NASA Marshall Space Flight Center’s Engine Systems branch has developed and maintained a robust software suite and operational processes that satisfy programmatic requirements levied on engines and the 7 Elements of Flight Rationale. Analysis at a systems level includes subsystem assessment of components such as turbomachinery and combustion devices as well as structural and fluid dynamics and transient and steady-state assessment at a systems level. Some of the most important tools to accomplish this analysis are automated script databases, creation of historical and statistical comparisons, and parameters calculated at the full data rate. These tools greatly simplify the crucial processes of anomaly investigation, limit monitoring, health assessment, and timely communication of key conclusions drawn from hot fire testing and flight data analysis.

Data Assessment↗

CBGA/PBGA for Highly Reliable Applications

The Jet Propulsion Laboratory (JPL) is currently assessing the use of Ball Grid Arrays (BGAs) for National Aeronautics and Space Administration (NASA) spaceflight applications. This work is being funded through NASA Headquarters, Code Q. The objectives are to demonstrate the robustness, quality and reliability of BGAs technology, and to assist in the solicited industrial, academic and other related consortia to work together to leverage the related efforts into a synergistic effort. Initial results of these activities will be summarized and presented in this paper.

code Q BGA's ball grid arrays Advanced Interconnec↗

Reusable Solid Rocket Motor - Accomplishments, Lessons, and a Culture of Success

The Reusable Solid Rocket Motor represents the largest solid rocket motor ever flown and the only human rated solid motor. Each Reusable Solid Rocket Motor (RSRM) provides approximately 3-million lb of thrust to lift the integrated Space Shuttle vehicle from the launch pad. The motors burn out approximately 2 minutes later, separate from the vehicle and are recovered and refurbished. The size of the motor and the need for high reliability were challenges. Thrust shaping, via shaping of the propellant grain, was needed to limit structural loads during ascent. The motor design evolved through several block upgrades to increase performance and to increase safety and reliability. A major redesign occurred after STS-51L with the Redesigned Solid Rocket Motor. Significant improvements in the joint sealing systems were added. Design improvements continued throughout the Program via block changes with a number of innovations including development of low temperature o-ring materials and incorporation of a unique carbon fiber rope thermal barrier material. Recovery of the motors and post flight inspection improved understanding of hardware performance, and led to key design improvements. Because of the multidecade program duration material obsolescence was addressed, and requalification of materials and vendors was sometimes needed. Thermal protection systems and ablatives were used to protect the motor cases and nozzle structures. Significant understanding of design and manufacturing features of the ablatives was developed during the program resulting in optimization of design features and processing parameters. The project advanced technology in eliminating ozone-depleting materials in manufacturing processes and the development of an asbestos-free case insulation. Manufacturing processes for the large motor components were unique and safety in the manufacturing environment was a special concern. Transportation and handling approaches were also needed for the large hardware segments. The reusable solid rocket motor achieved significant reliability via process control, ground test programs, and postflight assessment. Process control is mandatory for a solid rocket motor as an acceptance test of the delivered product is not feasible. Process control included process failure modes and effects analysis, statistical process control, witness panels, and process product integrity audits. Material controls and inspections were maintained throughout the sub tier vendors. Material fingerprinting was employed to assess any drift in delivered material properties. The RSRM maintained both full scale and sub-scale test articles. These enabled continuous improvement of design and evaluation of process control and material behavior. Additionally RSRM reliability was achieved through attention to detail in post flight assessment to observe any shift in performance. The postflight analysis and inspections provided invaluable reliability data as it enables observation of actual flight performance, most of which would not be available if the motors were not recovered. These unique challenges, features of the reusable solid rocket motor, materials and manufacturing issues, and design improvements will be discussed in the paper.

Moore, Dennis R.↗

A Comparison of a Brain-Based Adaptive System and a Manual Adaptable System for Invoking Automation

Two experiments are presented that examine alternative methods for invoking automation. In each experiment, participants were asked to perform simultaneously a monitoring task and a resource management task as well as a tracking task that changed between automatic and manual modes. The monitoring task required participants to detect failures of an automated system to correct aberrant conditions under either high or low system reliability. Performance on each task was assessed as well as situation awareness and subjective workload. In the first experiment, half of the participants worked with a brain-based system that used their EEG signals to switch the tracking task between automatic and manual modes. The remaining participants were yoked to participants from the adaptive condition and received the same schedule of mode switches, but their EEG had no effect on the automation. Within each group, half of the participants were assigned to either the low or high reliability monitoring task. In addition, within each combination of automation invocation and system reliability, participants were separated into high and low complacency potential groups. The results revealed no significant effects of automation invocation on the performance measures; however, the high complacency individuals demonstrated better situation awareness when working with the adaptive automation system. The second experiment was the same as the first with one important exception. Automation was invoked manually. Thus, half of the participants pressed a button to invoke automation for 10 s. The remaining participants were yoked to participants from the adaptable condition and received the same schedule of mode switches, but they had no control over the automation. The results showed that participants who could invoke automation performed more poorly on the resource management task and reported higher levels of subjective workload. Further, those who invoked automation more frequently performed more poorly on the tracking task and reported higher levels of subjective workload. and the adaptable condition in the second experiment revealed only one significant difference: the subjective workload was higher in the adaptable condition. Overall, the results show that a brain-based, adaptive automation system may facilitate situation awareness for those individuals who are more complacent toward automation. By contrast, requiring operators to invoke automation manually may have some detrimental impact on performance but does appear to increases subjective workload relative to an adaptive system.

Bailey, Nathan R.↗

Assessments of astronaut effectiveness

This study examined the reliability and convergent validity of three methods of peer and supervisory ratings of the effectiveness of individual NASA astronauts and their relationships with flight assignments. These two techniques were found to be reliable and relatively convergent. Seniority and a peer-rated Performance and Competence factor proved to be most closely associated with flight assignments, while supervisor ratings and a peer-rated Group Living and Personality factor were found to be unrelated. Results have implications for the selection and training of astronauts.

Rose, Robert M.↗

Defining Reliability and Robustness from a Human Factors Perspective

A human factors team was tasked with assessing best practices for developing a crewed space vehicle that is both reliable and robust. The team identified two broad dimensions of human factors are relevant to system design. Namely, the attributes of the product, and the processes used to develop the product. The “product” includes hardware, software, documentation, training systems, and procedures throughout all phases of the system life, including construction, testing, operation and maintenance. Three product attributes relevant to robustness are the extent to which task demands are within human capabilities, the capacity of the system to cope with unanticipated human actions, and the ability of the system to make use of unique human capabilities during non-routine situations. The “process” dimension of human factors relates to the activities that start in the early stages of design, and continue throughout the life of the system. There are, of course, no guarantees that a formal consideration of human factors throughout the design process will identify all the relevant human issues. In the absence of such a consideration, however, problems are virtually assured.

Hobbs, Alan↗

Crop-CASMA - A Web GIS Tool for Cropland Soil Moisture Monitoring and Assessment Based on SMAP Data

Timely, frequent, and complete cropland soil moisture information acquired throughout the growing season is critical for agricultural policy, production, food security, and food prices. The NASA Soil Moisture Active and Passive (SMAP) mission provides a reliable data source for cropland soil moisture assessment. This paper presents Crop-CASMA- a web GIS application tool for cropland soil moisture monitoring and assessment based on SMAP data. This interactive Web service-based GIS application tool enables CONUS SMAP derived soil moisture data visualization, dissemination, and analytics. In this paper, we describe the Crop-CASMA application system architecture, the application implementation, and the data it serves. In addition, we also present a few snapshots of the Crop-CASMA data for cropland soil moisture monitoring. The release of Crop-CASMA greatly enhances the user experience and facilitates using soil moisture data products for crop condition monitoring and decision support.

Zhengwei Yang↗

Crop-CASMA - A Web GIS Tool for Cropland soil moisture Monitoring and Assessment Based on SMAP Data

Timely, frequent, and complete cropland soil moisture information acquired throughout the growing season is critical for agricultural policy, production, food security, and food prices. The NASA Soil Moisture Active and Passive (SMAP) mission provides a reliable data source for cropland soil moisture assessment. This paper presents Crop-CASMA - a web GIS application tool for cropland soil moisture monitoring and assessment based on SMAP data. This interactive Web service-based GIS application tool enables CONUS SMAP derived soil moisture data visualization, dissemination, and analytics. In this paper, we describe the Crop-CASMA application system architecture, the application implementation, and the data it serves. In addition, we also present a few snapshots of the Crop-CASMA data for cropland soil moisture monitoring. The release of Crop-CASMA greatly enhances the user experience and facilitates using soil moisture data products for crop condition monitoring and decision support.

Reichle, Rolf H.↗

Evaluation of a Shuttle Derived Vehicle (SDV) for Cargo Transportation

In this new era of space exploration, a host of launch vehicles are being examined for possible use in transporting cargo and crew to low Earth orbit and beyond. Launch vehicles derived from the Space Shuttle Program (SSP), known as Shuttle Derived Vehicles (SDVs), are prime candidates for heavy-lift duty because of their potential to minimize non-recurring costs and because the Shuttle can leverage off proven high-performance flight systems with established ground and flight support. To determine the merits of SDVs, a detailed evaluation was performed. This evaluation included a trade study and risk assessment of options based on performance, safety reliability, cost, operations, and evolution. The purpose of this paper is to explain the approach, processes, and tools used to evaluate launch vehicles for heavy lift cargo transportation. The process included defining the trade space, characterizing the concepts, analyzing the systems, and scoring the options. The process also included a review by subject experts from NASA and industry to compare past and recent study data and assess the risks. A set of technical performance measures (TPMs) was generated based on the study requirements and constraints. Tools such as INTROS and POST were used to calculate performance, FIRST was used for prediction of reliability, and other software packages, both commercial and NASA-owned, were applied to study the trade space. By following a clear process and using the right tools a thorough assessment was performed. An SDV can be classified as either a side-mount vehicle (SMV) or an in-line vehicle OLV). An SMV is a Space Shuttle where the Orbiter is replaced by a cargo carrier. An ILV is comprised of a modified Shuttle External Tank (ET) with engines mounted to the bottom and cargo mounted atop. For both families of vehicles, Solid Rocket Boosters (SRBs) are attached to the ET. The first derivate of Shuttle is defined as the vehicle with minimum changes necessary to transform the Space Shuttle into an SDV. Deltas from the first derivate were also formulated to study more SDV options. Examples of deltas include replacing the SRBs with larger and/or more SRBs, adding an upper stage, increasing the size of the ET, changing the engines, and modifying the elements. Challenges for SDV range from tailoring infrastructure to meeting the exploration schedule. Although SDV is based on the Space Shuttle, it still includes development risk for designing and building a Cargo Carrier. There are also performance challenges in that Shuttle is not optimized for cargo-only missions, but it is a robust system built on reusability. Balancing the strengths and weaknesses of the Shuttle to meet Lunar and Mars mission objectives provides the framework for an informative trade study. SDV was carefully analyzed and the results of the study provide invaluable data for use in the new exploration initiative.

Roman, Jose M.↗

Using Facility Condition Assessments to Identify Actions Related to Infrastructure

To support cost effective, quality research it is essential that laboratory and testing facilities are maintained in a continuous and reliable state of availability at all times. NASA Langley Research Center (LaRC) and its maintenance contractor, Jacobs Technology, Inc. Research Operations, Maintenance, and Engineering (ROME) group, are in the process of implementing a combined Facility Condition Assessment (FCA) and Reliability Centered Maintenance (RCM) program to improve asset management and overall reliability of testing equipment in facilities such as wind tunnels. Specific areas are being identified for improvement, the deferred maintenance cost is being estimated, and priority is being assigned against facilities where conditions have been allowed to deteriorate. This assessment serves to assist in determining where to commit available funds on the Center. RCM methodologies are being reviewed and enhanced to assure that appropriate preventive, predictive, and facilities/equipment acceptance techniques are incorporated to prolong lifecycle availability and assure reliability at minimum cost. The results from the program have been favorable, better enabling LaRC to manage assets prudently.

Rubert, Kennedy F.↗

Software reliability - Measures and effects in flight critical digital avionics systems

The paper discusses software reliability as it applies particularly to design and evaluation of flight-critical digital avionics systems. Measures of software reliability, measurement methods and reliability (macro-) models are discussed. Recent work assessing their accuracy in predicting software errors in 'fly-by-wire' Newtonian applications is presented. Additional, detailed topics are discussed including software error distributions (e.g. catastrophic vs. noncatastrophic) and the effects of system growth/maturity on reliability improvement. In practical flight-critical digital applications, software reliability improvement is sought through use of parallel, redundant software (i.e. N-version programming) or backup software that can be invoked in the event of (primary) software failure. Achievable reliability levels are however highly sensitive to common-mode specification and programming errors. Recent data correlating these errors with net software reliability are discussed.

Dunn, William R.↗

Metallic Thermal Protection System Technology Development: Concepts, Requirements and Assessment Overview

A technology development program was conducted to evolve an earlier metallic thermal protection system (TPS) panel design, with the goals of: improving operations features, increasing adaptability (ease of attaching to a variety of tank shapes and structural concepts), and reducing weight. The resulting Adaptable Robust Metallic Operable Reusable (ARMOR) TPS system incorporates a high degree of design flexibility (allowing weight and operability to be traded and balanced) and can also be easily integrated with a large variety of tank shapes, airframe structural arrangements and airframe structure/material concepts. An initial attempt has been made to establish a set of performance based TPS design requirements. A set of general (FARtype) requirements have been proposed, focusing on defining categories that must be included for a comprehensive design. Load cases required for TPS design must reflect the full flight envelope, including a comprehensive set of limit loads, However, including additional loads. such as ascent abort trajectories, as ultimate load cases, and on-orbit debris/micro-meteoroid hypervelocity impact, as one of the discrete -source -damage load cases, will have a significant impact on system design and resulting performance, reliability and operability. Although these load cases have not been established, they are of paramount importance for reusable vehicles, and until properly included, all sizing results and assessments of reliability and operability must be considered optimistic at a minimum.

Dorsey, John T.↗

Space Shuttle Probabilistic Risk Assessment (SPRA) Iteration 3.2

The Shuttle is a very reliable vehicle in comparison with other launch systems. Much of the risk posed by Shuttle operations is related to fundamental aspects of the spacecraft design and the environments in which it operates. It is unlikely that significant design improvements can be implemented to address these risks prior to the end of the Shuttle program. The model will continue to be used to identify possible emerging risk drivers and allow management to make risk-informed decisions on future missions. Potential uses of the SPRA in the future include: - Calculate risk impact of various mission contingencies (e.g. late inspection, crew rescue, etc.). - Assessing the risk impact of various trade studies (e.g. flow control valves). - Support risk analysis on mission specific events, such as in flight anomalies. - Serve as a guiding star and data source for future NASA programs.

Boyer, Roger L.↗

Analysis of Ares 1 Ascent Navigation Options

The paper documents a collaborative analysis of ascent Navigation options for the Ares 1 launch vehicle by the NASA Marshall Space Flight Center (MSFC) and the C. S. Draper Laboratory. The objective of the work was the development of a Navigation concept and supporting requirements which meet the Ares 1 accuracy specification in a manner which is straightforward, reliable, and cost effective. Six primary Navigation architectures were considered. In each case analysis was performed to determine under what conditions the required accuracy at second stage cutoff could be achieved. Those architectures which met the accuracy requirements were then assessed in terms of cost, complexity, and reliability to determine a baseline Navigation approach and the primary supporting requirements.

Norris, Lee↗