Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “hardware failure”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

Holistic Measurement Driven Resilience: Combining Operational Fault and Failure Measurements and Fault Injection for Quantifying Fault Detection, Propagation and Impact. Final report

For HPC systems to date, application resilience to faults and failures has been accomplished by the brute- force method of checkpoint/restart, which allows an application to make forward progress in the face of system and application faults, errors, and failures independent of root cause or end result. It has remained the primary resilience mechanism because we lack a way to identify faults and anticipate consequences early enough to take meaningful mitigating action. However, checkpoint/restart implementations put a tremendous burden on system resources and on the applications themselves and is becoming less feasible at scale. Because we have not yet operated at scales at which checkpoint/restart fails to provide forward progress, despite increasing costs, vendors have had little motivation to provide the instrumentation necessary for early identification of faults and failures. However, as we move from petascale to exascale, component mean time to failure (MTTF) will render the existing techniques ineffectual and/or too expensive. Furthermore, fault recovery mechanisms such as failover and/or error correction introduce performance inconsistency. Instrumentation allowing early indication of problems and tools to enable use of such information by systems, operating systems, and applications offer an alternative, more scalable and less costly solution. In the HMDR project, we built on our experience and expertise developed and accumulated over years of research on design, monitoring, measurement, and assessment of resilient computing systems. Analysis of field data on the current and past generations of extreme-scale systems revealed several challenges that, if not addressed in increasingly larger and more complex systems, may hinder the effectiveness of future exascale computing systems. Specifically, i) file systems and interconnects in current-generation large-scale systems already operate at the margins of resiliency, including consistent performance, and may not scale to larger deployments; ii) automated, software-based failover mechanisms are frequently inadequate and can introduce wider failures, such that failures during recovery may lead to system/application failures, including system-wide outages; and iii) silent data corruption represents a critical fault mode and will require efficient detection mechanisms if next-generation applications are to take full advantage of exascale hardware. To address the above challenges, we assembled a team of world-renowned experts in resilient extreme- scale computing from the University of Illinois (Electrical and Computer Engineering, Computer Science, and NCSA), SNL, LANL, NERSC, and Cray. Our team includes representatives from centers that house many of the largest HPC resources in the world, both today and over the coming years. The team has a unique track record of research in i) system and application failure characterization based on the analysis of field data, ii) data-driven design of fault/error detection mechanisms, and iii) experimental characterization of system/application resiliency. The team includes system owners/operators who provide continuous data collection and access and ensure installation of appropriate analysis tools.

97 MATHEMATICS AND COMPUTING↗

Estimating Orion Heat Shield Failure Due To Ablator Cracking During The EFT-1 Mission

The Orion EFT-1 heatshield suffered from two major certification challenges: First, the mechanical properties used in design were not evident in the flight hardware and second, the flight article itself cracked during fabrication. The combination of these events motivated the Orion Program to pursue an engineering-level Probabilistic Risk Assessment (PRA) as part of heatshield certification rationale. The PRA provided loss of Mission (LOM) likelihoods considering the probability of a crack occurring during the mission and the likelihood of subsequent structure over-temperature. The methods and input data for the PRA are presented along with a discussion of the test data used to anchor the results. The Orion program accepted an EFT-1 Loss of Vehicle (LOV) risk of 1-in-160,000 due to in-mission Avcoat cracking based on the results of this analysis. Conservatisms in the result, along with future considerations for Exploration Missions (EM) are also addressed.

Avcoat↗

A Systematic Approach to Hardware Qualification

A systematic approach for the development of a hardware qualification approach is described. This approach stems from the need to break the "Catch-22" of not being able to fly new technology because it hasn't flown. A physics of failure approach is used to identify failure modes and the impact and likelihood of these failures on the mission requirements is plotted in a Requirements Matrix. These same failure modes are plotted against the effectiveness of the available Preventions, Analyses, Control and Tests (PACTs) at screening for, or eliminating, these failure modes in a Test Effectiveness Matrix. Matrix multiplication results in a ranked set of PACTs which can be sorted according to cost and redundancy with other PACTs. This, and other information which results from the process, will allow project managers to make more informed decisions regarding the cost and risk tradeoffs inherent in any qualification program.

hardware↗

The GSFC Combined Approach of ODC Stockpiling and Tribological Testing to Mitigate the Risks of ODC Elimination

In response to the elimination of production of several Ozone Depleting Chemicals (ODCs) which have been widely used in successful space flight mechanism cleaning and lubricating procedures, GSFC developed and implemented an overall philosophy of mitigating the risks to flight hardware during the transition phase to ODC-Free cleaning procedures. One leg of that philosophy is the initiation of a several tier testing program which will deliver increasing amounts of information over the next few years, starting with original surface analysis comparisons between ODC and various ODC-Free cleaning technologies. The other leg is the stockpiling of an appropriate amount of ODC solvents such that all short term GSFC missions will be able to stay with or revert to heritage cleaning and lubricating procedures in the face of life issues. While tribological testing, mechanism life testing and space-flight experience will ultimately bring us into the 21st century with environmentally friendly means of cleaning long-life precision mechanism components, many satellites will be launched over the next few years with a number of important tribological questions unanswered. In order to prepare for this challenge, the Materials Engineering Branch in cooperation with the Electromechanical Branch launched an intensive review of all ongoing missions. The failure risk was determined for each long-life mechanism based on a number of parameters, including a comparison of flight solvents used to clean the heritage/life test hardware. Also studied was the ability of the mechanism manufacturers to stockpile ODCs based on state laws and company policies. A stockpiling strategy was constructed based on this information and subsequently implemented. This paper provides an overview of the GSFC ODC elimination risk mitigation philosophy as well as a detailed examination of the development of the ODC stockpiling plan.

Predmore, Roamer↗

Apollo experience report: The problem of stress-corrosion cracking

Stress-corrosion cracking has been the most common cause of structural-material failures in the Apollo Program. The frequency of stress-corrosion cracking has been high and the magnitude of the problem, in terms of hardware lost and time and money expended, has been significant. In this report, the significant Apollo Program experiences with stress-corrosion cracking are discussed. The causes of stress-corrosion cracking and the corrective actions are discussed, in terminology familiar to design engineers and management personnel, to show how stress-corrosion cracking can be prevented.

Johnson, R. E.↗

Design and Integration of an Actuated Nose Strake Control System

Aircraft flight characteristics at high angles of attack can be improved by controlling vortices shed from the nose. These characteristics have been investigated with the integration of the actuated nose strakes for enhanced rolling (ANSER) control system into the NASA F-18 High Alpha Research Vehicle. Several hardware and software systems were developed to enable performance of the research goals. A strake interface box was developed to perform actuator control and failure detection outside the flight control computer. A three-mode ANSER control law was developed and installed in the Research Flight Control System. The thrust-vectoring mode does not command the strakes. The strakes and thrust-vectoring mode uses a combination of thrust vectoring and strakes for lateral- directional control, and strake mode uses strakes only for lateral-directional control. The system was integrated and tested in the Dryden Flight Research Center (DFRC) simulation for testing before installation in the aircraft. Performance of the ANSER system was monitored in real time during the 89-flight ANSER flight test program in the DFRC Mission Control Center. One discrepancy resulted in a set of research data not being obtained. The experiment was otherwise considered a success with the majority of the research objectives being met.

Flick, Bradley C.↗

System Risk Balancing Profiles: Software Component

The Software QA / V&V guide will be reviewed and updated based on feedback from NASA organizations and others with a vested interest in this area. Hardware, EEE Parts, Reliability, and Systems Safety are a sample of the future guides that will be developed. Cost Estimates, Lessons Learned, Probability of Failure and PACTS (Prevention, Avoidance, Control or Test) are needed to provide a more complete risk management strategy. This approach to risk management is designed to help balance the resources and program content for risk reduction for NASA's changing environment.

Kelly, John C.↗

Configuration Management at NASA

NASA programs are characterized by complexity, harsh environments and the fact that we usually have one chance to get it right. Programs last decades and need to accept new hardware and technology as it is developed. We have multiple suppliers and international partners Our challenges are many, our costs are high and our failures are highly visible. CM systems need to be scalable, adaptable to new technology and span the life cycle of the program (30+ years). Multiple Systems, Contractors and Countries added major levels of complexity to the ISS program and CM/DM and Requirements management systems center dot CM Systems need to be designed for long design life center dot Space Station Design started in 1984 center dot Assembly Complete in 2012 center dot Systems were developed on a task basis without an overall system perspective center dot Technology moves faster than a large project office, try to make sure you have a system that can adapt

Doreswamy, Rajiv↗

R2U2 in Space: System and Software Health Management for Small Satellites

In order for small but complex systems like rovers, SmallSats, or Unmanned Aircraft (UAS) to operate autonomously, they must have a real-time solution for assessing their own system health. System and Software Health Management (SHM) enables better detection of faulty sensors and software problems, and enables better fault management including mitigation of unpredicted fault scenarios in the absence of a human on-board. In recent work, we have developed a Responsive, Realizable, Unobtrusive Unit (R2U2) for on-board SHM of autonomous UAS and demonstrated its ability to detect faults during flight time. These faults, from sensor failures, to software problems, to malicious security attacks, can present as transient temporal faults that even humans are challenged to find. An R2U2 congfiuration is a modular combination of multiple types of temporal logic runtime observers with fault-specic Bayesian Nets and sensor filters. R2U2 reasons about both on-board hardware and software components; R2U2 itself can be instantiated as an independent FPGA (Field-Programmable Gate Array)-based conguration or as a software component running independently from other software on-board. Small satellites, such as CubeSats, also require on-board SHM and failure mitigation, as limited telemetry bandwidth does not allow the transmission of the entire system state for ground-based health management. However, the autonomous operation of satellites brings a set of challenges different from UAS, including the effects of radiation on non-rad-hard, low-cost components, and the harsher environment of space. We surmise that a new extension of R2U2 could be adapted to help better detect, for example, radiation errors in cheaper COTS (Commercial Off the Shelf) (not rad-hard) components often used in small space systems. Since small satellites often operate in coordination, we will also examine new ways of distributed monitoring of their communication and cooperation and real-time detection of off-nominal situations utilizing multiple satellites. This talk will discuss preliminary work and ideas for building on terrestrial success of system and software health management for the harsher, and differently challenging, environment of space.

Runtime Verification & Validation↗

Correlation study between vibrational environmental and failure rates of civil helicopter components

An investigation of two selected helicopter types, namely, the Models 206A/B and 212, is reported. An analysis of the available vibration and reliability data for these two helicopter types resulted in the selection of ten components located in five different areas of the helicopter and consisting primarily of instruments, electrical components, and other noncritical flight hardware. The potential for advanced technology in suppressing vibration in helicopters was assessed. The are still several unknowns concerning both the vibration environment and the reliability of helicopter noncritical flight components. Vibration data for the selected components were either insufficient or inappropriate. The maintenance data examined for the selected components were inappropriate due to variations in failure mode identification, inconsistent reporting, or inaccurate informaton.

Alaniz, O.↗

A Secondary Control Framework for Microgrid Interoperability With Vendor-Agnostic Grid-Forming Units: Design, Implementation, and Demonstration via Large-Scale Hardware Setup

The reliable operation of islanded microgrids increasingly depends on secondary controls that restore voltage and frequency to nominal values and ensure accurate active and reactive power sharing. Centralized secondary control architectures achieve high accuracy through global coordination at the cost of single-point failures and limited scalability compared with decentralized/distributed approaches. But a critical gap remains in addressing the interoperability and vendor-agnostic operation of secondary controls in real-world microgrids where heterogeneous diesel generator(s) and grid-forming (GFM) inverter(s) from multiple manufacturers always coexist. Practical and vendor-agnostic interoperability guidelines for the secondary control architecture of microgrids with multiple GFM units have not yet been developed; therefore, this paper proposes an interoperable and vendor-agnostic secondary control framework that operates seamlessly across GFM units from different vendors without relying on proprietary controls and protocols, hardware, or lock-ins. The framework leverages existing communication infrastructures (e.g., Modbus TCP/IP) to enable cost-effective deployment while addressing practical challenges, such as packet loss and quantization errors. Mitigation strategies-including data averaging, situational event-triggered control, and finite-iteration execution-are introduced to enhance reliability under real-world conditions. A generalized modeling and design framework is also presented, supported by robustness analysis to demonstrate independence from vendor-specific implementations. The proposed framework is validated through a large-scale hardware demonstration using a 3-$\phi$, 480-V, 60-Hz, 713-kVA laboratory hardware microgrid involving a heterogeneous diesel generator and multiple GFM inverters, showcasing its effectiveness in achieving stable voltage and frequency restoration and accurate power sharing under practical constraints. The results highlight the framework's potential as a scalable and practical solution for next-generation microgrids requiring openness, standard framework, and interoperability.

24 POWER TRANSMISSION AND DISTRIBUTION↗

SSME Condition Monitoring Using Neural Networks and Plume Spectral Signatures

For a variety of reasons, condition monitoring of the Space Shuttle Main Engine (SSME) has become an important concern for both ground tests and in-flight operation. The complexities of the SSME suggest that active, real-time condition monitoring should be performed to avoid large-scale or catastrophic failure of the engine. In 1986, the SSME became the subject of a plume emission spectroscopy project at NASA's Marshall Space Flight Center (MSFC). Since then, plume emission spectroscopy has recorded many nominal tests and the qualitative spectral features of the SSME plume are now well established. Significant discoveries made with both wide-band and narrow-band plume emission spectroscopy systems led MSFC to develop the Optical Plume Anomaly Detection (OPAD) system. The OPAD system is designed to provide condition monitoring of the SSME during ground-level testing. The operational health of the engine is achieved through the acquisition of spectrally resolved plume emissions and the subsequent identification of abnormal emission levels in the plume indicative of engine erosion or component failure. Eventually, OPAD, or a derivative of the technology, could find its way on to an actual space vehicle and provide in-flight engine condition monitoring. This technology step, however, will require miniaturized hardware capable of processing plume spectral data in real-time. An objective of OPAD condition monitoring is to determine how much of an element is present in the SSME plume. The basic premise is that by knowing the element and its concentration, this could be related back to the health of components within the engine. For example, an abnormal amount of silver in the plume might signify increased wear or deterioration of a particular bearing in the engine. Once an anomaly is identified, the engine could be shut down before catastrophic failure occurs. Currently, element concentrations in the plume are determined iteratively with the help of a non-linear computer code called SPECTRA, developed at the USAF Arnold Engineering Development Center. Ostensibly, the code produces intensity versus wavelength plots (i.e., spectra) when inputs such as element concentrations, reaction temperature, and reaction pressure are provided. However, in order to provide a higher-level analysis, element concentration is not specified explicitly as an input. Instead, two quantum variables, number density and broadening parameter, are used. Past experience with OPAD data analysis has revealed that the region of primary interest in any SSME plume spectrum lies in the wavelength band of 3300 A to 4330 A. Experience has also revealed that some elements, such as iron, cobalt and nickel, cause multiple peaks over the chosen wavelength range whereas other elements (magnesium, for example) have a few, relatively isolated peaks in the chosen wavelength range. Iteration with SPECTRA as a part of OPAD data analysis is an incredibly labor intensive task and not one to be performed by hand. What is really needed is the "inverse" of the computer code but the mathematical model for the inverse mapping is tenuous at best. However, building generalized models based upon known input/output mappings while ignoring details of the governing physical model is possible using neural networks. Thus the objective of the research project described herein was to quickly and accurately predict combustion temperature and element concentrations (i.e., number density and broadening parameter) from a given spectrum using a neural network. In other words, a neural network had to be developed that would provide a generalized "inverse" of the computer code SPECTRA.

Hopkins, Randall↗

Development of biaxial test fixture includes cryogenic application

Test fixture has the capability of producing biaxial stress fields in test specimens to the point of failure. It determines biaxial stress by dividing the applied load by the net cross section. With modification it can evaluate materials, design concepts, and production hardware at cryogenic temperatures.

Helf, J. C.↗

Design and evaluation of a fault-tolerant multiprocessor using hardware recovery blocks

Attention is given to the design and evaluation of a fault-tolerant multiprocessor whose rollback recovery mechanism is based on hardware recovery blocks constructed by consecutive state-save operations and several state-save units in every processor and memory module. Upon detection of failure, the multiprocessor reconfigures itself to replace the faulty module and the process originally assigned to the faulty module retreats to one of the previously saved states, in order to resume fault-free execution. A mathematical model is proposed for the calculation of multistep rollback recovery coverage and the risk of restart when all available saved states are exhausted. The mean and the variance of task execution time with the occurrence of rollbacks and/or restarts are evaluated.

Lee, Y.-H.↗

Evaluate the application of modal test and analysis processes to structural fault detection in MSFC-STS project elements

The Space Transportation System (STS) is a very complex and expensive flight system which is intended to carry payloads into low Earth orbit and return. A catastrophic failure of the STS (such as experienced in the 51-L incident) results in the loss of both human life as well as very expensive hardware. One impact of this incident was to reaffirm the need to do everything possible to insure the integrity and reliability of the STS is sufficient to produce a safe flight. One means of achieving this goal is to expand the number of inspection technologies available for use on the STS. The purpose was to begin to evaluate the possible use of assessing the structural integrity of STS components for which Marshall Space Flight Center (MSFC) has responsibility. This entailed reviewing the available literature and determining a low-level experimental program which could be performed by MSFC and would help establish the feasibility of using this technology for structural fault detection.

Springer, William T.↗

On developing the local research environment of the 1990s - The Space Station era

A requirements analysis for the Space Station's polar platform data system has been performed. Based upon this analysis, a cluster, layered cluster, and layered-modular implementation of one specific module within the Eos Data and Information System (EosDIS), an active data base for satellite remote sensing research has been developed. It is found that a distributed system based on a layered-modular architecture and employing current generation work station technologies has the requisite attributes ascribed by the remote sensing research community. Although, based on benchmark testing, probabilistic analysis, failure analysis and user-survey technique analysis, it is found that this architecture presents some operational shortcomings that will not be alleviated with new hardware or software developments. Consequently, the potential of a fully-modular layered architectural design for meeting the needs of Eos researchers has also been evaluated, concluding that it would be well suited to the evolving requirements of this multidisciplinary research community.

Chase, Robert↗

Next Generation Wiring

Wiring is a major operational component on aerospace hardware that accounts for substantial weight and volumetric space. Over time wire insulation can age and fail, often leading to catastrophic events such as system failure or fire. The next generation of wiring must be reliable and sustainable over long periods of time. These features will be achieved by the development of a wire insulation capable of autonomous self-healing that mitigates failure before it reaches a catastrophic level. In order to develop a self-healing insulation material, three steps must occur. First, methods of bonding similar materials must be developed that are capable of being initiated autonomously. This process will lead to the development of a manual repair system for polyimide wire insulation. Second, ways to initiate these bonding methods that lead to materials that are similar to the primary insulation must be developed. Finally, steps one and two must be integrated to produce a material that has no residues from the process that degrades the insulating properties of the final repaired insulation. The self-healing technology, teamed with the ability to identify and locate damage, will greatly improve reliability and safety of electrical wiring of critical systems. This paper will address these topics, discuss the results of preliminary testing, and remaining development issues related to self-healing wire insulation.

Medelius, Petro↗

It’s Hip To Be Square - Refurbishment of the NASA Langley National Transonic Facility Test Section Plenum Door

The “nearside” plenum door (NPD) at the 39-year-old NASA Langley Research Center (LARC) National Transonic Facility (NTF) has become increasingly recalcitrant during the opening /closing sequence. The NPD is the primary means of entry into the test section for personnel and for model installation. The sliding NPD hardware guide bearings have failed three (3) times within a one-year period and “quick fixes” were able to be made to guide rails, wheels and bearings to put the NPD back into operation. The NPD no longer can utilize a “quick fix” as the rolling hardware is at its limit for further modifications. This presentation will describe the NPD situation, the findings as to the cause of the periodic NPD failures, and the solution to remove, refurbish, and reinstall the NPD.

Test Facilities↗