How requirements knowledge grows in built systems
Explore the source record for details and available documents.
requirements testing operations defect analysis↗
SEARCH · Engineering Papers
Results for “requirements testing operations defect analysis”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Resolving requirements discovery in testing and operations
This paper describes the results of an investigation into requirements discovery during testing and operations.
requirements discovery requirements evolution defe↗
Analysis and Optimization of Test Plans for Advanced Exploration Systems Reliability and Supportability
Future crewed exploration missions beyond Low Earth Orbit (LEO) will operate farther from Earth and be logistically isolated for longer than any previous human spaceflight mission. Under these conditions, supportability and reliability willbestronger drivers of mission mass and risk than they have been in the past. Items with high failure rates, or uncertain failure rates, can result in high spares mass requirements and/or high risk on deep space missions. Testing is a critical element of system development which provides the opportunity to identify and resolve design issues, defects, or other failure modes before they cause problems during a mission. Reliability growth programs can reduce failure rates by identifying and remove failure modes via design changes, and long-duration life testing can provide valuable data to reduce failure rate estimate uncertainty and verify (to some level of confidence) that components are as reliable as expected. Testing activities take time and resources, however, and must be incorporated into program plans in order to be fully effective. This paper presents an integrated reliability test plan analysis and optimization methodology, which has been used to inform Advanced Exploration Systems (AES) Life Support Systems (LSS) ground test planning for future missions. The methodology determines the optimal number of test units to purchase and allocation of test time –split between reliability growth and uncertainty reduction testing –across a given set of items in order to minimize spares mass for a given mission under constraints on total test cost and schedule. Model outputs also include expected spares mass after testing and the expected number of modifications or refurbishments during testing, both of which can inform program planning. Discussion of the model, conclusions, and future work are also presented.
Testing↗
Analysis and Optimization of Test Plans for Advanced Exploration Systems Reliability and Supportability
Future crewed exploration missions beyond Low Earth Orbit (LEO) will operate farther from Earth and be logistically isolated for longer than any previous human spaceflight mission. Under these conditions, supportability and reliability willbestronger drivers of mission mass and risk than they have been in the past. Items with high failure rates, or uncertain failure rates, can result in high spares mass requirements and/or high risk on deep space missions. Testing is a critical element of system development which provides the opportunity to identify and resolve design issues, defects, or other failure modes before they cause problems during a mission. Reliability growth programs can reduce failure rates by identifying and remove failure modes via design changes, and long-duration life testing can provide valuable data to reduce failure rate estimate uncertainty and verify (to some level of confidence) that components are as reliable as expected. Testing activities take time and resources, however, and must be incorporated into program plans in order to be fully effective. This paper presents an integrated reliability test plan analysis and optimization methodology, which has been used to inform Advanced Exploration Systems (AES) Life Support Systems (LSS) ground test planning for future missions. The methodology determines the optimal number of test units to purchase and allocation of test time –split between reliability growth and uncertainty reduction testing –across a given set of items in order to minimize spares mass for a given mission under constraints on total test cost and schedule. Model outputs also include expected spares mass after testing and the expected number of modifications or refurbishments during testing, both of which can inform program planning. Discussion of the model, conclusions, and future work are also presented.
Testing↗
Design of an Automated Ultrasonic Scanning System for In-Situ Composite Cure Monitoring and Defect Detection
The preliminary design and development of an automated ultrasonic scanning system for in-situ composite cure monitoring and defect detection in the high temperature environment of an oven was completed. This preliminary design is a stepping stone to deployment in the high temperature and high pressure environment of an autoclave, the primary cure method of aerospace grade thermoset composites. Cure monitoring with real-time defect detection during the process could determine when defects form and how they move. In addition, real-time defect detection during cure could assist validating physics-based process models for predicting defects at all stages of the cure cycle. A physics-based process model for predicting porosity and fiber waviness originating during cure is currently under development by the NASA Advanced Composites Project (ACP). For the design, an ultrasonic contact scanner is enclosed in an insulating box that is placed inside an oven during cure. Throughout the cure cycle, the box is nitrogen-cooled to approximately room temperature to maintain a standard operating environment for the scanner. The composite part is mounted on the outside of the box in a vacuum bag on the build/tool plate. The build plate is attached to the bottom surface of the box. The scanner inspects the composite panel through the build plate, tracking the movement of defects introduced during layup and searching for new defects that may form during cure. The focus of this paper is the evaluation and selection of the build plate material and thickness. The selection was based on the required operating temperature of the scanner, the cure temperature of the composite material, thermal conductivity models of the candidate build plates, and a series of ultrasonic attenuation tests. This analysis led to the determination that a 63.5 mm thick build plate of borosilicate glass would be utilized for the system. The borosilicate glass plate was selected as the build plate material due to the low ultrasonic attenuation it demonstrated, its ability to efficiently insulate the scanner while supporting an elevated temperature on the part side of the plate, and the availability of a 63.5 mm thick plate without the need for lamination.
Hudson, Tyler B.↗
A Risk Analysis Tool for Estimating the Risk of Electrical Failures Due to Human Induced Defects
Aerospace electrical systems are required to withstand and adequately operate in extremely harsh environments that include, for example, high radiation exposure, temperature extremes, intense vibrational stress and drastic temperature cycling. The nature of aerospace electronics also demands high reliability since, with very few exceptions, there is no chance for hardware servicing or repairs. Common risk mitigation techniques for this type of situation are to perform a Reliability Analysis of the system throughout the development cycle, and to use electrical components that are regarded as “high reliability” because of additional controls and requirements applied in their design, manufacturing and testing. Unfortunately, studies have shown that even though these techniques are used, many systems fail to meet mission requirements well before the predicted lifetimes. This paper presents the analysis of failures of electrical parts, experienced during various stages of system development, at NASA Goddard Space Flight Center, Greenbelt MD, between the years 2001 and 2013. These components were subjected to qualification, screening and testing in which the goal was to ensure that the components would survive the stresses of the mission. The analysis categorizes failures by part type and failure mechanisms. One of the results of the analysis was the realization that a surprising proportion of failures experienced during system integration and testing were caused by human error (i.e. human induced defect). Further analysis included the determination of root failure mechanisms and any influencing factors contributing to these failures. The major causes of these defects were attributed to electrostatic damage (ESD), electrical overstress (EOS), mechanical overstress (MOS), and thermal overstress (TOS). Finally, the study proposes a risk analysis tool which incorporates these major causes for the failures, termed error-producing conditions (EPCs), and a proportionality factor representing the number of each type of failure that has occurred at the facility under study. These factors are quantified and used to communicate the risk of human induced defects for the assembly, integration and testing of space hardware based on the system’s electrical parts list. The new risk identification can trigger risk-mitigating actions more effectively, based on the presence of component categories or other hazardous conditions that have a history of failure due to human error.
Majewicz, Peter J.↗
Advanced Image Processing for Defect Visualization in Infrared Thermography
Results of a defect visualization process based on pulse infrared thermography are presented. Algorithms have been developed to reduce the amount of operator participation required in the process of interpreting thermographic images. The algorithms determine the defect's depth and size from the temporal and spatial thermal distributions that exist on the surface of the investigated object following thermal excitation. A comparison of the results from thermal contrast, time derivative, and phase analysis methods for defect visualization are presented. These comparisons are based on three dimensional simulations of a test case representing a plate with multiple delaminations. Comparisons are also based on experimental data obtained from a specimen with flat bottom holes and a composite panel with delaminations.
Plotnikov, Yuri A.↗
Topic Modeling of NASA Space System Problem Reports: Research in Practice
Problem reports at NASA are similar to bug reports: they capture defects found during test, post-launch operational anomalies, and document the investigation and corrective action of the issue. These artifacts are a rich source of lessons learned for NASA, but are expensive to analyze since problem reports are comprised primarily of natural language text. We apply topic modeling to a corpus of NASA problem reports to extract trends in testing and operational failures. We collected 16,669 problem reports from six NASA space flight missions and applied Latent Dirichlet Allocation topic modeling to the document corpus. We analyze the most popular topics within and across missions, and how popular topics changed over the lifetime of a mission. We find that hardware material and flight software issues are common during the integration and testing phase, while ground station software and equipment issues are more common during the operations phase. We identify a number of challenges in topic modeling for trend analysis: 1) that the process of selecting the topic modeling parameters lacks definitive guidance, 2) defining semantically-meaningful topic labels requires nontrivial effort and domain expertise, 3) topic models derived from the combined corpus of the six missions were biased toward the larger missions, and 4) topics must be semantically distinct as well as cohesive to be useful. Nonetheless,topic modeling can identify problem themes within missions and across mission lifetimes, providing useful feedback to engineers and project managers.
Data Mining↗
Vibration detection of component operability
In order to prevent catastrophic failure and eliminate unnecessary periodic maintenance in the Space Shuttle Orbiter dynamic components, instrumentation for detecting incipient failure in these components is required. This study investigated the utilization of vibrational phenomena as one of the principal physical parameters on which to base the design of this instrumentation. Baseline vibration data was collected from three aircraft type fans and two aircraft type pumps over a frequency range from a few Hertz to greater than 300 kHz. The baseline data included spectrum analysis of the vibration and detected carrier signals, as well as several non-spectrum parameters. Several defects were introduced into the five test items, and all defects were detected by at least one of the parameters with a margin of at least 2:1 over the worst case baseline.
Baird, B.↗
Ground Processing Affordability for Space Vehicles
Launch vehicles and most of their payloads spend the majority of their time on the ground. The cost of ground operations is very high. So, why so often is so little attention given to ground processing during development? The current global space industry and economic environment are driving more need for efficiencies to save time and money. Affordability and sustainability are more important now than ever. We can not continue to treat space vehicles as mere science projects. More RLV's (Reusable Launch Vehicles) are being developed for the gains of reusability which are not available for ELV's (Expendable Launch Vehicles). More human-rated vehicles are being developed, with the retirement of the Space Shuttles, and for a new global space race, yet these cost more than the many unmanned vehicles of today. We can learn many lessons on affordability from RLV's. DFO (Design for Operations) considers ground operations during design, development, and manufacturing-before the first flight. This is often minimized for space vehicles, but is very important. Vehicles are designed for launch and mission operations. You will not be able to do it again if it is too slow or costly to get there. Many times, technology changes faster than space products such that what is launched includes outdated features, thus reducing competitiveness. Ground operations must be considered for the full product Lifecycle, from concept to retirement. Once manufactured, launch vehicles along with their payloads and launch systems require a long path of processing before launch. Initial assembly and testing always discover problems to address. A solid integration program is essential to minimize these impacts, as was seen in the Constellation Ares I-X test rocket. For RLV's, landing/recovery and post-flight turnaround activities are performed. Multi-use vehicles require reconfiguration. MRO (Maintenance, Repair, and Overhaul) must be well-planned--- even for the unplanned problems. Defect limits and standard repairs need to be in-place as well as easily added. Many routine inspections and maintenance can be like an aircraft overhaul. Modifications and technology upgrades should be expected. Another factor affecting ground operations efficiency is trending. It is essential for RLV's, and also useful for ELV's which fly the same or similar models again. Good data analysis of technical and processing performance will determine fixes and improvements needed for safety, design, and future processing. Collecting such data on new or low-frequency vehicles is a challenge. Lessons can be learned from the Space Shuttle, or even the Concorde aircraft. For all of the above topics, efficient business systems must be established for comprehensive program management and good throughput. Drawings, specifications, and manuals for an entire launch vehicle are often in different formats from multiple vendors, plus they have proprietary constraints. Nonetheless, the integration team must ensure that all data needed is compatible and visible to each appropriate team member. Ground processing systems for scheduling, tracking, problem resolution, etc. must be well laid-out. The balance between COTS (commercial off the shelf) and custom software is difficult. Multiple customers, vendors, launch sites, and landing sites add to the complexity of efficient IT (Information Technology) tools.
Ingalls, John↗
Develop advanced nonlinear signal analysis topographical mapping system
The SSME has been undergoing extensive flight certification and developmental testing, which involves some 250 health monitoring measurements. Under the severe temperature pressure, and dynamic environments sustained during operation, numerous major component failures have occurred, resulting in extensive engine hardware damage and scheduling losses. To enhance SSME safety and reliability, detailed analysis and evaluation of the measurements signal are mandatory to assess its dynamic characteristics and operational condition. Efficient and reliable signal detection techniques will reduce catastrophic system failure risks and expedite the evaluation of both flight and ground test data, and thereby reduce launch turn-around time. The basic objective of this contract are threefold: (1) Develop and validate a hierarchy of innovative signal analysis techniques for nonlinear and nonstationary time-frequency analysis. Performance evaluation will be carried out through detailed analysis of extensive SSME static firing and flight data. These techniques will be incorporated into a fully automated system. (2) Develop an advanced nonlinear signal analysis topographical mapping system (ATMS) to generate a Compressed SSME TOPO Data Base (CSTDB). This ATMS system will convert tremendous amounts of complex vibration signals from the entire SSME test history into a bank of succinct image-like patterns while retaining all respective phase information. A high compression ratio can be achieved to allow the minimal storage requirement, while providing fast signature retrieval, pattern comparison, and identification capabilities. (3) Integrate the nonlinear correlation techniques into the CSTDB data base with compatible TOPO input data format. Such integrated ATMS system will provide the large test archives necessary for a quick signature comparison. This study will provide timely assessment of SSME component operational status, identify probable causes of malfunction, and indicate feasible engineering solutions. The final result of this program will yield an ATMS system of nonlinear and nonstationary spectral analysis software package integrated with the Compressed SSME TOPO Data Base (CSTDB) on the same platform. This system will allow NASA engineers to retrieve any unique defect signatures and trends associated with different failure modes and anomalous phenomena over the entire SSME test history across turbo pump families.
Jong, Jen-Yi↗
Develop advanced nonlinear signal analysis topographical mapping system
The Space Shuttle Main Engine (SSME) has been undergoing extensive flight certification and developmental testing, which involves some 250 health monitoring measurements. Under the severe temperature, pressure, and dynamic environments sustained during operation, numerous major component failures have occurred, resulting in extensive engine hardware damage and scheduling losses. To enhance SSME safety and reliability, detailed analysis and evaluation of the measurements signal are mandatory to assess its dynamic characteristics and operational condition. Efficient and reliable signal detection techniques will reduce catastrophic system failure risks and expedite the evaluation of both flight and ground test data, and thereby reduce launch turn-around time. The basic objective of this contract are threefold: (1) develop and validate a hierarchy of innovative signal analysis techniques for nonlinear and nonstationary time-frequency analysis. Performance evaluation will be carried out through detailed analysis of extensive SSME static firing and flight data. These techniques will be incorporated into a fully automated system; (2) develop an advanced nonlinear signal analysis topographical mapping system (ATMS) to generate a Compressed SSME TOPO Data Base (CSTDB). This ATMS system will convert tremendous amount of complex vibration signals from the entire SSME test history into a bank of succinct image-like patterns while retaining all respective phase information. High compression ratio can be achieved to allow minimal storage requirement, while providing fast signature retrieval, pattern comparison, and identification capabilities; and (3) integrate the nonlinear correlation techniques into the CSTDB data base with compatible TOPO input data format. Such integrated ATMS system will provide the large test archives necessary for quick signature comparison. This study will provide timely assessment of SSME component operational status, identify probable causes of malfunction, and indicate feasible engineering solutions. The final result of this program will yield an ATMS system of nonlinear and nonstationary spectral analysis software package integrated with the Compressed SSME TOPO Data Base (CSTDB) on the same platform. This system will allow NASA engineers to retrieve any unique defect signatures and trends associated with different failure modes and anomalous phenomena over the entire SSME test history across turbo pump families.
Source record↗
Vibration detection of component health and operability
In order to prevent catastrophic failure and eliminate unnecessary periodic maintenance in the shuttle orbiter program environmental control system components, some means of detecting incipient failure in these components is required. The utilization was investigated of vibrational/acoustic phenomena as one of the principal physical parameters on which to base the design of this instrumentation. Baseline vibration/acoustic data was collected from three aircraft type fans and two aircraft type pumps over a frequency range from a few hertz to greater than 3000 kHz. The baseline data included spectrum analysis of the baseband vibration signal, spectrum analysis of the detected high frequency bandpass acoustic signal, and amplitude distribution of the high frequency bandpass acoustic signal. A total of eight bearing defects and two unbalancings was introduced into the five test items. All defects were detected by at least one of a set of vibration/acoustic parameters with a margin of at least 2:1 over the worst case baseline. The design of a portable instrument using this set of vibration/acoustic parameters for detecting incipient failures in environmental control system components is described.
Baird, B. C.↗
Furnace Cyclic Oxidation Behavior of Multi-Component Low Conductivity Thermal Barrier Coatings
Ceramic thermal barrier coatings will play an increasingly important role in advanced gas turbine engines because of their ability to further increase engine operating temperatures and reduce cooling, thus helping achieve future engine low emission, high efficiency and improved reliability goals. Advanced multi-component zirconia-based thermal barrier coatings are being developed using an oxide defect clustering design approach to achieve the required coating low thermal conductivity and high temperature stability. Although the new composition coatings were not yet optimized for cyclic durability, an initial durability screening of the candidate coating materials was conducted using conventional furnace cyclic oxidation tests. In this paper, furnace cyclic oxidation behavior of plasma-sprayed zirconia-based defect cluster thermal barrier coatings was investigated at 1163 C using 45 min hot cycles. The ceramic coating failure mechanisms were studied using scanning electron microscopy (SEM) combined with X-ray diffraction (XRD) phase analysis after the furnace tests. The coating cyclic lifetime is also discussed in relation to coating processing, phase structures, dopant concentration, and other thermo-physical properties.
Zhu, Dong-Ming↗
Evaluation of Case Size 0603 BME Ceramic Capacitors
High volumetric efficiency of commercial base metal electrode (BME) ceramic capacitors allows for a substantial reduction of weight and sizes of the parts compared to currently used military grade precious metal electrode (PME) capacitors. Insertion of BME capacitors in space applications requires a thorough analysis of their performance and reliability. In this work, six types of cases size 0603 BME capacitors from three vendors have been evaluated. Three types of multilayer ceramic capacitors (MLCCs) were designed for automotive industry and three types for general purposes. Leakage currents in the capacitors have been measured in a wide range of voltages and temperatures, and measurements of breakdown voltages (VBR) have been used to assess the proportion and severity of defects in the parts. The effect of soldering-related thermal shock stresses was evaluated by analysis of distributions of VBR for parts in 'as is' condition and after terminal solder dip testing at 350 C. Highly Accelerated Life Testing (HALT) at different temperatures was used to assess the activation energy of degradation of leakage currents and predict behavior of the parts at life test and normal operating conditions. To address issues related to rework and manual soldering, capacitors were soldered onto different substrates at different soldering conditions. The results show that contrary to a common assumption that large-size capacitors are mostly vulnerable to soldering stresses, cracking in small size capacitors does happen unless special measures are taken during assembly processes.
testing↗
Presound: UAV Diagnostic System Enabled by Vibration-Based Machine Learning
A low-weight, inexpensive small unmanned aerial system (sUAS) that takes off, performs a mission, lands, and safely stows and recharges itself has myriad future applications ranging from agricultural imaging to last-mile package delivery. Likewise, Urban Air Mobility (UAM) systems will enable people to take air taxis from point to point in cities, rapidly moving commuters long distances without concern for road traffic and congestion. Fully electric aviation systems will be cleaner and quieter than ground transport. Cities could eliminate cars and buses, and convert roads to higher capacity bike and pedestrian throughways. Yet, for sUAS as well as UAM, system reliability and assurance is a limiting factor to deploying affordable autonomous flight systems. For this bright future of aviation to be realized, aircraft must be able to autonomously and accurately self-diagnose health issues both before takeoff and during flight. The GreenSight PreSound system is designed to identify defects on aircraft through intelligent analysis of vibration. It accomplishes this by measuring structural vibrations induced by the vehicle’s own propellers, and analyzing that data using a machine learning model that determines whether a defect is present. The PreSound system is designed to require no human oversight, and to operate across a wide array of vehicles through re-training of the model for each target aircraft. PreSound has been developed and seen limited early success using data collected from the GreenSight Dreamer sUAS, a 5lb quadrotor vehicle designed for aerial imaging applications. The final detection model, trained on data with props spinning at 50% throttle, achieves excellent performance with over 99% average accuracy in detecting blade damage using a single FFT vector input. It demonstrates the ability to generalize to new types of blade damage, correctly classifying a different type of blade damage with 98% accuracy. Full test pulses were classified with 100% accuracy, and in live testing, all sets of data during blade movement were classified accurately with over 95% confidence. When trained on in-flight data, the same model achieves an average accuracy of 85% in distinguishing between undamaged and blade-damaged states in flight. The authors believe that these accuracies show significant potential of this approach to expand unmanned flight safety, with significant potential benefits in accelerating Advanced Aerial Mobility (AAM) and UAM aviation applications.
UAS↗
Solving Upwind-Biased Discretizations: Defect-Correction Iterations
This paper considers defect-correction solvers for a second order upwind-biased discretization of the 2D convection equation. The following important features are reported: (1) The asymptotic convergence rate is about 0.5 per defect-correction iteration. (2) If the operators involved in defect-correction iterations have different approximation order, then the initial convergence rates may be very slow. The number of iterations required to get into the asymptotic convergence regime might grow on fine grids as a negative power of h. In the case of a second order target operator and a first order driver operator, this number of iterations is roughly proportional to h-1/3. (3) If both the operators have the second approximation order, the defect-correction solver demonstrates the asymptotic convergence rate after three iterations at most. The same three iterations are required to converge algebraic error below the truncation error level. A novel comprehensive half-space Fourier mode analysis (which, by the way, can take into account the influence of discretized outflow boundary conditions as well) for the defect-correction method is developed. This analysis explains many phenomena observed in solving non-elliptic equations and provides a close prediction of the actual solution behavior. It predicts the convergence rate for each iteration and the asymptotic convergence rate. As a result of this analysis, a new very efficient adaptive multigrid algorithm solving the discrete problem to within a given accuracy is proposed. Numerical simulations confirm the accuracy of the analysis and the efficiency of the proposed algorithm. The results of the numerical tests are reported.
Diskin, Boris↗
Exploration Extra-Vehicular Mobility Unit (xEMU) Composite Hard Upper Torso (CHUT) Development
The xEMU is the Exploration Mobility Unity or space suit designed for microgravity (cislunar and low earth orbit (LEO)) and lunar surface operations. This suit design allows crewmembers to perform extravehicular exploration, science, construction, maintenance, and contingency operations while unattached to a vehicle for life support in pressure and thermal environments that exceed human capability. The xEMU provides life support, environmental protection, and communications capabilities to the EVA crewmember while allowing sufficient mobility and visibility to perform dexterous EVA tasks. The effort documented in this paper, addressed the design, analysis, manufacturing, full-scale test article testing and validation for a Composite Hard Upper Torso(CHUT)unit. Design and analysis of the CHUT was based on measured B-basis properties of the selected S-glass/epoxy composite, and established final geometry, composite layup and interface details that met requirements. A complete manufacturing and assembly protocol was established for the CHUT starting from composite layup in the tool, to final assembly of all interface metal hardware prior to delivery to NASA for suit integration. Full-scale CHUT test articles underwent static and fatigue pressure testing (2 lifetimes), impact testing at critical stress locations for tool drop/microgravity scenarios, followed by post-impact fatigue testing. Effect of manufacturing defects was evaluated by manufacturing a full-scale CHUT with 0.375”/0.5” defects at critical stress locations, followed by static and life-cycle fatigue testing. In all cases, the CHUT design met or exceeded mass, structural, interface and functional requirements. Two (2) complete CHUT articles were delivered to NASA for full-scale suit integration and testing.
spacesuit↗