Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Reliability assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

Flight control electronics reliability/maintenance study

Collection and analysis of data are reported that concern the reliability and maintenance experience of flight control system electronics currently in use on passenger carrying jet aircraft. Two airlines B-747 airplane fleets were analyzed to assess the component reliability, system functional reliability, and achieved availability of the CAT II configuration flight control system. Also assessed were the costs generated by this system in the categories of spare equipment, schedule irregularity, and line and shop maintenance. The results indicate that although there is a marked difference in the geographic location and route pattern between the airlines studied, there is a close similarity in the reliability and the maintenance costs associated with the flight control electronics.

Dade, W. W.↗

Reliability of Digital Communications in Nuclear Facilities and Operations

A comprehensive evaluation of methods to compare the reliability of wired and wireless digital communication networks for use in nuclear power plants. The study underscores the critical role of communication reliability in ensuring operational safety in nuclear power plants. Key objectives include developing a methodology to assess communication technologies’ reliability, particularly for comparing wireless and wired networks, for nuclear facility applications. The framework focuses on technology-agnostic evaluations and emphasizes the importance of reliability metrics spanning safety, security, and monitoring functions. The framework emphasizes that the key performance indicators are application dependent and provides a hierarchy of different network types that will have different reliability requirements. The report considers both existing plants and advanced reactors, including small modular reactors.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Wafer level reliability for high-performance VLSI design

As very large scale integration architecture requires higher package density, reliability of these devices has approached a critical level. Previous processing techniques allowed a large window for varying reliability. However, as scaling and higher current densities push reliability to its limit, tighter control and instant feedback becomes critical. Several test structures developed to monitor reliability at the wafer level are described. For example, a test structure was developed to monitor metal integrity in seconds as opposed to weeks or months for conventional testing. Another structure monitors mobile ion contamination at critical steps in the process. Thus the reliability jeopardy can be assessed during fabrication preventing defective devices from ever being placed in the field. Most importantly, the reliability can be assessed on each wafer as opposed to an occasional sample.

Root, Bryan J.↗

Estimating Software Reliability for Space Launch Vehicles in Probabilistic Risk Assessment (PRA)

It is acutely recognized in the Probabilistic Risk assessment (PRA) field that software plays a defining role in overall system reliability for all modern systems across a wide variety of industries. Regardless if the software is embedded firmware for working components or elements, part of a Human-Machine-Interface, or automated command and control logic, the success of the software to fulfill its function under nominal and off-nominal environments will be a dominant contributor to system reliability. It is also recognized that software reliability prediction and estimation is one of the more challenging and questionable aspects of any PRA or system analyses due to the nature of software and its integration with physics based systems. Irrespective of this dichotomy, any incorporation of software reliability methods requires that the contributions are accountable, quantitative, and tractable. This paper provides a brief overview of software reliability methods, establishes some minimum requirements that the methods should incorporate for completeness, and provides a logic structure for applying software reliability. Model resolution will be discussed that supports current testing plans and trade studies. We will provide initial recommendations for use in the NASA PRA and present a future dynamic option for software and PRA. Space Launch Vehicle Software is recognized to be reliable in static conditions, yet relatively vulnerable to a set of failure modes in changing environments/flight phases. Two quantitative methods were chosen to incorporate software reliability into a Space Launch Vehicle PRA accounting for phase adjustments. One method predicts latent software failure using statistical methods, and the second provides estimates of coding errors and software operating system failures based on test and historical data, respectively. Software uncertainty will also be discussed. We determined that recommendations for PRA software reliability should be modeled at the software module level where multiple software components compose a module and combinations of the software architecture can lead to a functional failure.

Novack, Steven↗

Estimating Software Reliability for Space Launch Vehicles in Probabilistic Risk Assessment (PRA)

It is acutely recognized in the Probabilistic Risk Assessment (PRA) field that software plays a defining role in overall system reliability for all modern systems across a wide variety of industries. Regardless of whether the software is embedded firmware for working components or elements, part of a Human-Machine-Interface, or automated command and control logic, the success of the software to fulfill its function under nominal and off-nominal environments will be a dominant contributor to system reliability. It is also recognized that software reliability prediction and estimation is one of the more challenging and questionable aspects of any PRA or system analyses due to the nature of software and its integration with physics based systems. Irrespective of this dichotomy, any incorporation of software reliability methods requires that the contributions are accountable, quantitative, and tractable. This paper provides a brief overview of software reliability methods, establishes some minimum requirements that the methods should incorporate for completeness, and provides a logic structure for applying software reliability. Model resolution will be discussed that supports current testing plans and trade studies. We will provide initial recommendations for use in the National Aeronautics and Space Administration (NASA) PRA and present a future dynamic option for software and PRA. Space Launch Vehicle software is recognized to be reliable in static conditions, yet relatively vulnerable to a set of failure modes in changing environments/flight phases. Two quantitative methods were chosen to incorporate software reliability into a Space Launch Vehicle PRA accounting for phase adjustments. One method predicts latent software failure using statistical methods, and the second provides estimates of coding errors and software operating system failures based on test and historical data. Software uncertainty will also be discussed. It is determined that recommendations for PRA software reliability should be modeled at the software module level where multiple software components compose a module and combinations of the software architecture can lead to a functional failure.

Steven D. Novack↗

The importance of thermal-vacuum testing in achieving high reliability of spacecraft mechanisms

The work performed on thermal vacuum testing of complex mechanisms is described. The objective of these tests is to assess the mechanism reliability by monitoring performance in an environment that closely resembles the environment that will occur during flight. To be both valid and cost effective, these tests are performed in a detailed, formally controlled manner. A review of the major test observations is given, during which time some failure modes are detected. Full confidence now exists in many mechanism and component designs, and much valuable data obtained.

Parker, K.↗

Failure environment analysis tool applications

Understanding risks and avoiding failure are daily concerns for the women and men of NASA. Although NASA's mission propels us to push the limits of technology, and though the risks are considerable, the NASA community has instilled within, the determination to preserve the integrity of the systems upon which our mission and, our employees lives and well-being depend. One of the ways this is being done is by expanding and improving the tools used to perform risk assessment. The Failure Environment Analysis Tool (FEAT) was developed to help engineers and analysts more thoroughly and reliably conduct risk assessment and failure analysis. FEAT accomplishes this by providing answers to questions regarding what might have caused a particular failure; or, conversely, what effect the occurrence of a failure might have on an entire system. Additionally, FEAT can determine what common causes could have resulted in other combinations of failures. FEAT will even help determine the vulnerability of a system to failures, in light of reduced capability. FEAT also is useful in training personnel who must develop an understanding of particular systems. FEAT facilitates training on system behavior, by providing an automated environment in which to conduct 'what-if' evaluation. These types of analyses make FEAT a valuable tool for engineers and operations personnel in the design, analysis, and operation of NASA space systems.

Pack, Ginger L.↗

Failure environment analysis tool applications

Understanding risks and avoiding failure are daily concerns for the women and men of NASA. Although NASA's mission propels us to push the limits of technology, and though the risks are considerable, the NASA community has instilled within it, the determination to preserve the integrity of the systems upon which our mission and, our employees lives and well-being depend. One of the ways this is being done is by expanding and improving the tools used to perform risk assessment. The Failure Environment Analysis Tool (FEAT) was developed to help engineers and analysts more thoroughly and reliably conduct risk assessment and failure analysis. FEAT accomplishes this by providing answers to questions regarding what might have caused a particular failure; or, conversely, what effect the occurrence of a failure might have on an entire system. Additionally, FEAT can determine what common causes could have resulted in other combinations of failures. FEAT will even help determine the vulnerability of a system to failures, in light of reduced capability. FEAT also is useful in training personnel who must develop an understanding of particular systems. FEAT facilitates training on system behavior, by providing an automated environment in which to conduct 'what-if' evaluation. These types of analyses make FEAT a valuable tool for engineers and operations personnel in the design, analysis, and operation of NASA space systems.

Pack, Ginger L.↗

Probability of Failure and Risk Assessment of Propulsion Structural Components

Due to increasing need to account for the uncertainties in material properties, loading conditions, or geometries, a methodology was developed to determine structural reliability and the assess the risk associated with it. The methodology consists of a probabilistic structural analysis by a probabilistic finite element computer code Nonlinear Evaluation of Stochastic Structures Under Stress (NESSUS) and a generic probabilistic material properties model. The methodology is versatile and is equally applicable to high and cryogenic temperature structures. Results obtained demonstrate that the whole issue of structural reliability and risk can be formally evaluated using the methodology developed which is inclusive of uncertainties in material properties, structural parameters and loading conditions. The methodology is described in some detail with illustrative examples.

Shiao, Michael C.↗

A Methodology for Quantifying Certain Design Requirements During the Design Phase

A methodology for developing and balancing quantitative design requirements for safety, reliability, and maintainability has been proposed. Conceived as the basis of a more rational approach to the design of spacecraft, the methodology would also be applicable to the design of automobiles, washing machines, television receivers, or almost any other commercial product. Heretofore, it has been common practice to start by determining the requirements for reliability of elements of a spacecraft or other system to ensure a given design life for the system. Next, safety requirements are determined by assessing the total reliability of the system and adding redundant components and subsystems necessary to attain safety goals. As thus described, common practice leaves the maintainability burden to fall to chance; therefore, there is no control of recurring costs or of the responsiveness of the system. The means that have been used in assessing maintainability have been oriented toward determining the logistical sparing of components so that the components are available when needed. The process established for developing and balancing quantitative requirements for safety (S), reliability (R), and maintainability (M) derives and integrates NASA s top-level safety requirements and the controls needed to obtain program key objectives for safety and recurring cost (see figure). Being quantitative, the process conveniently uses common mathematical models. Even though the process is shown as being worked from the top down, it can also be worked from the bottom up. This process uses three math models: (1) the binomial distribution (greaterthan- or-equal-to case), (2) reliability for a series system, and (3) the Poisson distribution (less-than-or-equal-to case). The zero-fail case for the binomial distribution approximates the commonly known exponential distribution or "constant failure rate" distribution. Either model can be used. The binomial distribution was selected for modeling flexibility because it conveniently addresses both the zero-fail and failure cases. The failure case is typically used for unmanned spacecraft as with missiles.

Adams, Timothy↗

Probability of failure and risk assessment of propulsion structural components

Because of the increasing need to account for the uncertainties in material properties, loading conditions, geometry, etc., a methodology was developed to determine structural reliability and to assess the associated risk. The methodology consists of a probabilistic structural analysis by a probabilistic finite element computer code, numerical evaluation of stochastic structures under stress (NESSUS), and a generic probabilistic material property model. The methodology is versatile and is equally applicable to structures operating at high and cryogenic temperature environments. Results obtained demonstrate that the issues of structural reliability and risk can be formally evaluated by using the methodology developed which is inclusive of the uncertainties in material properties, structural parameters, and loading conditions. The methodology is described in some detail with illustrative examples.

Shiao, Michael C.↗

Meta-uncertainty for particle image velocimetry

Uncertainty quantification for Particle Image Velocimetry (PIV) is critical for comparing experimentally measured flow fields with Computational Fluid Dynamics (CFD) results, and model design and validation. However, PIV features a complex measurement chain with coupled, non-linear error sources, and quantifying the uncertainty is challenging. Multiple assessments show that none of the current methods can reliably measure the actual uncertainty across a wide range of experiments, and estimates can vary. Because the current methods differ in assumptions regarding the measurement process and calculation procedures, it is not clear which method is best to use for an experiment where the error distribution is unknown. To address this issue, we propose a method to estimate an uncertainty method's sensitivity and reliability, termed the Meta-Uncertainty. The novel approach is automated, local, and instantaneous, and based on perturbation of the recorded particle images. We developed an image perturbation scheme based on adding random unmatched particles to the interrogation window pair considering the signal-to-noise (SNR) of the correlation plane. Each uncertainty scheme's response to several trials of random particle addition is used to estimate a reliability metric, defined as the rate of change of the inter-quartile range (IQR) of the uncertainties with increasing levels of particle addition. We also propose applying the meta-uncertainty as a weighting metric to combine uncertainty estimates from individual schemes, based on ideas from the consensus forecasting literature. We use planar and stereo PIV measurements across a range of canonical flows to assess the performance of the uncertainty schemes. Further, a novel method is introduced to assess an uncertainty scheme's performance based on a quantile comparison of the error and uncertainty distributions, generalizing the current method of comparing the RMS of the two distributions. Here, the results show that the combined uncertainty method outperforms the individual methods, and this work establishes the meta-uncertainty as a useful reliability assessment tool for PIV uncertainty quantification.

47 OTHER INSTRUMENTATION↗

Probabilistic structural analysis methodology and applications to advanced space propulsion system components

The goal of the reported work is to develop and apply new technology that will enable the designer to efficiently and accurately account for each of the design sources of uncertainty as it might affect structural reliability and risk assessment. The paper discusses the development of the Numerical Evaluation of Stochastic Structures Under Stress (NESSUS) finite element code and its supporting reliability algorithms. The NESSUS code and the elements of the solution strategy are outlined and applications are made to several propulsion system components.

Cruse, T. A.↗

Estimates Of The Orbiter RSI Thermal Protection System Thermal Reliability

In support of the Space Shuttle Orbiter post-flight inspection, structure temperatures are recorded at selected positions on the windward, leeward, starboard and port surfaces. Statistical analysis of this flight data and a non-dimensional load interference (NDLI) method are used to estimate the thermal reliability at positions were reusable surface insulation (RSI) is installed. In this analysis, structure temperatures that exceed the design limit define the critical failure mode. At thirty-three positions the RSI thermal reliability is greater than 0.999999 for the missions studied. This is not the overall system level reliability of the thermal protection system installed on an Orbiter. The results from two Orbiters, OV-102 and OV-105, are in good agreement. The original RSI designs on the OV-102 Orbital Maneuvering System pods, which had low reliability, were significantly improved on OV-105. The NDLI method was also used to estimate thermal reliability from an assessment of TPS uncertainties that was completed shortly before the first Orbiter flight. Results fiom the flight data analysis and the pre-flight assessment agree at several positions near each other. The NDLI method is also effective for optimizing RSI designs to provide uniform thermal reliability on the acreage surface of reusable launch vehicles.

Kolodziej, P.↗

Reliability, stability during long-term storage, and intra-individual variation of circulating levels of osteopontin, osteoprotegerin, vascular endothelial growth factor-A, and interleukin-17A

Background: Studies in many populations have reported associations between circulating cytokine levels and various physiological or pathological conditions. However, the reliability of cytokine measurements in population studies, which measure cytokines in multiple assays over a prolonged period, has not been adequately examined; nor has stability during sample storage or intra-individual variation been assessed. Methods: We assessed (1) analytical reliability in short- and long-term repeated measurements; (2) stability and analytical reliability during long-term sample storage, and (3) variability within individuals over seasons, of four cytokines—osteopontin (OPN), osteoprotegerin (OPG), vascular endothelial growth factor-A (VEGF-A), and interleukin-17A (IL-17A). Measurements in plasma or serum samples were made with commercial kits according to standard procedures. Estimation was performed by fitting a random or mixed effects linear model on the log scale. Results: In repeated assays over a short period, OPN, OPG, and VEGF-A had acceptable reliability, with intra- and inter-assay coefficients of variation (CV) less than 0.11. Reliability of IL-17A was poor, with inter- and intra-assay CV 0.85 and 0.43, respectively. During long-term storage, OPG significantly decayed (-33% per year; 95% confidence interval [-54, -3.7]), but not OPN or VEGF-A (-0.3% or -6.3% per year, respectively). Intra- and inter-assay CV over a long period were comparable to that in a short period except for a slight increase in inter-assay CV of VEGF-A. Within-individual variation was small for OPN and VEGF-A, with intra-class correlations (ICC) 0.68 and 0.83, respectively, but large for OPG (ICC 0.11). Conclusions: We conclude that OPN and VEGF-A can be reliably measured in a large population, that IL-17A is suitable only for small experiments, and that OPG should be assessed with caution due to degradation during storage and intra-individual variation. The overall results of our study illustrate the need for validation under relevant conditions when measuring circulating cytokines in population studies.

60 APPLIED LIFE SCIENCES↗

Assessment of Extremes in Global Precipitation Products: How Reliable Are They?

Global gridded precipitation products have proven essential for many applications ranging from hydrological modeling and climate model validation to natural hazard risk assessment. They provide a global picture of how precipitation varies across time and space, specifically in regions where ground-based observations are scarce. While the application of global precipitation products has become widespread, there is limited knowledge on how well these products represent the magnitude and frequency of extreme precipitation—the key features in triggering flood hazards. Here, five global precipitation datasets (MSWEP, CFSR, CPC, PERSIANN-CDR, and WFDEI) are compared to each other and to surface observations. The spatial variability of relatively high precipitation events (tail heaviness) and the resulting discrepancy among datasets in the predicted precipitation return levels were evaluated for the time period 1979–2017. The analysis shows that 1) these products do not provide a consistent representation of the behavior of extremes as quantified by the tail heaviness, 2) there is strong spatial variability in the tail index, 3) the spatial patterns of the tail heaviness generally match the Köppen–Geiger climate classification, and 4) the predicted return levels for 100 and 1000 years differ significantly among the gridded products. More generally, our findings reveal shortcomings of global precipitation products in representing extremes and highlight that there is no single global product that performs best for all regions and climates.

Risk assessment↗

Uncertainties in obtaining high reliability from stress-strength models

There has been a recent interest in determining high statistical reliability in risk assessment of aircraft components. The potential consequences are identified of incorrectly assuming a particular statistical distribution for stress or strength data used in obtaining the high reliability values. The computation of the reliability is defined as the probability of the strength being greater than the stress over the range of stress values. This method is often referred to as the stress-strength model. A sensitivity analysis was performed involving a comparison of reliability results in order to evaluate the effects of assuming specific statistical distributions. Both known population distributions, and those that differed slightly from the known, were considered. Results showed substantial differences in reliability estimates even for almost nondetectable differences in the assumed distributions. These differences represent a potential problem in using the stress-strength model for high reliability computations, since in practice it is impossible to ever know the exact (population) distribution. An alternative reliability computation procedure is examined involving determination of a lower bound on the reliability values using extreme value distributions. This procedure reduces the possibility of obtaining nonconservative reliability estimates. Results indicated the method can provide conservative bounds when computing high reliability. An alternative reliability computation procedure is examined involving determination of a lower bound on the reliability values using extreme value distributions. This procedure reduces the possibility of obtaining nonconservative reliability estimates. Results indicated the method can provide conservative bounds when computing high reliability.

Neal, Donald M.↗

Assessing the Heat Transfer Modeling Capabilities of CFD Software for Involute-Shaped Plate Research Reactors

The ongoing efforts to convert High-Performance Research Reactors (HPRRs) using Highly Enriched Uranium (HEU) to Low-Enriched Uranium (LEU) fuel require reliable thermal–hydraulic assessments of modified core designs. The involute-shaped fuel plates used in several major HPRRs present unique modeling challenges due to their compact core geometries and high heat flux conditions. This study evaluates the capability of three commercial CFD tools, STAR-CCM+, COMSOL, and ANSYS CFX, to predict cladding-to-coolant heat transfer using Reynolds-Averaged Navier–Stokes (RANS) methods within the thermal–hydraulic regimes of involute-shaped plate reactors. Broad sensitivity analysis was conducted across a range of reactor-relevant parameters using two turbulence models (k−ϵ and k−ω SST) and different near-wall treatment strategies. The results were benchmarked against the Sieder–Tate correlation and experimental data from historic studies. The codes produced consistent results, showing good agreement with the empirical correlation of Sieder–Tate and the experimental measurements. The findings support the use of these commercial CFD codes as effective tools for assessing the thermal–hydraulic performance of involute-shaped plate HPRRs and guide future LEU core development.

CFD↗