Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Reliability assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

Unified analysis methods for a fault tolerant redundant strapdown inertial measurement unit

The use of a redundant strapdown inertial measurement unit (RSDIMU) has been considered as a source of sensor information for future aircraft. It is pointed out that failure detection and isolation (FDI) should be accomplished at the sensor level to ensure the accurate transfer of information to elements of the integrated avionics system. The present investigation is concerned with the impact of the FDI algorithm on system reliability and vice versa. A description is given of a technique to identify and assess critical areas of reliability requirements for the RSDIMU. Attention is given to the development of an FDI algorithm to meet these requirements.

Morrell, F. R.↗

Assessing Factors of Safety, Margins of Safety, and Reliability of Thermal Protection Systems

This paper provides formally derived definitions for Thermal Protection Systems (TPS) factors of safety and margins of safety borrowing from machine design approaches. The new factors of safety and margins of safety definitions are quite simple and easy to use, and should provide improved comparison of design safety and margins of past, present and future vehicles, These definitions are then applied to several entry vehicles, including Apollo, the Space Shuttle, the Mars Viking and Pathfinder vehicles, and the Pioneer Venus entry vehicle for example and clarity, and to aid in developing a database of previous TPS design experience. In addition to the factors and margins of safety, definitions of computed reliabilities incorporation the reliability index used in machine design are also developed and presented. Adoption and use of the reliability index will hopefully considerably aid the optimization of TPS design for future vehicles.

Rasky, Daniel J.↗

Evaluation of 10V Chip Polymer Tantalum Capacitors for Space Applications

Due to low ESR and safe failure mode, new technology chip polymer tantalum capacitors (CPTC) have gained popularity in the electronics design community, first in commercial applications, and now in hi-rel and space systems. The major drawbacks of these parts are high leakage currents, degradation under environmental stresses, and a relatively narrow temperature range of operating and storage conditions. Several studies have shown that a certain amount of moisture in polymer cathodes is necessary for a normal operation of the parts. This might limit applications of CPTCs in space systems and requires analysis of long-term exposure to deep vacuum conditions on their performance and reliability. High leakage currents and limited maximum operational temperature complicate accelerated testing that is necessary to assess long-term reliability and require new screening and qualification procedures for quality assurance. A better understanding of behavior of CPTCs as compared to traditional, MnO2, capacitors is necessary to develop adequate approaches for QA system for space applications. A specific of CPTCs is that different materials and processes might be used for low-voltage (10 V and less) and high-voltage (above 10 V) capacitors, so performance and degradation processes in these groups require separate analysis. In this work, that is a part of the NASA Electronic Parts and Packaging (NEPP) program, degradation of AC and DC characteristics under environmental stresses at different temperatures and voltages have been studied in nine lots of commercial and automotive grade capacitors rated to 10 V. Results of analysis of leakage currents, high temperature storage (HTS) up to 5000 hrs in vacuum and air at different temperatures, and Highly Accelerated Life Testing (HALT) in the range from 85 C to 145 C are presented. Temperature and voltage acceleration factors were calculated based on approximation of distributions of degradation rates with a general log-linear Weibull model. Mechanisms of degradation and failures, and requirements for screening and qualification testing are discussed.

Tantalum Capacitors↗

Tri-Agency Reliability Engineering Guidance: Post Mission Disposal and Extension Assessment

The Trilateral partners — the European Space Agency (ESA), Japan Aerospace Exploration Agency (JAXA), and National Aeronautics and Space Administration (NASA) and the United States Government (USG) in their execution of safe and successful missions, have a long-standing history of sustaining the shared space environment of operational Earth-Moon orbits with their global space-stewardship, or spacekeeping, of these areas. This has driven missions to limit the generation of new and long-lived debris, control debris releases, minimize accidental explosions and collisions, and ensure Post-Mission Disposal of space systems, so that the environment remains safe for future operations and explorations. Given the continued need for space systems to support global mandatory infrastructure and commercial enterprise, spacefarers are extending beyond the Trilateral partners, more and smaller satellites are being deployed, and current assets are being utilized much longer than expected. This is making space more congested than ever; therefore, the Trilateral partners are evaluating potential future debris mitigation strategies, evolving technology, developing on-orbit servicing capabilities, and advancing their abilities to assess disposal and mission extension plans. They are also sharing their lessons learned and identifying opportunities for future state-of-the-art advancements for current and future space enterprises. Sustaining the space environment cannot be ensured by any one agency or country. Thus, the Trilateral authors have shared their lessons learned, insights, and guidance, herein, on disposal and mission extension assessment strategies with the gratitude of each agency. As such, this document is not prescriptive, but was formulated to enhance value-and-risk-balanced operational decision-making, support policy refinement, and guide spacefaring partners beyond these agencies to assess their activities in space with safety and a global space-stewardship, or spacekeeping, in mind. This includes not only the disposal and mission extension assessment addressed herein, but also preserving space history, ensuring collaboration/interoperability of technology, supporting fellow operators without interfering, and the utilization of in-situ resources for the common benefit of humankind. It is the intention of the Trilateral partners that this document evolves based on community lessons learned and the introduction of new assessment methodologies. So, all readers are encouraged to share their insights with the authors from their own application of this guidance or other strategies to ensure each mission has a successful, safe, and judicious life and conclusion.

ESA↗

Monte Carlo Simulation of Markov, Semi-Markov, and Generalized Semi- Markov Processes in Probabilistic Risk Assessment

A standard tool of reliability analysis used at NASA-JSC is the event tree. An event tree is simply a probability tree, with the probabilities determining the next step through the tree specified at each node. The nodal probabilities are determined by a reliability study of the physical system at work for a particular node. The reliability study performed at a node is typically referred to as a fault tree analysis, with the potential of a fault tree existing.for each node on the event tree. When examining an event tree it is obvious why the event tree/fault tree approach has been adopted. Typical event trees are quite complex in nature, and the event tree/fault tree approach provides a systematic and organized approach to reliability analysis. The purpose of this study was two fold. Firstly, we wanted to explore the possibility that a semi-Markov process can create dependencies between sojourn times (the times it takes to transition from one state to the next) that can decrease the uncertainty when estimating time to failures. Using a generalized semi-Markov model, we studied a four element reliability model and were able to demonstrate such sojourn time dependencies. Secondly, we wanted to study the use of semi-Markov processes to introduce a time variable into the event tree diagrams that are commonly developed in PRA (Probabilistic Risk Assessment) analyses. Event tree end states which change with time are more representative of failure scenarios than are the usual static probability-derived end states.

English, Thomas↗

Inspection planning development: An evolutionary approach using reliability engineering as a tool

This paper proposes an evolutionary approach for inspection planning which introduces various reliability engineering tools into the process and assess system trade-offs among reliability, engineering requirement, manufacturing capability and inspection cost to establish an optimal inspection plan. The examples presented in the paper illustrate some advantages and benefits of the new approach. Through the analysis, reliability and engineering impacts due to manufacturing process capability and inspection uncertainty are clearly understood; the most cost effective and efficient inspection plan can be established and associated risks are well controlled; some inspection reductions and relaxations are well justified; and design feedbacks and changes may be initiated from the analysis conclusion to further enhance reliability and reduce cost. The approach is particularly promising as global competitions and customer quality improvement expectations are rapidly increasing.

Graf, David A.↗

A Model for Assessing the Liability of Seemingly Correct Software

Current research on software reliability does not lend itself to quantitatively assessing the risk posed by a piece of life-critical software. Black-box software reliability models are too general and make too many assumptions to be applied confidently to assessing the risk of life-critical software. We present a model for assessing the risk caused by a piece of software; this model combines software testing results and Hamlet's probable correctness model. We show how this model can assess software risk for those who insure against a loss that can occur if life-critical software fails.

Voas, Jeffrey M.↗

Electrical Substation Configuration Effect on Substation Reliability

It is crucial that the U.S. electrical grid be reliable, due to its critical role in the economy and our national defense/security. Many common tasks and industrial operations rely on proper electrical power distribution. In designing new bus systems or evaluating existing ones, the type of configuration employed affects the level of risk, reliability, maintenance, and cost involved. The present work utilizes Systems Analysis Programs for Hands-on Integrated Reliability Evaluations (SAPHIRE) to perform a probabilistic risk assessment (PRA)-based sensitivity study on substation reliability in regard to different bus configurations. This study examines single bus, main and transfer, breaker and a half, double bus/double breaker, and ring bus configurations applied to busses with different numbers of lines. The case variances, methods, and rankings presented herein can help guide bus configurations for electrical grid design/analysis in the future.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Electrical Substation Configuration Effect on Substation Reliability

The nation’s electrical grid must be reliable because of its critical role in the economy, defense, and security of the nation. Many common tasks and industrial operations rely on proper electrical power distribution. In the design of new bus systems or evaluation of existing bus systems, the type of bus configuration affects the risk, reliability, maintenance, and cost of the system. This work utilizes Systems Analysis Programs for Hands-on Integrated Reliability Evaluations (SAPHIRE) to perform a probabilistic risk assessment (PRA) based sensitivity study on the reliability of substations with differing bus configurations. This study examines single bus, main and transfer, breaker and a half, double bus/double breaker, and ring bus configurations applied to busses of varying number of lines. The case variances, methods, and rankings presented can provide a guide for bus configuration for future electrical grid design and analysis.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Development and Validation of a Probabilistic Risk Assessment Model for a Generic Modular High Temperature Gas-Cooled Reactor

This study looks to develop and validate a probabilistic risk assessment (PRA) model for the modular high temperature gas-cooled reactor (MHTGR) using INL’s Systems Analysis Programs for Hands-on Integrated Reliability Evaluations (SAPHIRE) software. Validation against a General Atomics design involves matching event and fault trees to historical frequencies, with a goal of under 15% difference. The research aims to deliver a reliable PRA model to assess the safety of MHTGRs for use within high-temperature industrial applications.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Reliability-based structural optimization: A proposed analytical-experimental study

An analytical and experimental study for assessing the potential of reliability-based structural optimization is proposed and described. In the study, competing designs obtained by deterministic and reliability-based optimization are compared. The experimental portion of the study is practical because the structure selected is a modular, actively and passively controlled truss that consists of many identical members, and because the competing designs are compared in terms of their dynamic performance and are not destroyed if failure occurs. The analytical portion of this study is illustrated on a 10-bar truss example. In the illustrative example, it is shown that reliability-based optimization can yield a design that is superior to an alternative design obtained by deterministic optimization. These analytical results provide motivation for the proposed study, which is underway.

Stroud, W. Jefferson↗

Ceramic component reliability with the restructured NASA/CARES computer program

The Ceramics Analysis and Reliability Evaluation of Structures (CARES) integrated design program on statistical fast fracture reliability and monolithic ceramic components is enhanced to include the use of a neutral data base, two-dimensional modeling, and variable problem size. The data base allows for the efficient transfer of element stresses, temperatures, and volumes/areas from the finite element output to the reliability analysis program. Elements are divided to insure a direct correspondence between the subelements and the Gaussian integration points. Two-dimensional modeling is accomplished by assessing the volume flaw reliability with shell elements. To demonstrate the improvements in the algorithm, example problems are selected from a round-robin conducted by WELFEP (WEakest Link failure probability prediction by Finite Element Postprocessors).

Powers, Lynn M.↗

Ceramic component reliability with the restructured NASA/CARES computer program

The Ceramics Analysis and Reliability Evaluation of Structures (CARES) integrated design program on statistical fast fracture reliability and monolithic ceramic components is enhanced to include the use of a neutral data base, two-dimensional modeling, and variable problem size. The data base allows for the efficient transfer of element stresses, temperatures, and volumes/areas from the finite element output to the reliability analysis program. Elements are divided to insure a direct correspondence between the subelements and the Gaussian integration points. Two-dimensional modeling is accomplished by assessing the volume flaw reliability with shell elements. To demonstrate the improvements in the algorithm, example problems are selected from a round-robin conducted by WELFEP (WEakest Link failure probability prediction by Finite Element Postprocessors).

Powers, Lynn M.↗

Reliability after inspection

The investigation is concerned with the derivation of relationships between the probability of having manufacturing defects, the probability of detecting a flaw, and the final reliability. Equations for the simple situation in which only one flaw can be present are used to introduce the relationships in a Bayes' theorem approach to the assessment of the final reliability. Situations which are prevalent in composites manufacturing are considered. Attention is given to a case involving the random occurrence of flaws on a laminate surface.

Davidson, J. R.↗

Objective Structured Clinical Evaluation (OSCE) of an Artificial Intelligence (AI) Clinical Decision Support System (CDSS) Tool

BACKGROUND Objective Structured Clinical Evaluations (OSCEs) have long been established as a robust methodology for summative assessment of clinical skills and decision-making during medical education. The recent integration of Artificial Intelligence (AI) into clinical decision-making processes has prompted the need for novel evaluation frameworks to assess the efficacy and reliability of AI clinical decision support system (CDSS) tools. This abstract outlines the process of quantitatively evaluating a novel CDSS (“Doc in a Box” Google 2024) trained on curated medical spaceflight data in the psychomotor domain as it interfaces with a human volunteer acting as the crew medical officer (CMO). PURPOSE The AI CDSS under review was developed as part of the Lunar Command and Control Interoperability (LuCCI) project, which is intended to address a gap in how Lunar Surface Systems (LSS) would interoperate across multiple programs, commercial partners, and international partners. The project objective is to define, prototype, integrate, and evaluate an interoperable lunar command, control, data, and software reference architecture to enable autonomy and informatics capability through common standards across LSS. A multi-modal AI-based CDSS compatible with Federated LSS will assist clinicians in diagnosing and managing complex medical conditions by providing evidence-based recommendations through predictive analytics. Given the critical role of decision-support as NASA continues to evolve its Earth-independent medical operations (EIMO), it is imperative to ensure that such AI tools perform reliably and align with clinical standards during progressive lunar and Martian exploration class missions. METHODS The OSCE framework, traditionally used for evaluating human clinicians, was adapted to assess the AI tool's decision-making capabilities in simulated clinical scenarios. In this adapted OSCE, the AI CDSS was tested across a series of structured clinical scenarios designed to mimic real-life spaceflight patient cases. These scenarios included a range of conditions and complexities, allowing for comprehensive assessment of the tool's performance. Key evaluation metrics included accuracy of diagnosis, timeliness of decision-making, and appropriate recommendations for therapies. The OSCE was scored by human physician evaluators who assessed the AI's recommendations in comparison with expert clinicians' medical decision making to ensure alignment with best practices and the standard of care. RESULTS Preliminary results indicate that the AI CDSS demonstrated high accuracy in diagnostic recommendations and decision support across various scenarios. However, certain limitations were noted, such as occasional discrepancies in handling complex or nuanced cases that required a more contextual understanding. Additionally, the tool scored higher on the diagnostic portion of the rubric, with lower scores in the therapeutic recommendations. These findings highlight the importance of continuous refinement and validation of AI tools through rigorous evaluation frameworks like the OSCE. The adaptation of OSCEs for AI tools presents several advantages, including a structured and reproducible approach to evaluation, the ability to test AI systems in diverse clinical scenarios, and the opportunity to benchmark AI performance against established clinical standards to permit charting of future progress as aerospace medicine evolves as a discipline. Remaining challenges include ensuring that these evaluations capture the full spectrum of clinical decision-making scenarios that will be confronted by CMOs during missions and adequately reflecting real-world variability of the austere spaceflight environment. CONCLUSION Employing OSCEs to evaluate AI clinical decision support tools offers a promising approach to validating their clinical utility and efficacy. This methodology not only provides insights into the tool's performance but also fosters ongoing improvement and alignment with standard of care practices. Future research should focus on refining these evaluation processes and addressing limitations to enhance the integration of AI tools in clinical spaceflight settings. REFERENCES Scott S, Hearns V, Barker MA. Testing Clinical Skills: A Look at the OSCE and USMLE Clinical Skills Exams. S D Med. 2019 Oct;72(10):451-453. Majumder MAA, Kumar A, Krishnamurthy K, Ojeh N, Adams OP, Sa B. An evaluative study of objective structured clinical examination (OSCE): students and examiners perspectives. Adv Med Educ Pract. 2019 Jun 5;10:387-397. Karam VY, Park YS, Tekian A, Youssef N. Evaluating the validity evidence of an OSCE: results from a new medical school. BMC Med Educ. 2018 Dec 20;18(1):313.

Ariana M Nelson↗

Modeling the impact of extreme summer drought on conventional and renewable generation capacity: Methods and a case study on the Eastern U.S. power system

Across recent years, there has been a growing prevalence of extreme weather events throughout the United States, posing significant challenges to the reliable and resilient operation of power systems. Specifically, summer droughts threaten to severely reduce available generation capacity to meet regional electricity demand, potentially leading to power outages. This underscores the importance of accurate resource adequacy (RA) assessment to ensure the reliable operation of the nation’s energy infrastructure. Accurately evaluating the usable capacity of regional generation fleets is a challenging undertaking due to the intricate interactions between power systems and hydro-climatic systems. Here, this paper proposes a systematic and analytical framework to evaluate the impacts of extreme summer drought events on the available capacity of various generating technologies, incorporating both meteorological and hydrologic factors. The framework provides detailed plant-level capacity derating models for hydroelectric, thermoelectric, and renewable power plants, facilitating evaluations with high temporal and spatial resolution. The application of the proposed impact assessment framework to the 2025 generation fleet of the real-world power system within the PJM and SERC regions of the United States yields insightful results. By analyzing the daily usable capacity of 6,055 at-risk generators across the study region, it shows that the summer capacity deration is most significant for hydroelectric and once-through thermal power plants, followed by recirculating thermal power plants and combustion turbines. In the event of the recurrence of the 2007 southeastern summer drought event in the near future, the generation fleet could experience a substantial reduction in available capacity, estimated at approximately 8.5 GW, compared to typical summer conditions. The sensitivity analysis reveals that the usable capacity of the generation fleet would suffer an even more significant decrease under conditions of increasingly severe summer droughts. The proposed approach and the findings of this study provide valuable methodologies and insights, empowering stakeholders to bolster the resilience of power systems against the potentially devastating effects of future extreme drought events.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Closing Report for NASA Cooperative Agreement NASA-1-242

Reliable estimates of exposures due to ionizing radiations are of paramount importance in achieving human exploration and development of space, and in several technologically important and scientifically significant areas impacting on industrial and public health. For proper assessment of radiation exposures reliable transport codes are needed. An essential input to the transport codes is the information about the interaction of ions and neutrons with the matter. Most of the information about this interaction is put in by nuclear cross section data. In order to obtain an accurate parameterization of cross sections data, theoretical input is indispensable especially for the processes where there is little or no experimental data available. In the grant period reliable data base was developed and a phenomenological model was developed for the total absorption cross sections valid for any charged/uncharged light, medium and heavy collision pairs valid for the entire energy range. It is gratifying to note the success of the model. The cross sections model has been adopted and is in use in NASA cosmic ray detector development projects, the radiation protection and shielding programs and several DoE laboratories and institutions. A list of the publications based on the work done during the grant period is given below and a sample copy of one of the papers is enclosed with this report.

Maung, Khin Maung↗