Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Reliability assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Lander Lighting Solution to Reduce Pilot & Autonomous Approach Errors

The south pole lighting environment will have harsh low inclination sunlight, making overhead judgement of surface features difficult. Autonomous solutions are great, however, the need for visual monitoring and independent go/no-go decisions remain. Our project proposes that lunar landing systems will be better served by including a powerful landing light system that improves visibility of surfaces from overhead by illuminating the ground at critical distances for the crew to make last minute decisions regarding an approach. The project utilized computer-based optical modeling software to predict requirements for a potential landing light system. The analysis based the lamp prediction from commercially available LED chip sets and lamp optics. The goal was to illustrate a method to raise the surface contrast of a landing site within an acceptable contrast threshold for most camera systems and human observers to recognize hazards that would not be noticed with low inclination sunlight alone. The Apollo lunar landings benefitted from overhead sun or dark conditions. The surface lighting at the Lunar South Pole is a harsh environment where surfaces are lit from a low inclination angle by the sun (from the side). This change in lighting condition precipitates a need for updated lunar landing systems that facilitate improved recognition of landing sites, and thereby increase pilot awareness of landing hazards. The reliance on LIDAR and other autonomous mechanisms alone is risky given the known usage of visual monitoring for operator concurrence on current spacecraft programs and present-day autonomous land-based vehicles. Visual monitoring via cameras or windows requires the surface contrast to be within 3 orders of magnitude for reasonable recognition of objects. Artificial overhead illumination, when sufficiently sized, provides a means to even out contrast problems created by low inclination sunlight, potentially reducing piloting errors. Current vehicle requirements do not specify this type of guidance for the purpose of increasing mission success. An optical ray-trace simulation model was developed in Zemax Optics Studio to predict the best combination of LED power, LED optics, lamp quantity, and lamp location to raise the surface contrast to within 2 orders of magnitude from 3 orders required to further increased visibility and reduce risk. The project considered the following design constraints: potential base diameter of lander, approach distance(s) for a go-no-go decision point (200 meter), solar inclination angle (2-7), lunar surface reflectance (10%), LED chip sets, LED focusing optics, LED power, lamp quantity, lamp locations, and illumination diameter of lunar surface landing zone. The results can be used to establish minimum design constraints for vehicle landing light systems. With a solar inclination angle ranging from 2-7 degrees, the horizontal illumination of the lunar surface is attenuated by about 10% when compared to overhead illumination from the Sun. This modifies the sun's maximum of 130,000 lux to 13,000 lux horizontal illuminance. The artificial lighting system was designed to provide an 18-meter-wide illumination zone, to create viewing clearances around a 6-meter-wide lander. The system provides an average illuminance of 300 lux, meeting the 2 orders of magnitude criteria. The solution utilized modern Chip On Board LEDs, that each utilized 17 watts, with focusing Total Internal Reflection (TIR) lenses. A lighting system of 300 LEDs was arrayed along the "bottom" of a “lander”. With 17 watts per LED, the system is estimated to require 5100 watts. This is a large amount of power, but it would only be needed during critical phases during the landing. LED lighting systems can be dimmed, and it is assumed that as the lander arrives closer to the landing site, the lighting system power can be adjusted as needed to produce the necessary surface illuminance. The designed reduction of contrast improves reliability of safety assessments using real time visible light camera systems and out the window viewing by the crew.

T A Clark↗
NASA NTRSDate not supplied

Safety & Mission Assurance (SMA) Activities in Support of Artemis I and Plans for Artemis II

The Artemis I mission in 2022 accomplished humanity’s first venture beyond Low-Earth Orbit (LEO) with a human-rated spacecraft in over fifty years. Artemis comprises several key Program elements – Multi-Purpose Crew Vehicle (MPCV) Orion Crew Module, Service Module, Launch Abort System; the Space Launch System (SLS) and the Exploration Ground System (EGS). Much of our human spaceflight experience with crewed lunar missions is captured in historical program documents, but first-hand knowledge is limited to a few spaceflight veterans. Missions to LEO have offered the opportunity of direct, near-instantaneous communications and assistance, and the ability to return to Earth within a matter of hours in case of emergency. Outward-bound missions do not have these features and will require a more autonomous and reliable spacecraft. The assessment of compliance with applicable safety requirements and adequacy of hazard controls and verifications is the responsibility of the MPCV Safety and Engineering Review Panel (MSERP), along with a Joint [NASA/ESA] Safety and Engineering Review Panel (JSERP) for the review of the European Service Module (ESM). The MSERP has two features that are relatively unique amongst NASA safety panels. First, NASA Engineering was added as a Panel co-chair, which enhanced the Engineering organization’s engagement and level of understanding of hazard analysis methodology and results. The MSERP has representation from each office, including Flight Operations Directorate (FOD) and Health and Medical Technical Authority, supporting the Orion Program in addition to the Engineering and Safety Technical Authority co-chairs. Second, the JSERP has a second set of co-chairs from ESA Engineering and ESA Product Assurance and Safety organizations, which recognizes the international arrangement as one of partnership. This paper will focus on SMA processes, activities, and plans for the Orion element and explore unique challenges associated with Artemis II as we approach the flight of the first crewed Orion vehicle.

Paul J. Collier↗
NASA NTRSDate not supplied

Expectation vs. Reality: The Sunrise Problem Applied to Probabilistic Risk Assessment

The Sunrise Problem is succinctly stated as a question: “what is the probability that the sun will rise tomorrow?” Attempts to answer this seemingly simple question reveal unexpected incongruities between statistical/probabilistic estimates and “real-world” expectations. Rather than being a purely philosophical problem, similar incongruities can be found in reliability and probabilistic risk assessment (PRA) analyses. These differences between statistical predictions and demonstrated reliability can result in analysis shortcomings that should be addressed and resolved. This presentation will begin by discussing the nature of the Sunrise Problem and how it applies to PRA and reliability. Examples of the Sunrise Problem in a PRA estimate will also be included, along with tips to identify and resolve the shortcomings that result from these anomalous situations.

Sunrise Problem↗
NASA NTRS1983

Unified analysis methods for a fault tolerant redundant strapdown inertial measurement unit

The use of a redundant strapdown inertial measurement unit (RSDIMU) has been considered as a source of sensor information for future aircraft. It is pointed out that failure detection and isolation (FDI) should be accomplished at the sensor level to ensure the accurate transfer of information to elements of the integrated avionics system. The present investigation is concerned with the impact of the FDI algorithm on system reliability and vice versa. A description is given of a technique to identify and assess critical areas of reliability requirements for the RSDIMU. Attention is given to the development of an FDI algorithm to meet these requirements.

Morrell, F. R.↗
NASA NTRS2001

Assessing Factors of Safety, Margins of Safety, and Reliability of Thermal Protection Systems

This paper provides formally derived definitions for Thermal Protection Systems (TPS) factors of safety and margins of safety borrowing from machine design approaches. The new factors of safety and margins of safety definitions are quite simple and easy to use, and should provide improved comparison of design safety and margins of past, present and future vehicles, These definitions are then applied to several entry vehicles, including Apollo, the Space Shuttle, the Mars Viking and Pathfinder vehicles, and the Pioneer Venus entry vehicle for example and clarity, and to aid in developing a database of previous TPS design experience. In addition to the factors and margins of safety, definitions of computed reliabilities incorporation the reliability index used in machine design are also developed and presented. Adoption and use of the reliability index will hopefully considerably aid the optimization of TPS design for future vehicles.

Rasky, Daniel J.↗
NASA NTRS2016

Evaluation of 10V Chip Polymer Tantalum Capacitors for Space Applications

Due to low ESR and safe failure mode, new technology chip polymer tantalum capacitors (CPTC) have gained popularity in the electronics design community, first in commercial applications, and now in hi-rel and space systems. The major drawbacks of these parts are high leakage currents, degradation under environmental stresses, and a relatively narrow temperature range of operating and storage conditions. Several studies have shown that a certain amount of moisture in polymer cathodes is necessary for a normal operation of the parts. This might limit applications of CPTCs in space systems and requires analysis of long-term exposure to deep vacuum conditions on their performance and reliability. High leakage currents and limited maximum operational temperature complicate accelerated testing that is necessary to assess long-term reliability and require new screening and qualification procedures for quality assurance. A better understanding of behavior of CPTCs as compared to traditional, MnO2, capacitors is necessary to develop adequate approaches for QA system for space applications. A specific of CPTCs is that different materials and processes might be used for low-voltage (10 V and less) and high-voltage (above 10 V) capacitors, so performance and degradation processes in these groups require separate analysis. In this work, that is a part of the NASA Electronic Parts and Packaging (NEPP) program, degradation of AC and DC characteristics under environmental stresses at different temperatures and voltages have been studied in nine lots of commercial and automotive grade capacitors rated to 10 V. Results of analysis of leakage currents, high temperature storage (HTS) up to 5000 hrs in vacuum and air at different temperatures, and Highly Accelerated Life Testing (HALT) in the range from 85 C to 145 C are presented. Temperature and voltage acceleration factors were calculated based on approximation of distributions of degradation rates with a general log-linear Weibull model. Mechanisms of degradation and failures, and requirements for screening and qualification testing are discussed.

Tantalum Capacitors↗
NASA NTRS2022

Tri-Agency Reliability Engineering Guidance: Post Mission Disposal and Extension Assessment

The Trilateral partners — the European Space Agency (ESA), Japan Aerospace Exploration Agency (JAXA), and National Aeronautics and Space Administration (NASA) and the United States Government (USG) in their execution of safe and successful missions, have a long-standing history of sustaining the shared space environment of operational Earth-Moon orbits with their global space-stewardship, or spacekeeping, of these areas. This has driven missions to limit the generation of new and long-lived debris, control debris releases, minimize accidental explosions and collisions, and ensure Post-Mission Disposal of space systems, so that the environment remains safe for future operations and explorations. Given the continued need for space systems to support global mandatory infrastructure and commercial enterprise, spacefarers are extending beyond the Trilateral partners, more and smaller satellites are being deployed, and current assets are being utilized much longer than expected. This is making space more congested than ever; therefore, the Trilateral partners are evaluating potential future debris mitigation strategies, evolving technology, developing on-orbit servicing capabilities, and advancing their abilities to assess disposal and mission extension plans. They are also sharing their lessons learned and identifying opportunities for future state-of-the-art advancements for current and future space enterprises. Sustaining the space environment cannot be ensured by any one agency or country. Thus, the Trilateral authors have shared their lessons learned, insights, and guidance, herein, on disposal and mission extension assessment strategies with the gratitude of each agency. As such, this document is not prescriptive, but was formulated to enhance value-and-risk-balanced operational decision-making, support policy refinement, and guide spacefaring partners beyond these agencies to assess their activities in space with safety and a global space-stewardship, or spacekeeping, in mind. This includes not only the disposal and mission extension assessment addressed herein, but also preserving space history, ensuring collaboration/interoperability of technology, supporting fellow operators without interfering, and the utilization of in-situ resources for the common benefit of humankind. It is the intention of the Trilateral partners that this document evolves based on community lessons learned and the introduction of new assessment methodologies. So, all readers are encouraged to share their insights with the authors from their own application of this guidance or other strategies to ensure each mission has a successful, safe, and judicious life and conclusion.

ESA↗
NASA NTRS2005

Monte Carlo Simulation of Markov, Semi-Markov, and Generalized Semi- Markov Processes in Probabilistic Risk Assessment

A standard tool of reliability analysis used at NASA-JSC is the event tree. An event tree is simply a probability tree, with the probabilities determining the next step through the tree specified at each node. The nodal probabilities are determined by a reliability study of the physical system at work for a particular node. The reliability study performed at a node is typically referred to as a fault tree analysis, with the potential of a fault tree existing.for each node on the event tree. When examining an event tree it is obvious why the event tree/fault tree approach has been adopted. Typical event trees are quite complex in nature, and the event tree/fault tree approach provides a systematic and organized approach to reliability analysis. The purpose of this study was two fold. Firstly, we wanted to explore the possibility that a semi-Markov process can create dependencies between sojourn times (the times it takes to transition from one state to the next) that can decrease the uncertainty when estimating time to failures. Using a generalized semi-Markov model, we studied a four element reliability model and were able to demonstrate such sojourn time dependencies. Secondly, we wanted to study the use of semi-Markov processes to introduce a time variable into the event tree diagrams that are commonly developed in PRA (Probabilistic Risk Assessment) analyses. Event tree end states which change with time are more representative of failure scenarios than are the usual static probability-derived end states.

English, Thomas↗
NASA NTRS1994

Inspection planning development: An evolutionary approach using reliability engineering as a tool

This paper proposes an evolutionary approach for inspection planning which introduces various reliability engineering tools into the process and assess system trade-offs among reliability, engineering requirement, manufacturing capability and inspection cost to establish an optimal inspection plan. The examples presented in the paper illustrate some advantages and benefits of the new approach. Through the analysis, reliability and engineering impacts due to manufacturing process capability and inspection uncertainty are clearly understood; the most cost effective and efficient inspection plan can be established and associated risks are well controlled; some inspection reductions and relaxations are well justified; and design feedbacks and changes may be initiated from the analysis conclusion to further enhance reliability and reduce cost. The approach is particularly promising as global competitions and customer quality improvement expectations are rapidly increasing.

Graf, David A.↗
NASA NTRS1991

A Model for Assessing the Liability of Seemingly Correct Software

Current research on software reliability does not lend itself to quantitatively assessing the risk posed by a piece of life-critical software. Black-box software reliability models are too general and make too many assumptions to be applied confidently to assessing the risk of life-critical software. We present a model for assessing the risk caused by a piece of software; this model combines software testing results and Hamlet's probable correctness model. We show how this model can assess software risk for those who insure against a loss that can occur if life-critical software fails.

Voas, Jeffrey M.↗
NASA NTRS1993

Reliability-based structural optimization: A proposed analytical-experimental study

An analytical and experimental study for assessing the potential of reliability-based structural optimization is proposed and described. In the study, competing designs obtained by deterministic and reliability-based optimization are compared. The experimental portion of the study is practical because the structure selected is a modular, actively and passively controlled truss that consists of many identical members, and because the competing designs are compared in terms of their dynamic performance and are not destroyed if failure occurs. The analytical portion of this study is illustrated on a 10-bar truss example. In the illustrative example, it is shown that reliability-based optimization can yield a design that is superior to an alternative design obtained by deterministic optimization. These analytical results provide motivation for the proposed study, which is underway.

Stroud, W. Jefferson↗
NASA NTRS1992

Ceramic component reliability with the restructured NASA/CARES computer program

The Ceramics Analysis and Reliability Evaluation of Structures (CARES) integrated design program on statistical fast fracture reliability and monolithic ceramic components is enhanced to include the use of a neutral data base, two-dimensional modeling, and variable problem size. The data base allows for the efficient transfer of element stresses, temperatures, and volumes/areas from the finite element output to the reliability analysis program. Elements are divided to insure a direct correspondence between the subelements and the Gaussian integration points. Two-dimensional modeling is accomplished by assessing the volume flaw reliability with shell elements. To demonstrate the improvements in the algorithm, example problems are selected from a round-robin conducted by WELFEP (WEakest Link failure probability prediction by Finite Element Postprocessors).

Powers, Lynn M.↗
NASA NTRS1992

Ceramic component reliability with the restructured NASA/CARES computer program

The Ceramics Analysis and Reliability Evaluation of Structures (CARES) integrated design program on statistical fast fracture reliability and monolithic ceramic components is enhanced to include the use of a neutral data base, two-dimensional modeling, and variable problem size. The data base allows for the efficient transfer of element stresses, temperatures, and volumes/areas from the finite element output to the reliability analysis program. Elements are divided to insure a direct correspondence between the subelements and the Gaussian integration points. Two-dimensional modeling is accomplished by assessing the volume flaw reliability with shell elements. To demonstrate the improvements in the algorithm, example problems are selected from a round-robin conducted by WELFEP (WEakest Link failure probability prediction by Finite Element Postprocessors).

Powers, Lynn M.↗
NASA NTRS1975

Reliability after inspection

The investigation is concerned with the derivation of relationships between the probability of having manufacturing defects, the probability of detecting a flaw, and the final reliability. Equations for the simple situation in which only one flaw can be present are used to introduce the relationships in a Bayes' theorem approach to the assessment of the final reliability. Situations which are prevalent in composites manufacturing are considered. Attention is given to a case involving the random occurrence of flaws on a laminate surface.

Davidson, J. R.↗
NASA NTRSDate not supplied

Objective Structured Clinical Evaluation (OSCE) of an Artificial Intelligence (AI) Clinical Decision Support System (CDSS) Tool

BACKGROUND Objective Structured Clinical Evaluations (OSCEs) have long been established as a robust methodology for summative assessment of clinical skills and decision-making during medical education. The recent integration of Artificial Intelligence (AI) into clinical decision-making processes has prompted the need for novel evaluation frameworks to assess the efficacy and reliability of AI clinical decision support system (CDSS) tools. This abstract outlines the process of quantitatively evaluating a novel CDSS (“Doc in a Box” Google 2024) trained on curated medical spaceflight data in the psychomotor domain as it interfaces with a human volunteer acting as the crew medical officer (CMO). PURPOSE The AI CDSS under review was developed as part of the Lunar Command and Control Interoperability (LuCCI) project, which is intended to address a gap in how Lunar Surface Systems (LSS) would interoperate across multiple programs, commercial partners, and international partners. The project objective is to define, prototype, integrate, and evaluate an interoperable lunar command, control, data, and software reference architecture to enable autonomy and informatics capability through common standards across LSS. A multi-modal AI-based CDSS compatible with Federated LSS will assist clinicians in diagnosing and managing complex medical conditions by providing evidence-based recommendations through predictive analytics. Given the critical role of decision-support as NASA continues to evolve its Earth-independent medical operations (EIMO), it is imperative to ensure that such AI tools perform reliably and align with clinical standards during progressive lunar and Martian exploration class missions. METHODS The OSCE framework, traditionally used for evaluating human clinicians, was adapted to assess the AI tool's decision-making capabilities in simulated clinical scenarios. In this adapted OSCE, the AI CDSS was tested across a series of structured clinical scenarios designed to mimic real-life spaceflight patient cases. These scenarios included a range of conditions and complexities, allowing for comprehensive assessment of the tool's performance. Key evaluation metrics included accuracy of diagnosis, timeliness of decision-making, and appropriate recommendations for therapies. The OSCE was scored by human physician evaluators who assessed the AI's recommendations in comparison with expert clinicians' medical decision making to ensure alignment with best practices and the standard of care. RESULTS Preliminary results indicate that the AI CDSS demonstrated high accuracy in diagnostic recommendations and decision support across various scenarios. However, certain limitations were noted, such as occasional discrepancies in handling complex or nuanced cases that required a more contextual understanding. Additionally, the tool scored higher on the diagnostic portion of the rubric, with lower scores in the therapeutic recommendations. These findings highlight the importance of continuous refinement and validation of AI tools through rigorous evaluation frameworks like the OSCE. The adaptation of OSCEs for AI tools presents several advantages, including a structured and reproducible approach to evaluation, the ability to test AI systems in diverse clinical scenarios, and the opportunity to benchmark AI performance against established clinical standards to permit charting of future progress as aerospace medicine evolves as a discipline. Remaining challenges include ensuring that these evaluations capture the full spectrum of clinical decision-making scenarios that will be confronted by CMOs during missions and adequately reflecting real-world variability of the austere spaceflight environment. CONCLUSION Employing OSCEs to evaluate AI clinical decision support tools offers a promising approach to validating their clinical utility and efficacy. This methodology not only provides insights into the tool's performance but also fosters ongoing improvement and alignment with standard of care practices. Future research should focus on refining these evaluation processes and addressing limitations to enhance the integration of AI tools in clinical spaceflight settings. REFERENCES Scott S, Hearns V, Barker MA. Testing Clinical Skills: A Look at the OSCE and USMLE Clinical Skills Exams. S D Med. 2019 Oct;72(10):451-453. Majumder MAA, Kumar A, Krishnamurthy K, Ojeh N, Adams OP, Sa B. An evaluative study of objective structured clinical examination (OSCE): students and examiners perspectives. Adv Med Educ Pract. 2019 Jun 5;10:387-397. Karam VY, Park YS, Tekian A, Youssef N. Evaluating the validity evidence of an OSCE: results from a new medical school. BMC Med Educ. 2018 Dec 20;18(1):313.

Ariana M Nelson↗
NASA NTRS1999

Closing Report for NASA Cooperative Agreement NASA-1-242

Reliable estimates of exposures due to ionizing radiations are of paramount importance in achieving human exploration and development of space, and in several technologically important and scientifically significant areas impacting on industrial and public health. For proper assessment of radiation exposures reliable transport codes are needed. An essential input to the transport codes is the information about the interaction of ions and neutrons with the matter. Most of the information about this interaction is put in by nuclear cross section data. In order to obtain an accurate parameterization of cross sections data, theoretical input is indispensable especially for the processes where there is little or no experimental data available. In the grant period reliable data base was developed and a phenomenological model was developed for the total absorption cross sections valid for any charged/uncharged light, medium and heavy collision pairs valid for the entire energy range. It is gratifying to note the success of the model. The cross sections model has been adopted and is in use in NASA cosmic ray detector development projects, the radiation protection and shielding programs and several DoE laboratories and institutions. A list of the publications based on the work done during the grant period is given below and a sample copy of one of the papers is enclosed with this report.

Maung, Khin Maung↗
NASA NTRS2020

Reliability Analysis of Complex NASA Systems with Model Based Engineering

The emergence of model-based engineering, with Model- Based Systems Engineering (MBSE) leading the way, is transforming design and analysis methodologies. The recognized benefits to systems development include moving from document-centric information systems and document-centric project communication to a model-centric environment in which control of design changes in the life cycles is facilitated. In addition, a “single source of truth” about the system, that is up-to-date in all respects of the design, becomes the authoritative source of data and information about the system. This promotes consistency and efficiency in regard to integration of the system elements as the design emerges and thereby may further optimize the design. Therefore Reliability Engineers (REs) supporting NASA missions must be integrated into model-based engineering to ensure the outputs of their analyses are relevant and value-needed to the design, development, and operational processes for failure risks assessment and communication.

Reliability prediction↗