Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “probabilistic”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52

Probabilistic Risk Analysis (PRA) of a Mobile Offshore Drilling Unit (MODU) Dynamic Positioning System (DPS)

Probabilistic Risk Assessment (PRA) has been utilized by NASA in a variety of space oriented projects. It has served as one of the primary risk identification and ranking tools. Recent developments in the oil and gas industry have presented opportunities for NASA to lend their PRA expertise to both ongoing and developmental projects within the industry. As a result, NASA has entered into an agreement with Anadarko Petroleum Company (APC) to collaboratively develop PRAs for different aspects of the subsea drilling and completion process of well development. This paper documents how PRA was applied to estimate the probability that a Mobile Offshore Drilling Unit (MODU) equipped with a generically configured Dynamic Positioning System (DPS) loses location and needs to initiate an emergency disconnect. Since this project was in essence a pilot project, the PRA described in this paper is intended to be generic such that the vessel meets the general requirements of an International Maritime Organization (IMO) Maritime Safety Committee (MSC)/Circ. 645 Class 3 dynamically positioned vessel. The results of this analysis are not intended to be applied to any specific drilling vessel, although provisions were made to allow the analysis to be configured to a specific vessel if required.

Thigpen, Eric B.↗

Comparative Analysis of Static and Dynamic Probabilistic Risk Assessment

This study examines three different methodologies for producing loss-of-mission (LOM) and loss-of-crew (LOC) risks estimates for probabilistic risk assessments (PRA) of crewed spacecraft. The three bottom-up, component-based PRA approaches examined are a traditional static fault tree, a dynamic Monte Carlo simulation, and a fault tree hybrid that incorporates some dynamic elements. These approaches were used to model the reaction control system thruster pod of a generic crewed spacecraft and mission, and a comparative analysis of the methods is presented. The methodologies are assessed in terms of the process of modeling a system, the actionable information produced for the design team, and the overall fidelity of the quantitative risk evaluation generated. The system modeling process is compared in terms of the effort required to generate the initial model, update the model in response to design changes, and support mass-versus-risk trade studies. The results are compared by examining the top-level LOM/LOC estimates and the relative risk driver rankings at the failure mode level. The fidelity of each modeling methodology is discussed in terms of its capability to handle real-world system dynamics such as cold-sparing, changes in mission operations due to loss of redundancy, and common cause failure modes. The paper also discusses the applicability of each methodology to different phases of system development and shows that a single methodology may not be suitable for all of the many purposes of a spacecraft PRA. The fault tree hybrid approach is shown to be best suited to the needs of early assessments during conceptual design phases. As the design begins to mature, the level of detail represented in the risk model must go beyond redundancy and nominal mission operations to include dynamic, time- and state-dependent system responses as well as diverse system capabilities. This is best accomplished using the dynamic simulation approach, since these phenomena are not easily captured by static methods. Ultimately, once the design has been finalized and the goal of the PRA is to provide design validation and requirement verification, more traditional, static fault tree approaches may become as appropriate as the simulation method.

Mattenberger, Christopher J.↗

PDC19 Impact Exercise: Probabilistic Asteroid Impact Risk Assessment

Probabilistic Asteroid Impact Risk (PAIR) - PDC (Planetary Defense Conference) 2019 Hypothetical Exercise, NASA Ames, Asteroid Threat Assessment Project (ATAP) - Characterization Summary and Updates: Assessment date: 19 April 2027; Impact date: 29 April 2027 (10 days); Earth impact probability: 100 percent, New York Area; Diameter (meters): 60 plus or minus 10 (1 minus sigma), range 26–93; Energy: mean 11 megatons, range 650 kilotons to 46 megatons; Type: S class, remaining chunk of disrupted contact binary. Risk Summary: Affected population: mean 2.4 million, range zero to 10.2 million; Likely airburst at approximately16 kilometers altitude (8 to 29 kilometers); Blast overpressure is primary hazard; Damage out to approximately 70 kilometers if larger, lower burst; Little-to-no damage if burst is small and high.

Wheeler, Lorien↗

"Making Safety Happen" Through Probabilistic Risk Assessment at NASA

NASA is using Probabilistic Risk Assessment (PRA) as one of the tools in its Safety & Mission Assurance (S&MA) tool belt to identify and quantify risks associated with human spaceflight. This paper discusses some of the challenges and benefits associated with developing and using PRA for NASA human space programs. Some programs have entered operation prior to developing a PRA, while some have implemented PRA from the start of the program. It has been observed that the earlier a design change is made in the concept or design phase, the less impact it has on cost and schedule. Not finding risks until the operation phase yields much costlier design changes and major delays, which can result in discussions of just accepting the risk. Risk contributors identified by PRA are not just associated with hardware failures. They include but are not limited to crew fatality due to medical causes, the environment the vehicle and crew are exposed to, the software being used, and the reliability of the crew performing required actions. Some programs have entered operation prior to developing a PRA, and while PRA can still provide a benefit for operations and future design trades, the benefit of implementing PRA from the start of the program provides the added benefit of informing design and reducing risk early in program development. Currently, NASA’s International Space Station (ISS) program is in its 20th year of on-orbit operations around the Earth and has several new programs in the design phase preparing to enter the operation phase all of which have active (or living) PRAs. These programs incorporate PRA as part of their Risk-Informed, Decision-Making (RIDM) process. For new NASA human spaceflight programs discussion begins with mission concept, establishing requirements, forming the PRA team, and continues through the design cycles into the operational phase. Several examples of PRA related applications and observed lessons are included.

Applications↗

Robustness Computation of Dynamic Controllability in Probabilistic Temporal Networks with Ordinary Distributions

Most existing works in Probabilistic Simple Temporal Networks (PSTNs) base their frameworks on well-defined probability distributions. This paper addresses on PSTN Dynamic Controllability (DC) robustness measure, i.e. the execution success probability of a network under dynamic control.We consider PSTNs where the probability distributions of the contingent edges are ordinary distributed (e.g. non-parametric, non-symmetric). We introduce the concepts of dispatching protocol (DP) as well as DP-robustness, the probability of success under a predefined dynamic policy.We propose a fixed-parameter pseudo-polynomial time algorithm to compute the exact DP-robustness of any PSTN under \textit{NextFirst} protocol, and apply to various PSTN datasets, including the real case of planetary exploration in the context of the Mars 2020 rover, and propose an original structural analysis.

Saint-Guillain, Michael↗

Bayesian Framework For Bioburden Density Calculations To Perform Planetary Protection Probabilistic Risk Assessment

The planetary protection discipline aims to minimize the microbial contamination on spacecraft to prevent the inadvertent contamination of other planetary bodies, known as forward planetary protection (PP). Planetary protection probabilistic risk assessment (PRA) relies on two core methodologies-the contamination probability event tree analysis and statistical parameter estimation. Planetary protection engineers combine several techniques to estimate the bioburden present on spacecraft components. A direct assay to enumerate CFU (colony forming units) is the preferred methodology, but given a similar processing environment the bioburden present on certain components is inferred using: (1) a NASA defined bioburden estimate based upon the biological cleanliness of the manufacturing/assembly environment or (2) sampled data from a similar spacecraft component. The paper presents an empirical Bayesian framework to systematically treat bioburden estimation and its uncertainties on different levels starting with measurement procedures to combining different components to subsystems and whole spacecraft. It is shown that the Bayesian approach can effectively handle estimations and their uncertainties at different levels and produce a reliable estimate for bioburden to be used to evaluate the probability of contamination.

Seuylemezian, Arman↗

Introduction to the IMPACT Probabilistic Risk and Tradespace Analysis Tool for Medical System Design

Background: Probabilistic risk analysis (PRA) is a method for estimating risk in complex engineered systems that, at a basic level, focuses on what can go wrong and the likelihood and consequences of those occurrences. NASA has used PRA as an integral component of medical system risk estimation and design for spaceflight. IMPACT (Informing Mission Planning via Analysis of Complex Tradespaces) is a novel tool to meet these goals for exploration missions. Overview: IMPACT performs hundreds of thousands of Monte Carlo simulations of missions to build aggregate pictures of medical risk. These simulations are based on 120 possible medical conditions (the IMPACT Condition List) selected in a consensus-based process because they are of highest likelihood and/or consequence for exploration spaceflight. The conditions are then tied to clinical capabilities which can be used for management (e.g., inserting an IV) and then to over 600 specific resources needed to deliver a capability (e.g., an angiocath or an ultrasound). Different mission profiles can be simulated with user-specified inputs such as mission duration, destination, number of crew and pre-existing medical conditions, and EVA frequency. While the IMPACT evidence base is designed for exploration environments, these user inputs allow the tool to be used across a broad range of missions. IMPACT’s primary outcome metrics include loss of crew life (LOCL, a measure of in-flight mortality due to medical conditions), need for evacuation (RTDC, return to definitive care), and crew disability (TTL, task time lost based on how medical conditions impact the ability to perform over 1000 specific exploration mission crew tasks). In addition to modeling medical risk, IMPACT also accepts user-specified constraints, such as limitations of mass or volume, and will output a recommended clinical capability set and specific medical resources that meet the mission constraints. Discussion: This abstract will provide an introduction to IMPACT and describe the nature of the underlying medical evidence. It will also detail potential use cases for how this tool can be utilized by NASA or commercial spaceflight providers.

Ben Easter↗

Probabilistic Approach to Assessing CCRS Capture System Performance Margin

In the aerospace industry, there are standard design principles and/or rule-of-thumb targets that define healthy levels of margins required at each developmental milestone for traditional metrics, such as mass, thermal, and power margins. When the technical resource is “non-traditional” in the sense that guiding margin principles are non-existent, systems engineering judgment is required to internally generate performance targets and methodologies to assess the system against the derived targets. This paper presents a probabilistic approach for assessing complex time-critical operations in order to apply global sensitivity analyses to identify input parameters that should (or should not) serve as design drivers.

Performance Margins↗

A Confidence-Based Approach to Including Survivors in a Probabilistic TID Failure Assessment

A probabilistic total ionizing dose (TID) failure assessment is extended to include survivor data, enabling the bounding of failure probability to a desired confidence level (CL) without failure data. The extension provides an avenue for analyzing microelectronics tested for TID without reaching a failure mode, a scenario often encountered by missions utilizing commercial-off-the-shelf (COTS) technologies. Using the type-I censored likelihood formulation and a realistic upper bound on expected device performance, the failure probability space is bounded by confidence contours within the context of a variable environment. The framework accommodates any type of distribution assumed for the part failure or the environment under consideration. Furthermore, the framework can be utilized pre-emptively to plan future device TID tests, minimizing costs while meeting survival requirements. Heritage data may also be used as survivors to further minimize testing costs when parts are from the same lot, but the amount of constraint derived from heritage is limited. Altogether, the framework enables a formal, mathematically rigorous analysis of radiation tolerant devices tested to a maximum dose, as well as flight heritage, in a hardness assurance methodology.

confidence↗

Artemis Missions Probabilistic Risk Assessment (PRA) & Reliability Assessment Overview

To show how NASA’s Moon-to-Mars (M2M) program can use hardware reliability assessments and comprehensive Probabilistic Risk Assessments (PRAs) to estimate risk of future missions and manage risk via safety and mission success requirements from the top down, so that this risk can be balanced with other program metrics like cost and schedule. These PRAs and reliability assessments can be used during the concept, design, and operational phases of development. This presentation also provides some thoughts on how the NASA process can be utilized for a lunar surface power grid development.

PRA↗

Probabilistic Hydrological Estimation of LandSlides (PHELS): Global Ensemble Landslide Hazard Modelling

In this study we present a model for the global Probabilistic Hydrological Estimation of LandSlides (PHELS). PHELS estimates the daily hazard of hydrologically triggered landslides at a coarse spatial resolution of 36 km, by combining landslide susceptibility (LSS) and (percentiles of) hydrological variable(s). The latter include daily rainfall, a 7-day antecedent rainfall index (ARI7) or root-zone soil moisture content (rzmc) as hydrological predictor variables, or the combination of rainfall and rzmc. The hazard estimates with any of these predictor variables have areas under the receiver operating characteristic curve (AUC) above 0.68. The best performance was found with combined rainfall and rzmc predictors (AUC = 0.79), which resulted in the lowest number of missed alarms (especially during spring) and false alarms. Furthermore, PHELS provides hazard uncertainty estimates by generating ensemble simulations based on repeated sampling of LSS and the hydrological predictor variables. The estimated hazard uncertainty follows the behaviour of the input variable uncertainties, is about 13.6 % of the estimated hazard value on average across the globe and in time and is smallest for very low and very high hazard values.

Anne Felsberg↗

Probabilistic Approach to Assessing Capture System Performance Margin in Mars Sample Return's Capture, Containment, and Return System

In the aerospace industry, there are standard design principles and/or rule-of-thumb targets that define healthy levels of margins required at each developmental milestone for traditional metrics, such as mass, thermal, and power margins. When the technical resource is “non-traditional,” in the sense that guiding margin principles are non-existent, systems engineering processes are required to internally generate performance targets and methodologies to assess the system against the derived targets. This paper presents a probabilistic approach for assessing complex time-critical operations which applies global sensitivity analyses to identify input parameters that should drive the design. This approach is used to design a critical payload required for the Mars Sample Return campaign aiming at bringing back rock and atmospheric samples from Mars.

Performance Margins↗

Validation of a Probabilistic Continuity Assessment Method for Earth Observation Portfolios

With the increased reliance on spaceborne Earth observation data among the Earth science community and other end users, it is important that efforts are made to promote data continuity for a range of parameters of interest. Continuity gaps may occur between missions measuring like parameters due to mission development delays or early termination and introduce the potential of increased uncertainty for retrieved parameters. To inform portfolio-level decisions for Earth observing missions, Ivanco et al. developed a method that enables the assessment of the probability of continuity gaps for multi-mission architectures and provides a framework to assess this probability in the context of multiple scenarios that represent possible future states of the architecture [Ivanco et al., “A Scenario-Based Approach to Assess Continuity Gaps in Earth Observations,” IEEE Aerospace Conf., 2024]. While this method was previously applied to assess continuity gaps for a specific multi-mission architecture, it had not yet been validated with historical data. This paper outlines the process of validating the probabilistic gap assessment method by utilizing data obtained from past NASA Earth Science mission formulation documents and provides a discussion of the results and takeaways from the validation. Future areas of improvement pertaining to both the modeling and simulation methodologies and underlying assumptions are identified and discussed.

Katharine Burn↗

Strategy for Risk Quantification of Spaceflight Crew Health and Performance Using Dynamic Probabilistic Risk Assessment

At NASA, the Crew Health and Performance (CHP) system represents the span of countermeasures, capabilities, interventions, and tested processes and procedures that in combination work to mitigate the human component of spaceflight mission risk. Across the varying NASA mental models of the CHP system, the different functionalities needed to meet human flight systems standards can be broken down into specific categories (i.e. medical capability, environmental health, behavioral health). These categories can be further broken down into specific subgroups generally associated with the CHP functionalities meant to mitigate or buy down individual human system risks. Taking a similar development approach we seek to leverage dynamic probabilistic risk assessment as a means to quantify and relatively assess the human risk state within the crew health and performance domain. By utilizing existing tools as integrators, we propose a rapid development strategy for incorporating research and operational data that represent the influence of the CHP system functionalities, in order to provide order of magnitudes estimates of the influence on most human system risks outcomes. The model system utilizes a modest cumulative risk approach and that limits the scope to primary paths of influence between the CHP functionalities and human system risks, thus enabling quick prototypes of the integrative effects of CHP functional combinations to solicit valuable feedback from stakeholders and customers on the data, relationship, and structure of the integration.

Drayton Munster↗

Confidence-Based Buffer for Strategic Deconfliction with Probabilistic Operational Intent

This paper presents a methodology to expand the 95% confidence level of the elliptical geometry given by Unmanned Aircraft System (UAS) operators planning to fly Beyond Visual Line of Sight (BVLOS) to any confidence level before being fed to the strategic deconfliction (SD) module, effectively increasing the separation buffer between Operational Intents (OIs). To assess the performance of this approach, it is integrated within an adaptation of the Rolling Horizon with K-Position Search volume-based strategic deconfliction approach, previously developed at NASA Ames, preventing the 4D overlapping of OIs shaped by ellipses instead of traditional blocks. Safety and efficiency metrics are evaluated through the deconfliction of four simulated package delivery route network structures across the San Francisco Metropolitan Area with increasing numbers of crossing waypoints (network complexity). Safety assessment entails the in-house creation of a metric to quantify collision occurrences per flight hour based on the frequency at which the probabilistic operational volume segments are sampled, whereas efficiency is measured using ground delay. Results indicate that the largest buffer growth occurs when increasing the confidence level beyond 99.9% and demonstrate the negative impact of network complexity on both metrics, regardless of the OI geometry. Further, the ellipse-based SD adaptation more accurately estimates temporal separation at crossings, allowing deconflicted vehicles to be closer together. It is concluded that the proposed methodology enables the desired confidence level to serve as an effective controller of buffer size.

strategic deconfliction↗

Confidence-Based Buffer for Strategic Deconfliction with Probabilistic Operational Intent

This paper presents a methodology to expand the 95% confidence level of the elliptical geometry given by Unmanned Aircraft System (UAS) operators planning to fly Beyond Visual Line of Sight (BVLOS) to any confidence level before being fed to the strategic deconfliction (SD) module, effectively increasing the separation buffer between Operational Intents (OIs). To assess the performance of this approach, it is integrated within an adaptation of the Rolling Horizon with K-Position Search volume-based strategic deconfliction approach, previously developed at NASA Ames, preventing the 4D overlapping of OIs shaped by ellipses instead of traditional blocks. Safety and efficiency metrics are evaluated through the deconfliction of four simulated package delivery route network structures across the San Francisco Metropolitan Area with increasing numbers of crossing waypoints (network complexity). Safety assessment entails the in-house creation of a metric to quantify collision occurrences per flight hour based on the frequency at which the probabilistic operational volume segments are sampled, whereas efficiency is measured using ground delay. Results indicate that the largest buffer growth occurs when increasing the confidence level beyond 99.9% and demonstrate the negative impact of network complexity on both metrics, regardless of the OI geometry. Further, the ellipse-based SD adaptation more accurately estimates temporal separation at crossings, allowing deconflicted vehicles to be closer together. It is concluded that the proposed methodology enables the desired confidence level to serve as an effective controller of buffer size.

safety↗

Adaptive Sampling Algorithms for Probabilistic Risk Assessment of Nuclear Simulations

Nuclear simulations are often computationally expensive, time-consuming, and high-dimensional with respect to the number of input parameters. Thus exploring the space of all possible simulation outcomes is infeasible using finite computing resources. During simulation-based probabilistic risk analysis, it is important to discover the relationship between a potentially large number of input parameters and the output of a simulation using as few simulation trials as possible. This is a typical context for performing adaptive sampling where a few observations are obtained from the simulation, a surrogate model is built to represent the simulation space, and new samples are selected based on the model constructed. The surrogate model is then updated based on the simulation results of the sampled points. In this way, we attempt to gain the most information possible with a small number of carefully selected sampled points, limiting the number of expensive trials needed to understand features of the simulation space. We analyze the specific use case of identifying the limit surface, i.e., the boundaries in the simulation space between system failure and system success. In this study, we explore several techniques for adaptively sampling the parameter space in order to reconstruct the limit surface. We focus on several adaptive sampling schemes. First, we seek to learn a global model of the entire simulation space using prediction models or neighborhood graphs and extract the limit surface as an iso-surface of the global model. Second, we estimate the limit surface by sampling in the neighborhood of the current estimate based on topological segmentations obtained locally. Our techniques draw inspirations from topological structure known as the Morse-Smale complex. We highlight the advantages and disadvantages of using a global prediction model versus local topological view of the simulation space, comparing several different strategies for adaptive sampling in both contexts. One of the most interesting models we propose attempt to marry the two by obtaining a coarse global representation using prediction models, and a detailed local representation based on topology. Our methods are validated on several analytical test functions as well as a small nuclear simulation dataset modeled after a simplified Pressurized Water Reactor.

97 MATHEMATICS AND COMPUTING↗