Engineering Papers⌕ Search

Engineering topics

Mathias, Donovan L.

Publications and source records attributed to Mathias, Donovan L..

At least 19 records

Risk and Performance Assessment of Generic Mission Architectures: Showcasing the Artemis Mission

A has initiated a strong push to return face. In this work, we astronaut assess performance and risk for proposed mission architectures using a new Mission Architecture Risk Assessment (MARA) tool. The MARA tool can produce statistics about the availability of components and overall performance of the mission considering potential failures of any of its components. In a Monte Carlo approach, the tool repeats the mission simulation multiple times while a random generator lets modules fail according to their failure rates. The results provide statistically meaningful insights into the overall performance of the chosen architecture. A given mission architecture can be freely replicated in the tool, with the mission timeline and basic characteristics of employed mission modules (habitats, rovers, power generation units, etc.) specified in a configuration file. Crucially, failure rates for each module need to be known or estimated. The tool performs an event-driven simulation of the mission and accounts for random failure events. Failed modules can be repaired, which takes crew time but restores operations. In addition to tracking individual modules, MARA can assess the availability of predefined functions throughout the mission. For instance, the function of resource collection would require a rover to collect the resources, a power generation unit to charge the rover, and a resource processing module. Together, the modules that are required for a given function are called a functional group. Similarly, we can assess how much crew time is available to achieve a mission benefit (e.g. research, building a base, etc) as opposed to spending crew time on repairs. Here we employ the method on the proposed NASA Artemis mission. Artemis aims to return United States astronauts to the lunar surface by 2024. Results provide insights into mission failure probabilities, up- and downtime for individual modules and crew-time resources spent on the repair of failed modules. The tool also allows us to tweak the mission architecture in order to find setups that produce more favorable mission performance. As such, the tool can be an aid in improving the mission architect abling cost-benefit analysis for mission improvement.

Rumpf, Clemens M.↗

Simulation-Based Height of Burst Map for Asteroid Airburst Damage Prediction

Entry and breakup models predict that airburst in the Earth's atmosphere is likely for asteroids up to approximately 200 meters in diameter. Objects of this size can deposit over 250 megatons of energy into the atmosphere. Fast-running ground damage prediction codes for such events rely heavily upon methods developed from nuclear weapons research to estimate the damage potential for an airburst at altitude. (Collins, 2005; Mathias, 2017; Hills and Goda, 1993). In particular, these tools rely upon the powerful yield scaling laws developed for point-source blasts that are used in conjunction with a Height of Burst (HOB) map to predict ground damage for an airburst of a specific energy at a given altitude. While this approach works extremely well for yields as large as tens of megatons, it becomes less accurate as yields increase to the hundreds of megatons potentially released by larger airburst events. This study revisits the assumptions underlying this approach and shows how atmospheric buoyancy becomes important as yield increases beyond a few megatons. We then use large-scale three-dimensional simulations to construct numerically generated height of burst maps that are appropriate at the higher energy levels associated with the entry of asteroids with diameters of hundreds of meters. These numerically generated HOB maps can then be incorporated into engineering methods for damage prediction, significantly improving their accuracy for asteroids with diameters greater than 80-100 m.

Burst Map↗

Using Information from Rendezvous Missions For Best-Case Appraisals of Impact Damage to Planet Earth Caused By Natural Objects

The Asteroid Threat Assessment Project (ATAP), a part of NASAs Planetary Defense Coordination Office (PDCO) has the responsibility to appraise the range of surface damage by potential asteroid impacts on land or water. If a threat is realized, the project will provide appraisals to officials empowered to make decisions on potential mitigation actions. This paper describes a scenario for assessment of surface damage when characterization of an asteroid had been accomplished by a rendezvous mission that would be conducted by the international planetary defense community. It is shown that the combination of data from ground and in-situ measurements on an asteroid provides knowledge that can be used to pin-point its impact location and predict the level of devastation it would cause. The hypothetical asteroid 2017 PDC with a size of 160 to 290 m in diameter to be discussed at the PDC 2017 meeting is used as an example. In order of importance for appraising potential damage, information required is: (1) where will the surface impact occur? (2) What is the mass, shape and size of the asteroid and what is its entry state (speed and entry angle) at the 100 km atmospheric pierce point? And (3) is the asteroid a monolith or a rubble pile? If it is a rubble pile, what is its sub and interior structure? Item (1) is of first order importance to determine levels of devastation (loss of life and infrastructure damage) because it varies strongly on the impact location. Items (2) and (3) are used as input for ATAPs simulations to define the level of surface hazards: winds, overpressure, thermal exposure; all created by the deposition of energy during the objects atmospheric flight, and/or cratering. Topics presented in this paper include: (i) The devastation predicted by 2017 PDCs impact based on initial observations using ATAPs risk assessment capability, (ii) How information corresponding to items (1) to (3) could be obtained from a rendezvous mission, and (iii) How information from a rendezvous mission could be used, along with that from ground observations and data from the literature, could provide input for an new risk analysis capability that is emerging from ATAPs research. It is concluded that this approach would result in appraisal with the least uncertainty possible (herein called the best-case) using simulation capabilities that are currently available or will be in the future.

Arnold, James O.↗

Using Information from Rendezvous Missions for Best-Case Appraisals of Impact Damage to Planet Earth Caused by Natural Objects

The Asteroid Threat Assessment Project (ATAP), a part of NASAs Planetary Defense Coordination Office (PDCO) has the responsibility to appraise the range of surface damage by potential asteroid impacts on land or water. If a threat is realized, the project will provide appraisals to officials empowered to make decisions about potential mitigation actions. This paper describes a scenario for assessment of surface damage when characterization of an asteroid had been accomplished by a rendezvous mission that would be conducted by the international planetary defense community. It is shown that the combination of data from ground and in-situ measurements on an asteroid provides knowledge that can be used to pin-point its impact location and predict the level of devastation it would cause. The hypothetical asteroid 2017 PDC with a size range of 160 to 290 m in diameter to be discussed at the PDC 2017 is used as an example. In order of importance for appraising potential damage, information required is: (1) where will the surface impact occur? (2) what is the mass, shape and size of the asteroid and what is its entry state (speed and entry angle) at the 100 km atmospheric pierce point? And (3) is the asteroid a monolith or a rubble pile? If it is a rubble pile, what is its structure and heterogeneity from the surface and throughout its interior? Item (1) is of first order importance to determine levels of devastation (loss of life and infrastructure damage) because it varies strongly on the impact location. Items (2) and (3) are used as inputs for ATAPs simulations to define the level of surface hazards: winds, overpressure, thermal exposure; all created by the deposition of energy during the objects atmospheric flight, andor cratering. Topics presented in this paper include: (i) the devastation predicted by 2017 PDCs impact on land based on initial observations using ATAPs risk assessment capability, (ii) how information corresponding to items (1) to (3) could be obtained from a rendezvous mission, and (iii) how information from a rendezvous mission could be used, along with that from ground observations and data from the literature to provide input for a new risk analysis capability that is emerging from ATAPs research. It is concluded that this approach would result in the creation of an appraisal of the threat from 2017 PDC with the least uncertainty possible, herein called the best-case.

Asteroid Impact Appraisals↗

Mission Success of U.S. Launch Vehicle Flights from a Propulsion Stage-Based Perspective: 1980-2015

This report documents a study of the historical safety and reliability trends of U.S. space launch vehicles from 1980 to 2015. The launch data history is examined to determine whether propulsion technology choices drove launch system risk and is used to understand how different propulsion system failures manifested into different failure scenarios. The historical data is processed by launch vehicle stage, where a stage is limited by definition to a single propulsion technology, either liquid or solid. Results are aggregated in terms of failure trends and manifestations as a functions of different propulsion stages. Failure manifestations are analyzed in order to understand the types and frequencies of accident environments in which an abort system for a crewed vehicle would be required to operate.

propulsion↗

Numerical Simulation of Bolide Entry with Ground Footprint Prediction

As they decelerate through the atmosphere, meteors deposit mass, momentum and energy into the surrounding air at tremendous rates. Trauma from the entry of such bolides produces strong blast waves that can propagate hundreds of kilometers and cause substantial terrestrial damage even when no ground impact occurs. We present a new simulation technique for airburst blast prediction using a fully-conservative, Cartesian mesh, finite-volume solver and investigate the ability of this method to model far- field propagation over hundreds of kilometers. The work develops mathematical models for the deposition of mass, momentum and energy into the atmosphere and presents verification and validation through canonical problems and the comparison of surface overpressures, and blast arrival times with actual results in the literature for known bolides. The discussion also examines the effects of various approximations to the physics of bolide entry that can substantially decrease the computational expense of these simulations. We present parametric studies to quantify the influence of entry-angle, burst-height and other parameters on the ground footprint of the airburst, and these values are related to predictions from analytic and handbook-methods.

Simulation↗

Dynamic Simulation Probabalistic Risk Assessment Model for an Enceladus Sample Return Mission

Enceladus, a moon of Saturn, has geyser-like jets that spray plumes of material into orbit. These jets could enable a free-flying spacecraft to collect samples and return them to Earth for study to determine if they contain the building blocks of life. The Office of Planetary Protection at NASA requires containment of any unsterilized samples and prohibits destructive impact of the spacecraft upon return to Earth, with a sample release probability of less than 1 in 1,000,000 as a recommended goal. This paper describes a probabilistic risk assessment model that uses dynamic simulation techniques to capture the physics-based, time- and state-dependent interactions between the sample return system and the environment, which drive the risk of sample release. The dynamic approach uses a Monte Carlo-style simulation to integrate the many phases and sources of risk for a sample return mission. The model is used to assess the achievability of the planetary protection reliability goal. This is accomplished by performing sensitivity studies assessing the impact of modeling assumptions to identify where uncertainties drive the risk. These results, in turn, are used to examine the feasibility of meeting key design and performance parameters that are needed to achieve the reliability goal for a given architecture with existing technologies.

Dynamic Simulation↗

Comparative Analysis of Static and Dynamic Probabilistic Risk Assessment

This study examines three different methodologies for producing loss-of-mission (LOM) and loss-of-crew (LOC) risks estimates for probabilistic risk assessments (PRA) of crewed spacecraft. The three bottom-up, component-based PRA approaches examined are a traditional static fault tree, a dynamic Monte Carlo simulation, and a fault tree hybrid that incorporates some dynamic elements. These approaches were used to model the reaction control system thruster pod of a generic crewed spacecraft and mission, and a comparative analysis of the methods is presented. The methodologies are assessed in terms of the process of modeling a system, the actionable information produced for the design team, and the overall fidelity of the quantitative risk evaluation generated. The system modeling process is compared in terms of the effort required to generate the initial model, update the model in response to design changes, and support mass-versus-risk trade studies. The results are compared by examining the top-level LOM/LOC estimates and the relative risk driver rankings at the failure mode level. The fidelity of each modeling methodology is discussed in terms of its capability to handle real-world system dynamics such as cold-sparing, changes in mission operations due to loss of redundancy, and common cause failure modes. The paper also discusses the applicability of each methodology to different phases of system development and shows that a single methodology may not be suitable for all of the many purposes of a spacecraft PRA. The fault tree hybrid approach is shown to be best suited to the needs of early assessments during conceptual design phases. As the design begins to mature, the level of detail represented in the risk model must go beyond redundancy and nominal mission operations to include dynamic, time- and state-dependent system responses as well as diverse system capabilities. This is best accomplished using the dynamic simulation approach, since these phenomena are not easily captured by static methods. Ultimately, once the design has been finalized and the goal of the PRA is to provide design validation and requirement verification, more traditional, static fault tree approaches may become as appropriate as the simulation method.

Mattenberger, Christopher J.↗

Engineering Risk Assessment of Space Thruster Challenge Problem

The Engineering Risk Assessment (ERA) team at NASA Ames Research Center utilizes dynamic models with linked physics-of-failure analyses to produce quantitative risk assessments of space exploration missions. This paper applies the ERA approach to the baseline and extended versions of the PSAM Space Thruster Challenge Problem, which investigates mission risk for a deep space ion propulsion system with time-varying thruster requirements and operations schedules. The dynamic mission is modeled using a combination of discrete and continuous-time reliability elements within the commercially available GoldSim software. Loss-of-mission (LOM) probability results are generated via Monte Carlo sampling performed by the integrated model. Model convergence studies are presented to illustrate the sensitivity of integrated LOM results to the number of Monte Carlo trials. A deterministic risk model was also built for the three baseline and extended missions using the Ames Reliability Tool (ART), and results are compared to the simulation results to evaluate the relative importance of mission dynamics. The ART model did a reasonable job of matching the simulation models for the baseline case, while a hybrid approach using offline dynamic models was required for the extended missions. This study highlighted that state-of-the-art techniques can adequately adapt to a range of dynamic problems.

Assessment↗

Conceptual Launch Vehicle and Spacecraft Design for Risk Assessment

One of the most challenging aspects of developing human space launch and exploration systems is minimizing and mitigating the many potential risk factors to ensure the safest possible design while also meeting the required cost, weight, and performance criteria. In order to accomplish this, effective risk analyses and trade studies are needed to identify key risk drivers, dependencies, and sensitivities as the design evolves. The Engineering Risk Assessment (ERA) team at NASA Ames Research Center (ARC) develops advanced risk analysis approaches, models, and tools to provide such meaningful risk and reliability data throughout vehicle development. The goal of the project presented in this memorandum is to design a generic launch 7 vehicle and spacecraft architecture that can be used to develop and demonstrate these new risk analysis techniques without relying on other proprietary or sensitive vehicle designs. To accomplish this, initial spacecraft and launch vehicle (LV) designs were established using historical sizing relationships for a mission delivering four crewmembers and equipment to the International Space Station (ISS). Mass-estimating relationships (MERs) were used to size the crew capsule and launch vehicle, and a combination of optimization techniques and iterative design processes were employed to determine a possible two-stage-to-orbit (TSTO) launch trajectory into a 350-kilometer orbit. Primary subsystems were also designed for the crewed capsule architecture, based on a 24-hour on-orbit mission with a 7-day contingency. Safety analysis was also performed to identify major risks to crew survivability and assess the system's overall reliability. These procedures and analyses validate that the architecture's basic design and performance are reasonable to be used for risk trade studies. While the vehicle designs presented are not intended to represent a viable architecture, they will provide a valuable initial platform for developing and demonstrating innovative risk assessment capabilities.

Launch Vehicle↗

Comparative Analysis of Static and Dynamic Probabilistic Risk Assessment

Implementation of risk-informed design allows the design team to thoroughly explore the risks of a system while iterating the operations concept, design, and requirements until the system meets mission objects and is achievable within constraints. To arrive at a space system design that is likely to meet all constraints placed upon mass, cost, performance and risk, the system requirements must be understood and traded against each other as early as the conceptual design phase. Depending on the project phase and the goals of the risk analysis, various PRA methodologies could be used to produce quantitative risk estimates to enable such a process. In order to better understand the applicability, advantages, and limitations of various PRA methodologies, a comparative analysis of three bottom-up, component-based PRA approaches was performed. The three methods examined are a traditional static fault tree, a fault tree hybrid, and a dynamic Monte Carlo simulation. Each approach was used to assess a generic reaction control system (RCS) thruster pod and mission. The methods are assessed in terms of the process of modeling a system, the actionable information produced for the design team, and the overall fidelity of the quantitative risk evaluation generated. The paper also discusses the applicability of each methodology to the different phases of system development.

Probablistic↗

Simulation Assisted Risk Assessment Applied to Launch Vehicle Conceptual Design

A simulation-based risk assessment approach is presented and is applied to the analysis of abort during the ascent phase of a space exploration mission. The approach utilizes groupings of launch vehicle failures, referred to as failure bins, which are mapped to corresponding failure environments. Physical models are used to characterize the failure environments in terms of the risk due to blast overpressure, resulting debris field, and the thermal radiation due to a fireball. The resulting risk to the crew is dynamically modeled by combining the likelihood of each failure, the severity of the failure environments as a function of initiator and time of the failure, the robustness of the crew module, and the warning time available due to early detection. The approach is shown to support the launch vehicle design process by characterizing the risk drivers and identifying regions where failure detection would significantly reduce the risk to the crew.

Mathias, Donovan L.↗

Technology Development Risk Assessment for Space Transportation Systems

A new approach for assessing development risk associated with technology development projects is presented. The method represents technology evolution in terms of sector-specific discrete development stages. A Monte Carlo simulation is used to generate development probability distributions based on statistical models of the discrete transitions. Development risk is derived from the resulting probability distributions and specific program requirements. Two sample cases are discussed to illustrate the approach, a single rocket engine development and a three-technology space transportation portfolio.

Mathias, Donovan L.↗

Launch Architecture Impact on Ascent Abort and Crew Survival

A study was performed to assess the effect of booster configuration on the ascent abort process. A generic abort event sequence was created and booster related risk drivers were identified. Three model boosters were considered in light of the risk drivers: a solid rocket motor configuration, a side mount combination solid and liquid configuration, and a stacked liquid configuration. The primary risk drivers included explosive fireball, overpressure, and fragment effects and booster-crew module re-contact. Risk drivers that were not specifically booster dependent were not addressed. The solid rocket configuration had the most benign influence on an abort while the side mount architecture provided the most challenging abort environment.

Mathias, Donovan L.↗

Trade Studies of Space Launch Architectures using Modular Probabilistic Risk Analysis

A top-down risk assessment in the early phases of space exploration architecture development can provide understanding and intuition of the potential risks associated with new designs and technologies. In this approach, risk analysts draw from their past experience and the heritage of similar existing systems as a source for reliability data. This top-down approach captures the complex interactions of the risk driving parts of the integrated system without requiring detailed knowledge of the parts themselves, which is often unavailable in the early design stages. Traditional probabilistic risk analysis (PRA) technologies, however, suffer several drawbacks that limit their timely application to complex technology development programs. The most restrictive of these is a dependence on static planning scenarios, expressed through fault and event trees. Fault trees incorporating comprehensive mission scenarios are routinely constructed for complex space systems, and several commercial software products are available for evaluating fault statistics. These static representations cannot capture the dynamic behavior of system failures without substantial modification of the initial tree. Consequently, the development of dynamic models using fault tree analysis has been an active area of research in recent years. This paper discusses the implementation and demonstration of dynamic, modular scenario modeling for integration of subsystem fault evaluation modules using the Space Architecture Failure Evaluation (SAFE) tool. SAFE is a C++ code that was originally developed to support NASA s Space Launch Initiative. It provides a flexible framework for system architecture definition and trade studies. SAFE supports extensible modeling of dynamic, time-dependent risk drivers of the system and functions at the level of fidelity for which design and failure data exists. The approach is scalable, allowing inclusion of additional information as detailed data becomes available. The tool performs a Monte Carlo analysis to provide statistical estimates. Example results of an architecture system reliability study are summarized for an exploration system concept using heritage data from liquid-fueled expendable Saturn V/Apollo launch vehicles.

Mathias, Donovan L.↗