Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “probability risk analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Assessing Geo and Leo Repeating Conjunctions Using High Fidelity Brute Force Monte Carlo Simulations

Probability of collision (P(sub c)) estimates for Earth-orbiting satellites typically assume a temporally-isolated conjunction event. However, under certain conditions two objects may experience multiple high-risk close approach events over the course of hours or days. In these repeating conjunction cases, the P(sub c) accumulates as each successive encounter occurs. The NASA Conjunction Assessment Risk Analysis team has updated its “brute force Monte Carlo” (BFMC) software to estimate such accumulating P(sub c) values for repeating conjunctions. This study describes the updated BFMC algorithm and discusses the implications for conjunction risk assessment.

Baars, Luis↗

Development of NASA's Accident Precursor Analysis Process Through Application on the Space Shuttle Orbiter

Accident Precursor Analysis (APA) serves as the bridge between existing risk modeling activities, which are often based on historical or generic failure statistics, and system anomalies, which provide crucial information about the failure mechanisms that are actually operative in the system. APA docs more than simply track experience: it systematically evaluates experience, looking for under-appreciated risks that may warrant changes to design or operational practice. This paper presents the pilot application of the NASA APA process to Space Shuttle Orbiter systems. In this effort, the working sessions conducted at Johnson Space Center (JSC) piloted the APA process developed by Information Systems Laboratories (ISL) over the last two years under the auspices of NASA's Office of Safety & Mission Assurance, with the assistance of the Safety & Mission Assurance (S&MA) Shuttle & Exploration Analysis Branch. This process is built around facilitated working sessions involving diverse system experts. One important aspect of this particular APA process is its focus on understanding the physical mechanism responsible for an operational anomaly, followed by evaluation of the risk significance of the observed anomaly as well as consideration of generalizations of the underlying mechanism to other contexts. Model completeness will probably always be an issue, but this process tries to leverage operating experience to the extent possible in order to address completeness issues before a catastrophe occurs.

Maggio, Gaspare↗

NASA's Human Mission to a Near-Earth Asteroid: Landing on a Moving Target

This paper describes a Bayesian approach for comparing the productivity and cost-risk tradeoffs of sending versus not sending one or more robotic surveyor missions prior to a human mission to land on an asteroid. The expected value of sample information based on productivity combined with parametric variations in the prior probability an asteroid might be found suitable for landing were used to assess the optimal number of spacecraft and asteroids to survey. The analysis supports the value of surveyor missions to asteroids and indicates one launch with two spacecraft going simultaneously to two independent asteroids appears optimal.

precursor decision making↗

Pitfalls and Precautions When Using Predicted Failure Data for Quantitative Analysis of Safety Risk for Human Rated Launch Vehicles

Launch vehicle reliability analysis is largely dependent upon using predicted failure rates from data sources such as MIL-HDBK-217F. Reliability prediction methodologies based on component data do not take into account system integration risks such as those attributable to manufacturing and assembly. These sources often dominate component level risk. While consequence of failure is often understood, using predicted values in a risk model to estimate the probability of occurrence may underestimate the actual risk. Managers and decision makers use the probability of occurrence to influence the determination whether to accept the risk or require a design modification. The actual risk threshold for acceptance may not be fully understood due to the absence of system level test data or operational data. This paper will establish a method and approach to identify the pitfalls and precautions of accepting risk based solely upon predicted failure data. This approach will provide a set of guidelines that may be useful to arrive at a more realistic quantification of risk prior to acceptance by a program.

Hatfield, Glen S.↗

Propellant injection systems and processes

The previous 'Art of Injector Design' is maturing and merging with the more systematic 'Science of Combustion Device Analysis.' This technology can be based upon observation, correlation, experimentation and ultimately analytical modeling based upon basic engineering principles. This methodology is more systematic and far superior to the historical injector design process of 'Trial and Error' or blindly 'Copying Past Successes.' The benefit of such an approach is to be able to rank candidate design concepts for relative probability of success or technical risk in all the important combustion device design requirements and combustion process development risk categories before committing to an engine development program. Even if a single analytical design concept cannot be developed to predict satisfying all requirements simultaneously, a series of risk mitigation key enabling technologies can be identified for early resolution. Lower cost subscale or laboratory experimentation to demonstrate proof of principle, critical instrumentation requirements, and design discriminating test plans can be developed based on the physical insight provided by these analyses.

Ito, Jackson I.↗

Decision Aid for Conjunction Risk Mitigation by Differential Drag

In the previous five years, the rate of conjunctions that the NASA Conjunction Assessment Risk Analysis (CARA) team processed and analyzed has more than tripled. (NASA CARA, 2024) New missions in the early development phases are now required to plan for dealing with conjunctions under the present space environment, and also projecting forward into a future likely with even further increased utilization of the space environment. Some missions are investigating the possibility of using differential drag to remediate conjunctions without expending limited fuel or for missions without propulsive capabilities. The NASA CARA team studied the historical record of conjunctions to evaluate the circumstances under which differential drag may be successfully applied and have developed a series of tables to use as a decision aid for missions considering differential drag. Currently, if a CARA-protected mission with maneuvering capabilities is predicted to have a conjunction with probability of collision (Pc) greater than 7E-5 (the default value of the ‘yellow threshold’, which may have some other value agreed by CARA and the mission during the Orbital Collison Avoidance Planning (OCAP) process), CARA will use its Maneuver Trade Space (MTS) tool to evaluate and recommend options for the timing and magnitude of a risk mitigation maneuver (RMM), based on the mission’s capabilities. If the conjunction’s Pc is greater than 1E-4, the ‘red threshold’, then an RMM must be executed per NASA Procedural Requirements (NPR) 8079.1 (NASA, 2023), although missions may execute an RMM even if the Pc is lower. The magnitude of the maneuver is typically a few cm/s, and CARA estimates how many will be required for the mission’s nominal lifetime – typically a few per year – during the OCAP process, to inform the mission’s delta-V requirement. For traditional satellites, this is usually smaller than other requirements for orbit insertion, maintenance, and disposal, but for CubeSats or other small satellite missions, a propulsion system may not provide much more than a few cm/s of delta-V or may not fit at all within the available budget of money, time, size, weight, and/or power (SWaP). Conversely, CubeSats often have deployable solar panels, which offer the capacity to have much higher areas facing some directions than others. Such a mission can instead use ‘differential drag’ to remediate a conjunction -- in other words, change its drag area (usually increasing) to deviate from the predicted collision course. This is how Planet’s Dove spacecraft maintain their formations and remediate conjunction risks without having on-board propulsion (Foster, et al., 2017) (Griffith, et al., 2021). CARA has been developing improvements to MTS to support differential-drag for NASA's missions -- where it is effective. CARA records all conjunctions of their protected payloads, with historical records starting in 2005 (with significant conjunction events starting to occur on or after 2013). From this record, approximately 7,300 had a Pc greater than 1E-4 at 3 days prior to the time of closest approach, the time analyzed for differential drag efficacy. Of those, approximately 4,300 had fully-defined covariance matrices stored for both the primary and secondary objects; this set of conjunctions is the basis for the analysis of this work. CARA’s MTS tool was used to propagate the primary satellite forward from that decision point with varying degrees of increase to ballistic coefficient (BC). Because these conjunctions came from multiple missions, the nondimensional ‘delta-BC’ factor was used to quantify and normalize the increase in ballistic coefficient, defined as follows: Delta-BC = BC_new / BC_old - 1 Positive delta-BC factors represent an increase in drag compared to the nominal attitude, while negative delta-BC factors (to a minimum of -1) represent a decrease in drag. At the conclusion of the differential-drag ‘maneuver’, the Pc was recalculated to evaluate whether or not the conjunction was mitigated (Pc < 3E-6). These results were then binned and sorted along several axes, including altitude, amount of delta-BC, and (pre-maneuver) rate of energy dissipation (EDR), to identify underlying patterns. The altitude plot is shown in Figure 1. To validate this analysis, we consulted the record of a NASA mission which uses differential drag to maintain its orbit and remediate conjunction risk. CARA’s empirical record of the mission’s orbit history suggests it achieves a delta-BC of 2.2. Of the twenty-one RMM plans that were submitted by this mission, eighteen were matched with conjunctions in the historical record; of those, twelve were successfully remediated (final measured Pc < 3E-6), and six were not. This is consistent with the expected efficacy for missions orbiting at that altitude. We are presently simulating this mission’s RMMs with MTS; this work is ongoing, but so far, the MTS results are qualitatively in agreement with the empirical results -- correctly predicting that a maneuver would or would not remediate a conjunction, if not exactly matching the final post-remediation Pc value. We found that differential drag was most successful for satellites with perigees below 560 km, and which could adopt an average delta-BC of 2 or greater (that is, increasing their ballistic coefficient by a factor of 3). However, this is a difficult threshold for a mission to clear; very few spacecraft are capable of adopting a high-drag configuration for 72 hours continuously. Planet’s Dove spacecraft use differential drag to remediate conjunctions (Griffith, et al., 2021), and they have a maximum delta-BC factor of 9, but in practice (with mission and charging constraints) they achieve a time-averaged delta-BC that is closer to 2 (Foster, et al., 2017). A mission’s differential drag utility strongly depends on the operational constraints that has the capacity to limit the time-averaged delta-BC. A mission with a high maximum delta-BC of 5 or more can have an effective delta-BC of less than 1 due to operational constraints such as instrument and solar panel pointing, especially if this constraint results in holding an intermediate drag value for most of its orbit. CARA has developed tables that can be used as decision aids to advise missions-in-development about the best way to utilize their differential drag capabilities. For missions below 560 km with the operational flexibility to devote multiple days to holding a high-drag configuration (or a sufficiently high drag ratio to compensate for limitations on that time), they are -- more likely than not -- able to successfully remediate high-risk conjunctions. Conversely, missions that do not meet these exacting criteria -- most missions -- can instead be advised to use on-board propulsion systems to perform RMMs, or to turn their minimum-area face towards the approach vector, thereby reducing Pc at the moment of conjunction due to the decreased Hard-Body Radius (HBR), that is a strongly correlated variable in the Pc calculations. (NASA, 2023)

conjunction assessment↗

Probabilistic structural analysis algorithm development for computational efficiency

The PSAM (Probabilistic Structural Analysis Methods) program is developing a probabilistic structural risk assessment capability for the SSME components. An advanced probabilistic structural analysis software system, NESSUS (Numerical Evaluation of Stochastic Structures Under Stress), is being developed as part of the PSAM effort to accurately simulate stochastic structures operating under severe random loading conditions. One of the challenges in developing the NESSUS system is the development of the probabilistic algorithms that provide both efficiency and accuracy. The main probability algorithms developed and implemented in the NESSUS system are efficient, but approximate in nature. In the last six years, the algorithms have improved very significantly.

Wu, Y.-T.↗

Effect of Cross-Correlation of Orbital Error on Probability of Collision Determination

This paper discusses the effect of global model error on probability of collision (Pc) determination. Modifications to the Pc formulation for cross-correlation of orbital error in prediction are developed and assessed for recent conjunctions. While specific geometries can be identified or constructed to produce significant change in Pc for the modified formulation, it is of operational interest to quanti- fy the relative occurrence of such cases for satellite conjunction risk assessment. Large-scale analysis is feasible per data collections in place over the past year.

Steve Casali↗

Uncertainties in obtaining high reliability from stress-strength models

There has been a recent interest in determining high statistical reliability in risk assessment of aircraft components. The potential consequences are identified of incorrectly assuming a particular statistical distribution for stress or strength data used in obtaining the high reliability values. The computation of the reliability is defined as the probability of the strength being greater than the stress over the range of stress values. This method is often referred to as the stress-strength model. A sensitivity analysis was performed involving a comparison of reliability results in order to evaluate the effects of assuming specific statistical distributions. Both known population distributions, and those that differed slightly from the known, were considered. Results showed substantial differences in reliability estimates even for almost nondetectable differences in the assumed distributions. These differences represent a potential problem in using the stress-strength model for high reliability computations, since in practice it is impossible to ever know the exact (population) distribution. An alternative reliability computation procedure is examined involving determination of a lower bound on the reliability values using extreme value distributions. This procedure reduces the possibility of obtaining nonconservative reliability estimates. Results indicated the method can provide conservative bounds when computing high reliability. An alternative reliability computation procedure is examined involving determination of a lower bound on the reliability values using extreme value distributions. This procedure reduces the possibility of obtaining nonconservative reliability estimates. Results indicated the method can provide conservative bounds when computing high reliability.

Neal, Donald M.↗

Useful Life Prediction for Payload Carrier Hardware

The Space Shuttle has been identified for use through 2020. Payload carrier systems will be needed to support missions through the same time frame. To support the future decision making process with reliable systems, it is necessary to analyze design integrity, identify possible sources of undesirable risk and recognize required upgrades for carrier systems. This project analyzed the information available regarding the carriers and developed the probability of becoming obsolete under different scenarios. In addition, this project resulted in a plan for an improved information system that will improve monitoring and control of the various carriers. The information collected throughout this project is presented in this report as process flow, historical records, and statistical analysis.

Ben-Arieh, David↗

Characterization of the Space Shuttle Ascent Debris using CFD Methods

After video analysis of space shuttle flight STS-107's ascent showed that an object shed from the bipod-ramp region impacted the left wing, a transport analysis was initiated to determine a credible flight path and impact velocity for the piece of debris. This debris transport analysis was performed both during orbit, and after the subsequent re-entry accident. The analysis provided an accurate prediction of the velocity a large piece of foam bipod ramp would have as it impacted the wing leading edge. This prediction was corroborated by video analysis and fully-coupled CFD/six degree of freedom (DOF) simulations. While the prediction of impact velocity was accurate enough to predict critical damage in this case, one of the recommendations of the Columbia Accident Investigation Board (CAIB) for return-to-flight (RTF) was to analyze the complete debris environment experienced by the shuttle stack on ascent. This includes categorizing all possible debris sources, their probable geometric and aerodynamic characteristics, and their potential for damage. This paper is chiefly concerned with predicting the aerodynamic characteristics of a variety of potential debris sources (insulating foam and cork, nose-cone ablator, ice, ...) for the shuttle ascent configuration using CFD methods. These aerodynamic characteristics are used in the debris transport analysis to predict flight path, impact velocity and angle, and provide statistical variation to perform risk analyses where appropriate. The debris aerodynamic characteristics are difficult to determine using traditional methods, such as static or dynamic test data, due to the scaling requirements of simulating a typical debris event. The use of CFD methods has been a critical element for building confidence in the accuracy of the debris transport code by bridging the gap between existing aerodynamic data and the dynamics of full-scale, in-flight events.

Murman, Scott M.↗

A methodology for probabilistic prediction of structural failures of launch vehicle propulsion systems

A quantitative methodology for estimating the probability of occurrence of critical structural failure modes of launch vehicle propulsion systems during mission operation is presented. In this approach, engineering analysis models that characterize specific failure modes based on the physics and mechanics of the failure phenomenon are used in a prescribed probabalistic structure in which quantified uncertainty in the information used in the analysis and quantified uncertainty of the engineering analysis models themselves are both considered in estimating failure risk. The methodology is applicable to high cycle fatigue, low cycle fatigue, flaw propagation stress rupture, and other failure modes of launch vehicle propulsion systems and other space-flight systems. The probabalistic failure assessment presented provides the capability of performing quantitative analyses to rank options to improve reliability, thereby enabling limited financial resources of development and improvement programs to be more effectively allocated.

Moore, N.↗

Probabilistic simulation of uncertainties in thermal structures

Development of probabilistic structural analysis methods for hot structures is a major activity at NASA-Lewis, and consists of five program elements: (1) probabilistic loads, (2) probabilistic finite element analysis, (3) probabilistic material behavior, (4) assessment of reliability and risk, and (5) probabilistic structural performance evaluation. Attention is given to quantification of the effects of uncertainties for several variables on High Pressure Fuel Turbopump blade temperature, pressure, and torque of the Space Shuttle Main Engine; the evaluation of the cumulative distribution function for various structural response variables based on assumed uncertainties in primitive structural variables; evaluation of the failure probability; reliability and risk-cost assessment; and an outline of an emerging approach for eventual hot structures certification. Collectively, the results demonstrate that the structural durability/reliability of hot structural components can be effectively evaluated in a formal probabilistic framework. In addition, the approach can be readily extended to computationally simulate certification of hot structures for aerospace environments.

Chamis, C. C.↗

Estimating Orion Heat Shield Failure Due To Ablator Cracking During The EFT-1 Mission

The Orion EFT-1 heatshield suffered from two major certification challenges: First, the mechanical properties used in design were not evident in the flight hardware and second, the flight article itself cracked during fabrication. The combination of these events motivated the Orion Program to pursue an engineering-level Probabilistic Risk Assessment (PRA) as part of heatshield certification rationale. The PRA provided loss of Mission (LOM) likelihoods considering the probability of a crack occurring during the mission and the likelihood of subsequent structure over-temperature. The methods and input data for the PRA are presented along with a discussion of the test data used to anchor the results. The Orion program accepted an EFT-1 Loss of Vehicle (LOV) risk of 1-in-160,000 due to in-mission Avcoat cracking based on the results of this analysis. Conservatisms in the result, along with future considerations for Exploration Missions (EM) are also addressed.

Avcoat↗

An Investigation Into Transecting Satellites in Future Space Traffic Management Scenarios

The number of satellites expected to populate the near-Earth space environment is set to dramatically increase in the coming decade as new large constellations are approved and deployed. Current strategies for deploying new batches of these satellites often involve launching into an initial orbit, and then performing apogee raising maneuvers to reach a target altitude. Similarly, end-of-life planning for these constellation satellites can consist of de-orbit burns that lower perigee to permit disposal via re-entry. Both the raising and de-orbiting maneuvers can result in the individual satellites traveling in transecting orbits that have the potential to cross other spacecraft trajectories. While individual large constellations may be able to coexist in separate altitude and inclination bands, having thousands of satellites moving between these bands as new satellites are added and old satellites are removed could pose additional collision risks. Similar concerns have been raised regarding the impact that large numbers of university-class CubeSats might have in terms of their overall collision risk, especially as these satellites typically do not have propulsion systems for active maneuvering. To assess the impact that transecting satellites might have on future space traffic management strategies, this study explored a variety of realistic future scenarios using a high-fidelity simulation tool. The model can simulate the orbit of tens of thousands of resident space objects (RSOs) simultaneously, to include active satellites, debris, rocket bodies, or even future hypothetical satellite constellations, using a realistic force model that incorporates non-spherical gravity, atmospheric drag, and solar radiation pressure, as well as station-keeping. The simulation can be customized to accommodate different methods of calculating the probability of collision, as well as the process for determining probability ellipsoids and screening volumes. This makes it possible to replicate, and compare, different processes used by different spacecraft operators and space situational awareness (SSA) providers. As the model is run forward in time, each conjunction event is recorded, allowing for the analysis of statistics and meta-data related to these events, providing insight into the nature and frequency of potential collisions, such as whether are they active or passive objects, what size are the two objects, and who owns the objects (if known). This information makes it possible to characterize how changes to the status quo affect the number and type of conjunctions that occur, as well as the distributional effects on various types of satellite operators. To assess the general risks that transecting satellites might pose for hypothetical future space object environments, approximately 60,000 new large constellation satellites were considered, in addition to the existing catalog of approximately 7800 known resident space objects (RSOs), over a simulation period of one year. The results indicate that the future space environment will introduce a non-linear increase in conjunction events as the number of RSOs also increase. This will require adjustments to spacecraft fuel budgets in order to conduct the avoidance maneuvers necessary to minimize collision risk, both for existing and new satellites. This increase is due in large part to the higher density of RSOs and the overlap between some constellation orbits. Current catalog objects were shown to require three times more ∆V for collision avoidance (CA) maneuvers in the simulated future environment, and some constellation spacecraft were estimated to devote the majority of their annual ∆V to CA. The impact of small satellites was found to be proportional for the current space environment, and actually decreased in terms of percentage for the future scenario, suggesting that small satellites do not pose an outsized collision risk. Lastly, transecting satellites were found to contribute thousands of additional conjunctions outside of their operational orbit, and may require up to an additional 5% in CA maneuver fuel allocation.

conjunction assessment↗

Application of Probabilistic Methods to Assess Risk Due to Resonance in the Design of J-2X Rocket Engine Turbine Blades

The LOX-Hydrogen J-2X Rocket Engine, which is proposed for use as an upper-stage engine for numerous earth-to-orbit and heavy lift launch vehicle architectures, is presently in the design phase and will move shortly to the initial development test phase. Analysis of the design has revealed numerous potential resonance issues with hardware in the turbomachinery turbine-side flow-path. The analysis of the fuel pump turbine blades requires particular care because resonant failure of the blades, which are rotating in excess of 30,000 revolutions/minutes (RPM), could be catastrophic for the engine and the entire launch vehicle. This paper describes a series of probabilistic analyses performed to assess the risk of failure of the turbine blades due to resonant vibration during past and present test series. Some significant results are that the probability of failure during a single complete engine hot-fire test is low (~1%) because of the small likelihood of resonance, but that the probability increases to around 30% for a more focused turbomachinery-only test because all speeds will be ramped through and there is a greater likelihood of dwelling at more speeds. These risk calculations have been invaluable for use by program management in deciding if risk-reduction methods such as dampers are necessary immediately or if the test can be performed before the risk-reduction hardware is ready.

Brown, Andrew M.↗

Validation of A Simulation Environment for Future Space Traffic Management

This study presents initial results of a newly developed simulation environment intendedto explore and assess future Space Traffic Management (STM) scenarios. The number ofnew Resident Space Objects (RSOs) in near-Earth orbit is expected to increase significantlywith the expected future deployment of a number of large constellations. These futurescenarios involve the addition of many tens of thousands of new RSOs, making the analysisinto their impact on collision risk extend beyond what traditional data-mining of present-dayconjunction data can reliably predict. To address this, a robust simulation environment wasdeveloped that implements a full force-model for orbit propagation, and computes continuousall-on-all conjunction statistics for arbitrarily large catalog sizes and simulation timeframes.Collision avoidance and station-keeping maneuvers can be optionally implemented based onconfigurable user inputs including physical characteristics and spacecraft meta-data (e.g.,commercial/government, owner country, etc.). Constellation build-out and de-orbit scenarioswere also implemented and modeled based on real-data analysis. Validation of the simulationresults was a critical component of the simulation development, and was done using the currentcatalog with comparisons against both public and internal NASA data-sets. The comparisonsdemonstrate that, with the appropriate settings, representative levels of conjunction ratesand probabilities can be obtained, providing confidence that the simulation tool can generatemeaningful outcomes for test scenarios. As an initial demonstration of the tool’s capabilities,year-long simulations with station-keeping were conducted to examine conjunction historiesusing both the current object catalog (5800 active satellites) and a hypothetical 60,000 objectscenario involving five potential large constellations. Output metrics include the number ofconjunction events, estimates of collision consequence (fragmentation), delta-V maneuver costs,and the probability of at least one collision occurring. The results highlight the potential thatthe simulation tool has for incorporating and running performance comparisons between, e.g.,various sets of maneuver guidelines, industry norms, and definitions of risk, with the overallobjective of providing actionable data to STM policy makers. The presentation will providean overview of the simulation development and validation efforts, as well as a discussion ofobservations gathered from the initial simulations performed.

conjunction assessment↗

An improved approach for flight readiness assessment

An improved methodology for quantitatively evaluating failure risk for a spaceflight system in order to assess flight readiness is presented. This methodology is of particular value when information relevant to failure prediction, including test experience and knowledge of parameters used in engineering analyses of failure phenomena, is limited. In this approach, engineering analysis models that characterize specific failure modes based on the physics and mechanics of the failure phenomena are used in a prescribed probabilistic structure to generate a failure probability distribution that is modified by test and flight experience in a Bayesian statistical procedure. The probabilistic structure and statistical methodology are generally applicable to any failure mode for which quantitative engineering analysis can be employed to characterize the failure phenomenon and are particularly well suited for use under the constraints on information availability that are typical of such spaceflight systems as the Space Shuttle and planetary spacecraft.

Moore, N. R.↗