Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Probabilistic models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31

A Probabilistic Framework for the Validation and Certification of Computer Simulations

The paper presents a methodology for quantifying, propagating, and managing the uncertainty in the data required to initialize computer simulations of complex phenomena. The purpose of the methodology is to permit the quantitative assessment of a certification level to be associated with the predictions from the simulations, as well as the design of a data acquisition strategy to achieve a target level of certification. The value of a methodology that can address the above issues is obvious, specially in light of the trend in the availability of computational resources, as well as the trend in sensor technology. These two trends make it possible to probe physical phenomena both with physical sensors, as well as with complex models, at previously inconceivable levels. With these new abilities arises the need to develop the knowledge to integrate the information from sensors and computer simulations. This is achieved in the present work by tracing both activities back to a level of abstraction that highlights their commonalities, thus allowing them to be manipulated in a mathematically consistent fashion. In particular, the mathematical theory underlying computer simulations has long been associated with partial differential equations and functional analysis concepts such as Hilbert spares and orthogonal projections. By relying on a probabilistic framework for the modeling of data, a Hilbert space framework emerges that permits the modeling of coefficients in the governing equations as random variables, or equivalently, as elements in a Hilbert space. This permits the development of an approximation theory for probabilistic problems that parallels that of deterministic approximation theory. According to this formalism, the solution of the problem is identified by its projection on a basis in the Hilbert space of random variables, as opposed to more traditional techniques where the solution is approximated by its first or second-order statistics. The present representation, in addition to capturing significantly more information than the traditional approach, facilitates the linkage between different interacting stochastic systems as is typically observed in real-life situations.

Ghanem, Roger↗

Operations and support cost modeling using Markov chains

Systems for future missions will be selected with life cycle costs (LCC) as a primary evaluation criterion. This reflects the current realization that only systems which are considered affordable will be built in the future due to the national budget constaints. Such an environment calls for innovative cost modeling techniques which address all of the phases a space system goes through during its life cycle, namely: design and development, fabrication, operations and support; and retirement. A significant portion of the LCC for reusable systems are generated during the operations and support phase (OS). Typically, OS costs can account for 60 to 80 percent of the total LCC. Clearly, OS costs are wholly determined or at least strongly influenced by decisions made during the design and development phases of the project. As a result OS costs need to be considered and estimated early in the conceptual phase. To be effective, an OS cost estimating model needs to account for actual instead of ideal processes by associating cost elements with probabilities. One approach that may be suitable for OS cost modeling is the use of the Markov Chain Process. Markov chains are an important method of probabilistic analysis for operations research analysts but they are rarely used for life cycle cost analysis. This research effort evaluates the use of Markov Chains in LCC analysis by developing OS cost model for a hypothetical reusable space transportation vehicle (HSTV) and suggests further uses of the Markov Chain process as a design-aid tool.

Unal, Resit↗

Probability of failure and risk assessment of propulsion structural components

The probabilistic structural analysis method (PSAM) was developed to analyze the effects of fluctuating loads, variable material properties, and uncertain analytical models especially for high performance structures such as the Space Shuttle Main Engine turbopump blades. Risk is calculated after expensive service experience. However, probabilistic structural analysis provides a rational alternative method to quantify uncertainties in the structural performance and durability. NESSUS (Numerical Evaluation of Stochastic Structures Under Stress) was developed as a probabilistic structural analysis computer code which integrates finite element methods and reliability algorithms, capable to predicting the probability distributions of structural response variables such as stress, displacement, natural frequencies, and buckling loads. This computer code is detailed.

Shiao, Michael C.↗

Prediction of Calcium Oxalate Stone Risk with Interventions

Introduction Mitigations intended to reduce bone mineral loss in-flight also influence the level of renal stone risk to astronauts. Extending a recent study completed by our group [1], we investigate the likely influence of combined fluid intake and Ca excretion mitigation strategies. Methods A computational biochemistry model representing CaOx crystal precipitation, growth, and agglomeration [2] is combined with a probabilistic analysis to predict the in-flight CaOx renal stone incidence risk ratio (IRR) relative to pre-flight values using 1517 astronaut 24-hour urine chemistries. The output of this simulation is used to assess the combined impact of controlling fluid intake and Ca excretion on maintaining IRR < 1.2 for > 95% of the population, a threshold determined from initial analysis of the model output compared to referent populations [1]. Results and Conclusions Figure 1 illustrates the simulated in-flight astronaut population (n=40000) with CaOx IRR > 1.2. The red lines indicate the known clinical risk boundary of each factor, and the white box is considered the area of high combined clinical risk. The simulation and identified risk threshold conform well to the expected clinical risk boundaries. The results, assuming insensible water losses equal or exceed 0.7 L/day, imply mitigations achieve risks similar to pre-flight levels when either Ca < 150 mg/day or fluid volume intake > 3.2 L/day individually, or combined Ca < 200 and fluid volume intake > 2.5 L/day. We continue to investigate similar compounded effects and look to apprise engineering trades by informing relative risk changes during mission design. References [1] D. A. Goodenow-Messman, S. A. Gokoglu, M. Kassemi, and J. Myers, Jerry G., “Characterization of Astronaut CaOx Renal Stone Incidence Rates to Quantify In-flight and Post-flight Relative Risk,” npj Microgravity, in review, 2021. [2] M. Kassemi and D. Thompson, “Prediction of renal crystalline size distributions in space using a PBE analytic model. 1. Effect of microgravity-induced biochemical alterations,” Am. J. Physiol. Physiol., vol. 311, no. 3, pp. F520–F530, Sep. 2016, doi: 10.1152/ajprenal.00401.2015.

Debra A Goodenow↗

Dynamic systems-engineering process - The application of concurrent engineering

A system engineering methodology is described which enables users, particulary NASA and DOD, to accommodate changing needs; incorporate emerging technologies; identify, quantify, and manage system risks; manage evolving functional requirements; track the changing environment; and reduce system life-cycle costs. The approach is a concurrent, dynamic one which starts by constructing a performance model defining the required system functions and the interrelationships. A detailed probabilistic risk assessment of the system elements and their interrelationships is performed, and quantitative analysis of the reliability and maintainability of an engineering system allows its different technical and process failure modes to be identified and their probabilities to be computed. Decision makers can choose technical solutions that maximize an objective function and minimize the probability of failure under resource constraints.

Wiskerchen, Michael J.↗

Technology Assessments within NASA's Integrated Technology Assessment Center

NASA's Advanced Space Transportation Program (ASTP) founded the Integrated Technology Assessment Center (ITAC) to provide a comprehensive, systematic approach to identify long-term technology needs, to quantify payoffs for technology investments, and to assess the progress of ASTP-sponsored technology programs in the hypersonics/Earth-to-orbit area. To accomplish these goals, the ITAC has assembled an experienced team representing a broad sector of the aerospace community and developed a systematic assessment process complete with supporting tools. In the ITAC approach, concepts for transportation systems are first selected based on relevance to the ASTP. Models of these concepts are then developed and data on advanced technologies are collected. Projections of key technology characteristics with respect to the specific concepts of interest are made. Both the models and technology projections are then fed into the ITAC's probabilistic systems analysis framework. The probabilistic outputs are weighed against metrics of interest to ASTP and a multivariate decision making process is used to provide inputs for technology prioritization within the ASTP. At present, the ITAC program is working to evaluate a variety of technologies for three two-stage hypersonic vehicle concepts. Concepts include an all rocket, vertical take off-horizontal landing (VTHL) system, a horizontal take-off-horizontal landing (HTHL) RBCC-propelled first stage/all rocket second stage system, and an HTHL turbine-based first stage/all rocket second stage system. This paper will provide a status update of the ITAC program including current results and plans.

Taylor, J. L.↗

Technology Assessments within NASA's Integrated Technology Assessment Center

NASA's Advanced Space Transportation Program (ASTP) founded the Integrated Technology Assessment Center (ITAC) to provide a comprehensive, systematic approach to identify long-term technology needs, to quantify payoffs for technology investments, and to assess the progress of ASTP-sponsored technology programs in the hypersonics/Earth-to-orbit area. To accomplish these goals, the ITAC has assembled an experienced team representing a broad sector of the aerospace community and developed a systematic assessment process complete with supporting tools. In the ITAC approach, concepts for transportation systems are first selected based on relevance to the ASTP. Models of these concepts are then developed and data on advanced technologies are collected. Projections of key technology characteristics with respect to the specific concepts of interest are made. Both the models and technology projections are then fed into the ITAC's probabilistic systems analysis framework. The probabilistic outputs are weighed against metrics of interest to ASTP and a multivariate decision making process is used to provide inputs for technology prioritization within the ASTP. At present, the ITAC program is working to evaluate a variety of technologies for three two-stage hypersonic vehicle concepts. Concepts include an all rocket, vertical take off-horizontal landing (VTHL) system, a horizontal takeoff-horizontal landing (HTHL) RBCC-propelled first stage/all rocket second stage system, and an HTHL turbine-based first stage/all rocket second stage system. This paper will provide a status update of the ITAC program including current results and plans.

Taylor, J. L.↗

Multimodel Ensemble Methods for Prediction of Wake-Vortex Transport and Decay Originating NASA

Several multimodel ensemble methods are selected and further developed to improve the deterministic and probabilistic prediction skills of individual wake-vortex transport and decay models. The different multimodel ensemble methods are introduced, and their suitability for wake applications is demonstrated. The selected methods include direct ensemble averaging, Bayesian model averaging, and Monte Carlo simulation. The different methodologies are evaluated employing data from wake-vortex field measurement campaigns conducted in the United States and Germany.

Korner, Stephan↗

Real-Time Prediction of Safety Margins in the National Airspace

Underlying all operations in the National Airspace System (NAS) is the concept of safety. Safety, as defined by acceptable levels of risk, is to be maintained at all times. The real-time safety monitoring (RTSM) framework is under development to provide an automated system to quantify safety in the NAS, estimate the current level of safety, and predict the future evolution of safety and the occurrence of events that pose an increased risk to flights so that these occurrences can be managed strategically rather than mitigated reactively. This paper presents the mathematical framework, the models, and the monitoring and prediction algorithms used to achieve this. RTSM computes safety as expressed through a set of safety margins based on user-defined safety metrics, thresolds, and events. Sources of uncertainty are modeled and propagated through the predictions in order to compute the probabilistic evolution of safety and the probability of events that introduce increased risk to operations. A prototype implementation is discussed and results demonstrating feasibility are presented. The results highlight the kinds of predictions that can be computed and the fidelity that is currently achieved.

national airspace system↗

Dynamic Adjustment of Simulation Parameters for Efficient Vehicle Prognostics

Model-based diagnostics and prognostics rely on state estimation and uncertainty management algorithms to produce useful information for system operators and maintainers. This information enables more informed operational decisions, condition-based maintenance, and overall mission safety assurance. Typically, uncertainty is associated with vehicle state-of-health estimation and prediction results because of modeling errors, internal or external sources of noise, and sensor inaccuracy. Probabilistic uncertainty management methods including Sequential Monte Carlo simulation are commonly used to reason about state-of-health estimates and predictions in the presence of these sources of uncertainty. However, such algorithms can be computationally expensive as they require a very large number of samples to obtain a sufficiently accurate quantification of the end of life probability distribution. As a result, highly mobile autonomous systems that leverage the prognostic results for mission-level replanning are often constrained in their processing capability because of these computationally expensive simulation approaches. Therefore, in this paper, we investigate algorithmic methods for dynamically adjusting simulation time step as well as number of samples to achieve highly efficient prognostic results while maintaining results accuracy. Results obtained from simulated flight experiments of an electric unmanned aerial vehicle are presented to verify the efficacy of such algorithms.

Prognostics↗

Improving the Fidelity of Capability & Resource Weighting in A Probalistic Risk Assessment Model for Spaceflight

INTRODUCTION NASA’s Informing Mission Planning via Analysis of Complex Tradespaces (IMPACT) tool uses Probabilistic Risk Assessment (PRA) to provide an evidence-based, data-driven estimate of how medical system capabilities affect mission outcomes. IMPACT maps condition incidence to available resources thereby facilitating the calculation of outcome metrics that allow the estimation of mission medical risk. Conditions can be nominally categorized as either treated or untreated depending on the availability of necessary diagnostic and therapeutic capabilities. This categorization enables IMPACT to estimate the effect of various medical system configurations on mission outcomes such as crew mortality, disability, crew member down-time, return to duty/recovery, and need for evacuation. IMPACT currently employs an equal weighting, “partial credit” approach to define treatment in which each of the capabilities associated with a given condition contributes an equal amount to management of the condition. This feature enables IMPACT to report values in between “fully untreated” and “fully treated” based on the proportion of capabilities available within the model. However, as is normal in medical/clinical practice, not all individual capabilities contribute equally to medical care. For example, the ability to provide intramuscular epinephrine during an anaphylactic episode contributes more likelihood of overall management success than does the administration of oral diphenhydramine. We hypothesize that weighting the relative contribution of each capability to each specific condition will improve outcome prediction and therefore will better provide mission planners with more nuanced and accurate options when designing space medical systems. METHODS Using a five-point Fibonacci scaling sequence (1, 2, 3, 5, 8) subject matter experts from NASA’s Exploration Medical Capabilities (ExMC) element assigned relative contribution weighting values to each identified capability within IMPACT. Since the relative importance of each capability varies depending on the specific condition, the resulting “partial” weighting was completed for more than 1,600 individual weighting assignments for 666 capabilities across 121 conditions. Each assignment required three-physician concurrence based on the overall importance of the capability to the diagnosis and management of the condition being considered and the difficulty with which it could be improvised by the crew. Once complete, 100,000 IMPACT simulations were run for a 6-month Lunar mission with a 30-day surface stay to evaluate the effect of this modification of the model. RESULTS Partial weighting significantly decreased predicted task time loss (TTL), evacuation, and loss of crew life without causing significant changes to the recommended medical system design. CONCLUSIONS The paucity of real-world referent data to support long-duration space missions of this type limits the ability to judge one predictive analytics method as superior to another. However, since the proposed method significantly reduces and optimizes outcome risks—without changing the medical system design—incorporating a partial weighting methodology is likely to provide a more accurate and operationally-relevant representation of medical risk without compromising IMPACTs ability to inform overarching medical system requirements.

Steller JG↗

Probabilistic Forecasting of Surface Ozone with a Novel Statistical Approach

The recent change in the Environmental Protection Agency's surface ozone regulation, lowering the surface ozone daily maximum 8-h average (MDA8) exceedance threshold from 75 to 70 ppbv, poses significant challenges to U.S. air quality (AQ) forecasters responsible for ozone MDA8 forecasts. The forecasters, supplied by only a few AQ model products, end up relying heavily on self-developed tools. To help U.S. AQ forecasters, this study explores a surface ozone MDA8 forecasting tool that is based solely on statistical methods and standard meteorological variables from the numerical weather prediction (NWP) models. The model combines the self-organizing map (SOM), which is a clustering technique, with a step wise weighted quadratic regression using meteorological variables as predictors for ozone MDA8. The SOM method identifies different weather regimes, to distinguish between various modes of ozone variability, and groups them according to similarity. In this way, when a regression is developed for a specific regime, data from the other regimes are also used, with weights that are based on their similarity to this specific regime. This approach, regression in SOM (REGiS), yields a distinct model for each regime taking into account both the training cases for that regime and other similar training cases. To produce probabilistic MDA8 ozone forecasts, REGiS weighs and combines all of the developed regression models on the basis of the weather patterns predicted by an NWP model. REGiS is evaluated over the San Joaquin Valley in California and the northeastern plains of Colorado. The results suggest that the model performs best when trained and adjusted separately for an individual AQ station and its corresponding meteorological site.

Ozone variables↗

Mission Reliability Estimation for Repairable Robot Teams

A mission reliability estimation method has been designed to translate mission requirements into choices of robot modules in order to configure a multi-robot team to have high reliability at minimal cost. In order to build cost-effective robot teams for long-term missions, one must be able to compare alternative design paradigms in a principled way by comparing the reliability of different robot models and robot team configurations. Core modules have been created including: a probabilistic module with reliability-cost characteristics, a method for combining the characteristics of multiple modules to determine an overall reliability-cost characteristic, and a method for the generation of legitimate module combinations based on mission specifications and the selection of the best of the resulting combinations from a cost-reliability standpoint. The developed methodology can be used to predict the probability of a mission being completed, given information about the components used to build the robots, as well as information about the mission tasks. In the research for this innovation, sample robot missions were examined and compared to the performance of robot teams with different numbers of robots and different numbers of spare components. Data that a mission designer would need was factored in, such as whether it would be better to have a spare robot versus an equivalent number of spare parts, or if mission cost can be reduced while maintaining reliability using spares. This analytical model was applied to an example robot mission, examining the cost-reliability tradeoffs among different team configurations. Particularly scrutinized were teams using either redundancy (spare robots) or repairability (spare components). Using conservative estimates of the cost-reliability relationship, results show that it is possible to significantly reduce the cost of a robotic mission by using cheaper, lower-reliability components and providing spares. This suggests that the current design paradigm of building a minimal number of highly robust robots may not be the best way to design robots for extended missions.

Trebi-Ollennu, Ashitey↗

Developing Probabilistic Safety Performance Margins for Unknown and Underappreciated Risks

Probabilistic safety requirements currently formulated or proposed for space systems, nuclear reactor systems, nuclear weapon systems, and other types of systems that have a low-probability potential for high-consequence accidents depend on showing that the probability of such accidents is below a specified safety threshold or goal. Verification of compliance depends heavily upon synthetic modeling techniques such as PRA. To determine whether or not a system meets its probabilistic requirements, it is necessary to consider whether there are significant risks that are not fully considered in the PRA either because they are not known at the time or because their importance is not fully understood. The ultimate objective is to establish a reasonable margin to account for the difference between known risks and actual risks in attempting to validate compliance with a probabilistic safety threshold or goal. In this paper, we examine data accumulated over the past 60 years from the space program, from nuclear reactor experience, from aircraft systems, and from human reliability experience to formulate guidelines for estimating probabilistic margins to account for risks that are initially unknown or underappreciated. The formulation includes a review of the safety literature to identify the principal causes of such risks.

Safety Performance Margin↗

Application of Deterministic and Probabilistic System Design Methods and Enhancements of Conceptual Design Tools for ERA Project

This report documents work done by the Aerospace Systems Design Lab (ASDL) at the Georgia Institute of Technology, Daniel Guggenheim School of Aerospace Engineering for the National Aeronautics and Space Administration, Aeronautics Research Mission Directorate, Integrated System Research Program, Environmentally Responsible Aviation (ERA) Project. This report was prepared under contract NNL12AA12C, "Application of Deterministic and Probabilistic System Design Methods and Enhancement of Conceptual Design Tools for ERA Project". The research within this report addressed the Environmentally Responsible Aviation (ERA) project goal stated in the NRA solicitation "to advance vehicle concepts and technologies that can simultaneously reduce fuel burn, noise, and emissions." To identify technology and vehicle solutions that simultaneously meet these three metrics requires the use of system-level analysis with the appropriate level of fidelity to quantify feasibility, benefits and degradations, and associated risk. In order to perform the system level analysis, the Environmental Design Space (EDS) [Kirby 2008, Schutte 2012a] environment developed by ASDL was used to model both conventional and unconventional configurations as well as to assess technologies from the ERA and N+2 timeframe portfolios. A well-established system design approach was used to perform aircraft conceptual design studies, including technology trade studies to identify technology portfolios capable of accomplishing the ERA project goal and to obtain accurate tradeoffs between performance, noise, and emissions. The ERA goal, shown in Figure 1, is to simultaneously achieve the N+2 benefits of a cumulative noise margin of 42 EPNdB relative to stage 4, a 75 percent reduction in LTO NOx emissions relative to CAEP 6 and a 50 percent reduction in fuel burn relative to the 2005 best in class aircraft. There were 5 research task associated with this research: 1) identify technology collectors, 2) model technology collectors in EDS, 3) model and assess ERA technologies, 4) LTO and cruise emission prediction, and 5) probabilistic analysis of technology collectors and portfolios.

Mavris, Dimitri N.↗

Performance Risk Model Validation with Operationally Relevant Tasks

Human Research Program aims to develop methods to support astronauts’ health and productivity during spaceflight. The Crew Health and Performance Probabilistic Risk Assessment (CHP-PRA) team uses powerful computational methods to predict mission risk in both domains: medical and performance. Here, we show how CHP-PRA uses the Performance Risk Model (PRisM) to quantify the performance risk and show an application of the model on operationally relevant tasks. There are various metrics adopted across performance researchers that PRisM can accommodate. For data analysis, interpretation, and integration, we use a method of unifying data from multiple sources by converting each to a single metric. We consult subject matter experts prior to integrating the converted data into PRisM. The method we use is inspired by the Cooper-Harper rating scale [1]. Using this unified metric, we can easily combine data from various tests and lab groups. We explain our conversion method in detail and show how it pertains to the process of testing and validation of PRisM on operational tasks. We conducted an initial validation in collaboration with the Behavioral Health and Performance (BHP) lab. We test PRisM using data on their operationally relevant task ROBoT-r, a track-and-capture task for grappling incoming resupply vehicles [2]. Several other labs at NASA Johnson Space Center worked together to design 7 Functional Task Tests (FTTs) in pursuit of simulating the tasks required after landing on a planetary surface and after return to Earth [3]. Here we use the results from both ROBoT-r and the 7 FTTs and compare their experiment data to PRisM’s computational output to demonstrate how PRisM can support operations by predicting crew performance on future missions.

performance modeling↗