Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Integrated assessment model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Modeling Pilot Behavior for Assessing Integrated Alert and Notification Systems on Flight Decks

Numerous new flight deck configurations for caution, warning, and alerts can be conceived; yet testing them with human-in-the-Ioop experiments to evaluate each one would not be practical. New sensors, instruments, and displays are being put into cockpits every day and this is particularly true as we enter the dawn of the Next Generation Air Transportation System (NextGen). By modeling pilot behavior in a computer simulation, an unlimited number of unique caution, warning, and alert configurations can be evaluated 24/7 by a computer. These computer simulations can then identify the most promising candidate formats to further evaluate in higher fidelity, but more costly, Human-in-the-Ioop (HITL) simulations. Evaluations using batch simulations with human performance models saves time, money, and enables a broader consideration of possible caution, warning, and alerting configurations for future flight decks.

Cover, Mathew↗

An Integrated Reliability and Physics-Based Risk Modeling Approach for Assessing Human Spaceflight Systems

This paper presents an integrated reliability and physics-based risk modeling approach for assessing human spaceflight systems. The approach is demonstrated using an example, end-to-end risk assessment of a generic-crewed space transportation system during a reference mission to the International Space Station. The behavior of the system is modeled using analysis techniques from multiple disciplines in order to properly capture the dynamic time- and state- dependent consequences of failures encountered in different mission phases. We discuss how to combine traditional reliability analyses with Monte Carlo simulation methods and physics-based engineering models to produce loss-of- mission and loss-of-crew risk estimates supporting risk-based decision-making and requirement verification. This approach facilitates risk-informed design by providing more realistic representation of system failures and interactions; identifying key risk-driving sensitivities, dependencies, and assumptions; and tracking multiple figures of merit within a single, responsive assessment framework that can readily incorporate evolving design information throughout system development.

Risk assessment↗

Bayesian Analysis for Risk Assessment of Selected Medical Events in Support of the Integrated Medical Model Effort

The Exploration Medical Capability project is creating a catalog of risk assessments using the Integrated Medical Model (IMM). The IMM is a software-based system intended to assist mission planners in preparing for spaceflight missions by helping them to make informed decisions about medical preparations and supplies needed for combating and treating various medical events using Probabilistic Risk Assessment. The objective is to use statistical analyses to inform the IMM decision tool with estimated probabilities of medical events occurring during an exploration mission. Because data regarding astronaut health are limited, Bayesian statistical analysis is used. Bayesian inference combines prior knowledge, such as data from the general U.S. population, the U.S. Submarine Force, or the analog astronaut population located at the NASA Johnson Space Center, with observed data for the medical condition of interest. The posterior results reflect the best evidence for specific medical events occurring in flight. Bayes theorem provides a formal mechanism for combining available observed data with data from similar studies to support the quantification process. The IMM team performed Bayesian updates on the following medical events: angina, appendicitis, atrial fibrillation, atrial flutter, dental abscess, dental caries, dental periodontal disease, gallstone disease, herpes zoster, renal stones, seizure, and stroke.

Gilkey, Kelly M.↗

Architecture for Integrated Medical Model Dynamic Probabilistic Risk Assessment

Probabilistic Risk Assessment (PRA) is a modeling tool used to predict potential outcomes of a complex system based on a statistical understanding of many initiating events. Utilizing a Monte Carlo method, thousands of instances of the model are considered and outcomes are collected. PRA is considered static, utilizing probabilities alone to calculate outcomes. Dynamic Probabilistic Risk Assessment (dPRA) is an advanced concept where modeling predicts the outcomes of a complex system based not only on the probabilities of many initiating events, but also on a progression of dependencies brought about by progressing down a time line. Events are placed in a single time line, adding each event to a queue, as managed by a planner. Progression down the time line is guided by rules, as managed by a scheduler. The recently developed Integrated Medical Model (IMM) summarizes astronaut health as governed by the probabilities of medical events and mitigation strategies. Managing the software architecture process provides a systematic means of creating, documenting, and communicating a software design early in the development process. The software architecture process begins with establishing requirements and the design is then derived from the requirements.

Probability Theory↗

Integrated Computational Fluid Dynamics and Thermal Desktop Thermal Modeling for Assessment of the EMU in Support of ISS EVA 80

Following the reports of water accumulation in the Extravehicular Mobility Unit (EMU) helmet during the ISS US EVA-80, various efforts for mitigation and further understanding of this phenomenon have been undertaken with the goal of prevention and to ensure crew safety in future EVAs. In support of this goal, a combination of Thermal Desktop thermal modeling and Computational Fluid Dynamics (CFD) has been performed in order to characterize the performance of the EMU components, specifically those within the ventilation/cooling water loops. This modeling effort evaluates the dry/wet gas pressure drop and flow distribution through gas and liquid flow paths using CFD, as well as a two-phase flow assessment of condensation production and water separation/removal performance using an integrated Thermal Desktop model of important EMU ventilation loop components. The models assess this overall thermal-fluid performance in comparison with previous existing models, design points, and historical EVA data using their inputs.

Blain Ryan Lancaster↗

Integrated Computational Fluid Dynamics and Thermal Desktop Thermal Modeling for Assessment of the EMU in Support of ISS EVA 80

Following the reports of water accumulation in the Extravehicular Mobility Unit (EMU) helmet during the ISS US EVA-80, various efforts for mitigation and further understanding of this phenomenon have been undertaken with the goal of prevention and to ensure crew safety in future EVAs. In support of this goal, a combination of Thermal Desktop thermal modeling and Computational Fluid Dynamics (CFD) has been performed in order to characterize the performance of the EMU components, specifically those within the ventilation/cooling water loops. This modeling effort evaluates the dry/wet gas pressure drop and flow distribution through gas and liquid flow paths using CFD, as well as a two-phase flow assessment of condensation production and water separation/removal performance using an integrated Thermal Desktop model of important EMU ventilation loop components. The models assess this overall thermal-fluid performance in comparison with previous existing models, design points, and historical EVA data using their inputs.

EVA 80↗

An Integrated Physics-Based Risk Model for Assessing the Asteroid Threat

Although most asteroids and other near-Earth objects (NEOs) do not pose a threat to Earth’s inhabitants, impacts from objects that are just tens of meters in diameter can cause significant damage if they occur over a populated area. This paper forms the foundation of an effort at NASA Ames Research Center to quantify these risks and identify the greatest risk-driving parameters and uncertainties. An integrated risk model that couples dynamic probabilistic simulations of strike occurrences with physics-based models of NEO impact damage factors has been developed to generate casualty estimates for a range of NEO impact properties. Currently, the model focuses on the risk due to blast overpressure damage from airbursts and impacts on land. The model is first used to reproduce results from established sources, and then is extended to perform sensitivity studies that yield greater insights into risk driving parameters. Results show that meteor strength and entry angle play a role for small to mid-size NEOs, and that accounting for the specific target location significantly affects casualty estimates and dominates the risk. Future work will continue to refine and expand the models to better characterize key impact risk factors, include additional types of threats such as tsunamis and climate effects, and ultimately support assessments of potential asteroid mitigation strategies.

Asteroid Threat↗

Selection of a Representative Subset of Global Climate Models that Captures the Profile of Regional Changes for Integrated Climate Impacts Assessment

We present the Representative Temperature and Precipitation (T&P) GCM Subsetting Approach developed within the Agricultural Model Intercomparison and Improvement Project (AgMIP) to select a practical subset of global climate models (GCMs) for regional integrated assessment of climate impacts when resource limitations do not permit the full ensemble of GCMs to be evaluated given the need to also focus on impacts sector and economics models. Subsetting inherently leads to a loss of information but can free up resources to explore important uncertainties in the integrated assessment that would otherwise be prohibitive. The Representative T&P GCM Subsetting Approach identifies five individual GCMs that capture a profile of the full ensemble of temperature and precipitation change within the growing season while maintaining information about the probability that basic classes of climate changes (relatively cool/wet, cool/dry, middle, hot/wet, and hot/dry) are projected in the full GCM ensemble. We demonstrate the selection methodology for maize impacts in Ames, Iowa, and discuss limitations and situations when additional information may be required to select representative GCMs. We then classify 29 GCMs over all land areas to identify regions and seasons with characteristic diagonal skewness related to surface moisture as well as extreme skewness connected to snow-albedo feedbacks and GCM uncertainty. Finally, we employ this basic approach to recognize that GCM projections demonstrate coherence across space, time, and greenhouse gas concentration pathway. The Representative T&P GCM Subsetting Approach provides a quantitative basis for the determination of useful GCM subsets, provides a practical and coherent approach where previous assessments selected solely on availability of scenarios, and may be extended for application to a range of scales and sectoral impacts.

Climate Change; GCMs; Climate Model Subset; Repres↗

Perspectives on Climate Effects on Agriculture: The International Efforts of AgMIP in Sub-Saharan Africa

Agriculture in Sub-Saharan Africa (SSA) is experiencing climate change-related effects that call for integrated regional assessments, yet capacity for these assessments has been low. The Agricultural Model Intercomparison and Improvement Project (AgMIP) is advancing research on integrated regional assessments of climate change that include climate, crop, and economic modeling and analysis. Through AgMIP, regional integrated assessments are increasingly gaining momentum in SSA, and multi-institutional regional research teams (RRTs) centered in East, West, and Southern· Africa are generating new information on climate change impacts and adaptation in selected agricultural systems. The research in Africa is organized into four RRTs and a coordination team. Each of the RRTs in SSA is composed of scientists from the Consultative Group of International Agricultural Research (CGIAR) institutions, National Agriculture Research institutes (NARs), and universities consisting of experts in crop and economic modeling, climate, and information technology. Stakeholder involvement to inform specific agricultural systems to be evaluated, key outputs, and the representative agricultural pathways (RAPs), is undertaken at two levels: regional and national, in order to contribute to decision making at these levels. Capacity building for integrated assessment (lA) is a key component that is undertaken continuously through interaction with experts in regional and SSA-wide workshops, and through joint creation of tools. Many students and research affiliates have been identified and entrained as part of capacity building in IA. Bi-monthly updates on scholarly publications in climate change in Africa also serve as a vehicle for knowledge-sharing. With 60 scientists already trained and actively engaged in IA and over 80 getting monthly briefs on the latest information on climate change, a climate-informed community of experts is gradually taking shape in SSA. (See Part 2, Appendices 3-5 in this volume for AgMIP Regional Workshop reports.)

Kihara, Job↗

Regional and Model-Specific Response Types in A Global Gridded Crop Model Ensemble

Crop models are often employed to project crop yields under changing conditions such as global warming and associated management change for adaptation. Multi-model ensembles are promoted to enhance the robustness of projections, but questions remain on what causes often large differences between projections of individual models. Global Gridded Crop Models (GGCMs) are especially exposed to this question when applied for assessing climate change impacts, adaptation, environmental impacts of agricultural production, because their results are used in downstream analyses, such as in integrated assessment or economic modeling for projecting future land-use change. Even though global gridded crop models are often based on detailed field-scale models or have implemented similar modeling principles in other ecosystem models, global-scale models are subject to substantial uncertainties from both model structure and parametrization as well as from calibration and input data quality. AgMIP’s Global Gridded Crop Model Intercomparison (GGCMI) has thus set out to intercompare GGCMs in order to evaluate model performance, describe model uncertainties, identify inconsistencies within the ensemble and underlying reasons, and to ultimately improve models and modeling capacities. In phase 2 of the GGCMI activities, 12 modeling groups followed a modeling protocol that asked for up to 1404 31-year global simulations at 0.5 arc-degree spatial resolution to assess models’ sensitivities to changes in carbon dioxide (C; 4 different levels) temperature (T; 7 different offset levels), water supply (W; 9 levels), and nitrogen (N; 3 levels), the so-called CTWN experiment (Franke et al. 2020; http://dx.doi.org/10.5194/gmd-13-2315-2020). We here present analyses of model response types using impact response surfaces along the C, T, W, and N dimensions, respectively and collectively. Doing so, we can understand differences in simulated responses per driver rather than aggregated changes in yields. We find that models’ sensitivities to the individual driver dimensions are substantially different and often more different across models than across regions. A cluster analysis finds regional and model-specific patterns. There is some agreement across models with respect to the spatial patterns of response types but strong differences in the distribution of response type clusters across models suggests that models need to undergo further scrutiny. We suggest establishing standards in model process evaluation not only against historical dynamics but also against dedicated experiments across the CTWN dimensions.

crop models↗

Identification of Safety Metrics for Airport Surface Operations

A large fraction of safety incidents occurs on the ground during airport surface operations. Although these incidents are mostly non-fatal with a few exceptions, they are high profile incidents that remain a source of concern for the National Transportation Safety Board (NTSB), the Federal Aviation Administration (FAA), major airlines, and other stakeholders of the National Airspace System (NAS). These incidents have historically been mitigated by implementing changes to regulations, policies, and procedures over time. This approach has minimized but not eliminated the risk of occurrence of safety incidents. It is thus important to develop integrated techniques to assess, model, and prevent these incidents by analyzing the risk and likelihood of occurrence and communicating results of the analysis to decision-making personnel who can mitigate and prevent incidents in real time. The work presented in this paper builds on a previously developed architecture for safety, Real-Time Safety Monitoring (RTSM), to enable monitoring and prediction of the safety of the NAS. In the RTSM framework, hazards to flight are translated to safety metrics such as wake vortex encounters or loss of separation, that can be modeled and analyzed offline and also predicted and monitored in real time (online). The intent of this paper is to integrate predictable incidents that occur during surface and ground operations into the safety portfolio of the RTSM project by (i) identifying suitable information sources from which ground incidents can be studied, (ii) developing safety metrics correlated with surface operations, and (iii) recommending suitable data sources that can be quantified and used for the computation of pertinent safety metrics.

safety↗

Identification of Safety Metrics for Airport Surface Operations

A large fraction of safety incidents occurs on the ground during airport surface operations. Although these incidents are mostly non-fatal with a few exceptions, they are high profile incidents that remain a source of concern for the National Transportation Safety Board (NTSB), the Federal Aviation Administration (FAA), major airlines, and other stakeholders of the National Airspace System (NAS). These incidents have historically been mitigated by implementing changes to regulations, policies, and procedures over time. This approach has minimized but not eliminated the risk of occurrences. It is thus important to develop integrated techniques to assess, model, and prevent these incidents by analyzing the risk and likelihood of occurrence and communicating results of the analysis to decision-making personnel who can mitigate and prevent incidents in real time. The research presented in this report builds on prior work of researchers at the NASA Ames Research Center who developed an automated framework, Real-Time Safety Monitoring (RTSM), to enable monitoring and prediction of the safety of the NAS. In the RTSM framework, hazards to flight are translated to safety metrics such as wake vortex encounters or loss of separation, that can be modeled and analyzed offline and also predicted and monitored in real time (online). The intent of this report is to integrate predictable incidents that occur during surface and ground operations into the safety portfolio of the RTSM project by (i) identifying suitable information sources from which ground incidents can be studied, (ii) developing safety metrics correlated with surface operations, and (iii) recommending suitable data sources that can be quantified and used for the computation of pertinent safety metrics.

ground operations↗

Sleep Disruption Medical Intervention Forecasting (SDMIF) Module for the Integrated Medical Model

The NASA Integrated Medical Model (IMM) assesses the risk, including likelihood and impact of occurrence, of all credible in-flight medical conditions. Fatigue due to sleep disruption is a condition that could lead to operational errors, potentially resulting in loss of mission or crew. Pharmacological consumables are mitigation strategies used to manage the risks associated with sleep deficits. The likelihood of medical intervention due to sleep disruption was estimated with a well validated sleep model and a Monte Carlo computer simulation in an effort to optimize the quantity of consumables. METHODS: The key components of the model are the mission parameter program, the calculation of sleep intensity and the diagnosis and decision module. The mission parameter program was used to create simulated daily sleep/wake schedules for an ISS increment. The hypothetical schedules included critical events such as dockings and extravehicular activities and included actual sleep time and sleep quality. The schedules were used as inputs to the Sleep, Activity, Fatigue and Task Effectiveness (SAFTE) Model (IBR Inc., Baltimore MD), which calculated sleep intensity. Sleep data from an ISS study was used to relate calculated sleep intensity to the probability of sleep medication use, using a generalized linear model for binomial regression. A human yes/no decision process using a binomial random number was also factored into sleep medication use probability. RESULTS: These probability calculations were repeated 5000 times resulting in an estimate of the most likely amount of sleep aids used during an ISS mission and a 95% confidence interval. CONCLUSIONS: These results were transferred to the parent IMM for further weighting and integration with other medical conditions, to help inform operational decisions. This model is a potential planning tool for ensuring adequate sleep during sleep disrupted periods of a mission.

Lewandowski, Beth↗

The Extravehicular Suit Impact Load Attenuation Study for Use in Astronaut Bone Fracture Prediction

The NASA Integrated Medical Model (IMM) assesses the risk, including likelihood and impact of occurrence, of all credible in-flight medical conditions. Fracture of the proximal femur is a traumatic injury that would likely result in loss of mission if it were to happen during spaceflight. The low gravity exposure causes decreases in bone mineral density which heightens the concern. Researchers at the NASA Glenn Research Center have quantified bone fracture probability during spaceflight with a probabilistic model. It was assumed that a pressurized extravehicular activity (EVA) suit would attenuate load during a fall, but no supporting data was available. The suit impact load attenuation study was performed to collect analogous data. METHODS: A pressurized EVA suit analog test bed was used to study how the offset, defined as the gap between the suit and the astronaut s body, impact load magnitude and suit operating pressure affects the attenuation of impact load. The attenuation data was incorporated into the probabilistic model of bone fracture as a function of these factors, replacing a load attenuation value based on commercial hip protectors. RESULTS: Load attenuation was more dependent on offset than on pressurization or load magnitude, especially at small offsets. Load attenuation factors for offsets between 0.1 - 1.5 cm were 0.69 +/- 0.15, 0.49 +/- 0.22 and 0.35 +/- 0.18 for mean impact forces of 4827, 6400 and 8467 N, respectively. Load attenuation factors for offsets of 2.8 - 5.3 cm were 0.93 +/- 0.2, 0.94 +/- 0.1 and 0.84 +/- 0.5, for the same mean impact forces. Reductions were observed in the 95th percentile confidence interval of the bone fracture probability predictions. CONCLUSIONS: The reduction in uncertainty and improved confidence in bone fracture predictions increased the fidelity and credibility of the fracture risk model and its benefit to mission design and operational decisions.

Lewandowski, Beth E.↗

Space station ECLSS integration analysis: Simplified General Cluster Systems Model, ECLS System Assessment Program enhancements

The data base verification of the ECLS Systems Assessment Program (ESAP) was documented and changes made to enhance the flexibility of the water recovery subsystem simulations are given. All changes which were made to the data base values are described and the software enhancements performed. The refined model documented herein constitutes the submittal of the General Cluster Systems Model. A source listing of the current version of ESAP is provided in Appendix A.

Ferguson, R. E.↗

The Future of Integrated Performance Modeling in the Crew Health and Performance – Probabilistic Risk Assessment Project

The NASA engineering community utilizes event-driven and fault-tree probabilistic techniques to classify risks in the space environment by taking advantage of the inherent knowledge of complex spaceflight system design and testing to quantify failure risk. In harmonizing the risk of human space flight, answering the question of ‘How do we balance health, performance and resource risks with other engineering risks on long duration space missions?’ remains a deeply challenging and largely qualitative practice. The Human Research Program’s Medical Extensible Dynamic Probabilistic Risk Assessment Tool (MEDPRAT) was a significant step forward in efforts to robustly quantify the risk to crew health for exploration missions. However, there remains a significant gap in the ability to comprehensively assess and characterize risk across the disparate functionalities and capabilities which comprise the Crew Health and Performance (CHP) system. The Crew Health and Performance – Probabilistic Risk Assessment (CHP-PRA) project seeks to characterize CHP risks by expanding beyond the foundation established by its PRA predecessors like IMM and MEDPRAT, that simulate medical risk metrics like loss of crew life and evacuations. One of the new risk measures in the CHP-PRA system is embodied in our Performance Risk Model (PRisM). PRisM provides a novel way of assessing crew performance on mission tasks, using a generalized framework which relates back to NASA-STD-3001. This approach allows PRisM to capture and integrate data from a variety of different domains into a single, unified, reproducible representation of astronaut performance. In this presentation, we discuss the motivation for the CHP-PRA work and give a high level overview of the goals of the project, outline the forward work for PRisM, and discuss collaboration opportunities for the community who might explore if their domain knowledge and data could be represented, integrated, and quantified with these tools, whose outcomes are metrics useful for supporting operational mission planning and decision making.

Lauren McIntyre↗