Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “risk and uncertainty assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Uncertainty Estimation Cheat Sheet for Probabilistic Risk Assessment

"Uncertainty analysis itself is uncertain, therefore, you cannot evaluate it exactly," Source Uncertain Quantitative results for aerospace engineering problems are influenced by many sources of uncertainty. Uncertainty analysis aims to make a technical contribution to decision-making through the quantification of uncertainties in the relevant variables as well as through the propagation of these uncertainties up to the result. Uncertainty can be thought of as a measure of the 'goodness' of a result and is typically represented as statistical dispersion. This paper will explain common measures of centrality and dispersion; and-with examples-will provide guidelines for how they may be estimated to ensure effective technical contributions to decision-making.

Britton, Paul T.↗

A review of risk and uncertainty assessment for geologic carbon storage

Carbon capture, utilization, and storage (CCUS) in geological formations play a key role in mitigating anthropogenic CO 2 emissions and achieving the aggressive goal of net-zero greenhouse gas emissions. Risk and uncertainty assessment is crucial for ensuring the safety and reliability of geologic carbon storage (GCS) by evaluating CO 2 migration in subsurface, forecasting potential leakage and induced seismicity risks, and optimizing operational and monitoring plans. In this review, the use and progress of risk assessment for GCS over the last few decades are examined. Here, we use the Southwest Regional Partnership on Carbon Sequestration (SWP), which is one of the seven regional partnerships supported by the United States Department of Energy (U.S. DOE), as an example of large-scale CCUS projects in North America. Additionally, future trends and requirements for risk assessment in GCS are discussed. The information provided in this review can help readers understand the significance of risk and uncertainty assessment and apply it effectively in large-scale GCS projects.

58 GEOSCIENCES↗

Failure Analysis–Informed Risk Assessment Framework for Geological Carbon Storage Using Numerical Simulation and Machine Learning

Geological carbon storage (GCS) is recognized as a critical technology for achieving large-scale reductions in anthropogenic carbon dioxide (CO 2 ) emissions. Ensuring long-term containment and safety requires robust risk assessment frameworks that account for geological uncertainty and identify potential failure scenarios. Among various indicators, the area of review (AoR) serves as a key metric for evaluating storage performance, regulatory compliance, and monitoring design, as it delineates the spatial extent impacted by pressure buildup and plume migration. However, conventional AoR-based risk assessments typically perturb parameters within narrow uncertainty bounds, potentially overlooking rare but high-impact events arising from extreme geological conditions. In this study, we present a failure analysis–informed risk assessment framework for large-scale GCS projects to improve site prescreening and monitoring design. A suite of 300 numerical simulations was generated using stochastic geological models that vary five key parameters: net-to-gross ratio, anisotropy azimuth, porosity multiplier, permeability multiplier, and vertical-to-horizontal permeability ratio. Among these, 200 realizations represent normal geological uncertainty, while 100 additional cases explore extreme yet plausible conditions for failure-case analysis. The AoR was simulated and computed from pressure and CO 2 saturation fields, where the baseline AoR boundary, representing the extent predicted under typical geological uncertainty, was defined as the union of 200 normal-range simulations, and failure was identified when extreme-range cases exceeded this baseline. Results show that incorporating broader parameter uncertainty produces significantly larger AoR extents, underscoring the potential underestimation of risk under conventional uncertainty ranges. Furthermore, spatial probability maps derived from failure-induced AoR exceedance identify regions requiring enhanced monitoring attention. Various machine learning (ML)–based classifiers were developed to predict failure occurrence from geological parameters, with the random forest model achieving the highest performance (F1-score of 0.986). Consistent findings from correlation coefficient, feature importance, and Sobol sensitivity analyses reveal that low net-to-gross ratios and permeability multipliers are the dominant risk drivers, reflecting reduced reservoir connectivity and limited pressure dissipation. Altogether, these results provide a novel framework for risk-informed site prescreening and monitoring design that explicitly considers rare but high-impact geological scenarios in GCS projects.

25 ENERGY STORAGE↗

Computational requirements for hypersonic flight performance estimates

The computational requirements for hypersonic flight performance estimates are discussed and a procedure for fulfilling these requirements is presented. In order to effectively use computational fluid dynamics in design, especially for estimating performance quantities, consideration should be given to the credibility of CFD, design sensitivities, test uncertainties, risk assessment, and consistency in determination. It is found that a design-specific computational technology developed with programmatic research can be used in the design of hypervelocity vehicles.

Mehta, Unmeel B.↗

Operational Implementation of a Pc Uncertainty Construct for Conjunction Assessment Risk Analysis

Earlier this year the NASA Conjunction Assessment and Risk Analysis (CARA) project presented the theoretical and algorithmic aspects of a method to include the uncertainties in the calculation inputs when computing the probability of collision (Pc) between two space objects, principally uncertainties in the covariances and the hard-body radius. The output of this calculation approach is to produce rather than a single Pc value an entire probability density function that will represent the range of possible Pc values given the uncertainties in the inputs and bring CA risk analysis methodologies more in line with modern risk management theory. The present study provides results from the exercise of this method against an extended dataset of satellite conjunctions in order to determine the effect of its use on the evaluation of conjunction assessment (CA) event risk posture. The effects are found to be considerable: a good number of events are downgraded from or upgraded to a serious risk designation on the basis of consideration of the Pc uncertainty. The findings counsel the integration of the developed methods into NASA CA operations.

assessment↗

Climate Change Signal in Atlantic Tropical Cyclones Today and Near Future

This manuscript discusses the challenges in detecting and attributing recently observed trends in the Atlantic tropical cyclone (TC) and the epistemic uncertainty we face in assessing future risk. We use synthetic storms downscaled from five CMIP5 models by the Columbia HAZard model (CHAZ), and directly simulated storms from high-resolution climate models. We examine three aspects of recent TC activity: the upward trend and multi-decadal oscillation of the annual frequency, the increase in storm wind intensity, and the decrease in forward speed. Some data sets suggest that these trends and oscillation are forced while others suggest that they can be explained by natural variability. Projections under warming climate scenarios also show a wide range of possibilities, especially for the annual frequencies, which increase or decrease depending on the choice of moisture variable used in the CHAZ model and on the choice of climate model. The uncertainties in the annual frequency lead to epistemic uncertainties in TC risk assessment. Here, we investigate the potential for reduction of these epistemic uncertainties through a statistical practice, namely likelihood analysis. We find that historical observations are more consistent with the simulations with increasing frequency than those with decreasing frequency, but we are not able to rule out the latter. We argue that the most rational way to treat epistemic uncertainty is to consider all outcomes contained in the results. In the context of risk assessment, since the results contain possible outcomes in which TC risk is increasing, this view implies that the risk is increasing.

54 ENVIRONMENTAL SCIENCES↗

Quantifying uncertainty in aggregated climate change risk assessments

High-level assessments of climate change impacts aggregate multiple perils into a common framework. This requires incorporating multiple dimensions of uncertainty. Here we propose a methodology to transparently assess these uncertainties within the ‘Reasons for Concern’ framework, using extreme heat as a case study. We quantitatively discriminate multiple dimensions of uncertainty, including future vulnerability and exposure to changing climate hazards. High risks from extreme heat materialise after 1.5–2 °C and very high risks between 2–3.5 °C of warming. Risks emerge earlier if global assessments were based on national risk thresholds, underscoring the need for stringent mitigation to limit future extreme heat risks.

54 ENVIRONMENTAL SCIENCES↗

NRAP-open-IAM: A flexible open-source integrated-assessment-model for geologic carbon storage risk assessment and management

Large-scale implementation of geologic carbon storage (GCS) to help reduce atmospheric greenhouse gas emissions requires stakeholder confidence that injected CO2 will remain contained and that potential subsurface environmental risks are acceptably small and manageable. The U.S. Department of Energy’s National Risk Assessment Partnership (NRAP) has developed an open-source integrated assessment model (NRAP-Open-IAM) to help address questions about a potential GCS site’s ability to effectively contain injected CO 2 and protect groundwater and other overlying environmentally sensitive receptors. NRAP-Open-IAM allows a user to: (1) incorporate relevant site geologic and injection scenario data; (2) characterize important site features and events;(3) couple fast prediction models of various system components of the engineered geologic system; and (4) execute stochastic, dynamic simulation of whole GCS system performance, leakage risk assessment, and uncertainty quantification. NRAP-Open-IAM is available on GitLab (https://gitlab.com/NRAP/OpenIAM), and is accompanied by multiple application examples and detailed user and developer guides.

54 ENVIRONMENTAL SCIENCES↗

Milestone Report for MS8: Extend Quantitative Brine and CO 2 Leakage Calculations

This report summarizes results of the risk analysis and characterization of CO 2 and brine leakage potential of Farnsworth Unit (FWU) wells. U.S. DOE’s National Risk Assessment Partnership (NRAP) program works on quantitatively assess long-term environmental risks amidst significant geologic uncertainty and variability. NRAP risk assessment and computational tools are developed to quantify uncertainties and calculate risk associated with geologic sequestration of carbon dioxide (CO 2 ). For this study, we have developed a workflow from University of Utah’s physics-based reservoir simulators to performing leakage calculations using NRAP Tools. NRAP tools (NRAP-IAM-CS, RROM-Gen) are used to conduct leakage risk analysis based on Eclipse simulation results, and characterize wellbore leakage at the Farnworth Site. This report summarizes results of the risk analysis and characterization of CO 2 and brine leakage potential of Farnsworth Unit (FWU) wells.

54 ENVIRONMENTAL SCIENCES↗

Science Goals in Radiation Protection for Exploration

Space radiation presents major challenges to future missions to the Earth s moon or Mars. Health risks of concern include cancer, degenerative and performance risks to the central nervous system, heart and lens, and the acute radiation syndromes. The galactic cosmic rays (GCR) contain high energy and charge (HZE) nuclei, which have been shown to cause qualitatively distinct biological damage compared to terresterial radiation, such as X-rays or gamma-rays, causing risk estimates to be highly uncertain. The biological effects of solar particle events (SPE) are similar to terresterial radiation except for their biological dose-rate modifiers; however the onset and size of SPEs are difficult to predict. The high energies of GCR reduce the effectiveness of shielding, while SPE s can be shielded however the current gap in radiobiological knowledge hinders optimization. Methods used to project risks on Earth must be modified because of the large uncertainties in projecting health risks from space radiation, and thus impact mission requirements and costs. We describe NASA s unique approach to radiation safety that applies probabilistic risk assessments and uncertainty based criteria within the occupational health program for astronauts and to mission design. The two terrestrial criteria of a point estimate of maximum acceptable level of risk and application of the principle of As Low As Reasonably Achievable (ALARA) are supplemented by a third requirement that protects against risk projection uncertainties using the upper 95% confidence level (CL) in radiation risk projection models. Exploration science goals in radiation protection are centered on ground-based research to achieve the necessary biological knowledge, and in the development of new technologies to improve SPE monitoring and optimize shielding. Radiobiology research is centered on a ground based program investigating the radiobiology of high-energy protons and HZE nuclei at the NASA Space Radiation Laboratory (NSRL) located at DoE s Brookhaven National Laboratory in Upton, NY. We describe recent NSRL results that are closing the knowledge gap in HZE radiobiology and improving exploration risk estimates. Linking probabilistic risk assessment to research goals makes it possible to express risk management objectives in terms of quantitative metrics, which include the number of days in space without exceeding a given risk level within well defined confidence limits, and probabilistic assessments of the effectiveness of design trade spaces such as material type, mass, solar cycle, crew selection criteria, and biological countermeasures. New research in SPE alert and risk assessment, individual radiation sensitivity, and biological countermeasure development are described.

Cucinotta, Francs A.↗

Biological Based Risk Assessment for Space Exploration

Exposures from galactic cosmic rays (GCR) - made up of high-energy protons and high-energy and charge (HZE) nuclei, and solar particle events (SPEs) - comprised largely of low- to medium-energy protons are the primary health concern for astronauts for long-term space missions. Experimental studies have shown that HZE nuclei produce both qualitative and quantitative differences in biological effects compared to terrestrial radiation, making risk assessments for cancer and degenerative risks, such as central nervous system effects and heart disease, highly uncertain. The goal for space radiation protection at NASA is to be able to reduce the uncertainties in risk assessments for Mars exploration to be small enough to ensure acceptable levels of risks are not exceeded and to adequately assess the efficacy of mitigation measures such as shielding or biological countermeasures. We review the recent BEIR VII and UNSCEAR-2006 models of cancer risks and their uncertainties. These models are shown to have an inherent 2-fold uncertainty as defined by ratio of the 95% percent confidence level to the mean projection, even before radiation quality is considered. In order to overcome the uncertainties in these models, new approaches to risk assessment are warranted. We consider new computational biology approaches to modeling cancer risks. A basic program of research that includes stochastic descriptions of the physics and chemistry of radiation tracks and biochemistry of metabolic pathways, to emerging biological understanding of cellular and tissue modifications leading to cancer is described.

Cucinotta, Francis A.↗

Ensemble Methodologies for Astronaut Cancer Risk Assessment in the face of Large Uncertainties

A new approach to NASA space radiation risk modeling has successfully extended the current NASA probabilistic cancer risk model to an ensemble framework able to consider sub-model parameter uncertainty (e.g. uncertainty in a radiation quality parameter) as well as model-form uncertainty associated with differing theoretical or empirical formalisms (e.g. combined dose-rate and radiation quality effects). Ensemble methodologies are already widely used in weather prediction, modeling of infectious disease outbreaks, and certain terrestrial radiation protection applications to better understand how uncertainty may influence risk decision-making. Applying ensemble methodologies to space radiation risk projections offers the potential to efficiently incorporate emerging research results, allow for the incorporation of future (including international) models, improve uncertainty quantification for underlying sub-models developed against sparse experimental data, and reduce the impact of subjective bias on risk projections. Moreover, risk forecasting across an ensemble of multiple predictive models can provide stakeholders additional information on risk acceptance if current health/medical standards cannot be met or the level of knowledge doesn’t permit a specific risk or exposure limit to be developed for future space exploration missions. In this work, ensemble risk projections implementing multiple sub-models of radiation quality, dose and dose-rate effectiveness factors, excess risk, and latency as ensemble members are presented. Initial consensus methods for ensemble model weights and correlations to account for individual model bias are discussed. In these analyses, the ensemble forecast compares well to results from NASA's current operational cancer risk projection model used to assess permissible exposure limits and permissible mission durations for astronauts. However, a large range of projected risk values are obtained at the upper 95th confidence level where models must extrapolate beyond available biological data sets; closer agreement is seen at the median + one sigma due to the inherent similarities in available models. Future work, including the addition of new models and methods for statistical correlation between predictive members are discussed to define alternate ways of thinking about risk and ‘acceptable’ uncertainty with respect to NASA’s current permissible exposure limits.

space radiation↗

Quantitative Risk Assessment (Topical Report)

Carbon capture, utilization, and storage (CCUS) in geological formations plays a key role in mitigating anthropogenic CO 2 emissions and achieving the aggressive goal of net-zero greenhouse gas emissions. Quantitative risk assessment is crucial for ensuring the safety and reliability of geologic carbon storage (GCS) by evaluating CO 2 migration in subsurface, forecasting potential leakage and induced seismicity risks, and optimizing operational and monitoring plans. We present the use, progress, and research trends of risk assessment from the Southwest Regional Partnership on Carbon Sequestration (SWP) as an example of large-scale CCUS projects in North America. The information provided in this report can help readers understand the significance of risk and uncertainty assessment and apply them effectively in large-scale CCUS projects.

42 ENGINEERING↗