Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “probabilistic modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,009 records · Page 56

Review of Quantitative Software Reliability Methods

The current U.S. Nuclear Regulatory Commission (NRC) licensing process for digital systems rests on deterministic engineering criteria. In its 1995 probabilistic risk assessment (PRA) policy statement, the Commission encouraged the use of PRA technology in all regulatory matters to the extent supported by the state-of-the-art in PRA methods and data. Although many activities have been completed in the area of risk-informed regulation, the risk-informed analysis process for digital systems has not yet been satisfactorily developed. Since digital instrumentation and control (I&C) systems are expected to play an increasingly important role in nuclear power plant (NPP) safety, the NRC established a digital system research plan that defines a coherent set of research programs to support its regulatory needs. One of the research programs included in the NRC's digital system research plan addresses risk assessment methods and data for digital systems. Digital I&C systems have some unique characteristics, such as using software, and may have different failure causes and/or modes than analog I&C systems; hence, their incorporation into NPP PRAs entails special challenges. The objective of the NRC's digital system risk research is to identify and develop methods, analytical tools, and regulatory guidance for (1) including models of digital systems into NPP PRAs, and (2) using information on the risks of digital systems to support the NRC's risk-informed licensing and oversight activities. For several years, Brookhaven National Laboratory (BNL) has worked on NRC projects to investigate methods and tools for the probabilistic modeling of digital systems, as documented mainly in NUREG/CR-6962 and NUREG/CR-6997. However, the scope of this research principally focused on hardware failures, with limited reviews of software failure experience and software reliability methods. NRC also sponsored research at the Ohio State University investigating the modeling of digital systems using dynamic PRA methods. These efforts, documented in NUREG/CR-6901, NUREG/CR-6942, and NUREG/CR-6985, included a functional representation of the system's software but did not explicitly address failure modes caused by software defects or by inadequate design requirements. An important identified research need is to establish a commonly accepted basis for incorporating the behavior of software into digital I&C system reliability models for use in PRAs. To address this need, BNL is exploring the inclusion of software failures into the reliability models of digital I&C systems, such that their contribution to the risk of the associated NPP can be assessed.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

A Sensitivity-informed, Process Model Abstraction Implementation in GoldSim - 19276

System-level Performance Assessment (PA) models rely on specific process-level models for some inputs, such as infiltration. For probabilistic PA, the value of the process model output depends on the values of input parameters that also vary in the PA model. The simplest conceptual solution is to draw values of the input parameters from their distributions, run the process level model at these values, and then use the output where it is needed in the PA model. However, this solution is unsatisfactory for multiple reasons: (1) the PA Model should be set up such that new runs can be made and distributions can change without having to go back and run the process-level model; (2) calling the process model from the system model is possible, but technical difficulties remain in coupling the two; and (3) there is no uncertainty in the process-level model results incorporated into the PA model. Therefore, it is desirable to develop a method that maps the values of PA Model inputs to process level model outputs, in real time within the PA Model set up and using as simple of a map as possible without losing key features of the relationship. This has been termed 'model abstraction' because information about process model runs is 'abstracted' to be used with the PA model. A simple 'nearest neighbor' abstraction approach is presented to overcome these problems, in which a sensitivity-informed distance metric is used to map a system-level model realization to the most appropriate process-level model realization. (authors)

97 MATHEMATICS AND COMPUTING↗

Probabilistic evaluation of on-line checks in fault-tolerant multiprocessor systems

The analysis of fault-tolerant multiprocessor systems that use concurrent error detection (CED) schemes is much more difficult than the analysis of conventional fault-tolerant architectures. Various analytical techniques have been proposed to evaluate CED schemes deterministically. However, these approaches are based on worst-case assumptions related to the failure of system components. Often, the evaluation results do not reflect the actual fault tolerance capabilities of the system. A probabilistic approach to evaluate the fault detecting and locating capabilities of on-line checks in a system is developed. The various probabilities associated with the checking schemes are identified and used in the framework of the matrix-based model. Based on these probabilistic matrices, estimates for the fault tolerance capabilities of various systems are derived analytically.

Nair, V. S. S.↗

A hybrid deep neural operator/finite element method for ice-sheet modeling

One of the most challenging and consequential problems in climate modeling is to provide probabilistic projections of sea level rise. A large part of the uncertainty of sea level projections is due to uncertainty in ice sheet dynamics. At the moment, accurate quantification of the uncertainty is hindered by the cost of ice sheet computational models. In this work we develop a hybrid approach to approximate existing ice sheet models at a fraction of their cost. Our approach consists of replacing the finite element model for the momentum equations for the ice velocity, the most expensive part of an ice sheet model, with a Deep Operator Network, while we retain a classic finite element discretization for the evolution of the ice thickness. We show that the resulting hybrid model is very accurate and it is an order of magnitude faster than the traditional finite element model. Further, a distinctive feature of the proposed model, compared to other neural network approaches, is that it can handle high-dimensional parameter spaces (parameter fields) such as the basal friction at the bed of the glacier and can therefore be used for generating samples for uncertainty quantification. Further, we study the impact of hyper-parameters, number of unknowns and correlation length of the parameter distribution on the training and accuracy of the Deep Operator Network on a synthetic ice sheet model. We then target the evolution of the Humboldt glacier in Greenland and show that our hybrid model can provide accurate statistics of the glacier mass loss and can be effectively used to accelerate the quantification of uncertainty.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Addressing uncertainty in genome-scale metabolic model reconstruction and analysis

The reconstruction and analysis of genome-scale metabolic models constitutes a powerful systems biology approach, with applications ranging from basic understanding of genotype-phenotype mapping to solving biomedical and environmental problems. However, the biological insight obtained from these models is limited by multiple heterogeneous sources of uncertainty, which are often difficult to quantify. Here we review the major sources of uncertainty and survey existing approaches developed for representing and addressing them. A unified formal characterization of these uncertainties through probabilistic approaches and ensemble modeling will facilitate convergence towards consistent reconstruction pipelines, improved data integration algorithms, and more accurate assessment of predictive capacity.

59 BASIC BIOLOGICAL SCIENCES↗

Bayesian learning with Gaussian processes for low-dimensional representations of time-dependent nonlinear systems

This work presents a data-driven method for learning low-dimensional time-dependent physics-based surrogate models whose predictions are endowed with uncertainty estimates. We use the operator inference approach to model reduction that poses the problem of learning low-dimensional model terms as a regression of state space data and corresponding time derivatives by minimizing the residual of reduced system equations. Standard operator inference models perform well with accurate training data that are dense in time, but producing stable and accurate models when the state data are noisy and/or sparse in time remains a challenge. Another challenge is the lack of uncertainty estimation for the predictions from the operator inference models. Our approach addresses these challenges by incorporating Gaussian process surrogates into the operator inference framework to (1) probabilistically describe uncertainties in the state predictions and (2) procure analytical time derivative estimates with quantified uncertainties. The formulation leads to a generalized least-squares regression and, ultimately, reduced-order models that are described probabilistically with a closed-form expression for the posterior distribution of the operators. The resulting probabilistic surrogate model propagates uncertainties from the observed state data to reduced-order predictions. Furthermore, we demonstrate the method is effective for constructing low-dimensional models of two nonlinear partial differential equations representing a compressible flow and a nonlinear diffusion–reaction process, as well as for estimating the parameters of a low-dimensional system of nonlinear ordinary differential equations representing compartmental models in epidemiology.

Data-driven model reduction↗

Model-Driven Development of Reliable Avionics Architectures for Lunar Surface Systems

This paper discusses a method used for the systematic improvement of NASA s Lunar Surface Systems avionics architectures in the area of reliability and fault-tolerance. This approach utilizes an integrated system model to determine the effects of component failure on the system s ability to provide critical functions. A Markov model of the potential degraded system modes is created to characterize the probability of these degraded modes, and the system model is run for each Markov state to determine its status (operational or system loss). The probabilistic results from the Markov model are first produced from state transition rates based on NASA data for heritage failure rate data of similar components. An additional set of probabilistic results are created from a representative set of failure rates developed for this study, for a variety of component quality grades (space-rated, mil-spec, ruggedized, and commercial). The results show that careful application of redundancy and selected component improvement should result in Lunar Surface Systems architectures that exhibit an appropriate degree of fault-tolerance, reliability, performance, and affordability.

Borer, Nicholas↗

A Graphical Model for Fusing Diverse Microbiome Data

This paper develops a Bayesian graphical model for fusing disparate types of count data. The motivating application is the study of bacterial communities from diverse high-dimensional features, in this case, transcripts, collected from different treatments. In such datasets, there are no explicit correspondences between the communities and each corresponds to different factors, making data fusion challenging. We introduce a flexible multinomial-Gaussian generative model for jointly modeling such count data. This latent variable model jointly characterizes the observed data through a common multivariate Gaussian latent space that parameterizes the set of multinomial probabilities of the transcriptome counts. The covariance matrix of the latent variables induces a covariance matrix of co-dependencies between all the transcripts, effectively fusing multiple data sources. We present a computationally scalable variational Expectation-Maximization (EM) algorithm for inferring the latent variables and the parameters of the model. Here, the inferred latent variables provide a common dimensionality reduction for visualizing the data and the inferred parameters provide a predictive posterior distribution. In addition to simulation studies that demonstrate the variational EM procedure, we apply our model to a bacterial microbiome dataset.

59 BASIC BIOLOGICAL SCIENCES↗

First-of-a-Kind Risk-Informed Digital Twin for Operational Decision Making

A digital twin (DT) is a digital model or a collection of models of a physical entity. DTs in the nuclear arena can be used from plant design through decommissioning. Decisions are typically a priori or made offline. Risk-informed decision making is identifying what can go wrong, its frequency, and the consequences of its failure. Ideally risk-informed decision making reflects the current state of the plant and provides a decision in real time. Traditionally, probabilistic risk assessments (PRAs) evaluate the failures of safety systems, the risk of core damage, and the offsite dose as the consequence. However, this DT evaluates the decisions on the control side rather than the protection side. It uses the same risk methods to probabilistically inform the decision-making process but in a different way. Rather than evaluating the risk of core damage, this DT evaluates the likelihood of avoiding a trip set point while maintaining plant safety. Performance-based assessments are identified via its probabilistic evaluation of operational alternatives based on system status. Because the purpose of the control system is to maintain system variables within prescribed operating ranges, upsets or challenges that can exceed a trip set point resulting in a plant transient and a challenge to plant mitigating systems based on actual plant conditions, are evaluated to safely maintain the plant within the operating ranges. The probabilistic portion of the model is autonomously and automatically adjusted, and the metric of interest (i.e. likelihood of avoiding a trip set point) is recalculated. The digital representation of the physical system (i.e. the DT) performs a deterministic performance–based assessment of the probabilistically identified alternatives identified to validate the probabilistic assessment. A decision-making algorithm selects the appropriate option based on the probabilistic and deterministic assessments and transmits a control signal to a component(s) to initiate a corrective action or informs an operator of its decision.

digital twin↗

Characterization of Extremes and Compound Impacts: Applications of Machine Learning and Interpretable Neural Networks

Focal Area: This white paper responds to Focal area III by exploring data fusion, learning and explainable AI methods in characterizing hydrological extremes and interconnections. It also addresses Focal area II by using probabilistic AI and ensemble ML for predicting extremes and compound extremes. Science Challenge: A key question associated with the integrated water (or hydrological) cycle grand challenge in the Earth and Environmental Systems Sciences Division (EESSD) strategic plan, is how the frequency and intensity of hydrological events will change. Prediction of the tail behavior (extremes) of the hydrological cycle is especially challenging, because of their stochasticity and low probability. These extreme events and their compound impacts have significant societal and economic consequences. It is anticipated for the next-generation Earth System models (ESMs), that model predictability of the water cycle will improve with increased resolution (e.g., regionally refined E3SM), advanced software and computational architectures, and improved model physics based on the data from ARM measurements and high-fidelity models. However, the challenges for predictability of low-probability high-impact extreme events will unlikely be alleviated with conventional modeling and data-driven approaches, as ESMs are calibrated largely for capturing the high-frequency mean climate states. Recent AI and ML applications have shown great potential in quantifying well-defined climate extremes (e.g., supervised learning of tropical cyclones/atmospheric rivers by ClimateNet1) but few efforts are dedicated to compound events, extreme drivers and uncertainty estimation. We envision the opportunity to develop and apply ML and interpretable AI methods extended on the existing efforts, specifically, for: (1) identification of compound extremes, (2) diagnosing drivers of extremes, (3) bias correction in extreme predictions and (4) probabilistic modeling of extremes.

54 ENVIRONMENTAL SCIENCES↗

Improving Site-Specific Radiological Performance Assessments - 13431

An improved approach is presented for conducting complete and defensible radiological site-specific performance assessments (PAs) to support radioactive waste disposal decisions. The basic tenets of PA were initiated some thirty years ago, focusing on geologic disposals and evaluating compliance with regulations. Some of these regulations were inherently probabilistic (i.e., addressing uncertainty in a quantitative fashion), such as the containment requirements of the U.S. Environmental Protection Agency's (EPA's) 40 CFR 191, Environmental Radiation Protection Standards for Management and Disposal of Spent Nuclear Fuel, High-Level and Transuranic Radioactive Wastes, Chap. 191.13 [1]. Methods of analysis were developed to meet those requirements, but at their core early PAs used 'conservative' parameter values and modeling approaches. This limited the utility of such PAs to compliance evaluation, and did little to inform decisions about optimizing disposal, closure and long-term monitoring and maintenance, or, in general, maintaining doses 'as low as reasonably achievable' (ALARA). This basic approach to PA development in the United States was employed essentially unchanged through the end of the 20. century, principally by the U.S. Department of Energy (DOE). Performance assessments developed in support of private radioactive waste disposal operations, regulated by the U.S. Nuclear Regulatory Commission (NRC) and its agreement states, were typically not as sophisticated. Discussion of new approaches to PA is timely, since at the time of this writing, the DOE is in the midst of revising its Order 435.1, Radioactive Waste Management [2], and the NRC is revising 10 CFR 61, Licensing Requirements for Land Disposal of Radioactive Waste [3]. Over the previous decade, theoretical developments and improved computational technology have provided the foundation for integrating decision analysis (DA) concepts and objective-focused thinking, plus a Bayesian approach to probabilistic modeling and risk analysis, to guide improvements in PA. This decision-making approach, [4, 5, 6] provides a transparent formal framework for using a value- or objective-focused approach to decision-making. DA, as an analytical means to implement structured decision making, provides a context for both understanding how uncertainty affects decisions and for targeting uncertainty reduction. The proposed DA approach improves defensibility and transparency of decision-making. The DA approach is fully consistent with the need to perform realistic modeling (rather than conservative modeling), including evaluation of site-specific factors. Instead of using generic stylized scenarios for radionuclide fate and transport and for human exposures to radionuclides, site-specific scenarios better represent the advantages and disadvantages of alternative disposal sites or engineered designs, thus clarifying their differences as well as providing a sound basis for evaluation of site performance. The full DA approach to PA is described, from explicitly incorporating societal values through stakeholder involvement to model building. Model building involves scoping by considering features, events, processes, and exposure scenarios (FEPSs), development of a conceptual site model (CSM), translation into numerical models and subsequent computation, and model evaluation. These are implemented in a cycle of uncertainty analysis, sensitivity analysis and value of information analysis so that uncertainty can be reduced until sufficient confidence is gained in the decisions to be made. This includes the traditional focus on hydrogeological processes, but also places emphasis on other FEPSs such as biotically-induced transport and human exposure phenomena. The significance of human exposure scenarios is emphasized by modifying the traditional acronym 'FEPs' to include them, hence 'FEPSs'. The radioactive waste community is also recognizing that disposal sites are to be considered a national (or even global) resource. As such, there is a pressing need to optimize their utility within the constraints of protecting human health and the environment. Failing to do so will result in the need for additional sites or options for storing radioactive waste temporarily, assuming a continued need for radioactive waste disposal. Optimization should be performed using DA, including economic analysis, invoked if necessary through the ALARA process. The economic analysis must recognize the cost of implementation (disposal design, closure, maintenance, etc.), and intra- and inter-generational equity in order to ensure that the best possible radioactive waste management decisions are made for the protection of both current and future generations. In most cases this requires consideration of population or collective risk. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Improving the real-time probabilistic channel flood forecasting by incorporating the uncertainty of inflow using the particle filter

An accurate and reliable real-time flood forecast is crucial for mitigating flood disasters. The errors associated with the inflow boundary forcing data are considered as an important source of uncertainties in hydraulic model. In this paper, a real-time probabilistic channel flood forecasting model is developed with a novel function to incorporate the uncertainty of the forcing inflow. This new approach couples a hydraulic model with the particle filter (PF) data assimilation algorithm, a sequential Bayesian Monte Carlo method. The stage observations at hydrological stations are assimilated at each time step to update the model states in order to improve the next time step’s forecasting. This new approach is tested against a real flood event occurred in the upper Yangtze River. As compared with the open loop simulations, the evaluations of model performance with several deterministic and probabilistic metrics indicate that the accuracy of the ensemble mean prediction and the reliability of the uncertainty quantification are improved pronouncedly as a result of the PF assimilation. Further assessment of the prediction results at different lead times shows that the improvement of model performance deteriorates with the increase of the lead time due to the gradual diminishing of the updating effect for the initial conditions. Based on the analyses of the number of particles and the assimilation frequency, we find that the optimal number of particles can be determined by balancing the model performance and the computation cost, while a high assimilation frequency is preferred to incorporate the emerging observations to update the model states to match the real conditions.

Channel flood forecasting, probabilistic forecast,↗

Common-Cause Failure Treatment in Event Assessment: Basis for a Proposed New Model

Event assessment is an application of probabilistic risk assessment in which observed equipment failures and outages are mapped into the risk model to obtain a numerical estimate of the event’s risk significance. In this paper, we focus on retrospective assessments to estimate the risk significance of degraded conditions such as equipment failure accompanied by a deficiency in a process such as maintenance practices. In modeling such events, the basic events in the risk model that are associated with observed failures and other off-normal situations are typically configured to be failed, while those associated with observed successes and unchallenged components are assumed capable of failing, typically with their baseline probabilities. This is referred to as the failure memory approach to event assessment. The conditioning of common-cause failure probabilities for the common cause component group associated with the observed component failure is particularly important, as it is insufficient to simply leave these probabilities at their baseline values, and doing so may result in a significant underestimate of risk significance for the event. Past work in this area has focused on the mathematics of the adjustment. In this paper, we review the Basic Parameter Model for common-cause failure, which underlies most current risk modelling, discuss the limitations of this model with respect to event assessment, and introduce a proposed new framework for common-cause failure, which uses a Bayesian network to model underlying causes of failure, and which has the potential to overcome the limitations of the Basic Parameter Model with respect to event assessment.

99 GENERAL AND MISCELLANEOUS↗

System risk quantification and decision making support using functional modeling and dynamic Bayesian network

Risk-informed decision-making requires a probabilistic assessment of the likelihood of success of control action, given the system status. This paper presents a systematic state transition modeling approach integrating dynamic probabilistic risk assessment with a decision-making process using a dynamic Bayesian network (DBN) coupled with functional modeling. A functional model designed with multilevel flow modeling (MFM) technique was used to build a system state structure inferred by energy, mass, and information flow so that one can verify the developed model with respect to system functionality. The MFM model represents the causal relationship among the nodes, which captures the structure of process parameters and control units. Each node may have multiple possible states, and the DBN structured by the MFM model represents the time-domain transitions among the defined states. Furthermore, the MFM-DBN integrated state transition modeling is a white-box approach that allows one to draw the system's risk profile by updating the system states and supports the decisions probabilistically with physical inference. An example of a simple heating system has been used to illustrate this process, including decision-making support based on quantitative risk profile. For demonstrating its applicability to a complex system operational decision making, a case study of station blackout accident scenario leading to the seal loss of coolant accident in a nuclear power plant is presented. The proposed approach effectively provided the risk profile along time for each option so that the operators can make the best decision, which minimizes the plant risk.

42 ENGINEERING↗

Conjoint-measurement framework for the study of probabilistic information processing.

The theory of conjoint measurement described by Krantz et al. (1971) is shown to indicate how a descriptive model of human processing of probabilistic information built around Bayes' rule is to be tested and how it is to be used to obtain subjective scale values. Specific relationships concerning these scale values are shown to emerge, and the theoretical prospects resulting from this development are discussed.

Wallsten, T. S.↗

Explicitly Accounting for Multiple Spatial Scales in Data Informing Kd Distribution Development - 18414

This work provides an example of incorporating information about spatial scale into input parameter distribution development for probabilistic performance assessment (PA) models and highlights the importance of having an interdisciplinary team working together in the distribution development process. The novel approach is demonstrated for contaminant partitioning coefficients for water/rock (Kds), providing a specific context for discussing the approach and challenges, but the strategy is general and applies to many other PA model inputs. In this example, a PA model of a radioactive waste disposal site is assumed to have large cells representing spatial scales of up to thousands of square meters in area and several to tens of meters in depth. Spatial variability in Kds is expected to occur at scales much smaller than the units in the model domain over which values are applied, and therefore values are intended to represent possible averages over the modeled volume (i.e., spatial scale represented by a PA model cell). Information about possible Kd values for each material category comes from a variety of literature sources, and the reported results used to inform the distribution are available at a wide range of scales (e.g., individual batch experiment results from small-scale samples, averages based on samples collected over site-scales, averages based on samples from large regions, etc.). Effectively addressing the mismatch in spatial scale between available information and the PA Model is a challenge within PA distribution development and it takes effort from database managers, subject matter experts, modelers, and statisticians. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Development of a Risk-Based Comparison Methodology of Carbon Capture Technologies

Given the varying degrees of maturity among existing carbon capture (CC) technology alternatives, an understanding of the inherent technical and financial risk and uncertainty associated with these competing technologies is requisite to the success of carbon capture as a viable solution to the greenhouse gas emission challenge. The availability of tools and capabilities to conduct rigorous, risk–based technology comparisons is thus highly desirable for directing valuable resources toward the technology option(s) with a high return on investment, superior carbon capture performance, and minimum risk. To address this research need, we introduce a novel risk-based technology comparison method supported by an integrated multi-domain risk model set to estimate risks related to technological maturity, technical performance, and profitability. Through a comparison between solid sorbent and liquid solvent systems, we illustrate the feasibility of estimating risk and quantifying uncertainty in a single domain (modular analytical capability) as well as across multiple risk dimensions (coupled analytical capability) for comparison. This method brings technological maturity and performance to bear on profitability projections, and carries risk and uncertainty modeling across domains via inter-model sharing of parameters, distributions, and input/output. The integration of the models facilitates multidimensional technology comparisons within a common probabilistic risk analysis framework. This approach and model set can equip potential technology adopters with the necessary computational capabilities to make risk-informed decisions about CC technology investment. The method and modeling effort can also be extended to other industries where robust tools and analytical capabilities are currently lacking for evaluating nascent technologies.

carbon capture↗

Natural Hazard Risk Assessments at the Global Scale

Since 1990, natural hazards have led to over 1.6 million fatalities globally, and economic losses are estimated at an average of around USD 260–310 billion per year. The scientific and policy communities recognise the need to reduce these risks. As a result, the last decade has seen a rapid development of global models for assessing risk from natural hazards at the global scale. In this paper, we review the scientific literature on natural hazard risk assessments at the global scale, and we specifically examine whether and how they have examined future projections of hazard, exposure, and/or vulnerability. In doing so, we examine similarities and differences between the approaches taken across the different hazards, and we identify potential ways in which different hazard communities can learn from each other. For example, there are a number of global risk studies focusing on hydrological, climatological, and meteorological hazards that have included future projections and disaster risk reduction measures (in the case of floods), whereas fewer exist in the peer-reviewed literature for global studies related to geological hazards. On the other hand, studies of earthquake and tsunami risk are now using stochastic modelling approaches to allow for a fully probabilistic assessment of risk, which could benefit the modelling of risk from other hazards. Finally, we discuss opportunities for learning from methods and approaches being developed and applied to assess natural hazard risks at more continental or regional scales. Through this paper, we hope to encourage further dialogue on knowledge sharing between disciplines and communities working on different hazards and risk and at different spatial scales.

Philip J. Ward↗