Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Probabilistic Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,207 records · Page 67

Optimized Uncertainty Quantification Algorithm Within a Dynamic Event Tree Framework

Methods for developing Phenomenological Identification and Ranking Tables (PIRT) for nuclear power plants have been a useful tool in providing insight into modelling aspects that are important to safety. These methods have involved expert knowledge with regards to reactor plant transients and thermal-hydraulic codes to identify are of highest importance. Quantified PIRT provides for rigorous method for quantifying the phenomena that can have the greatest impact. The transients that are evaluated and the timing of those events are typically developed in collaboration with the Probabilistic Risk Analysis. Though quite effective in evaluating risk, traditional PRA methods lack the capability to evaluate complex dynamic systems where end states may vary as a function of transition time from physical state to physical state . Dynamic PRA (DPRA) methods provide a more rigorous analysis of complex dynamic systems. A limitation of DPRA is its potential for state or combinatorial explosion that grows as a function of the number of components; as well as, the sampling of transition times from state-to-state of the entire system. This paper presents a method for performing QPIRT within a dynamic event tree framework such that timing events which result in the highest probabilities of failure are captured and a QPIRT is performed simultaneously while performing a discrete dynamic event tree evaluation. The resulting simulation results in a formal QPIRT for each end state. The use of dynamic event trees results in state explosion as the number of possible component states increases. This paper utilizes a branch and bound algorithm to optimize the solution of the dynamic event trees. The paper summarizes the methods used to implement the branch-and-bound algorithm in solving the discrete dynamic event trees.

42 ENGINEERING↗

Cost-Effectiveness Analysis of Stereotactic Body Radiotherapy and Radiofrequency Ablation for Medically Inoperable, Early-Stage Non-Small Cell Lung Cancer

Purpose: The standard management of medically inoperable Stage I non-small-cell lung cancer (NSCLC) conventionally has been fractionated three-dimensional conformal radiation therapy (3D-CRT). The relatively poor local control rate and inconvenience associated with this therapy have prompted the development of stereotactic body radiotherapy (SBRT), a technique that delivers very high doses of irradiation typically over 3 to 5 sessions. Radiofrequency ablation (RFA) has also been investigated as a less costly, single-day therapy that thermally ablates small, peripheral tumors. The cost-effectiveness of these three techniques has never been compared. Methods and Materials: We developed a Markov model to describe health states of 65-year-old men with medically inoperable NSCLC after treatment with 3D-CRT, SBRT, and RFA. Given their frail state, patients were assumed to receive supportive care after recurrence. Utility values, recurrence risks, and costs were adapted from the literature. Sensitivity analyses were performed to model uncertainty in these parameters. Results: The incremental cost-effectiveness ratio for SBRT over 3D-CRT was $6,000/quality-adjusted life-year, and the incremental cost-effectiveness ratio for SBRT over RFA was $14,100/quality-adjusted life-year. One-way sensitivity analysis showed that the results were robust across a range of tumor sizes, patient utility values, and costs. This result was confirmed with probabilistic sensitivity analyses that varied local control rates and utilities. Conclusion: In comparison to 3D-CRT and RFA, SBRT was the most cost-effective treatment for medically inoperable NSCLC over a wide range of treatment and disease assumptions. On the basis of efficacy and cost, SBRT should be the primary treatment approach for this disease.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Certainty grids for mobile robots

A numerical representation of uncertain and incomplete sensor knowledge called Certainty Grids has been used successfully in several mobile robot control programs, and has proven itself to be a powerful and efficient unifying solution for sensor fusion, motion planning, landmark identification, and many other central problems. Researchers propose to build a software framework running on processors onboard the new Uranus mobile robot that will maintain a probabilistic, geometric map of the robot's surroundings as it moves. The certainty grid representation will allow this map to be incrementally updated in a uniform way from various sources including sonar, stereo vision, proximity and contact sensors. The approach can correctly model the fuzziness of each reading, while at the same time combining multiple measurements to produce sharper map features, and it can deal correctly with uncertainties in the robot's motion. The map will be used by planning programs to choose clear paths, identify locations (by correlating maps), identify well-known and insufficiently sensed terrain, and perhaps identify objects by shape. The certainty grid representation can be extended in the same dimension and used to detect and track moving objects.

Moravec, H. P.↗

Inference of Unresolved Point Sources at High Galactic Latitudes Using Probabilistic Catalogs

The detection of point sources in images is a fundamental operation in astrophysics, and is crucial for constraining population models of the underlying point sources or characterizing the background emission. Standard techniques fall short in the crowded-field limit, losing sensitivity to faint sources and failing to track their covariance with close neighbors. We construct a Bayesian framework to perform inference of faint or overlapping point sources. The method involves probabilistic cataloging, where samples are taken from the posterior probability distribution of catalogs consistent with an observed photon count map. In order to validate our method, we sample random catalogs of the gamma-ray sky in the direction of the North Galactic Pole (NGP) by binning the data in energy and point-spread function classes. Using three energy bins spanning 0.3–1, 1–3, and 3–10 GeV, we identify 270{sub −10}{sup +30} point sources inside a 40{sup ∘}×40{sup ∘} region around the NGP above our point-source inclusion limit of 3×10{sup −11} cm{sup −2} s{sup −1} sr{sup −1} GeV{sup −1} at the 1–3 GeV energy bin. Modeling the flux distribution as a power law, we infer the slope to be −1.92{sub −0.05}{sup +0.07} and estimate the contribution of point sources to the total emission as 18{sub −2}{sup +2}%. These uncertainties in the flux distribution are fully marginalized over the number as well as the spatial and spectral properties of the unresolved point sources. This marginalization allows a robust test of whether the apparently isotropic emission in an image is due to unresolved point sources or of truly diffuse origin.

79 ASTRONOMY AND ASTROPHYSICS↗

Probabilistic methods in a study of trip setpoints

Most early vintage Boiling Water Reactors have a high head and high capacity High Pressure Coolant Injection (HPCI) pump to keep the core covered following a loss of coolant accident (LOCA). However, the protection afforded by the HPCI pump for mitigating a LOCA introduces the potential that a spurious start of the HPCI pump could oversupply the reactor vessel and lead to an automatic trip of the main turbine due to high water level. A turbine trip and associated increase in moderator density could challenge the bases of fuel integrity operating limits. To prevent turbine trip during spurious operation of the HPCI pump, the reactor protection system includes instrumentation and logic to sense high water level and automatically trip the HPCI pump prior to reaching the turbine trip setpoint. This paper describes an analysis that was performed to determine if existing reactor vessel water level trip instrumentation, logic and setpoints result in a high probability that the HPCI pump will trip prior to actuation of the turbine trip. Using nominal values for the initial water level and for the HPCI pump and turbine trip setpoints, and using the probability distribution functions for measurement uncertainty in these setpoints, a Monte Carlo simulation was employed to determine probabilities of successfully tripping the HPCI pump prior to tripping of the turbine. The results of the analysis established that the existing setpoints, instrumentation and logic would be expected to reliably prevent a trip of the main turbine. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Minimizing Uncertainties Impact in Decision Making with an Applicability Study for Economic Power Dispatch

This report summaries the work performed under the LDRD project on the preliminary study on knowledge automation, where specific focus has been made on the investigation of the impact of uncertainties of human decision making onto the optimization of the process operation. At first the statistics on signals from the Brain-Computing Interface (BCI) is analyzed so as to obtain the uncertainties characterization of human operators during the decision making phase using the electroencephalogram (EEG) signals. This is then followed by the discussions of an architecture that reveals the equivalence between optimization and closed loop feedback control design, where it has been shown that all the optimization problems can be transferred into the control design problem for closed loop systems. This has led to a “closed loop” framework, where the structure of the decision making is shown to be subjected to both process disturbances and controller’s uncertainties. The latter can well represent the uncertainties or randomness occurred during human decision making phase. As a result, a stochastic optimization problem has been formulated and a novel solution has been proposed using probability density function (PDF) shaping for both the cost function and the constraints using stochastic distribution control concept. A sufficient condition has been derived that guarantees the convergence of the optimal solution and discussions have been made for both the total probabilistic solution and chanced constrained optimization which have been well-studied in optimal power flows (OPF) area. A simple case study has been carried out for the economic dispatch of powers for a grid system when there are distributed energy resources (DERs) in the system, and encouraging results have been obtained showing that a significant savings on the generation cost can be expected.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

A Prefire Approach for Probabilistic Assessments of Postfire Debris‐Flow Inundation

Increases in wildfire activity and rainfall intensification are driving more postfire debris flows (PFDF) in many regions around the world. PFDFs are most common in the first postfire year and may even occur before a fire is fully controlled. This underscores the importance of assessing postfire hazards before a fire starts. Evaluation of PFDF hazards prior to fire can help strategize interventions lessening the negative effects of future fires. However, debris-flow runout and inundation analyses are not routine in PFDF hazard assessments, partially due to time constraints and substantial uncertainties in boundary conditions. Here, we propose a prefire PFDF inundation assessment framework using a debris-flow runout model based on the Herschel-Bulkley (HB) rheology (HEC-RAS v6.1). We constrain model inputs and parameters using Bayesian posterior analysis, rainfall-runoff simulations, and a debris-flow volume model. We use observations from recent PFDF incidents in northern Arizona, USA, to calibrate model components and then apply our prefire inundation assessment framework in a nearby unburned area. Specifically, we (a) identify yield stress as the most influential factor on inundation extent and arrival time in a HB model, (b) establish posterior distributions for model parameters suitable for forward modeling by leveraging uncertainties in field observations, and (c) implement a predictive forward analysis in an area that has not burned recently to evaluate PFDF inundation under several future fire scenarios. This study improves our ability to assess postfire debris-flow hazards before a fire begins and provides guidance for future applications of single-phase rheological models when assessing PFDF hazards.

54 ENVIRONMENTAL SCIENCES↗

Development of Waste Inventory for Probabilistic Performance Assessment Modeling - 19361

Estimation of radioactive waste inventory is a key initial step in the development of an environmental fate and transport model for performance assessment (PA) of radioactive waste sites. PA model output is often sensitive to parameters that represent inventory as a source term, yet estimation is a difficult problem. Inventory estimation for a probabilistic performance assessment (PPA) is related to, but distinct from, that performed for waste excavation, characterization, and offsite disposal. The latter appropriately focuses on obtaining the most detailed information possible on specific hazards and locations; however, these questions cannot be fully answered without intrusive site characterization efforts. This type of characterization is often not feasible when assembling information regarding a source term in a PPA model. Development of waste inventory for a PPA is one piece of a larger hierarchical model. The physical process model represented by Goldsim computer code represents one level of the hierarchy, and the second level of the hierarchy involves estimation of inputs such as inventory, transport, and risk parameters. The estimation of inputs is not a straightforward problem. The parameters of a computer model often do not have an equivalence to the physical quantities they describe, and estimation of the physical quantities themselves can be difficult due to limitations of available information. Inventory information for the West Valley Site in upstate New York is based on data from historical shipping and disposal forms. In the 1990's, the West Valley Demonstration Project (WVDP) compiled information from existing databases and historical waste records into one complete modern database. A conceptual model was then applied and used with recorded information to characterize the waste mass and radionuclide composition for each waste burial. Information was ultimately aggregated over all waste records to estimate the mass of each radionuclide within each trench, hole, or caisson. Three decades later, we revisit the master database, make updates with newly-identified information, and incorporate the conceptual model previously used for inventory estimation in the hierarchical modeling framework. We characterize uncertainty using probability distributions for waste mass and radionuclide composition at the individual shipment or individual burial level. Uncertainty incorporated at the lowest level of the hierarchy is ultimately carried through to uncertainty in PPA model endpoints. Sensitivity analysis of early model results is then applied to identify influential inputs and guide subsequent efforts towards parameters that drive risk. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Evanescent radiation, quantum mechanics and the Casimir effect

An attempt to bridge the gap between classical and quantum mechanics and to explain the Casimir effect is presented. The general nature of chaotic motion is discussed from two points of view: the first uses catastrophe theory and strange attractors to describe the deterministic view of this motion; the underlying framework for chaos in these classical dynamic systems is their extreme sensitivity to initial conditions. The second interpretation refers to randomness associated with probabilistic dynamics, as for Brownian motion. The present approach to understanding evanescent radiation and its relation to the Casimir effect corresponds to the first interpretation, whereas stochastic electrodynamics corresponds to the second viewpoint. The nonlinear behavior of the electromagnetic field is also studied. This well-understood behavior is utilized to examine the motions of two orbiting charges and shows a closeness between the classical behavior and the quantum uncertainty principle. The evanescent radiation is used to help explain the Casimir effect.

Schatten, Kenneth H.↗

IAEA Initiatives that Integrate Stakeholders, Models and Decision Making - 18646

The International Atomic Energy Agency (IAEA) has initiated an effort to provide stakeholder support services as part of Phase II of the Constraints to Implementing Decommissioning and Environmental Remediation (CIDER II) programs. The intent of this sub-group of CIDER II is to provide members states support in areas of stakeholder communication, engagement and participation, with the goal of building trust in decommissioning and environmental remediation (D and ER) decisions for radioactive contamination and facilities. IAEA has also initiated a follow-on effort to address Modeling and Data for Radiological Impact Assessments (MODARIA II), which is aimed at enhancing the capabilities of Member States to simulate radionuclide transfer in the environment, and to ensure appropriate levels of protection from ionizing radiation. Working Group 1 of MODARIA II is focused on the integration of modeling and decision analysis. These two groups have complementary and supporting objectives, which provides an opportunity for collaboration and mutual benefit. The technical integrator is the approach of structured decision making, which follows a five-step process that combines stakeholder values with models through a technically defensible decision analysis. Briefly, the steps are: 1. Provide the context and decision context for the problem; 2. Obtain costs, values and concerns from stakeholders, to develop objectives that need to be achieved (e.g., improve human health, minimize costs, increase jobs); 3. Identify options that might achieve the objectives (e.g., cleanup, institutional controls, education); 4. Develop probabilistic models that connect options to objectives so that the objectives can be evaluated collectively (e.g., a fate and transport and risk model to address the objective of reducing human health risk, a cost model to address costs of taking action); and, 5. Model evaluation, including sensitivity analysis, to determine if an action can be taken with sufficient certainty, or if collection of more data is needed to decrease uncertainty before a decision is made. This approach also supports adaptive management as new data are collected. This approach clarifies the roles of stakeholders and subject matter experts in the decision-making process, where stakeholders specify values, and subject matter experts focus on the models that are needed to evaluate the options. It also provides a technically defensible, reproducible, transparent and traceable approach to all of the components necessary to properly solve the types of complex decision problems that plague radioactive waste management, decommissioning and environmental remediation. This paper introduces the major challenges to implementing such a broad scale of decision analysis, and approaches to overcoming those challenges, which include not only the technical challenges, but also the need to develop capacity in a range of skills not usually accommodated in environmental modeling and includes the need for the IAEA to address decision making in different countries, and with different cultures, religions, political affiliations, and languages. This paper explores the potential for IAEA to benefit from both the CIDER II and MODARIA II programs, and hence to develop a fully integrated approach to effective decision making for radioactive waste management and environmental remediation. Note that there are many people involved in these efforts at the IAEA, and credit belongs to those people for the progress that has been made to date. Our intent here is simply to introduce these IAEA programs at the WM2018 Symposium to provide our perspective and some awareness of some of the directions in which IAEA appears to be headed regarding stakeholder engagement, environmental and risk modeling, data science, and decision analysis. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

A Prefire Approach for Probabilistic Assessments of Postfire Debris-Flow Inundation

Increases in wildfire activity and rainfall intensification are driving more postfire debris flows (PFDF) in many regions around the world. PFDFs are most common in the first postfire year and may even occur before a fire is fully controlled. This underscores the importance of assessing postfire hazards before a fire starts. Evaluation of PFDF hazards prior to fire can help strategize interventions lessening the negative effects of future fires. However, debris-flow runout and inundation analyses are not routine in PFDF hazard assessments, partially due to time constraints and substantial uncertainties in boundary conditions. Here, we propose a prefire PFDF inundation assessment framework using a debris-flow runout model based on the Herschel-Bulkley (HB) rheology (HEC-RAS v6.1). We constrain model inputs and parameters using Bayesian posterior analysis, rainfall-runoff simulations, and a debris-flow volume model. We use observations from recent PFDF incidents in northern Arizona, USA, to calibrate model components and then apply our prefire inundation assessment framework in a nearby unburned area. Specifically, we (a) identify yield stress as the most influential factor on inundation extent and arrival time in a HB model, (b) establish posterior distributions for model parameters suitable for forward modeling by leveraging uncertainties in field observations, and (c) implement a predictive forward analysis in an area that has not burned recently to evaluate PFDF inundation under several future fire scenarios. This study improves our ability to assess postfire debris-flow hazards before a fire begins and provides guidance for future applications of single-phase rheological models when assessing PFDF hazards.

54 ENVIRONMENTAL SCIENCES↗

Exploration with Scalable Gaussian Process Reinforcement Learning

Exploration is a challenging problem in reinforcement learning (RL), especially in environments with sparse rewards. Quantifying and utilizing the parametric uncertainty has been shown to be paramount for successful exploration [Osband et al., 2018]. Bayesian, or approximately Bayesian, methods present a principled means of estimating the parametric uncertainty in RL problems. Gaussian processes, nonparametric Bayesian models, are often impractical due to poor scalability and computational bottlenecks. We introduce a scalable Gaussian process RL (GPRL) method which directly induces sparsity in the covariance matrix to facilitate faster computation. This is a departure from previous GPRL methods which instead rely on data reduction and subsampling. We compare various covariance-based exploration techniques (Thompson sampling, upper confidence bound, and probabilistic maximum variance) which leverage our scalable GP framework in sparse reward environments. Finally, we show favorable comparison against the bootstrapped deep Q-Network.

97 MATHEMATICS AND COMPUTING↗

A Probabilistic Approach of Incorporating Safety and Reliability in System Designs for a Manned Mission to Mars

Conceptual stages in mission design often lack the input of quantitative safety and reliability assessments, simply because failure rates or other data are not yet available for systems that have not yet been designed. Absence of such data should not, however, prevent the development of a quantitative risk models with placeholders for missing data. Functions (that is, actions the systems must perform) in mission design will eventually require system probabilities of success, and there could be much learned from surrogate data, adequately bounded in uncertainty, used in a large event tree model of a complex mission.

Railsback, Jan W.↗

Extension of the ADAPT Framework for Multiple Simulators

Probabilistic Risk Assessment (PRA) uses fault tree/event tree analysis to evaluate the environmental impacts of nuclear power plants due to internal or external initiating events. In a fault tree, basic failure events are assembled using primarily And/Or logic to determine the combinations of failures that lead to failure of the system as a whole. An event tree is forward-facing, and begins with a single initiating event. From there the analysis considers what event may occur next, and branches out among the possible configurations of occurrence and non-occurrence of that event. This branching continues until end states are reached. End states may include a safe and stable configuration of the plant, or any number of differing failure states. Both fault and event trees require basic event probabilities as inputs to provide insight on the likelihood of different outcomes. PRA has been applied to nuclear power plants as an analysis tool since the 1975 Reactor Safety Study. In a traditional PRA, the order of events is prescribed by the analyst and each event is typically a binary aleatory uncertainty: occurrence or non-occurrence. Discrete dynamic event tree (DDET) analysis eliminates this subjectivity in ordering of events by using the output of a dynamic system model (simulator) to inform the branching. Branching conditions are triggered by the existence of a relevant plant state in the code, and therefore only occur as physically appropriate. The DDET approach also allows consideration of both epistemic and aleatory uncertainties on a phenomenologically and stochastically consistent platform. One limitation of the DDET driver codes developed to date (namely ADAPT, ADS, and MCDET ) is that the tree is driven by a single simulator. The goal of this work is a general multi-simulator driver. This limits the parameter space that may be explored in a single DDET to that which may be covered by a single simulator. In this work, the Analysis of Dynamic Accident Progression Trees (ADAPT) code is extended to support multiple arbitrary simulators. This capability will increase the depth and breadth of phenomena that may be analyzed in a single DDET. For example, a large-scale system code may pass the analysis to a more detailed code if certain conditions are met, in order to capture relevant phenomena that would be lost if only the system code were to be used. In addition, the time required to cover a given uncertainty space may be reduced by dynamically identifying and running only the situations that are appropriate given the plant conditions in each simulator. The use of multiple simulators is expected to further reduce subjectivity in PRA by enabling high fidelity modeling of reality. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Development of Simplified Probabilistic Risk Assessment Model for Seismic Initiating Event

ABSTRACT This paper discusses a simplified method to evaluate seismic risk using a methodology built on dividing the seismic intensity spectrum into multiple discrete bins. The seismic probabilistic risk assessment model uses Nuclear Regulatory Commission’s (NRC’s) full power Standardized Plant Analysis Risk (SPAR) model as the starting point for development. The seismic PRA models are integrated with their respective internal events at-power SPAR model. This is accomplished by combining the modified system fault trees from the full power SPAR model with seismic event tree logic. The peak ground acceleration is divided into five bins. The g-value for each bin is estimated using the geometric mean of lower and upper values of that particular bin and the associated frequency for each bin is estimated by taking the difference between upper and lower values of that bin. The component’s fragilities are calculated for each bin using the plant data, if available, or generic values of median peak ground acceleration and uncertainty values for the components. For human reliability analysis (HRA), the SPAR HRA (SPAR-H) method is used which requires the analysts to complete relatively straight forward worksheets that include the performance shaping factors (PSFs). The results are then used to estimate human error probabilities (HEPs) of interest. This work is expected to improve the NRC’s ability to include seismic hazards in risk assessments for operational events in support of the reactor oversight program (e.g., significance determination process).

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Multi-Fidelity Gaussian Process for Distribution System Voltage Probabilistic Estimation with PVs

The increasing penetration of behind-the-meter PVs causes challenges to maintain voltage security due to the lack of distribution system visibility. This paper proposes a nonlinear autoregressive Gaussian process (NARGP) approach to fuse limited number of SCADA/AMI data together with historical pseudo measurements for distribution node voltage probabilistic estimation. The high-fidelity SCADA data are fused with the low-fidelity AMI and pseudo measurements by the autoregressive algorithm embedded in the Gaussian process. This allows us to use multi-fidelity data to achieve entire distribution system voltage visibility. Numerical results carried out on the IEEE 123node system demonstrate that the NARGP method is able to obtain high accuracy in estimating bus voltage and quantifying estimation uncertainties as compared to other approaches.

distribution system estimation↗

Deep-Learning-Based Koopman Modeling for Online Control Synthesis of Nonlinear Power System Transient Dynamics

Power system stability and control have become more challenging due to the increasing uncertainty associated with renewable generation. Here, the performance of conventional control is highly driven by the physics-based offline-developed dynamic models that can deviate from the actual system characteristics under different operating conditions and/or configurations. Data-driven approaches based on online measurements can be a better solution to addressing these issues by capturing real-time operation conditions. This article describes a novel fully data-driven probabilistic framework to derive a linear representation of postcontingency grid dynamics and online prescribe control based on the derived model to enhance transient stability. The complex nonlinear power system dynamics is approximated by a linear model by using multiple neural network modules that infer distributions of the observations and introducing a Koopman layer to sample possible Koopman linear models from the inferred distributions. The trained model features linearity that can be easily incorporated into the existing linear control design paradigm and ease the controller design process. The effectiveness of Koopman-based control designs is validated through comparative case studies, which demonstrate increased prediction accuracy and control performance when applied to a power system with heterogeneous generator dynamics.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Validation Metrics for Deterministic and Probabilistic Data

Computational modeling and simulation are paramount to modern science. Computational models often replace physical experiments that are prohibitively expensive, dangerous, or occur at extreme scales. Thus, it is critical that these models accurately represent and can be used as replacements for reality. This paper provides an analysis of metrics that may be used to determine the validity of a computational model. While some metrics have a direct physical meaning and a long history of use, others, especially those that compare probabilistic data, are more difficult to interpret. Furthermore, the process of model validation is often application-specific, making the procedure itself challenging and the results difficult to defend. We therefore provide guidance and recommendations as to which validation metric to use, as well as how to use and decipher the results. Furthermore an example is included that compares interpretations of various metrics and demonstrates the impact of model and experimental uncertainty on validation processes.

97 MATHEMATICS AND COMPUTING↗