Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty qualification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Efficient sampling for spatial uncertainty qualification in multibody system dynamics applications.

We present two methods for efficiently sampling the response (trajectory space) of multibody systems operating under spatial uncertainty, when the latter is assumed to be representable with Gaussian processes. In this case, the dynamics (time evolution) of the multibody systems depends on spatially indexed uncertain parameters that span infinite-dimensional spaces. This places a heavy computational burden on existing methodologies, an issue addressed herein with two new conditional sampling approaches. When a single instance of the uncertainty is needed in the entire domain, we use a fast Fourier transform technique. When the initial conditions are fixed and the path distribution of the dynamical system is relatively narrow, we use an incremental sampling approach that is fast and has a small memory footprint. Both methods produce the same distributions as the widely used Cholesky-based approaches. We illustrate this convergence at a smaller computational effort and memory cost for a simple non-linear vehicle model.

97 MATHEMATICS AND COMPUTING↗

Tonopah Test Range Optical Tracking TSPI Uncertainty Qualification Analysis.

Tonopah Test Range (TTR) is an outpost of Sandia National Laboratories (SNL) in the Nevada desert, which has been used for the testing of ballistics and non-nuclear components of both nuclear and conventional weapons since 1957. These tests typically involve the drop or flight of test objects, which impact on one of several dry lake beds at the facility.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Analysis of FRAM Measurements to Establish Methodology Uncertainty

Qualification measurements were performed at Oak Ridge National Laboratory (ORNL) on a variety of measurement standards. These measurements will be used to qualify the Fixed-Energy, Response Function Analysis with Multiple Efficiency (FRAM) code with a high purity germanium (HPGe) detector for use at ORNL. Measured items include uranium isotopic standards, U 3 O 8 line sources, and a uranium tetrafluoride source. The 235 U enrichment was estimated using the FRAM isotopic analysis software for each source and compared with the declared isotopic values.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Analysis of ISOCS Measurements to Establish Methodology Uncertainty

Qualification measurements were performed at the US Department of Energy’s (DOE’s) Oak Ridge National Laboratory (ORNL) on a variety of measurement standards. These measurements will be used to qualify the In-Situ Object Counting System (ISOCS) measurement method with a high-purity germanium (HPGe) detector for use at ORNL. Measured items include uranium isotopic standards, filter papers coated with uranium oxide (U 3 O 8 ), U 3 O 8 line sources, and a uranium tetrafluoride (UF 4 ) source. The 235 U mass was estimated using the ISOCS calibration software for each source and compared with the declared isotope mass value.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Use of Forward Sensitivity Analysis Method to Improve Code Scaling, Applicability, and Uncertainty (CSAU) Methodology

Code Scaling, Applicability, and Uncertainty (CSAU) methodology was developed in late 1980s by US NRC to systematically quantify reactor simulation uncertainty. Basing on CSAU methodology, Best Estimate Plus Uncertainty (BEPU) methods have been developed and widely used for new reactor designs and existing LWRs power uprate. In spite of these successes, several aspects of CSAU have been criticized for further improvement: i.e., (1) subjective judgement in PIRT process; (2) high cost due to heavily relying large experimental database, needing many experts man-years work, and very high computational overhead; (3) mixing numerical errors with other uncertainties; (4) grid dependence and same numerical grids for both scaled experiments and real plants applications; (5) user effects; Although large amount of efforts have been used to improve CSAU methodology, the above issues still exist. With the effort to develop next generation safety analysis codes, new opportunities appear to take advantage of new numerical methods, better physical models, and modern uncertainty qualification methods. Forward sensitivity analysis (FSA) directly solves the PDEs for parameter sensitivities (defined as the differential of physical solution with respective to any constant parameter). When the parameter sensitivities are available in a new advanced system analysis code, CSAU could be significantly improved: (1) Quantifying numerical errors: New codes which are totally implicit and with higher order accuracy can run much faster with numerical errors quantified by FSA. (2) Quantitative PIRT (Q-PIRT) to reduce subjective judgement and improving efficiency: treat numerical errors as special sensitivities against other physical uncertainties; only parameters having large uncertainty effects on design criterions are considered. (3) Greatly reducing computational costs for uncertainty qualification by (a) choosing optimized time steps and spatial sizes; (b) using gradient information (sensitivity result) to reduce sampling number. (4) Allowing grid independence for scaled integral effect test (IET) simulation and real plant applications: (a) eliminate numerical uncertainty on scaling; (b) reduce experimental cost by allowing smaller scaled IET; (c) eliminate user effects. This paper will review the issues related to the current CSAU, introduce FSA, discuss a potential Q-PIRT process, and show simple examples to perform FSA. Finally, the general research direction and requirements to use FSA in a system analysis code will be discussed.

99 GENERAL AND MISCELLANEOUS↗

Extended Forward Sensitivity Analysis for Uncertainty Quantification

This paper presents the extended forward sensitivity analysis as a method to help uncertainty qualification. By including time step and potentially spatial step as special sensitivity parameters, the forward sensitivity method is extended as one method to quantify numerical errors. Note that by integrating local truncation errors over the whole system through the forward sensitivity analysis process, the generated time step and spatial step sensitivity information reflect global numerical errors. The discretization errors can be systematically compared against uncertainties due to other physical parameters. This extension makes the forward sensitivity method a much more powerful tool to help uncertainty qualification. By knowing the relative sensitivity of time and space steps with other interested physical parameters, the simulation is allowed to run at optimized time and space steps without affecting the confidence of the physical parameter sensitivity results. The time and space steps forward sensitivity analysis method can also replace the traditional time step and grid convergence study with much less computational cost. Two well-defined benchmark problems with manufactured solutions are utilized to demonstrate the method.

99 GENERAL AND MISCELLANEOUS↗

Extended Forward Sensitivity Analysis for Uncertainty Quantification

Verification and validation (V&V) are playing more important roles to quantify uncertainties and realize high fidelity simulations in engineering system analyses, such as transients happened in a complex nuclear reactor system. Traditional V&V in the reactor system analysis focused more on the validation part or did not differentiate verification and validation. The traditional approach to uncertainty quantification is based on a 'black box' approach. The simulation tool is treated as an unknown signal generator, a distribution of inputs according to assumed probability density functions is sent in and the distribution of the outputs is measured and correlated back to the original input distribution. The 'black box' method mixes numerical errors with all other uncertainties. It is also not efficient to perform sensitivity analysis. Contrary to the 'black box' method, a more efficient sensitivity approach can take advantage of intimate knowledge of the simulation code. In these types of approaches equations for the propagation of uncertainty are constructed and the sensitivities are directly solved for as variables in the simulation. This paper presents the forward sensitivity analysis as a method to help uncertainty qualification. By including time step and potentially spatial step as special sensitivity parameters, the forward sensitivity method is extended as one method to quantify numerical errors. Note that by integrating local truncation errors over the whole system through the forward sensitivity analysis process, the generated time step and spatial step sensitivity information reflect global numerical errors. The discretization errors can be systematically compared against uncertainties due to other physical parameters. This extension makes the forward sensitivity method a much more powerful tool to help uncertainty qualification. By knowing the relative sensitivity of time and space steps with other interested physical parameters, the simulation is allowed to run at optimized time and space steps without affecting the confidence of the physical parameter sensitivity results. The time and space steps forward sensitivity analysis method can also replace the traditional time step and grid convergence study with much less computational cost. Several well defined benchmark problems with manufactured solutions are utilized to demonstrate the extended forward sensitivity analysis method. All the physical solutions, parameter sensitivity solutions, even the time step sensitivity in one case, have analytical forms, which allows the verification to be performed in the strictest sense.

97 MATHEMATICS AND COMPUTING↗

Use of Forward Sensititvity Analysis Method to Improve Code Scaling, Applicability, and Uncertainty (CSAU) Methodology

Since the Code Scaling, Applicability, and Uncertainty (CSAU) methodology was proposed about two decades ago, it has been widely used for new reactor designs and existing LWRs power uprates. In spite of these huge successes, CSAU has been criticized for the need of further improvement, focusing on two main issues - lack of objectiveness and high cost. With the effort to develop next generation safety analysis codes, new opportunities appear to take advantage of new numerical methods, better physical models, and modern uncertainty qualification methods. Forward sensitivity analysis (FSA) directly solves the partial differential equations for parameter sensitivities. Moreover, our work shows that time and space steps can be treated as special sensitivity parameters so that numerical errors can be directly compared with physical uncertainties. When the FSA is implemented in a new advanced system analysis code, CSAU could be significantly improved by quantifying numerical errors and allowing a quantitative PIRT (Q-PIRT) to reduce subjective judgement and improving efficiency. This paper will review the issues related to the current CSAU implementations, introduce FSA, show a simple example to perform FSA, and discuss potential improvements on CSAU with FSA. Finally, the general research direction and requirements to use FSA in an advanced system analysis code will be discussed.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Understanding Material Strength Variabilities and Uncertainties for Component Qualification (2020 LDRD Final Report)

At its core, material specification and materials qualification require an understanding of the uncertainties in relation to a given performance metric. When simulations are used to inform the design and evaluation of these metrics, it is essential to understand the uncertainties in the underlying models and parameters that feed into those simulations. In this work, we have created a statistical framework to address uncertainties in the materials strength modeling used in integrated simulations. The framework is based on the Bayesian methodology, which allows for uncertainties to be updated as new data become available. The results of this work show how model parameters and their uncertainties can be updated as new and different types of strength data are added, as well as methods for determining which future experiment has the greatest potential to reduce the uncertainty. The statistical framework developed in this project will be utilized to assess and propagate the uncertainties in the strength models used in the programmatic simulations and to create a way to formally update those uncertainties as new data become available.

36 MATERIALS SCIENCE↗

Investigation of Mixing Law Efficacy for Gaseous Hydrodynamic Simulations

A computational simulation of various mixing laws for gaseous equations of state using planar traveling shocks for multiple mixtures in three dimensions is analyzed against nominal experimental data. Numerical simulations utilize the Sandia National Laboratories shock hydrodynamic code CTH and other codes including the thermochemical equilibrium code TIGER and the uncertainty qualification and sensitivity analysis code DAKOTA. The mixtures are a 1:1 and a 1:3 molar mixture of helium and sulfur hexafluoride. The mixing laws to be analyzed are the ideal gas law, Amagat's Law, Dalton's Law, the BKW EOS, the EXP6 EOS, and the JCZ3 EOS. Examination of the experimental data with TIGER revealed that the shock strength should not be strong enough to turn the mixture non-ideal as the compressibility factor z was essentially unity (z ≈ 1.02). Experimental results show that none of the equations of state are able to accurately predict the properties of the shocked mixture; similar discrepancies have been observed in previous works. Kinetic molecular theory appears to introduce a parameter which offers an explanation regarding the discrepancies. Implementation of the KMT pararneter into the EOS is left for future work.

42 ENGINEERING↗

Development of a neutronics calculation method for designing commercial type Japanese sodium-cooled fast reactor

Under the R and D project to improve the modeling accuracy for the design of fast breeder reactors the authors are developing a neutronics calculation method for designing a large commercial type sodium- cooled fast reactor. The calculation method is established by taking into account the special features of the reactor such as the use of annular fuel pellet, inner duct tube in large fuel assemblies, large core. The Verification and Validation, and Uncertainty Qualification (V and V and UQ) of the calculation method is being performed by using measured data from the prototype FBR Monju. The results of this project will be used in the design and analysis of the commercial type demonstration FBR, known as the Japanese Sodium fast Reactor (JSFR). (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Development of Fusion Neutronics Methodology, Software, and Testing Facility in FDS Team

Fusion neutronics including methodology, software, experiments, etc. is studied concerning the generation, utilizing and protection of neutrons in fusion facilities. Achievements have been made in the past decades to solve the new problems fusion neutronics. However there is still some way to go such as following. Automatic modeling method based on CAD has been developed to avoid the heavy burden of manual geometry description. The pre-processing costs much time to simplify the CAD model for converting to Constructive Solid Geometry (CSG), 2D or 3D mesh based geometry. This problem has become a new focus. Deep penetration of radiation shielding is notable problem for fusion. Adaptive variance reduction methods such as Consistent Adjoint Driven Importance Sampling (CADIS) were developed to accelerate convergence. However the gap still exists between engineering requirements and current methodology. The geometry simplification, homogenizing based tally, error in nuclear data and error propagation in coupled calculation, etc., causes considerable uncertainty, which leads to 'safety factor' applied in simulation results to achieve required safety margin. It can significantly raise the cost and even makes it impractical to initiate the fusion facilities. Uncertainty qualification, error analysis and error propagation problem should be studied. New methodology and software should be validated. For example the (n,p), (n,a), (n,t) cross section of Cu, Fe, W, Ni which is important for evaluation of material radiation damage is absent. The validation of neutronics properties of special components such as first wall, blanket and coil are needed. The D-T fusion neutron generator can directly represent the neutron environment in fusion reactors. However the neutron yield is several orders of magnitudes lower than requirements. To resolve obstacles in fusion neutronics, broad improvements of methodology, software and testing facility have been achieved by FDS Team in recent years and the main progress was introduced in this paper.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Risk-averse optimal control of semilinear elliptic PDEs

In this paper, we consider the optimal control of semilinear elliptic PDEs with random inputs. These problems are often nonconvex, infinite-dimensional stochastic optimization problems for which we employ risk measures to quantify the implicit uncertainty in the objective function. In contrast to previous works in uncertainty quantification and stochastic optimization, we provide a rigorous mathematical analysis demonstrating higher solution regularity (in stochastic state space), continuity and differentiability of the control-to-state map, and existence, regularity and continuity properties of the control-to-adjoint map. Our proofs make use of existing techniques from PDE-constrained optimization as well as concepts from the theory of measurable multifunctions. We illustrate our theoretical results with two numerical examples motivated by the optimal doping of semiconductor devices.

97 MATHEMATICS AND COMPUTING↗

The 2014 Sandia Verification and Validation Challenge: Problem statement

This paper presents a case study in utilizing information from experiments, models, and verification and validation (V&V) to support a decision. It consists of a simple system with data and models provided, plus a safety requirement to assess. The goal is to pose a problem that is flexible enough to allow challengers to demonstrate a variety of approaches, but constrained enough to focus attention on a theme. This was accomplished by providing a good deal of background information in addition to the data, models, and code, but directing the participants' activities with specific deliverables. In this challenge, the theme is how to gather and present evidence about the quality of model predictions, in order to support a decision. This case study formed the basis of the 2014 Sandia V&V Challenge Workshop and this resulting special edition of the ASME Journal of Verification, Validation, and Uncertainty Quantification.

42 ENGINEERING↗

RAVEN Theory Manual

RAVEN is a software framework able to perform parametric and stochastic analysis based on the response of complex system codes. The initial development was aimed at providing dynamic risk analysis capabilities to the thermohydraulic code RELAP-7, currently under development at Idaho National Laboratory (INL). Although the initial goal has been fully accomplished, RAVEN is now a multi-purpose stochastic and uncertainty quantification platform, capable of communicating with any system code. In fact, the provided Application Programming Interfaces (APIs) allow RAVEN to interact with any code as long as all the parameters that need to be perturbed are accessible by input files or via python interfaces. RAVEN is capable of investigating system response and explore input space using various sampling schemes such as Monte Carlo, grid, or Latin hypercube. However, RAVEN strength lies in its system feature discovery capabilities such as: constructing limit surfaces, separating regions of the input space leading to system failure, and using dynamic supervised learning techniques. The development of RAVEN started in 2012 when, within the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program, the need to provide a modern risk evaluation framework arose. RAVEN’s principal assignment is to provide the necessary software and algorithms in order to employ the concepts developed by the Risk Informed Safety Margin Characterization (RISMC) program. RISMC is one of the pathways defined within the Light Water Reactor Sustainability (LWRS) program. In the RISMC approach, the goal is not just to identify the frequency of an event potentially leading to a system failure, but the proximity (or lack thereof) to key safety-related events. Hence, the approach is interested in identifying and increasing the safety margins related to those events. A safety margin is a numerical value quantifying the probability that a safety metric (e.g. peak pressure in a pipe) is exceeded under certain conditions. Most of the capabilities, implemented having RELAP-7 as a principal focus, are easily deployable to other system codes. For this reason, several side activates have been employed (e.g. RELAP5-3D, any MOOSE-based App, etc.) or are currently ongoing for coupling RAVEN with several different software. The aim of this document is to provide a set of commented examples that can help the user to become familiar with the RAVEN code usage.

97 MATHEMATICS AND COMPUTING↗

Mechanistic Multiscale Uncertainty Propagation in Support of Accelerated Fuel Qualification

Taking a nuclear fuel concept through the research, development, and qualification stages has historically taken on the order of 20 to 25 years because of extensive irradiation tests required for a variety of conditions. The concept of accelerated fuel qualification (AFQ) has been proposed to increase the innovation pace for nuclear fuels. The goal of AFQ is not to replace the traditional qualification approach but rather to reduce the total number of experiments required to ensure approval from the regulatory authority. Of the many AFQ approaches being explored, advanced modeling—and, in particular, mechanistic modeling—is in a uniquely cross-cutting position to reduce the number of required integral tests through the inclusion of separate-effects testing, while helping to extrapolate reactor performance during rare events. We make the case that propagation of uncertainty through various computational length scales helps contextualize mechanistic modeling. We will utilize UO 2 fission gas diffusion predictions from the atomistically informed cluster dynamics code Centipede to inform fuel performance rodlet simulations using the BISON finite element code as the metric for showing how multiscale mechanistic uncertainty quantification can help reduce uncertainty in fuel performance. In conclusion, by quantifying uncertainty and its reduction through multiscale modeling, the qualification process may be accelerated through the reduction of costly irradiation experiments.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗