Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty Quantification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

Recent advances in the quantification of uncertainties in reaction theory

Uncertainty quantification has become increasingly more prominent in nuclear physics over the past several years. In few-body reaction theory, there are four main sources that contribute to the uncertainties in the calculated observables: the effective potentials, approximations made to the few-body problem, structure functions, and degrees of freedom left out of the model space. In this work, we illustrate some of the features that can be obtained when modern statistical tools are applied in the context of nuclear reactions. This work consists of a summary of the progress that has been made in quantifying theoretical uncertainties in this domain, focusing primarily on those uncertainties coming from the effective optical potential as well as their propagation within various reaction theories. We use, as the central example, reactions on the doubly-magic stable nucleus 40 Ca, namely neutron and proton elastic scattering and single-nucleon transfer 40 Ca(d,p) 41 Ca. First, we show different optimization schemes used to constrain the optical potential from differential cross sections and other experimental constraints; we then discuss how these uncertainties propagate to the transfer cross section, comparing two reaction theories. Finally, we finish by laying out our future plans.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Quantification of Uncertainty and Risk Sensitivity for Safety of Emerging Operations

The growing need to develop and deploy small unmanned aerial vehicles (sUAVs) for various applications in the airspace necessitates reliable tools to accurately predict the flight trajectories of the sUAVs. The knowledge of the predicted trajectories help decision makers anticipate potential conflict, assess the risk, and take appropriate risk mitigation actions. In addition, uncertainties in vehicle models, weather, and controller action further highlights the need for reliable prediction tools. In this project, the application of mixed sparse grid-based quadrature and generalized polynomial chaos(gPC) expansion method for uncertainty quantification and collision assessment in air traffic consisting of fixed-wing small unmanned aerial vehicles (sUAV) was studied. From the results obtained, it can be concluded that this provides a reliable framework to carry out quantitative conflict assessment in an unmanned air traffic, which when employed, can improve the functionalities of the unmanned traffic management system. It was observed that the results from the gPC expansion framework developed in the project can be utilized to conduct rapid probabilistic collision assessment for near real-time unmanned traffic management in the airspace. From the vehicle models, position updates, and wind-field data, a priori gPC based 3-σcon-fidence ellipses can provide estimates of potential conflict at some future instants. The computational costs scaled linearly when the uncertain inputs were fewer. Further, the largest allowable distribution of para-metric uncertainties that leads to the smallest risk of collision in traffic of small unmanned aerial vehicles could be calculated. The time of closest approach between two sUAVs can be established paving way for development of proactive mitigation strategies. The separation between the sUAVs was found to be most significantly affected by uncertainties in the maximum available thrusts, zero-lift drag coefficients, and wing planform areas of the sUAVs. The study of uncertain wind-fields indicated that a heterogeneous traffic mix resulted in an increased probability of conflict. Increased measurement update rate reduced the uncertain-ties in the trajectories of the vehicles, further reducing the probability of conflict but rapid updates of all vehicles in the airspace poses a stringent communication limitation. The gPC framework also provided the means to analyze vehicle impact (crash region) due to loss of control resulting from actuator failure in sUAS traffic, essentially to predict impact and crash zones for representative vehicles. The predicted regions when compared with non-participant density, provides a means to develop an early mitigation strategy, should the sUAV detect an imminent actuator failure.

Rajnish Bhusal↗

Quantification of the Uncertainties for the Space Launch System Liftoff/Transition and Ascent Databases

A detailed description of the uncertainty quantification process for the Space Launch System Block 1 vehicle configuration liftoff/transition and ascent 6-Degree-of-Freedom (DOF) aerodynamic databases is presented. These databases were constructed from wind tunnel test data acquired in the NASA Langley Research Center 14- by 22-Foot Subsonic Wind Tunnel and the Boeing Polysonic Wind Tunnel in St. Louis, MO, respectively. The major sources of error for these databases were experimental error and database modeling errors.

Favaregh, Amber L.↗

TPSAS-NF1676L-32640-DND

Computational fluid dynamics is now considered to be an indispensable tool for the design and development of scramjet engine components. Unfortunately, the quantification of uncertainties is rarely addressed with anything other than sensitivity studies, so the degree of confidence associated with the numerical results remains exclusively with the subject matter expert that generated them. This practice must be replaced with a formal uncertainty quantification process for computational fluid dynamics to play an expanded role in the system design, development, and flight certification process. Given the limitations of current hypersonic ground test facilities, this expanded role is believed to be a requirement by some in the hypersonics community if scramjet engines are to be given serious consideration as a viable propulsion system. The present effort describes a simple, relatively low cost, nonintrusive approach to uncertainty quantification that includes the basic ingredients required to handle both aleatoric (random) and epistemic (lack of knowledge) sources of uncertainty.

Robert A Baurle↗

Experimental Covariance Determination for Critical Integral Experiments

Integral benchmarks for criticality safety and nuclear data validation require expensive uncertainty quantification studies. In general, uncertainty quantification techniques ignore correlations between experiments and shared parts. Experiments, such as the TEX (Thermal/Epithermal eXperiments) campaigns, consist of many shared parts, such as the ‘Jemima’ HEU fuel plates, which create a strong correlation in their uncertainties. While these correlations are known to exist, they are often not estimated due to the complexity of such calculations. This paper describes an intuitive method of determining the covariance for each of the experimental components, providing a correlation for each family of parts across the multiple cases examined within a benchmark. A proof-of-principle study using the TEX-HEU experimental campaign was performed and verified that the correlations can be calculated with information commonly found in the ICSBEP (International Criticality Safety Benchmark Evaluation Project) benchmarks. This study showed that the introduction of model and experimental covariances reduces the χ 2 per degree of freedom from 2.203 to 1.179, indicating that the omission causes overly pessimistic bias quantifications. This technique can be seamlessly integrated to current benchmark evaluations as well as reevaluations of legacy benchmarks.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Model-based quantification of margins and uncertainties in metal additive manufacturing for process design and qualification

Laser powder bed fusion (LPBF) Additive Manufacturing (AM) has the potential to enable the production of components with novel designs and material properties unachievable otherwise. However, process repeatability is a challenge, making qualification ill-defined and greatly reducing the utility of what could be an important manufacturing technology. In this work, a combination of modeling, uncertainty quantification (UQ), and experimentation are used in an effort to predict and bound the range of possible outcomes of the LPBF process. Quantities of interest predicted are melt pool dimensions, microstructure features, and mechanical distortions. A combination of high fidelity thermal-fluid models, microstructure growth models, and reduced fidelity, rapid thermal and mechanical models are used. Uncertainty propagation techniques are used to predict probability distributions of quantities of interest from estimates of process uncertainties. Repeated experiments are done to quantify observed probability distributions and compared to predicted distributions to determine if predictions are precise and accurate. Novel modeling methods are microstrucutre characterization techniques are also discussed. It is found that high fidelity models do a generally good job bounding experimentally observed melt pool morphologies for both bead-on-plate and powder bed cases. Microstructure models are able to bound a number of experimentally observed microstructure statistics, but with low precision due to challenges with calibrating the microstructure growth model parameters. A developed modified inherent strain distortion model does not accurately predict observed distortions. A lumped laser distortion model shows promise in being both accurately and precisely bounding observed outcomes from the deflection comb build, but requires further evaluation on more builds and geometries.

36 MATERIALS SCIENCE↗

A Statistician’s Overview of Physics-Informed Neural Networks for Spatio-Temporal Data

The recent success of deep neural network models with physical constraints (so-called, Physics-Informed Neural Networks, PINNs) has led to renewed interest in the incorporation of mechanistic information in predictive models. Statisticians and others have long been interested in this problem, which has led to several practical and innovative solutions dating back decades. In this overview, we focus on the problem of data-driven prediction and inference of dynamic spatio-temporal processes that include mechanistic information, such as would be available from partial differential equations, with a strong focus on the quantification of uncertainty associated with data, process, and parameters. Here, we give a brief review of several paradigms and focus our attention on Bayesian implementations given they naturally accommodate uncertainty quantification. We then show that it is straight-forward to include the Bayesian PINN (B-PINN) within the Bayesian hierarchical model (BHM) framework that has long been considered for modeling dynamic spatio-temporal processes. Such a BHM-PINN is illustrated via a simulation study in which a latent nonlinear Burgers’ equation PDE governs the dynamics of Poisson distributed spatio-temporal data. Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work.

Bayesian↗

¬¬Integration of Quantification of Margins and Uncertainties Methodology into Parallel Discrete Event Simulator Framework

Parallel Discrete Events Simulation (PDES) is becoming increasingly important to lab efforts in security and intelligence. It is used to model complex asynchronous systems such as computer networks, satellite systems, vehicular traffic, and human performance. Uncertainty Quantification (UQ) techniques have become a mainstay of Verification and Validation (V&V) efforts on physics simulations. However, PDES models are very different from traditional physics simulations, and research into UQ techniques for PDES is in its infancy. It is not clear which traditional UQ techniques can be applied to PDES, or what new techniques will need to be developed. The goal of this project was to identify existing UQ techniques that can be applied to PDES, and to develop new techniques as necessary. The project implemented or developed techniques to handle issues that do not appear in traditional physics simulations, but are common among PDES, including sampling techniques for high-dimensional homogenous inputs, response surfaces for high-variance heteroskedastic output, and characterization of skewed output distributions. These are foundational UQ techniques that must be used in any complete UQ analysis (Tong 2018).

97 MATHEMATICS AND COMPUTING↗

Nuclear Criticality Safety Integral Experiment Covariance Determination

Integral benchmarks for criticality safety and nuclear data validation require expensive uncertainty quantification studies. Commonly, the uncertainty quantification ignores correlations between experiments that share components. Experiments such as the TEX (Thermal/Epithermal eXperiments) campaigns consist of many shared parts between experiments, such as fuel, which creates a strong correlation in their errors. While these correlations are known to exist, they are often not estimated due to the complexity of such calculations. This paper describes a software package that uses an intuitive method of determining the covariance for each of the experimental components, providing a correlation matrix for each family of parts across the multiple cases examined within a benchmark. The code uses the TEX-HEU campaign as a proof of concept, and we show that the correlations can be calculated with information commonly found in ICSBEP (International Criticality Safety Benchmark Evaluation Project) benchmarks. The estimated covariances are used in χ 2 trending studies to evaluate their impact on nuclear data validation. The covariance determination code can be easily integrated into current benchmark evaluations as well as reevaluating legacy benchmark uncertainties. Uncertainty correlation calculations should become the baseline for criticality safety integral experiment benchmarks and can now be easily calculated with the described software package.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Data coverage assessment on neural network based digital twins for autonomous control system

We report in a recently developed Nearly Autonomous Management and Control (NAMAC) system, neural networks (NNs) are used to develop digital twins for diagnosis (DT-Ds). However, NNs are not usually considered extrapolation models and may result in large errors if they are applied to unseen data outside the training data (uncovered). In this study, we propose a data coverage assessment (DCA) to determine if the NN-based DT-Ds are extrapolated based on their epistemic uncertainty. The uncertainty quantification algorithms and uncertainty thresholds are selected based on the confusion matrix of classifying evaluation data into covered or uncovered data. To demonstrate the adaptability of the proposed framework, we applied it to a basic feedforward neural network and a more advanced recurrent neural network based on a more nonlinear database. Case studies show that the proposed framework can distinguish unseen data for both basic and advanced applications with proper uncertainty quantification algorithms and thresholds.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Nuclear Criticality Safety Integral Experiment Covariance Determination

Integral benchmarks for criticality safety and nuclear data validation require expensive uncertainty quantification studies. Commonly, the uncertainty quantification ignores correlations between experiments that share components. Experiments such as the TEX (Thermal/Epithermal eXperiments) campaigns consist of many shared parts, such as fuel, which create a strong correlation in their uncertainties. While these correlations are known to exist, they are often not estimated due to the complexity of such calculations. This paper describes a software package that uses an intuitive method of determining the covariance for each of the experimental components, providing a correlation matrix for each family of parts across the multiple cases examined within a benchmark. The code uses the TEX-HEU campaign as a proof of concept, and we show that the correlations can be calculated with information commonly found in ICSBEP (International Criticality Safety Benchmark Evaluation Project) benchmarks. The estimated covariances are used in χ 2 trending studies to evaluate their impact on nuclear data validation. Without covariances, χ 2 per degree of freedom was calculated as 2.203 and with covariances it was 1.179. The difference shows that omitting covariance information may cause overly pessimistic bias quantifications. The covariance determination code can be easily integrated into current benchmark evaluations as well as reevaluating legacy benchmark uncertainties. Uncertainty correlation calculations should become the baseline for criticality safety integral experiment benchmarks and can now be easily calculated with the described software package.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Proceedings for the Workshop on Applied Nuclear Data Activities 2024

The Workshop for Applied Nuclear Data Activities (WANDA) is designed to increase communication among nuclear data (ND) users in multidisciplinary federal programs, ND producers, ND funders, and other ND experts. It also presents an opportunity to cross-pollinate ideas as well as introduce ND gaps identified by federal programs to ND experts and ND capabilities to the various federal ND users. WANDA 2024 included five technical sessions, three of which focused on Fusion Energy Sciences (FES)—FES Fusion Neutronics, FES Tritium Production, and FES Material Damage—and two stand-alone sessions—Isotopes and Targetry for Nuclear Data and Uncertainty Quantification. The FES sessions successfully brought new voices to the WANDA discussions, expanding the application space in which nuclear data are critical. FES programs need accurate nuclear data with realistic uncertainty quantification to properly estimate, for example, shielding, activation, tritium production, helium production, structural material integrity, and superconducting magnet operation. This includes a variety of projectile (neutrons, photons, charged particles) and target atoms. One of the action items common to all the FES sessions was a need to perform sensitivity studies to identify the prioritization of nuclear data needs. The Isotopes and Targetry session highlighted the many capabilities available to produce high-quality targets for nuclear data measurements, including 3D printing with spherical powders, combustion synthesis coupled with spin coating & electrospraying, inkjet printing, and isotopic doping. These new methods open doors for more accurate measurement, but it was also stressed that sample characterization following any method of fabrication is of the highest importance to accurately interpret nuclear data measurement results that used that sample. The Uncertainty Quantification (UQ) session was broken into two categories: nuclear data uncertainty quantification and the use of that uncertainty quantification. Thematic to the UQ session was the loss of information when going from nuclear data measurement, to evaluation, to evaluated file, and finally to neutron transport calculations. Current evaluated ND libraries typically only contain covariances, which assume that the probability distributions are Gaussian. Beyond being a simplified assumption for many evaluations, this can lead to negative values on many observables when attempting to sample the covariance. The covariance format, however, is very efficient in that a simple set of linear equations can transform uncertainty from parameters or cross sections to the application of interest. Focused collaboration is needed between nuclear data evaluators and nuclear data users to ensure that needs are being met.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗