Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Sensitivity and Uncertainty Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Hierarchical Data Format for Nuclear Data Sensitivities

The SCALE code system includes capabilities for sensitivity and uncertainty (S/U) analysis as part of its TSUNAMI code suite. The sensitivity of a quantity of interest (for example, an application’s $k_{eff}$) to nuclear data is stored as a profile in a text-based file, which is known as a sensitivity data file (SDF). The sensitivity profile can be used to calculate uncertainties, correlation coefficients, and similarity indices. One of the goals of the present work was to seek general performance improvements in the TSUNAMI code suite, starting with the TSUNAMI-IP code for calculating similarity indices. Through profiling, it was found that reading the text-based sensitivity files was a performance bottleneck in the TSUNAMI-IP code. In a typical TSUNAMI-IP calculation, an application might be compared to thousands of benchmarks, thus requiring the reading of thousands of SDFs. Reading of binary-based data is generally faster than reading text-based data. Hierarchical Data Format 5 (HDF5) is a binary-based format that also benefits from being portable, and it can be inspected with nonproprietary tools. This paper describes an HDF5-based file format that has been introduced for SDFs.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A general framework for quantifying uncertainty at scale

Abstract In many fields of science, comprehensive and realistic computational models are available nowadays. Often, the respective numerical calculations call for the use of powerful supercomputers, and therefore only a limited number of cases can be investigated explicitly. This prevents straightforward approaches to important tasks like uncertainty quantification and sensitivity analysis. This challenge can be overcome via our recently developed sensitivity-driven dimension-adaptive sparse grid interpolation strategy. The method exploits, via adaptivity, the structure of the underlying model (such as lower intrinsic dimensionality and anisotropic coupling of the uncertain inputs) to enable efficient and accurate uncertainty quantification and sensitivity analysis at scale. Here, we demonstrate the efficiency of this adaptive approach in the context of fusion research, in a realistic, computationally expensive scenario of turbulent transport in a magnetic confinement tokamak device with eight uncertain parameters, reducing the effort by at least two orders of magnitude. In addition, we show that this refinement method intrinsically provides an accurate surrogate model that is nine orders of magnitude cheaper than the high-fidelity model.

Farcaş, Ionuţ-Gabriel (ORCID:0000000238841580)↗

Variance Decomposition of MEDLI2 Reconstructed Heating Using Neural Networks

The Mars Entry, Descent, and Landing Instrumentation (MEDLI2) sensor suite collected data during entry of the Mars 2020 Perseverance rover into Mars’ atmosphere. An inverse estimation of the backshell and heatshield surface aeroheating was performed, using the data from the MEDLI2 Instrumented Sensor Plugs, a network of thermocouples embedded within the thermal protection system across the aeroshell. Monte Carlo analysis was conducted to assess the sensitivity of the surface heat rate, temperature, and heat load to uncertainties in thermocouple depth and material properties. In this paper, a variance decomposition method using Sobol indices was employed to understand the relative contributions of each uncertainty parameter. Performing this analysis using results from the inverse analysis tool FIAT_Opt was found to require incredibly high computation time, and thus machine learning models were trained and evaluated as a surrogate model for FIAT_Opt. This paper demonstrates that machine learning models can be an efficient, accurate alternative to state-of-the-art inverse analysis tools like FIAT_Opt, especially for computationally-expensive processes. Using these models, the sensitivity analysis showed that uncertainties in heat capacity and thermal conductivity were the main drivers for the overall uncertainty in peak reconstructed heating and heat load.

H S Alpert↗

Investigating uncertainties in human adaptation and their impacts on water scarcity in the Colorado river Basin, United States

The Colorado River Basin (CRB) supports the water supply for seven states and forty million people in the Western United States (US) and has been suffering an extensive drought for more than two decades. As climate change continues to reshape water resources distribution in the CRB, its impact can differ in intensity and location, resulting in variations in human adaptation behaviors. The feedback from human systems in response to the environmental changes and the associated uncertainty is critical to water resources management, especially for water-stressed basins. This paper investigates how human adaptation affects water scarcity uncertainty in the CRB and highlights the uncertainties in human behavior modeling. Our focus is on agricultural water consumption, as approximately 80% of the water consumption in the CRB is used in agriculture. We adopted a coupled agent-based and water resources modeling approach for exploring human-water system dynamics, in which an agent is a human behavior model that simulates a farmer’s water consumption decisions. We examined uncertainties at the system, agent, and parameter levels through uncertainty, clustering, and sensitivity analyses. The uncertainty analysis results suggest that the CRB water system may experience 13 to 30 years of water shortage during the 2019–2060 simulation period, depending on the paths of farmers’ adaptation. The clustering analysis identified three decision-making classes: bold, prudent, and forward-looking, and quantified the probabilities of an agent belonging to each class. The sensitivity analysis results indicated agents whose decision-making models require further investigation and the parameters with the higher uncertainty reduction potentials. Here, by conducting numerical experiments with the coupled model, this paper presents quantitative and qualitative information about farmers’ adaptation, water scarcity uncertainties, and future research directions for improving human behavior modeling.

Agent-based modeling↗

PSUADE

PSUADE (Problem Solving testbed for Uncertainty Analysis and Design Exploration) is a mathematical software useful for performing uncertainty quantification and sensitivity analysis.

Tong, CharlesH↗

Operational and Technical Updates to the Object Reentry Survival Analysis Tool

The Object Reentry Survival Analysis Tool (ORSAT) has been used in the NASA Orbital Debris Program Office for over 25 years to estimate risk due to uncontrolled reentry of spacecraft and rocket bodies. Development over the last 3 years has included: a major change to the treatment of carbon fiber- and glass fiber-reinforced plastics (CFRP and GFRP, respectively); an updated atmospheric model; a new model for computing casualty area around an impacting debris object; and a newly-implemented scheme to determine the breakup altitude of a reentry object. Software also was written to automatically perform parameter sweeps in ORSAT to allow for uncertainty quantification and sensitivity analysis for components with borderline demisability. These updates have improved the speed and fidelity of the reentry analysis performed using ORSAT, and have allowed for improved engineering understanding by estimating the uncertainty for each component’s survivability. A statistical model for initial conditions captures the latitude bias in population density, a large improvement over the previous inclination-based latitude-averaged models. A sample spacecraft has been analyzed with standard techniques using ORSAT 6.2.1 and again using all the updated models; we will demonstrate the variation in the total debris casualty area and overall expectation of casualty.

Ostrom, C.↗

Bayesian analysis of (3 +1)⁢D relativistic nuclear dynamics with the RHIC beam energy scan data

This work presents a Bayesian inference study for relativistic heavy-ion collisions in the beam energy scan program at the BNL Relativistic Heavy-Ion Collider. The theoretical model simulates event-by-event (3+1)-dimensional [(3+1)⁢D] collision dynamics using hydrodynamics and hadronic transport theory. We analyze the model's 20-dimensional posterior distributions obtained using three model emulators with different accuracy and demonstrate the essential role of training an accurate model emulator in the Bayesian analysis. Our analysis provides robust constraints on the quark-gluon plasma's transport properties and various aspects of (3+1)⁢D relativistic nuclear dynamics. By running full model simulations with 100 parameter sets sampled from the posterior distribution, we make predictions for p T -differential observables and estimate their systematic theory uncertainty. Here, a sensitivity analysis is performed to elucidate how individual experimental observables respond to different model parameters, providing useful physics insights into the phenomenological model for heavy-ion collisions.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A design methodology for nonlinear systems containing parameter uncertainty

In the present design methodology for nonlinear systems containing parameter uncertainty, a generalized sensitivity analysis is incorporated which employs parameter space sampling and statistical inference. For the case of a system with j adjustable and k nonadjustable parameters, this methodology (which includes an adaptive random search strategy) is used to determine the combination of j adjustable parameter values which maximize the probability of those performance indices which simultaneously satisfy design criteria in spite of the uncertainty due to k nonadjustable parameters.

Young, G. E.↗

Effects of Photovoltaic Module Materials and Design on Module Deformation Under Load

Quasi-static structural finite-element models of an aluminum-framed crystalline silicon photovoltaic module and a glass-glass thin-film module were constructed and validated against experimental measurements of deflection under uniform pressure loading. Specific practices in the computational representation of module assembly were identified as influential to matching experimental deflection observations. Additionally, parametric analyses using Latin hypercube sampling were performed to propagate input uncertainties related to module materials, dimensions, and tolerances into uncertainties in simulated deflection. Sensitivity analyses were performed on the uncertainty quantification datasets using linear correlation coefficients and variance-based sensitivity indices to elucidate key parameters influencing module deformation. Results identified edge tape and adhesive material properties as being strongly correlated to module deflection, suggesting that optimization of these materials could yield module stiffness gains at par with the conventionally structural parameters, such as glass thickness. This exercise verifies the applicability of finite-element models for accurately predicting mechanical behavior of solar modules and demonstrates a workflow for model-based parametric uncertainty quantification and sensitivity analysis. Finally, applications of this capability include the assessment of field environment loads, derivation of representative loading conditions for reduced-scale testing, and module design optimization, among others.

42 ENGINEERING↗

A magnetic diagnostic suite for the Pegasus-III experiment

Pegasus-III is an ultralow aspect ratio spherical tokamak providing a dedicated US experiment for comparative solenoid-free startup studies. A new magnetic diagnostic suite for equilibrium and low frequency (<200 kHz) magnetohydrodynamic mode analysis has been installed. These new diagnostics address the significant challenges of measuring magnetic field in a high noise environment with the majority constrained to fit in an 8 mm diagnostic gap on the high field side. Electrostatic switching noise generated by the 16 independent current feedback-controlled power supplies produces dV cm /dt ~ 1 kV/μs and volt level common mode noise on the magnetics. Immunity to this switching noise is accomplished through differential signal runs and signal processing, along with end-to-end electromagnetic interference shielding. The magnetic measurements are simultaneously digitized at 1 MHz and conditioned by precision 8 pole Butterworth filters with a corner frequency of 200 kHz to prevent aliasing down to the 16-bit level over the full passband. Ex-vessel calibrations of the B p coils were completed with a typical uncertainty of <0.5%. Stray toroidal field pickup from coil misalignment or positioning errors is corrected using a physics-based model. Comparisons of the corrected measurements to modeling agree to within 1.3% on average. This is within the 1.5% measurement uncertainty that a sensitivity analysis determined is needed for accurate fast boundary and equilibrium reconstruction.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Pebble Tanker Model for Nuclear Criticality Safety Needs

This report documents a study performed to investigate the requirements for criticality safety benchmark experiments for high-assay, low-enriched uranium (HALEU) fuel in transportation applications. In this work, an exploratory application model, the “Pebble Tanker,” was developed to represent TRISO fuel in a transportation scenario for an analysis of the validation basis in industrial quantities. An aspect of the criticality validation process involves assessing the “similarity” between application and experimental benchmark systems through an integral index parameter evaluation. Here, this includes propagating nuclear data uncertainties and calculating a correlation coefficient (hereinafter referred to as “c k ”) to evaluate the similarity of benchmark experiments compared with the application Pebble Tanker model. Finding sufficient critical benchmark experiments allows for the evaluation of bias and bias uncertainty, thus determining the upper subcritical limit (USL) of the transportation package. A target k eff of ~0.94 was used in this work to establish appropriate modeling conditions, reflecting a reasonable estimate for a USL. Two container models were investigated: one with the Hermes-type pebble and one with the Pebble Bed Modular Reactor (PBMR)–type pebble. The models were simplified, considering only fuel, containment structure, and either water or air. This allows a focus on the underlying physics of applications involving TRISO fuel pebbles using the Pebble Tanker model. A crucial consideration is the transport package's ability to safely hold pebbles while flooded, maintaining subcritical conditions. Tools available in the SCALE 6.3.1 suite—the CSAS6-Shift, TSUNAMI-3D-Shift, and TSUNAMI-IP sequences—were employed for neutronics and sensitivity and uncertainty (S/U) analysis of the Pebble Tanker. Findings demonstrated sufficient available critical experiment benchmarks to perform a validation of the Pebble Tanker in the most reactive state, i.e., when the Tanker is flooded.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

PyApprox: A software package for sensitivity analysis, Bayesian inference, optimal experimental design, and multi-fidelity uncertainty quantification and surrogate modeling

PyApprox is a Python-based one-stop-shop for probabilistic analysis of numerical models such as those used in the earth, environmental and engineering sciences. Easy to use and extendable tools are provided for constructing surrogates, sensitivity analysis, Bayesian inference, experimental design, and forward uncertainty quantification. The algorithms implemented represent a wide range of methods for model analysis developed over the past two decades, including recent advances in multi-fidelity approaches that use multiple model discretizations and/or simplified physics to significantly reduce the computational cost of various types of analyses. An extensive set of Benchmarks from the literature is also provided to facilitate the easy comparison of new or existing algorithms for a wide range of model analyses. Here, this paper introduces PyApprox and its various features, and presents results demonstrating the utility of PyApprox on a benchmark problem modeling the advection of a tracer in groundwater.

54 ENVIRONMENTAL SCIENCES↗

Computationally inexpensive part-scale thermal history of additive friction-stir deposition

This study presents an analytical model for steady-state power generation and tool heat loss in additive friction-stir deposition (AFSD), developed to enable part-scale thermal simulation while remaining computationally inexpensive. The model predicts total generated power, yielding 3.7–4.7 kW across deposition temperature setpoints of 400–460 °C for the deposition of AA6061 with a Be-Cu tool. This corresponds to 90–95% of the reported spindle power. Tool heat loss is experimentally determined by calibrating a steady-state energy balance between the generated power, the substrate-deposition thermal gradient, and a temperature dependent tool heat loss term: q tool (T) = a + b (T - 400°C) with a = 2.7 x 10 6 Wm -2 and b = 9.5 x 10 3 Wm -2 K -1 . The calibration indicates that about 69% of the generated heat is conducted into the tool for this configuration, which is much higher than previously reported. The calibrated heat-source is implemented in finite element software (Adamantine) to simulate the transient thermal history of a 100 cm 3 representative build in 8 min on a standard desktop (at 0.635 mm build-height resolution). For the first three layers, the substrate temperatures between simulation and experiment are within 10% mean absolute percentage error. Sensitivity analysis indicates that uncertainties in average deposition temperature and deformation localization (stir-zone geometry, depth, and spatial dependance of strain-rate and flow stress) dominate model variance, motivating additional experimental verification.

Additive Friction-Stir Deposition↗

JetGP: A derivative enhanced Gaussian process library

Derivative enhanced Gaussian Processes (DEGPs) can significantly improve surrogate model accuracy over standard Gaussian Process (GP) formulations by incorporating derivative information. However, standard implementations scale poorly with dimension, limiting their use in high dimensional engineering problems. JetGP is a Python framework that unifies existing derivative enhanced GP methodologies into a single library and extends them to support arbitrary order derivative information. The library implements four complementary formulations: standard derivative enhanced Gaussian Processes (DEGP), directional DEGP (DDEGP), generalized directional DEGP (GDDEGP), and weighted DEGP (WDEGP). By unifying these approaches in a consistent interface with robust numerical implementations, JetGP enables practitioners to balance predictive accuracy and computational efficiency for high dimensional optimization, uncertainty quantification, and sensitivity analysis in engineering design.

Derivative enhanced Gaussian process↗

Advanced surrogate model for electron-scale turbulence in tokamak pedestals

We derive an advanced surrogate model for predicting turbulent transport at the edge of tokamaks driven by electron temperature gradient (ETG) modes. Our derivation is based on a recently developed sensitivity-driven sparse grid interpolation approach for uncertainty quantification and sensitivity analysis at scale, which informs the set of parameters that define the surrogate model as a scaling law. Our model reveals that ETG-driven electron heat flux is influenced by the safety factor q, electron beta β e and normalized electron Debye length λ D , in addition to well-established parameters such as the electron temperature and density gradients. To assess the trustworthiness of our model's predictions beyond training, we compute prediction intervals using bootstrapping. The surrogate model's predictive power is tested across a wide range of parameter values, including within-distribution testing parameters (to verify our model) as well as out-of-bounds and out-of-distribution testing (to validate the proposed model). Overall, validation efforts show that our model competes well with, or can even outperform, existing scaling laws in predicting ETG-driven transport.

fusion plasma↗

SCALE Lattice Physics Code Assessments of Accident Tolerant Fuel

This report highlights accident-tolerant fuel (ATF) code assessment activities performed under Project NRCHQ- 60-17-T-0017, Lattice Physics Enhancements and Assessment. ATF covers a broad range of advanced fuel and clad designs for light water reactors (LWRs) to enhance performance under several accident conditions. Several ATF concepts are anticipated to be deployed as lead test rods (LTRs) or lead test assemblies (LTAs) within the next five years. The purpose of this work is to assess the predictive capabilities of NRC neutronics codes that underpin various licensing calculations. ATF designs use different fuel and clad materials compared to standard UO 2 fuel and zirconium-alloy claddings (hereafter UO 2 -Zry). These new materials and geometrical designs need to be assessed to quantify the impact of nuclear data uncertainties on quantities of interest (QOIs) in licensing calculations and the impact of modeling approximations which may be valid for UO 2 -Zry but not for ATF. This report outlines a systematic approach for ATF neutronics code assessment which includes sensitivity and uncertainty (S/U) analysis of nuclear data, identification of experimental benchmark and gaps for code validation, investigation of modeling approximations, and code-to-code comparisons of calculated QOIs against high-fidelity reference continuous energy (CE) Monte Carlo (MC) calculations. This report focuses on the assessment of the SCALE/Polaris lattice physics code for reactor safety analysis. Polaris lattice physics calculations generate few group (FG) cross sections for PARCS full-core calculations. (Full-core analysis, spent fuel analysis, and severe accident analysis will be performed in future work.) The selected ATF concepts for this report include Cr 2 O 3 and Al 2 O 3 -Cr 2 O 3 -doped UO 2 fuel, U 3 Si 2 fuel, FeCrAl cladding, SiC cladding, and Cr-coated cladding.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Investigating Kinetic Mechanisms of Soot Formation in Plasma Pyrolysis of Methane via Active Learning (Final Technical Report)

Plasma pyrolysis of methane is an effective route for zero-carbon hydrogen production. Yet, soot generated from pyrolysis of hydrocarbons is detrimental to the climate and human health. There is ample experimental and theoretical evidence that suggests polycyclic aromatic hydrocarbons (PAHs) are the molecular precursors to soot particles. The reaction pathways of PAH formation are intricately dependent on a multitude of process parameters, whose kinetic mechanisms are not well-understood in plasma pyrolysis. This project aims to leverage advances in the kinetic modeling of soot formation in combustion, as well as in surrogate modeling and active learning, to systematically investigate the effects of process parameter on the kinetics of PAH formation in plasma pyrolysis of methane. To this end, we propose to use the PAH formation kinetics model developed by the PPPL/PU group based on the well-established ABF and HACA mechanisms, coupled with low-temperature plasma models. We will develop an active learning (AL) framework based on Bayesian optimization to systematically and data-efficiently explore the complex and multivariable parameter space of plasma pyrolysis in order to quantify the effects of plasma and feed parameters on the ABF and HACA kinetic pathways. AL is the branch of machine learning concerned with systematically querying samples from a system (experimental or computational) to train a data-driven model that maps design parameters to a performance criterion. We will use the data generated via AL to perform global sensitivity analysis, combined with uncertainty quantification, to elucidate the impact of different reaction pathways on minimizing formation of soot precursors. This study will result in an improved understanding of kinetics of PAH formation in plasma pyrolysis and can pave the way for more advanced mechanistic studies (e.g., soot nucleation mechanisms). Additionally, the findings will be useful for establishing practical strategies for increasing the pyrolysis efficiency and producing high-grade carbon for synthesis of nanomaterials.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗