Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Variance reduction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Weak-form latent space dynamics identification

Recent work in data-driven modeling has demonstrated that a weak formulation of model equations enhances the noise robustness of a wide range of computational methods. In this paper, we demonstrate the power of the weak form to enhance the LaSDI (Latent Space Dynamics Identification) algorithm, a recently developed data-driven reduced order modeling technique. We introduce a weak form-based version WLaSDI (Weak-form Latent Space Dynamics Identification). WLaSDI first compresses data, then projects onto the test functions and learns the local latent space models. Notably, WLaSDI demonstrates significantly enhanced robustness to noise. With WLaSDI, the local latent space is obtained using weak-form equation learning techniques. Compared to the standard sparse identification of nonlinear dynamics (SINDy) used in LaSDI, the variance reduction of the weak form guarantees a robust and precise latent space recovery, hence allowing for a fast, robust, and accurate simulation. We demonstrate the efficacy of WLaSDI vs. LaSDI on several common benchmark examples including viscid and inviscid Burgers', radial advection, and heat conduction. For instance, in the case of 1D inviscid Burgers' simulations with the addition of up to 100% Gaussian white noise, the relative error remains consistently below 6% for WLaSDI, while it can exceed 10,000% for LaSDI. Similarly, for radial advection simulations, the relative errors stay below 15% for WLaSDI, in stark contrast to the potential errors of up to 10,000% with LaSDI. Moreover, speedups of several orders of magnitude can be obtained with WLaSDI. For example applying WLaSDI to 1D Burgers' yields a 140X speedup compared to the corresponding full order model.

97 MATHEMATICS AND COMPUTING↗

Shutdown dose rate analysis with the Shift Monte Carlo radiation transport code and modular verification workflow

Calculation of the shutdown dose rate is crucial for safe fusion reactor operations. The Rigorous-two-step (R2S) method is a method that requires connected neutron transport, activation, and gamma transport. Shift has integrated variance reduction with a deterministic solver Denovo, supports multiple geometry formats, and is scalable. These features make it an attractive transport solver choice for an R2S workflow. An R2S workflow for the Shift Monte Carlo code is developed and compared to the existing Oak Ridge National Laboratory Shutdown Dose Rate Code Suite (ORCS) workflow. Also, a Python framework for integrating two R2S workflows is developed to mix and match each step in the R2S workflow for improved collaboration and verification experience. In this study, results show that the Shift-Denovo R2S workflow and the ORCS workflow calculate the shutdown dose rate of the ITER Shutdown Dose Rate benchmark problem with an average relative error of 2.285%.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Estimation of distributions via multilevel Monte Carlo with stratified sampling

We design and implement a novel algorithm for computing a multilevel Monte Carlo (MLMC) estimator of the joint cumulative distribution function (CDF) of a vector-valued quantity of interest in problems with random input parameters and initial conditions. Our approach combines MLMC with stratified sampling of the input sample space by replacing standard Monte Carlo at each level with stratified Monte Carlo initialized with proportionally allocated samples. We show that the resulting stratified MLMC (sMLMC) algorithm is more efficient than its standard MLMC counterpart due to the additional variance reduction provided by the stratification of the random parameter's domain, especially at the coarsest levels. Additional computational cost savings are obtained by smoothing the indicator function with a Gaussian kernel, which proves to be an efficient and robust alternative to recently developed polynomial-based techniques.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

UQpy: A general purpose Python package and development environment for uncertainty quantification

In this paper, we present the UQpy software toolbox, an open-source Python package for general uncertainty quantification (UQ) in mathematical and physical systems. The software serves as both a user-ready toolbox that includes many of the latest methods for UQ in computational modeling and a convenient development environment for Python programmers advancing the field of UQ. The paper presents an introduction to the software's architecture and existing capabilities, divided in the code in a set of modules centered around different UQ tasks such as sampling methods, generation of random processes and random fields, probabilistic inverse modeling, reliability analysis, surrogate modeling, and active learning. The paper also highlights the importance of the RunModel module, which is used to drive simulations in the uncertainty analyses performed in UQpy. This module conveniently allows the user to define computational models directly in Python, or to run simulations from a third-party software in serial or in parallel. To illustrate the various capabilities, two examples are tracked throughout the paper and analyzed repeatedly for various UQ tasks. The first is a Python model solving a nonlinear structural dynamics problem, used to illustrate UQpy's capabilities in sampling and forward propagation of high dimensional random vectors (stochastic processes), and probabilistic inference. The second model is a third-party Abaqus finite element model solving the thermomechanical response of a beam structure. This example is used to illustrate UQpy's capabilities in variance reduction sampling techniques, reliability analysis, surrogate modeling and active learning techniques.

97 MATHEMATICS AND COMPUTING↗

Photon detector response function methodology using MCNP and shift hybrid radiation transport code for wide-area contamination assay applications

Here, radiation transport modeling using the Monte Carlo N-Particle (MCNP) radiation transport code and Monte Carlo code, Shift, were employed to model detector responses for a variety of wide-area photon contamination scenarios. In this study, 2" × 2" and 3" × 3" cylindrical NaI(Tl) scintillation detector configurations at source detector-distances of 0.5 cm, 1 cm, 2.54 cm, 10 cm, and 30 cm were modeled. Media of soil, concrete, and steel were evaluated for contamination depths ranging from surface to a depth of an infinite thickness in each medium for photon energies ranging from 20 keV to 3 MeV, which correspond to the energies that current detectors can discern. Monoenergetic photon surface contamination detector responses for each of the media, source–detector distances, and detectors were estimated using MCNP v6.2. Shift was harnessed for improved variance reduction of particle transport in highly attenuating media to obtain average cell fluxes in the two MCNP NaI(Tl) scintillation detector configurations. Average cell flux values in Shift were coupled with detector responses from MCNP to convert average cell flux in a void to energy distribution of pulses in the NaI(Tl) scintillation detector crystal of interest. An optimized detector response function methodology was developed by coupling the MCNP radiation transport method with the Consistent Adjoint Driven Importance Sampling (CADIS) hybrid radiation transport method built into Shift to significantly decrease the runtime of thousands of MCNP pulse height simulations. The methodology may be utilized to quickly and accurately facilitate the assessment of a broad range of wide-area environmental contamination assay and decommissioning cleanup applications.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Global stochastic optimization of stellarator coil configurations

In the construction of a stellarator, the manufacturing and assembling of the coil system is a dominant cost. These coils need to satisfy strict engineering tolerances, and if those are not met the project could be cancelled as in the case of the National Compact Stellarator Experiment (NCSX) project. Therefore, our goal is to find coil configurations that increase construction tolerances without compromising the performance of the magnetic field. In this paper, we develop a gradient-based stochastic optimization model which seeks robust stellarator coil configurations in high dimensions. In particular, we design a two-step method: first, we perform an approximate global search by a sample efficient trust-region Bayesian optimization; second, we refine the minima found in step one with a stochastic local optimizer. To this end, we introduce two stochastic local optimizers: BFGS applied to the sample average approximation; and Adam, equipped with a control variate for variance reduction. Numerical simulations performed on a W7-X-like coil configuration demonstrate that our global optimization approach finds a variety of promising local solutions at less than 0.1% of the cost of previous work, which considered solely local stochastic optimization.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Skyshine Calculations for a Large Spent Nuclear Fuel Storage Facility with SCALE 6.2.3

The SCALE code system developed at Oak Ridge National Laboratory includes state-of-the-art capabilities for radiation source term and radiation transport simulations that can be used in numerous applications, including dose rate analyses of complex consolidated interim storage facilities (CISFs). A licensed CISF could be used to store tens of thousands of tonnes of spent nuclear fuel discharged from commercial power reactors using various cask and storage pad designs. A CISF design must comply with the regulatory requirements provided in 10 CFR Part 72, including requirements related to annual dose limits applicable to real individuals located beyond the area controlled by the licensee. Therefore, calculating a dose to the public is a necessary part of the licensing process for the construction of a CISF. These calculations are very challenging because of the complexity of the CISF design and the low magnitude of dose rate at large distances from the facility. This paper describes detailed far-field dose rate calculations performed for a proposed CISF using MAVRIC, the Monte Carlo radiation shielding sequence in SCALE 6.2.3, with automated variance reduction based on discrete ordinates calculations. The method presented in this paper uses a detailed Monte Carlo radiation transport simulation in one step from source to dose rate. A series of independent simulations was made using the complete site geometry (all casks present), but with only one cask containing radiation sources to obtain the dose rate maps produced by each storage cask. The CISF dose rate map was obtained by adding the dose rate maps produced by the independent individual cask simulations. Ample volumes of air and soil extending beyond the location of interest for dose rate calculation were included in the calculation model to properly simulate important radiation attenuation and scattering events that affect far-field dose rates. Furthermore, a comprehensive sensitivity study is included in this paper to illustrate the importance of selecting appropriate air volume, mass density, and composition for CISF skyshine dose rate calculations. Dry soil and soil containing water were analyzed to determine their effects on groundshine radiation.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Secondary-Source Core Reload Modeling with VERA

The CASL reactor simulation package VERA has been adapted to provide high-fidelity simulation capabilities for modeling source range detector response during subcritical reactor configurations. New features include the activation and shuffling of secondary-source assemblies, use of burned fuel neutron emission data from the ORIGEN depletion solver to the MPACT deterministic neutron transport solver, allowance of user-defined sources in MPACT based on material composition, ability to solve the subcritical source-driven system with neutron multiplication using the MPACT diffusion solver, and transfer of the calculated fission source from MPACT to the continuous-energy Monte Carlo solver Shift for final detector response evaluation using the CADIS methodology for variance reduction. These new capabilities were benchmarked against Watts Bar Unit 1 plant operating data for the first few fuel loading steps and were found to demonstrate excellent agreement with the measured data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Decay Dose Shielding Analysis with Hybrid Unstructured Mesh/Constructive Solid Geometry Monte Carlo Calculation and ADVANTG Acceleration

Here, the target segments of the Oak Ridge National Laboratory Second Target Station (STS) neutron production facility become highly activated due to spallation reactions or nuclei transmutation by primary protons and emitted neutrons. Once the target segments are removed from their location within the core vessel, decay dose rates must be accurately quantified to determine the shielding configurations of remote-handling tools and transport casks and to aid in planning maintenance activities. For this analysis, we utilized a hybrid unstructured mesh (UM)/constructive solid geometry approach for calculating spallation products and neutron fluxes, activation calculations using the AARE package that includes the CINDER2008 activation code to calculate the decay photon source at different cooling times, and the ADVANTG code to accelerate the final decay photon transport calculation. Both Type 316 stainless steel (SS-316) and lead were investigated as candidates for shielding materials. The decay photon transport calculation through the thick SS-316 or lead shields exhibited between 25 and 30 orders-of-magnitude attenuations in the radial direction, depending on the shield. Such a difficult shielding calculation required advanced variance reduction. ADVANTG has some missing features, which limits its usability in spallation neutron source applications. It does not support volumetric sources created for MCNP6.2 UM capability. An approximate source was created for this problem. Not only was this approximate source needed for running the ADVANTG calculation to generate the weight windows, but also it was essential to develop source biasing (SB) parameters that were crucial for dramatically accelerating the decay photon transport in this problem. With this approximate source, the analysis was completed in a very reasonable computational time, and the design of the STS remote-handling equipment was finalized. This paper compares the efficiency of Monte Carlo simulations with different weight window and SB parameters calculated using different approximate ADVANTG calculations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Analysis of Second Target Station Target Removal Dose Rates

The Second Target Station (STS) project at Oak Ridge National Laboratory’s spallation neutron source is a crucial initiative for maintaining U.S. leadership in neutron sciences. The STS aims to create the world’s brightest pulsed cold neutron source, enabling cutting-edge research across various scientific disciplines. To ensure safe and efficient maintenance operations, understanding the effects of shutdown dose rates from activated components within the STS target systems is essential. This study establishes a computational framework for calculating decay gamma sources and subsequent shutdown dose rates utilizing advanced methods to account for all activation channels, including high-energy interactions down to thermal neutron capture. This study describes a novel integration of multiple tools and provides an effective means of analyzing activation and shutdown dose rates at spallation neutron facilities. A custom-developed script automates the decay gamma source generation process, ensuring proper sampling during the variance reduction phase, which is critical for accurate predictions of shutdown dose rates.

Transmutation↗

Evaluation of PBR Spent Fuel Criticality and Dose Rate Compliance for Storage and Transportation

Spent tri-structural isotropic (TRISO)–based fuels have a strong track record in storage and transportation without documented incidents. This work seeks to reduce uncertainty to aid in more informed spent fuel management of TRISO-based fuels by modeling both fresh and spent pebble bed reactor (PBR) fuel and comparing the results to the regulatory standards from 10 CFR 71. SCALE was used for all modeling due to it having fast and accurate methods for handling PBR fuel modeling, as well as having an efficient method for shielding calculations in monaco with automated variance reduction using importance calculations (MAVRIC), which utilizes the consistent adjoint-driven importance sampling (CADIS) and the forward-weighted consistent adjoint-driven importance sampling (FW-CADIS) methods. KENO-VI was used for all criticality calculations, TSUNAMI was used for uncertainty quantification on k-effective, TRITON and the Oak Ridge isotope generation code (ORIGEN) were both used for depletion of the fuel, and MAVRIC was used for shielding calculations. For criticality assessments, this study focused on the requirement that the value of the neutron multiplication factor, k-effective (k-eff), would not exceed a peak value of 0.95, including uncertainty, with 95% confidence. Criticality was initially examined by modeling fresh fuel from three different designs—HTR-10 fuel, PBMR-400 fuel, and demonstration fuel representative of a TRISO-fueled modern high-temperature gas reactor (HTGR) design, henceforth referred to as Demo HTGR—and placing them into various sized containers with conditions described in 10 CFR 71 to quantify the peak k-eff state. When the peak value of 0.95 k-eff was exceeded, mitigation methods were examined in those scenarios. Burnup credit, pebble displacement in areas of strong neutron multiplication, and random pebble replacement using pebbles of various compositions and replacement fractions were examined. In summary, the criticality of PBR fuels can be well accounted for by restricting container size, taking credit for burnup, or by displacing/replacing pebbles. Uncertainty of the k-eff due to nuclear data uncertainties was recorded at ~0.6644%Δk/k, or roughly 664% mil (pcm). The nuclear data–induced uncertainty was relatively small and should not require significant modification in the design to be accounted for. Revisions to the evaluated nuclear data file values have been shown to have a larger impact than nuclear data–induced uncertainty. For dose rate aspects, U.S. Nuclear Regulatory Commission regulations require a maximum dose rate of 10 millirem per hour (mrem/h) at 2 meters. In examining the dose rate behavior of spent PBR fuel, the representative Demo HTGR fuel was modeled exclusively due to it possessing the highest target burnup of the examined fuels. Equilibrium cycle modeling methods were used to produce a higher-fidelity discharge isotopic composition than simple assumptions, such as reflected pebbles. The discharge composition was used as a source term in the fixed-source transport shielding calculations, and dose rates were calculated at 2 m for the shortest possible cooling time. The low concentration of fuel material led to dose rates that were in line with regulatory limits, despite the high burnup when compared to traditional light water reactor fuels. In conclusion, the methods employed in this study would require more work to further verify and validate and are limited to the criticality and dose rate analyses performed.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DeepMC: a deep learning method for efficient Monte Carlo beamlet dose calculation by predictive denoising in magnetic resonance-guided radiotherapy

Abstract Emerging magnetic resonance (MR) guided radiotherapy affords significantly improved anatomy visualization and, subsequently, more effective personalized treatment. The new therapy paradigm imposes significant demands on radiation dose calculation quality and speed, creating an unmet need for the acceleration of Monte Carlo (MC) dose calculation. Existing deep learning approaches to denoise the final plan MC dose fail to achieve the accuracy and speed requirements of large-scale beamlet dose calculation in the presence of a strong magnetic field for online adaptive radiotherapy planning. Our deep learning dose calculation method, DeepMC, addresses these needs by predicting low-noise dose from extremely noisy (but fast) MC-simulated dose and anatomical inputs, thus enabling significant acceleration. DeepMC simultaneously reduces MC sampling noise and predicts corrupted dose buildup at tissue-air material interfaces resulting from MR-field induced electron return effects. Here we demonstrate our model’s ability to accelerate dose calculation for daily treatment planning by a factor of 38 over traditional low-noise MC simulation with clinically meaningful accuracy in deliverable dose and treatment delivery parameters. As a post-processing approach, DeepMC provides compounded acceleration of large-scale dose calculation when used alongside established MC acceleration techniques in variance reduction and graphics processing unit-based MC simulation.

Engineering↗

Applications of flow models to the generation of correlated lattice QCD ensembles

Machine-learned normalizing flows can be used in the context of lattice quantum field theory to generate statistically correlated ensembles of lattice gauge fields at different action parameters. This work demonstrates how these correlations can be exploited for variance reduction in the computation of observables. Three different proof-of-concept applications are demonstrated using a novel residual flow architecture: continuum limits of gauge theories, the mass dependence of QCD observables, and hadronic matrix elements based on the Feynman–Hellmann approach. In all three cases, it is shown that statistical uncertainties are significantly reduced when machine-learned flows are incorporated as compared with the same calculations performed with uncorrelated ensembles or direct reweighting. Published by the American Physical Society 2024

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Internal Delensing of Cosmic Microwave Background Polarization B -Modes with the POLARBEAR Experiment

Using only cosmic microwave background polarization data from the polarbear experiment, we measure B-mode polarization delensing on subdegree scales at more than 5σ significance. We achieve a 14% B-mode power variance reduction, the highest to date for internal delensing, and improve this result to 22% by applying for the first time an iterative maximum a posteriori delensing method. Our analysis demonstrates the capability of internal delensing as a means of improving constraints on inflationary models, paving the way for the optimal analysis of next-generation primordial B-mode experiments.

79 ASTRONOMY AND ASTROPHYSICS↗

A Machine Learning–Based Tire Life Prediction Framework for Increasing Life of Commercial Vehicle Tires

In the commercial freight industry, tire retreading decisions are often conservative due to limited knowledge of a tire’s remaining service life. This practice leads to increased costs and material waste. This paper proposes a machine learning–based approach for estimating tire casing life and retreadability, focusing on usage data rather than wear information. This approach could extend the tire’s lifespan and reduce landfill waste. Data integration from diverse tire casing measurement sources presents challenges, including imbalanced removal data. Our methodology addresses these challenges by using historical inspection, telematics, and finite element modeling (FEM) datasets. We introduce “Tire Casing Energy” as a comprehensive usage input and apply a Variance-Reduction Synthetic Minority Oversampling Technique (VR-SMOTE) for data imbalance rectification. A random forest model is used to estimate the state of the tire casing and the casing removal probability, with Bayesian optimization applied for hyperparameter tuning, enhancing model accuracy. Here, the proposed prediction framework is able to differentiate different truck fleets and tire locations based on their usage parameters. With the aid of this machine learning model, the importance and sensitivity of different tire usage parameters can be obtained, which is beneficial to maximize tire life.

Data balancing↗

Probing for the Trace Estimation of a Permuted Matrix Inverse Corresponding to a Lattice Displacement

We report thatpProbing is a general technique that is used to reduce the variance of the Hutchinson stochastic estimator for the trace of the inverse of a large, sparse matrix A. The variance of the estimator is the sum of the squares of the off-diagonal elements of A -1 . Therefore, this technique computes probing vectors that when used in the estimator annihilate the largest off-diagonal elements. For matrices that display decay of the magnitude of |A$^{-1}_{ij}$| with the graph distance between nodes i and j, this is achieved through graph coloring of increasing powers A k . Equivalently, when a matrix stems from a lattice discretization, it is computationally beneficial to find a distance-k coloring of the lattice. Previously, a hierarchical coloring was proposed so that k can be increased at runtime as needed without discarding previous work. In this work, we study probing for the more general problem of computing the trace of a permutation of A -1 , say PA -1 . The motivation comes from lattice quantum chromodynamics (QCD), where we need to construct “disconnected diagrams” to extract flavor-separated generalized parton functions. In lattice QCD, where the matrix has a four-dimensional toroidal lattice structure, these nonlocal operators correspond to a PA -1 , where P is the permutation relating to some displacement $\vec{p}$ in one or more dimensions. We focus on a single dimension displacement (p), but our methods are general. We show that probing on A k or (PA) k does not annihilate the largest magnitude elements. To resolve this issue, our displacement-based probing works on PA k using a new coloring scheme that works directly on appropriately displaced neighborhoods on the lattice. We prove lower bounds on the number of colors needed and study the effect of this scheme on variance reduction, both theoretically and experimentally on a real-world lattice QCD calculation. We achieve orders of magnitude speedup over the unprobed or the naively probed methods.

97 MATHEMATICS AND COMPUTING↗

Weak-Form Latent Space Dynamics Identification

This software showcases the enhanced capabilities of the Latent Space Dynamics Identification (LaSDI) algorithm through the application of the weak form, resulting in WLaSDI. WLaSDI first compresses the data, then projects it onto test functions, and subsequently learns the local latent space models. Notably, WLaSDI demonstrates significantly improved robustness to noise. Using weak-form equation learning techniques, WLaSDI achieves local latent space modeling. Compared to the standard sparse identification of nonlinear dynamics (SINDy) used in LaSDI, the variance reduction of the weak form ensures robust and precise latent space recovery, enabling fast, robust, and accurate simulations. We demonstrate the efficacy of WLaSDI against LaSDI using several common benchmark examples, including viscid and inviscid Burgers', radial advection, and heat conduction. For instance, in 1D inviscid Burgers' simulations with up to 100% Gaussian white noise, WLaSDI maintains relative errors consistently below 6%, whereas LaSDI errors can exceed 10,000%. Similarly, in radial advection simulations, WLaSDI keeps relative errors below 16%, compared to potential errors of up to 10,000% with LaSDI. Additionally, WLaSDI achieves significant speedups, such as a 140X speedup in 1D Burgers' simulations compared to the corresponding full order model.

Choi, Youngsoo↗

CV4Quantum

CV4Quantum is a statistical technique for reducing the sampling overhead in probabilistic error cancellation, which is an error mitigation technique used in quantum computing. CV4Quantum is based on the control variates method, which is a Monte Carlo variance reduction technique. This repository contains the code and data associated with a demonstration of CV4Quantum using simulation experiments.

Shyamsundar, Prasanth [Fermi National Accelerator ↗