Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “variational Monte Carlo”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Uncertainty quantification in multivariable regression for material property prediction with Bayesian neural networks

With the increased use of data-driven approaches and machine learning-based methods in material science, the importance of reliable uncertainty quantification (UQ) of the predicted variables for informed decision-making cannot be overstated. UQ in material property prediction poses unique challenges, including multi-scale and multi-physics nature of materials, intricate interactions between numerous factors, limited availability of large curated datasets, etc. In this work, we introduce a physics-informed Bayesian Neural Networks (BNNs) approach for UQ, which integrates knowledge from governing laws in materials to guide the models toward physically consistent predictions. To evaluate the approach, we present case studies for predicting the creep rupture life of steel alloys. Experimental validation with three datasets of creep tests demonstrates that this method produces point predictions and uncertainty estimations that are competitive or exceed the performance of conventional UQ methods such as Gaussian Process Regression. Additionally, we evaluate the suitability of employing UQ in an active learning scenario and report competitive performance. The most promising framework for creep life prediction is BNNs based on Markov Chain Monte Carlo approximation of the posterior distribution of network parameters, as it provided more reliable results in comparison to BNNs based on variational inference approximation or related NNs with probabilistic outputs.

36 MATERIALS SCIENCE↗

Photometry of Outer Solar System Objects from the Dark Energy Survey. I. Photometric Methods, Light-curve Distributions, and Trans-Neptunian Binaries

We report the methods of and initial scientific inferences from the extraction of precision photometric information for the >800 trans-Neptunian objects (TNOs) discovered in the images of the Dark Energy Survey (DES). Scene-modeling photometry is used to obtain shot-noise-limited flux measures for each exposure of each TNO, with background sources subtracted. Comparison of double-source fits to the pixel data with single-source fits are used to identify and characterize two binary TNO systems. A Markov Chain Monte Carlo method samples the joint likelihood of the intrinsic colors of each source as well as the amplitude of its flux variation, given the time series of multiband flux measurements and their uncertainties. A catalog of these colors and light-curve amplitudes A is included with this publication. We show how to assign a likelihood to the distribution q(A) of light-curve amplitudes in any subpopulation. Using this method, we find decisive evidence (i.e., evidence ratio <0.01) that cold classical (CC) TNOs with absolute magnitude 6 < H$_{r}$ < 8.2 are more variable than the hot classical (HC) population of the same H$_{r}$, reinforcing theories that the former form in situ and the latter arise from a different physical population. Resonant and scattering TNOs in this H$_{r}$ range have variability consistent with either the HCs or CCs. DES TNOs with H$_{r}$ < 6 are seen to be decisively less variable than higher-H$_{r}$ members of any dynamical group, as expected. More surprising is that detached TNOs are decisively less variable than scattering TNOs, which requires them to have distinct source regions or some subsequent differential processing.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Using Best Basis Inventory Data to Direct Strategies for Real Time Monitoring of Hanford High Level Waste – 26226

The potential to accelerate the processing of low- and high-level tank waste by applying real-time monitoring (RTM) of chemical and physical properties has prompted research into the suitability of multiple analytical methods for that purpose. The broad variety of waste stream properties and the large number of analytes of interest (as evidenced by Waste Acceptance Criteria (WAC) and Process Control Limit (PCL) lists) lead to an overwhelming set of possible analytical scenarios. This report describes the use of Best Basis Inventory (BBI) data to find the most relevant analytical targets for the specific case of monitoring the blending of High Level Waste from multiple tanks prior to introduction into a vitrification facility. Campaigns for blending this waste to minimize the risk of exceeding WACs and PCLs have been proposed. However, the predicted compositions of the blended materials do not incorporate any uncertainties that may be associated with the representativeness of the waste layer samples or the laboratory analyses that generated the BBI data. Also, they do not include any uncertainty associated with the precision of collecting highly specific fractions of the layers during a blending campaign or any inhomogeneities that may exist in those layers. Monte Carlo methods are used to apply uncertainties to the compositions of the individual layers specified in the campaign recipes. The resulting variations in the compositions of the blended materials allow estimation of the risks of exceeding WACs and PCLs for each campaign. A critical subset of WACs/PCLs – NOx, NaK, AlFeZr, and S – are especially at risk of being exceeded in multiple campaigns. These analytes should be the focus of instrument development. We also have extracted the expected solid/supernate distribution for these analytes, which establishes important performance criteria for individual analytical methods. The BBI data also permits an understanding of the different chemical forms in which the analytes appear. Thus, the need to establish instrumental sensitivity to these forms can be gainfully addressed. Although concentrating on one specific application – the blending of tank waste - this approach should be generalizable for the analysis of other possible RTM applications for waste processing.

Lascola, Robert [Savannah River National Laborator↗

Variational calculation of closed-shell nuclei up to A=40 [Slides]

Compute ground state properties of closed-shell nuclei up to A = 40 with quantum Monte Carlo. Analyze the behavior of phenomenological Hamiltonians in medium-heavy nuclei. Study the high-momentum components of the nuclear wave function and potential in-medium modifications of the nucleon form factors.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

$t_1$-Noise eliminated dipolar heteronuclear multiple-quantum coherence solid-state NMR spectroscopy

Heteronuclear correlation (HETCOR) spectroscopy is one of the key tools in the arsenal of the solid-state NMR spectroscopist to probe chemical and spatial proximities between two different nuclei and enhance spectral resolution. Dipolar heteronuclear multiple-quantum coherence (D-HMQC) is a powerful technique that can be potentially utilized to obtain 1 H detected 2D HETCOR solid-state NMR spectra of any NMR active nucleus. A long-standing problem in 1 H detected D-HMQC solid-state NMR experiments is the presence of t 1 -noise which reduces sensitivity and impedes spectral interpretation. In this contribution, we describe novel pulse sequences, termed t 1 -noise eliminated (TONE) D-HMQC, that minimize t 1 -noise and can provide higher sensitivity and resolution than conventional D-HMQC. Monte-Carlo and numerical simulations confirm that t 1 -noise in conventional D-HMQC primarily occurs because random MAS frequency fluctuations cause variations in the NMR signal amplitude from scan to scan, leading to imperfect cancellation of uncorrelated signals by phase cycling. The TONE D-HMQC sequence uses 1 H π-pulses to refocus the evolution of 1 H CSA across each SR4 2 1 recoupling block, improving the stability of the pulse sequence to random MAS frequency fluctuations. The 1 H refocusing pulses also restore the orthogonality of in-phase and anti-phase magnetization for all crystallite orientations at the end of each recoupling block, enabling the use of 90° flip-back or LG spin-lock trim pulses to reduce the intensity of uncorrelated signals. We demonstrate the application of these methods to acquire 1 H detected 2D 1 H{ 35 Cl} and 1 H{ 13 C} HETCOR spectra of histidine·HCl·H 2 O with reduced t 1 -noise. To show generality, we also apply these methods to obtain 2D 1 H{ 17 O} spectra of 20%- 17 O fmoc-alanine and for the first time at natural abundance, 2D 1 H{ 25 Mg} HETCOR spectra of magnesium hydroxide. The TONE D-HMQC sequences are also used to probe 1 H– 25 Mg and 1 H– 27 Al proximities in Mg–Al layered double hydroxides and confirm the even mixing of Mg and Al in these materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Dark Energy Survey Year 3 results: marginalization over redshift distribution uncertainties using ranking of discrete realizations

ABSTRACT Cosmological information from weak lensing surveys is maximized by sorting source galaxies into tomographic redshift subsamples. Any uncertainties on these redshift distributions must be correctly propagated into the cosmological results. We present hyperrank, a new method for marginalizing over redshift distribution uncertainties, using discrete samples from the space of all possible redshift distributions, improving over simple parametrized models. In hyperrank, the set of proposed redshift distributions is ranked according to a small (between one and four) number of summary values, which are then sampled, along with other nuisance parameters and cosmological parameters in the Monte Carlo chain used for inference. This approach can be regarded as a general method for marginalizing over discrete realizations of data vector variation with nuisance parameters, which can consequently be sampled separately from the main parameters of interest, allowing for increased computational efficiency. We focus on the case of weak lensing cosmic shear analyses and demonstrate our method using simulations made for the Dark Energy Survey (DES). We show that the method can correctly and efficiently marginalize over a wide range of models for the redshift distribution uncertainty. Finally, we compare hyperrank to the common mean-shifting method of marginalizing over redshift uncertainty, validating that this simpler model is sufficient for use in the DES Year 3 cosmology results presented in companion papers.

79 ASTRONOMY AND ASTROPHYSICS↗

Universal method for the optimization of HDC coating uniformity on non-planar, non-stationary substrates for inertial confinement fusion targets

The thickness uniformity of chemical vapor deposited (CVD) diamond coatings on non-planar, non-stationary substrates depends on both the intrinsic instantaneous coating thickness distribution (ICTD) of the coating conditions used and, if applicable, on the frequency of substrate reorientation. While important for many CVD diamond applications, the relative impact of the ICTD and substrate reorientation on the coating thickness uniformity has not been studied. In this work, we systematically investigate the effect of these factors for microwave-plasma chemical vapor deposition (MPCVD) of diamond (referred to as high density carbon (HDC) in the inertial confinement fusion (ICF) community) coatings on spherical, rolling substrates. This coating technique is used to fabricate capsules for ICF experiments, which require extreme coating uniformity with <0.3 % thickness variation (so-called Mode 1 or M1) to ensure symmetric compression of imploding targets. To extract the otherwise unobservable reorientation timescale (Δt), Monte Carlo simulations were performed using experimental ICTD data as input. This combined approach confirms scaling relationships between the substrate reorientation timescale as well as coating thickness and coating uniformity, as expected from a 3D random walk. Simulations confirm that M1 is Rayleigh-distributed and scales as (Δt) 1/2 , consistent with the randomization of two angles that determine orientation of a sphere. We also demonstrate that, under the conditions studied, Δt is the dominant factor in determining thickness uniformity while the intrinsic ICTD has minimal impact. Finally, experiments show that Δt can be affected by total batch size under constant agitation conditions due to space constraints that limit the capsule reorientation kinetics. In conclusion, this study highlights the utility of a combined experiment-simulation approach as a general methodology for understanding and improving coating uniformity on non-planar, non-stationary substrates.

Capsule↗

Bayesian analysis for estimating statistical parameter distributions of elasto-viscoplastic material models

High temperature design methods rely on constitutive models for inelastic deformation and failure typically calibrated against the mean of experimental data without considering the associated scatter. Variability may arise from the experimental data acquisition process, from heat-to-heat material property variations, or both and need to be accurately captured to predict parameter bounds leading to efficient component design. Applying the Bayesian Markov Chain Monte Carlo (MCMC) method to produce statistical models capturing the underlying uncertainty in the experimental data is an area of ongoing research interest. This work varies aspects of the Bayesian MCMC method and explores their effect on the posterior parameter distributions for a uniaxial elasto-viscoplastic damage model using synthetically generated reference data. From our analysis with the uniaxial inelastic model we determine that an informed prior distribution including different types of test conditions results in more accurate posterior parameter distributions. The parameter posterior distributions, however, do not improve when increasing the number of similar experimental data. Additionally, changing the amount of scatter in the data affects the quality of the posterior distributions, especially for the less sensitive model parameters. Moreover, we perform a sensitivity study of the model parameters against the likelihood function prior to the Bayesian analysis. The results of the sensitivity analysis help to determine the reliability of the posterior distributions and reduce the dimensionality of the problem by fixing the insensitive parameters. The comprehensive study described in this work demonstrates how to efficiently apply the Bayesian MCMC methodology to capture parameter uncertainties in high temperature inelastic material models. Quantifying these uncertainties in inelastic models will improve high temperature engineering design practices and lead to safer, more effective component designs.

42 ENGINEERING↗

Single reader between-cases AUC estimator with nested data

The area under the receiver operating characteristic curve (AUC) is widely used in evaluating diagnostic performance for many clinical tasks. It is still challenging to evaluate the reading performance of distinguishing between positive and negative regions of interest (ROIs) in the nested-data problem, where multiple ROIs are nested within the cases. To address this issue, we identify two kinds of AUC estimators, within-cases AUC and between-cases AUC. We focus on the between-cases AUC estimator, since our main research interest is in patient-level diagnostic performance rather than location-level performance (the ability to separate ROIs with and without disease within each patient). Another reason is that as the case number increases, the number of between-cases paired ROIs is much larger than the number of within-cases ROIs. We provide estimators for the variance of the between-cases AUC and for the covariance when there are two readers. We derive and prove the above estimators’ theoretical values based on a simulation model and characterize their behavior using Monte Carlo simulation results. We also provide a real-data example. Moreover, we connect the distribution-based simulation model with the simulation model based on the linear mixed-effect model, which helps better understand the sources of variation in the simulated dataset.

Health Care Sciences & Services↗

Computational multiphysics modeling of radioactive aerosol deposition in diverse human respiratory tract geometries

The evaluation of aerosol exposure relies on generic mathematical models that assume uniform particle deposition profiles over the human respiratory tract and do not account for subject-specific characteristics. Here we introduce a hybrid-automated computational workflow that generates personalized particle deposition profiles in 3D reconstructed human airways from computed tomography scans using Computational Fluid and Particle Dynamics simulations. This is the first large-scale study to consider realistic airways variability, where 380 lower and 40 upper human respiratory tract 3D geometries are reconstructed and parameterized. The data is clustered into nine groups using random forest regression. Computational fluid and particle dynamics simulations are conducted on these representative geometries using a realistic heavy-breathing respiratory cycle and radioactive iodine-131 as a source term. Monte Carlo radiation transport simulations are performed to obtain detailed energy deposition maps. Our findings emphasize the importance of personalized studies, as minor respiratory tract variations notably influence deposition patterns rather than global parameters of the lower airways, observing more than 30% variance in the mass deposition fraction.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Data-Driven Global Sensitivity Analysis of Three-Phase Distribution System with PVs

Global sensitivity analysis (GSA) of distribution system with respect to stochastic PV variations plays an important role in designing optimal voltage control schemes. This paper proposes a Kriging, i.e., Gaussian process modeling enabled data-driven GSA method. The key idea is to develop a surrogate model that captures the hidden global relationship between voltage and real and reactive power injections from the historical data. With the surrogate model, the Sobol index can be conveniently calculated to assess the global sensitivity of voltage to various power injection variations. Comparison results with other model-based GSA methods on the IEEE 37-bus feeder, such as the polynomial chaos expansion and the Monte Carlo approaches demonstrate that the proposed method can achieve accurate GSA outcomes while maintaining high computational efficiency.

distribution system analysis↗

Unbinned extraction of $γ$ from $B\to DK$ with normalizing flows

We introduce an unbinned method for extracting the CKM angle $γ$ from the decay chain $B^\pm \to (D \to K_S π^+ π^-) K^\pm$ using normalizing flows (NFs). The NFs, trained on $D$ decay data, learn a faithful continuous representation of the amplitude and strong phase variation over the $D\to K_Sπ^+π^-$ Dalitz plot whose fidelity improves with increased data sample sizes. With this input, the $B$ decay data can be used to extract the parameters $r_B$, $δ_B$, and $γ$. We test the method on Monte Carlo generated data, where it successfully recovers the injected value of $γ$ within uncertainties. The present implementation propagates statistical uncertainties from finite training data via an ensemble of independently trained flows, and does not attempt to capture the effects of systematic experimental errors. We explore two versions of the method that differ in how the trigonometric constraint on phase variation is encoded, and comment on the possible extension to Bayesian NFs, which would provide direct uncertainty estimates on the learned densities without requiring ensemble training.

Grossman, Yuval [Cornell U., LEPP]↗

Magnetic tunnel junction random number generators applied to dynamically tuned probability trees driven by spin orbit torque

Abstract Perpendicular magnetic tunnel junction (pMTJ)-based true-random number generators (RNGs) can consume orders of magnitude less energy per bit than CMOS pseudo-RNGs. Here, we numerically investigate with a macrospin Landau–Lifshitz-Gilbert equation solver the use of pMTJs driven by spin–orbit torque to directly sample numbers from arbitrary probability distributions with the help of a tunable probability tree. The tree operates by dynamically biasing sequences of pMTJ relaxation events, called ‘coinflips’, via an additional applied spin-transfer-torque current. Specifically, using a single, ideal pMTJ device we successfully draw integer samples on the interval [0, 255] from an exponential distribution based on p -value distribution analysis. In order to investigate device-to-device variations, the thermal stability of the pMTJs are varied based on manufactured device data. It is found that while repeatedly using a varied device inhibits ability to recover the probability distribution, the device variations average out when considering the entire set of devices as a ‘bucket’ to agnostically draw random numbers from. Further, it is noted that the device variations most significantly impact the highest level of the probability tree, with diminishing errors at lower levels. The devices are then used to draw both uniformly and exponentially distributed numbers for the Monte Carlo computation of a problem from particle transport, showing excellent data fit with the analytical solution. Finally, the devices are benchmarked against CMOS and memristor RNGs, showing faster bit generation and significantly lower energy use.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

LHC hadronic jet generation using convolutional variational autoencoders with normalizing flows

Abstract In high energy physics, one of the most important processes for collider data analysis is the comparison of collected and simulated data. Nowadays the state-of-the-art for data generation is in the form of Monte Carlo (MC) generators. However, because of the upcoming high-luminosity upgrade of the Large Hadron Collider (LHC), there will not be enough computational power or time to match the amount of needed simulated data using MC methods. An alternative approach under study is the usage of machine learning generative methods to fulfill that task. Since the most common final-state objects of high-energy proton collisions are hadronic jets, which are collections of particles collimated in a given region of space, this work aims to develop a convolutional variational autoencoder (ConVAE) for the generation of particle-based LHC hadronic jets. Given the ConVAE’s limitations, a normalizing flow (NF) network is coupled to it in a two-step training process, which shows improvements on the results for the generated jets. The ConVAE+NF network is capable of generating a jet in 18.30 ± 0.04 μ s , making it one of the fastest methods for this task up to now.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Marginal unbiased score expansion and application to CMB lensing

Here, we present the marginal unbiased score expansion (MUSE) method, an algorithm for generic high-dimensional hierarchical Bayesian inference. MUSE performs approximate marginalization over arbitrary non-Gaussian latent parameter spaces, yielding Gaussianized asymptotically unbiased and near-optimal constraints on global parameters of interest. It is computationally much cheaper than exact alternatives like Hamiltonian Monte Carlo (HMC), excelling on funnel problems which challenge HMC, and does not require any problem-specific user supervision like other approximate methods such as variational inference or many simulation-based inference methods. MUSE makes possible the first joint Bayesian estimation of the delensed Cosmic Microwave Background (CMB) power spectrum and gravitational lensing potential power spectrum, demonstrated here on a simulated data set as large as the upcoming South Pole Telescope 3G 1500 deg 2 survey, corresponding to a latent dimensionality of ~6 million and of order 100 global bandpower parameters. On a subset of the problem where an exact but more expensive HMC solution is feasible, we verify that MUSE yields nearly optimal results. We also demonstrate that existing spectrum-based forecasting tools which ignore pixel-masking underestimate predicted error bars by only ~10%. This method is a promising path forward for fast lensing and delensing analyses which will be necessary for future CMB experiments such as SPT-3G, Simons Observatory, or CMB-S4, and can complement or supersede existing HMC approaches. The success of MUSE on this challenging problem strengthens its case as a generic procedure for a broad class of high-dimensional inference problems.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A Broad Grid of 2D Kilonova Emission Models

Depending upon the properties of their compact remnants and the physics included in the models, simulations of neutron star mergers can produce a broad range of ejecta properties. The characteristics of this ejecta, in turn, define the kilonova emission. To explore the effect of ejecta properties, we present a grid of 2-component 2D axisymmetric kilonova simulations that vary mass, velocity, morphology, and composition. The masses and velocities of each component vary, respectively, from 0.001 to 0.1 M ⊙ and 0.05 to 0.3c, covering much of the range of results from the neutron star merger literature. The set of 900 models is constrained to have a toroidal low electron fraction (Y e ) ejecta with a robust r-process composition and either a spherical or lobed high-Y e ejecta with two possible compositions. We simulate these models with the Monte Carlo radiative transfer code SuperNu using a full suite of lanthanide and 4th row element opacities. We examine the trends of these models with parameter variation, show how it can be used with statistical tools, and compare the model light curves and spectra to those of AT2017gfo, the electromagnetic counterpart of GW170817.

79 ASTRONOMY AND ASTROPHYSICS↗

Life-cycle cost-benefit analysis of a novel self-heating pavement made from coal-derived solid carbon

Winter weather events challenge the safety, efficiency, and sustainability of roadway networks, particularly road bridges vulnerable to climate impacts. Although effective, conventional de-icing methods incur high expenses and cause significant environmental contamination. To address these longstanding issues, a low-cost novel coal-derived carbon enabled smart pavement (CDC-SP) de-icing system was developed, aiming to alleviate traffic delays, severe corrosion, compromised safety, and environmental pollution. However, the economic performance of CDC-SP has not been quantified to guide decision-making. To this end, this paper presents a Life-Cycle Cost-Benefit Analysis (LCCBA) to assess the economic feasibility of the CDC-SP de-icing system for road bridges in five representative urban and rural areas across cool humid and cold humid climate zones. Given the variations and uncertainties of several factors that determine the costs and benefits, a sensitivity analysis was conducted to determine the system’s economic reliability. Additionally, a Monte Carlo simulation (MCS) was performed to quantify the impacts of important factors and identify the most beneficial scenarios. Furthermore, the CDC-SP de-icing systems have demonstrated substantial economic benefits and short payback periods, showing great applicability for rural and urban road bridges with different service levels across multiple climate zones as compared to conventional de-icing methods.

36 MATERIALS SCIENCE↗

Revisiting excitation gaps in the fractional quantum Hall effect

Recent systematic measurements of the quantum well width dependence of the excitation gaps of fractional quantum Hall states in high mobility samples open the possibility of a better quantitative understanding of this important issue. Here we present what we believe to be accurate theoretical gaps including the effects of finite width and Landau level (LL) mixing. While theory captures the width dependence, there still remains a deviation between the calculated and the measured gaps, presumably caused by disorder. It is customary to model the experimental gaps of the n/(2n ± 1) states as Δ n/(2n+1) = Ce 2 /[(2n ± 1)ϵl]-Γ, where ϵ is the dielectric constant of the background semiconductor and l is the magnetic length; the first term is interpreted as the cyclotron energy of composite fermions and Γ as a disorder-induced broadening of composite-fermion LLs. Fitting the gaps for various fractional quantum Hall states, we find that Γ can be nonzero even in the absence of disorder.

36 MATERIALS SCIENCE↗