Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Monte Carlo method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

Bayesian Monte Carlo Evaluation of Imperfect (n, 233 U) Data and Model

Conventional nuclear data evaluation methods using generalized linear least squares make the following assumptions: prior and posterior probability distribution functions (PDFs) of all model parameters and data are normal (Gaussian); the linear approximation is sufficiently accurate to minimize the cost function (even for nonlinear models); the model (e.g., of neutron cross section) and experimental data (including covariance data) are without defect and prior PDFs of parameters and measured data are known perfectly. Neglect of covariance between model parameters and measured data in conventional evaluations contributes to imperfections. These assumptions are inherent to the generalized linear least squares minimization method commonly used for resolved resonance region neutron cross section evaluations but are often not justified due to the presence of non-normal PDFs, nonlinear models (e.g., R-matrix formalism), and inherent imperfections in data and models (e.g., imperfect covariance data). Here, these assumptions are removed in a mathematical framework of Bayes’ theorem, which is implemented using the Metropolis-Hastings Monte Carlo method. Most importantly, new parameters are introduced to parameterize discrepancies between the theoretical model and measured data to quantify judgement about discrepancies or imperfections in a reproducible manner. An evaluation of 233U in the eV region using the ENDF-B/VIII.0 library and transmission data (Guber et al.) is presented, and posterior parameters are compared to those obtained by conventional evaluation methods. This example illustrates the effects of removing the most harmful assumption: that of model-data perfection.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Method of information entropy for convergence assessment of molecular dynamics simulations

The lack of a reliable method to evaluate the convergence of molecular dynamics simulations has contributed to discrepancies in different areas of molecular dynamics. Here, the method of information entropy is introduced to molecular dynamics for stationarity assessment. The Shannon information entropy formalism is used to monitor the convergence of the atom motion to a steady state in a continuous spatial domain and is also used to assess the stationarity of calculated multidimensional fields such as the temperature field in a discrete spatial domain. It is demonstrated in this work that monitoring the information entropy of the atom position matrix provides a clear indicator of reaching steady state in radiation damage simulations, non-equilibrium molecular dynamics thermal conductivity computations, and simulations of Poiseuille and Couette flow in nanochannels. A main advantage of the present technique is that it is non-local and relies on fundamental quantities available in all molecular dynamics simulations. Unlike monitoring average temperature, the technique is applicable to simulations that conserve total energy such as reverse non-equilibrium molecular dynamics thermal conductivity computations and to simulations where energy dissipates through a boundary as in radiation damage simulations. The method is applied to simulations of iron using the Tersoff/ZBL splined potential, silicon using the Stillinger–Weber potential, and to Lennard–Jones fluid. Its applicability to both solids and fluids shows that the technique has potential for generalization to other areas in molecular dynamics.

74 ATOMIC AND MOLECULAR PHYSICS↗

Characterization of Partially Observed Epidemics - Application to COVID-19

This report documents a statistical method for the "real-time" characterization of partially observed epidemics. Observations consist of daily counts of symptomatic patients, diagnosed with the disease. Characterization, in this context, refers to estimation of epidemiological parameters that can be used to provide short-term forecasts of the ongoing epidemic, as well as to provide gross information for the time-dependent infection rate. The characterization problem is formulated as a Bayesian inverse problem, and is predicated on a model for the distribution of the incubation period. The model parameters are estimated as distributions using a Markov Chain Monte Carlo (MCMC) method, thus quantifying the uncertainty in the estimates. The method is applied to the COVID-19 pandemic of 2020, using data at the country, provincial (e.g., states) and regional (e.g. county) levels. The epidemiological model includes a stochastic component due to uncertainties in the incubation period. This model-form uncertainty is accommodated by a pseudo-marginal Metropolis-Hastings MCMC sampler, which produces posterior distributions that reflect this uncertainty. We approximate the discrepancy between the data and the epidemiological model using Gaussian and negative binomial error models; the latter was motivated by the over-dispersed count data. For small daily counts we find the performance of the calibrated models to be similar for the two error models. For large daily counts the negative-binomial approximation is numerically unstable unlike the Gaussian error model. Application of the model at the country level (for the United States, Germany, Italy, etc.) generally provided accurate forecasts, as the data consisted of large counts which suppressed the day-to-day variations in the observations. Further, the bulk of the data is sourced over the duration before the relaxation of the curbs on population mixing, and is not confounded by any discernible country-wide second wave of infections. At the state-level, where reporting was poor or which evinced few infections (e.g., New Mexico), the variance in the data posed some, though not insurmountable, difficulties, and forecasts were able to capture the data with large uncertainty bounds. The method was found to be sufficiently sensitive to discern the flattening of the infection and epidemic curve due to shelter-in-place orders after around 90% quantile for the incubation distribution (about 10 days for COVID-19). The proposed model was also used at a regional level to compare the forecasts for the central and north-west regions of New Mexico. Modeling the data for these regions illustrated different disease spread dynamics captured by the model. While in the central region the daily counts peaked in the late April, in the north-west region the ramp-up continued for approximately three more weeks.

59 BASIC BIOLOGICAL SCIENCES↗

Quantitative uranium elemental reconstruction using spectral x-ray radiography

X-ray radiography offers the ability to noninvasively inspect the internal structure and material composition of objects. Dual-energy radiography allows material discrimination but is limited in quantitative material measurements due to the broad nature of the interrogating x-ray spectrum. Spectral radiography detectors provide an observation of not just the number of x rays that are transmitted through a sample but also the spectrum. Here, experimental validations of a method to use spectral x-ray radiography to accurately quantify the uranium mass in a powder are presented. An accurate system response model was developed, which includes a model of the incident x-ray source spectrum and a pixel-wise detector response that describes how the transmitted x rays were observed. Further, a calibration to account for the effect of partial x-ray attenuation was developed. As a result, the method is demonstrated to be capable of estimating the uranium mass in a variety of uranium oxide powders to a bias of –0.01±0.62%.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Challenges in Markov Chain Monte Carlo for Bayesian Neural Networks

Markov chain Monte Carlo (MCMC) methods have not been broadly adopted in Bayesian neural networks (BNNs). This paper initially reviews the main challenges in sampling from the parameter posterior of a neural network via MCMC. Such challenges culminate to lack of convergence to the parameter posterior. Nevertheless, this paper shows that a nonconverged Markov chain, generated via MCMC sampling from the parameter space of a neural network, can yield via Bayesian marginalization a valuable posterior predictive distribution of the output of the neural network. Further, classification examples based on multilayer perceptrons showcase highly accurate posterior predictive distributions. The postulate of limited scope for MCMC developments in BNNs is partially valid; an asymptotically exact parameter posterior seems less plausible, yet an accurate posterior predictive distribution is a tenable research avenue.

97 MATHEMATICS AND COMPUTING↗

Parameter estimation for X-ray scattering analysis with Hamiltonian Markov Chain Monte Carlo

Bayesian-inference-based approaches, in particular the random-walk Markov Chain Monte Carlo (MCMC) method, have received much attention recently for X-ray scattering analysis. Hamiltonian MCMC, a state-of-the-art development in the field of MCMC, has become popular in recent years. It utilizes Hamiltonian dynamics for indirect but much more efficient drawings of the model parameters. We described the principle of the Hamiltonian MCMC for inversion problems in X-ray scattering analysis by estimating high-dimensional models for several motivating scenarios in small-angle X-ray scattering, reflectivity, and X-ray fluorescence holography. Hamiltonian MCMC with appropriate preconditioning can deliver superior performance over the random-walk MCMC, and thus can be used as an efficient tool for the statistical analysis of the parameter distributions, as well as model predictions and confidence analysis.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Optimizing shift selection in multilevel Monte Carlo for disconnected diagrams in lattice QCD

The calculation of disconnected diagram contributions to physical signals is a computationally expensive task in Lattice QCD. To extract the physical signal, the trace of the inverse Lattice Dirac operator, a large sparse matrix, must be stochastically estimated. Because the variance of the stochastic estimator is typically large, variance reduction techniques must be employed. Multilevel Monte Carlo (MLMC) methods reduce the variance of the trace estimator by utilizing a telescoping sequence of estimators. Frequency Splitting is one such method that uses a sequence of inverses of shifted operators to estimate the trace of the inverse lattice Dirac operator, however there is no a priori way to select the shifts that minimize the cost of the multilevel trace estimation. Here we present a sampling and interpolation scheme that is able to predict the variances associated with Frequency Splitting under displacements of the underlying space time lattice. The interpolation scheme is able to predict the variances to high accuracy and therefore chooses shifts that correspond to an approximate minimum of the cost for the trace estimation. We show that Frequency Splitting with the chosen shifts displays significant speedups over multigrid deflation, and that these shifts can be used for multiple configurations within the same ensemble with no penalty to performance.

97 MATHEMATICS AND COMPUTING↗

First-Principles Statistical Mechanics Study of Magnetic Fluctuations and Order–Disorder in the Spinel LiNi 0.5 Mn 1.5 O 4 Cathode

While significant magnetic interactions exist in lithium transition metal oxides, commonly used as Li-ion cathodes, the interplay between magnetic couplings, disorder, and redox processes remains poorly understood. In this work, we focus on the high-voltage spinel LiNi 0.5 Mn 1.5 O 4 (LNMO) cathode as a model system on which to apply a computational framework that uses first principles-based statistical mechanics methods to predict the finite temperature magnetic properties of materials and provide insights into the complex interplay between magnetic and chemical degrees of freedom. Density functional theory calculations on multiple distinct Ni–Mn orderings within the LNMO system, including the ordered ground-state structure (space group P4332), reveal a preference for a ferrimagnetic arrangement of the Ni and Mn sublattices due to strong antiferromagnetic superexchange interactions between neighboring Mn 4+ and Ni 2+ ions and ferromagnetic Mn–Mn and Ni–Ni couplings, as revealed by magnetic cluster expansions. These results are consistent with qualitative predictions using the Goodenough-Kanamori-Anderson rules. Simulations of the finite temperature magnetic properties of LNMO are conducted using Metropolis Monte Carlo. We find that a “semiclassical” Monte Carlo sampling method based on the Heisenberg Hamiltonian accurately predicts experimental magnetic transition temperatures observed in magnetometry measurements. This study highlights the importance of a robust computational toolkit that accurately captures the complex chemomagnetic interactions and predicts finite temperature magnetic behavior to help analyze experimental magnetic and magnetic resonance spectroscopy data acquired ex situ and operando.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Ab initio electronic density in solids by many-body plane-wave auxiliary-field quantum Monte Carlo calculations

We present accurate many-body results of the electronic densities in several solid materials, including Si, NaCl, and Cu. These results are obtained using the ab initio auxiliary-field quantum Monte Carlo (AFQMC) method working in a plane-wave basis with norm-conserving, multiple-projector pseudopotentials. AFQMC has been shown to be an excellent many-body total energy method. Computation of observables and correlation functions other than the ground-state energy requires back-propagation, whose adaption and implementation in the plane-wave basis AFQMC framework are discussed in the present paper. This development allows us to compute correlation functions, electronic densities, and interatomic forces, paving the way for geometry optimizations and calculations of thermodynamic properties in solids. Finite supercell size effects are considerably more subtle in the many-body framework than in independent-electron calculations. We analyze the convergence of the electronic density, and obtain best estimates for the thermodynamic limit. The densities from several typical density functionals are benchmarked against our near-exact results. The electronic densities we obtained can also be used to help construct improved density functionals.

36 MATERIALS SCIENCE↗

Magnetic multilayer edges in Bernal-stacked hexagonal boron nitride

Single-layer h-BN is known to have edges with unique magnetism; however, in the commonly fabricated multilayer AA'-h-BN, edge relaxations occur that create interlayer bonds and eliminate the unpaired electrons at the edge. Recently, a robust method of growing the unconventional Bernal-stacked h-BN (AB-h-BN) has been reported. Here, we use theoretical approaches to investigate the nitrogen-terminated zigzag edges in AB-h-BN that can be formed in a controlled fashion using a high-energy electron beam. We find that these "open"edges remain intact in bilayer and multilayer AB-h-BN, enabling researchers potentially to investigate these edge states experimentally. We also investigate the thermodynamics of the spin configurations at the edge by constructing a lattice model that is based on parameters extracted from a set of first-principles calculations. We find that the edge spins in neighboring layers interact very weakly, resulting in a sequence of independent spin chains in multilayer samples. By solving this model using Monte Carlo simulations, we can determine nm-scale correlation lengths at liquid-N 2 temperatures and lower. At low temperatures, these edges may be utilized in magnetoresistance and spintronics applications.

1-dimensional spin chains↗

A quantum Monte Carlo study of systems with effective core potentials and node nonlinearities

In this report we study beryllium dihydride (BeH2) and acetylene (C2H2) molecules using real-space diffusion Monte Carlo (DMC) method. The molecules serve as perhaps the simplest prototypes that illustrate the difficulties with biases in the fixed-node DMC calculations that might appear with the use of effective core potentials (ECPs) or other nonlocal operators. This is especially relevant for the recently introduced correlation consistent ECPs (ccECPs) for 2s2p elements. Corresponding ccECPs exhibit deeper potential functions due to higher fidelity to all-electron counterparts, which could lead to larger local energy fluctuations. We point out that the difficulties stem from issues that are straightforward to address by upgrades of basis sets, use of T-moves for nonlocal terms, inclusion of a few configurations into the trial function and similar. The resulting accuracy corresponds to the ccECP target (chemical accuracy) and it is in consistent agreement with independent correlated calculations. Further possibilities for upgrading the reliability of the DMC algorithm and considerations for better adapted and more robust Jastrow factors are discussed as well.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Evaluating the benefits of kinetic Monte Carlo and microkinetic modeling for catalyst design studies in the presence of lateral interactions

Popular computational catalyst design strategies rely on the identification of reactivity descriptors, which can be used along with Brønsted–Evans–Polanyi (BEP) and scaling relations as input to a microkinetic model (MKM) to make predictions for activity or selectivity trends. The main benefit of this approach is related to the inherent dimensionality reduction of the large material space to just a few catalyst descriptors. Conversely, it is well documented that a small set of descriptors is insufficient to capture the intricacies and complexities of a real catalytic system. The inclusion of coverage effects through lateral adsorbate-adsorbate interactions can narrow the gap between simplified descriptor predictions and real systems, but mean-field MKMs cannot properly account for local coverage effects. This shortcoming of the mean-field approximation can be rectified by switching to a lattice-based kinetic Monte Carlo (kMC) method using cluster expansion representation of adsorbate–adsorbate lateral interactions. Using the prototypical CO oxidation reaction as an example, we critically evaluate the benefits of kMC over MKM in terms of trend predictions and computational cost when using only a small set of input parameters. After confirming that in the absence of lateral interactions the kMC and MKM approaches yield identical trends and mechanistic information, we observed substantial differences between the two kinetic models when lateral interactions were introduced. Here, the mean-field implementation applies coverage corrections directly to the descriptors, causing an artificial overprediction of the activity of strongly binding metals. In contrast, the cluster expansion in kMC implementation can differentiate among the highly active metals but it is very sensitive to the set of included interaction parameters. Considering that computational screening relies on a minimal set of descriptors, for which MKM makes reasonable trend predictions at a ca. three orders of magnitude lower computational cost than kMC, the MKM approach does provide a better entry point for computational catalyst design.

36 MATERIALS SCIENCE↗

A deep learning approach to fast analysis of collective Thomson scattering spectra

Fast analysis of collective Thomson scattering ion acoustic wave features using a deep convolutional neural network model is presented. The network was trained from spectra to predict the plasma parameters, including ion velocities, population fractions, and ion and electron temperatures. A fully kinetic particle-in-cell simulation was used to model a laboratory astrophysics experiment and simulate a diagnostic image of the ion acoustic wave feature. Network predictions were compared with Bayesian inference of the plasma model parameters for both the simulated and experimentally measured images. Both approaches were fairly accurate predicting the simulated image and the network predictions matched a good portion of the Bayesian results for the experimentally measured image. The Bayesian approach is more robust to noise and motivates future work to train deep learning models with realistic noise. The advantage of the deep learning model is making thousands of predictions in a few hundred milliseconds, compared to a few seconds to minutes per prediction for the optimization and Bayesian approaches presented here. The results demonstrate promising capabilities of deep learning models to analyze Thomson data orders of magnitude faster than conventional methods when using the neural network for standalone analysis. If more rigorous analysis is needed, neural network predictions can be used to quickly initialize other optimization methods and increase chances of success. This is especially useful when the dataset becomes very large or highly dimensional and manually refining initial conditions for the entire dataset are no longer tractable.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Computing the Paschen curve for argon with speed-limited particle-in-cell simulation

Upon inclusion of collisions, the speed-limited particle-in-cell (SLPIC) simulation method successfully computed the Paschen curve for argon. The 1D3V simulations modeled an electron cascade across an argon-filled capacitor, including electron-neutral ionization, electron-neutral elastic collisions, electron-neutral excitation, and ion-induced secondary electron emission. In electrical breakdown, the timescale difference between ion and electron motion makes traditional PIC methods computationally slow. To decrease this timescale difference and speed up computation, here we used SLPIC, a time-domain algorithm that limits the speed of the fastest electrons in the simulation. The SLPIC algorithm facilitates a straightforward, fully kinetic treatment of dynamics and collisions. SLPIC was as accurate as PIC, but ran up to 200 times faster. SLPIC accurately computed the Paschen curve for argon over three orders of magnitude in pressure.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Correlation effects on coupled electronic and structural properties of doped rare-earth trihydrides

Rare-earth trihydride (𝑅⁢H 3 ) compounds exhibit intriguing coupled electronic and structural properties as a function of doping, hydrogen vacancies, and thermodynamic conditions. Theoretical studies of these materials typically rely on density functional theory (DFT), including the use of small supercells that may underestimate strong correlation effects and structural distortions which in turn may influence their metallicity. Here, we elucidate the roles of lattice distortions and correlation effects on the electronic properties of pristine and doped 𝑅⁢H 3 compounds by adopting DFT +U and quantum Monte Carlo (QMC) methods. Linear-response constrained DFT (LR-cDFT) methods find Hubbard U ≈ 2 eV for 𝑅 𝑑 orbitals and U ≈ 6 eV for H 𝑠 ⁡/N 𝑝 /O 𝑝 orbitals. The small U on Lu 𝑑 orbitals is consistent with QMC calculations on LuH 3 and LuH 2.875 ⁢N 0.125 . In pure face-centered-cubic (FCC) 𝑅⁢H 3 (𝑅 = Lu,Y) compounds, neither DFT nor DFT +U with the self-consistently determined U is enough to create a band gap, however a supercell with hydrogen distortions creates a small gap whose magnitude increases when performing DFT +U with self-consistently determined U values. Furthermore, correlation effects, in turn, have a moderate influence on the coupled structural and electronic properties of doped 𝑅⁢H 3 compounds and may be important when considering the competition between structural distortions and superconductivity.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

An explicitly solvable energy-conserving algorithm for pitch-angle scattering in magnetized plasmas

In this work, we develop an Explicitly Solvable Energy-Conserving (ESEC) algorithm for the Stochastic Differential Equation (SDE) describing the pitch-angle scattering process in magnetized plasmas. The Cayley transform is used to calculate both the deterministic gyromotion and stochastic scattering, affording the algorithm to be explicitly solvable and exactly energy conserving. An unusual property of the SDE for pitch-angle scattering is that its coefficients diverge at the zero velocity and do not satisfy the global Lipschitz condition. Consequently, when standard numerical methods, such as the Euler-Maruyama (EM), are applied, numerical convergence is difficult to establish. For the proposed ESEC algorithm, its energy-preserving property enables us to overcome this obstacle. We rigorously prove that the ESEC algorithm is order 1/2 strongly convergent. This result is confirmed by detailed numerical studies. For the case of pitch-angle scattering in a magnetized plasma with a constant magnetic field, the numerical solution is benchmarked against the analytical solution, and excellent agreements are found.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

An all-digital associated particle imaging system for the 3D determination of isotopic distributions

Associated particle imaging (API) is a non-destructive nuclear technique for the 3D determination of isotopic distributions. By detecting the alpha particle associated with the emitted neutron in the deuterium–tritium fusion reaction with a position- and time-resolving detector, the direction of the 14.1 MeV neutron and its time of emission can be determined. Employing this method, isotope characteristic gamma rays emitted in inelastic neutron scattering events can be correlated with the neutron interaction location. Here, an API system consisting of a sealed-type neutron generator, gamma detectors, and a position-sensitive alpha detector was designed, constructed, and characterized. The system was tested with common soil elements and shown to be sensitive to 12 C, 16 O, 28 Si, 27 Al, and 56 Fe. New aspects of our approach are the use of a yttrium–aluminum–perovskite scintillator, using a sapphire window instead of a fiber-optic faceplate for light transport to the photomultiplier, and the all-digital data acquisition system. We present a description of the system with simulations and experimental results that show a position resolution on the alpha detector of 1 mm, a depth resolution using a LaBr 3 detector of 6.2 cm, and an angular resolution of 4.5°. Additionally, we present single-element gamma response measurements for the elements mentioned above together with a comparison to Monte Carlo simulations (MCNP6).

47 OTHER INSTRUMENTATION↗

Scalable Risk Assessment of Rare Events in Power Systems With Uncertain Wind Generation and Loads

Risk assessment of rare events has become increasingly important in power system planning and operation with the increasing integration of renewable energy and the presence of system uncertainties. However, quantifying the risk posed by rare events via the traditional method, i.e., Monte Carlo sampling (MCS), incurs substantial computational expense stemming from the vast ensemble of power flow simulations. To accelerate the assessment, this paper proposes a Deep Neural Network (DNN)-kernelized vector-valued Gaussian Process (VVGP) approach with excellent computational efficiency while maintaining high accuracy. Consequently, serving as a surrogate model for the power flow solver, the DNN-kernelized VVGP enables significantly faster but accurate risk assessment compared to the power flow solver. The developed surrogate model evaluates low-order N - k events that contain more than 90% instances by adeptly capturing the topological features while the high-order N - k events are assessed via a power flow solver, thereby striking a balance between computational efficiency and uncertainty quantification accuracy. Moreover, the model incorporates a Support Vector Machine (SVM) classifier to resample concerning low-probability tail events to counteract the biases potentially introduced during the DNN-kernelized VVGP evaluations. Simulations conducted on the modified IEEE 24-bus, 118-bus, and European 1354-bus systems demonstrate that the proposed method maintains the accuracy benchmark set by MCS while significantly reducing computational demands in large-scale power systems as compared to other state-of-the-art methods.

17 WIND ENERGY↗