Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Monte Carlo”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

A parallel evolutionary multiple-try metropolis Markov chain Monte Carlo algorithm for sampling spatial partitions

We develop an Evolutionary Markov Chain Monte Carlo (EMCMC) algorithm for sampling spatial partitions that lie within a large, complex, and constrained spatial state space. Our algorithm combines the advantages of evolutionary algorithms (EAs) as optimization heuristics for state space traversal and the theoretical convergence properties of Markov Chain Monte Carlo algorithms for sampling from unknown distributions. Local optimality information that is identified via a directed search by our optimization heuristic is used to adaptively update a Markov chain in a promising direction within the framework of a Multiple-Try Metropolis Markov Chain model that incorporates a generalized Metropolis-Hastings ratio. We further expand the reach of our EMCMC algorithm by harnessing the computational power afforded by massively parallel computing architecture through the integration of a parallel EA framework that guides Markov chains running in parallel.

97 MATHEMATICS AND COMPUTING↗

Variational Monte Carlo calculations of n + H 3 scattering

A paramount goal in nuclear physics is to unify ab initio treatments of bound and unbound states. The position-space quantum Monte Carlo (QMC) methods have a long history of successful bound-state calculations in light systems but have seen minimal implementation in unbound systems. Here, we introduce a numerical method to improve the efficiency and accuracy of unbound-state calculations in QMC. As an initial application, we compute scattering observables for the smallest system available to probe three-body forces, the neutron-triton system, using variational Monte Carlo (VMC) wave functions. The method involves inferring long-range amplitudes in the wave function from integrals over the short-range region where all the particles interact. This approach using integral relations is well established in the literature; here, we develop it for the QMC framework. We validate our approach with a consistency check between short-range spectroscopic overlap functions computed from direct evaluation and from the integral relations; scattering amplitudes are long-range asymptotics of those overlaps. Comparison against published benchmark calculations using the same potential demonstrates that when applied to the current VMC wave functions, the integral method produces more accurate scattering observables than direct evaluation from the same variational wave function. However, it still differs noticeably from the exact results. Using additional interactions, we then present phase shifts and mixing parameters for the n + 3 H system. In particular, we present one of the first applications of the Norfolk family of local coordinate-space chiral potentials in unbound systems of A > 2. The Norfolk results accurately describe s-wave scattering but predict p-wave cross sections too large. Compared with previous QMC scattering calculations, the integral method avoids difficulties associated with the precise computation of energy differences and with convergence outside the interaction region, which is particularly severe in the variational calculation. Application of the integral method here paves the way for its use in Green's function Monte Carlo (GFMC) calculations. In GFMC, the wave functions are more accurate, but the high-precision convergence of their tails is slow, and there are additional difficulties in reading out amplitudes. Here, the integral methods will address both of those remaining problems.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Monte-Carlo Neutrino Transport in Neutron Star Merger Simulations

Gravitational waves and electromagnetic signals from merging neutron star binaries provide valuable information about the the properties of dense matter, the formation of heavy elements, and high-energy astrophysics. To fully leverage observations of these systems, we need numerical simulations that provide reliable predictions for the properties of the matter unbound in these mergers. An important limitation of current simulations is the use of approximate methods for neutrino transport that do not converge to a solution of the transport equations as numerical resolution increases, and thus have errors that are impossible to quantify. Here, we report on a first simulation of a binary neutron star merger that directly solves the transport equations using Monte-Carlo techniques. We demonstrate that a computationally cheap Monte-Carlo transport can be implemented without ill effects from sampling noise. We apply Monte-Carlo transport to an unequal mass neutron star binary merger up to 5ms past merger, and report on the properties of the matter and neutrino outflows. Finally, we compare our results to the output of our best approximate `M1' transport scheme, demonstrating that an M1 scheme that carefully approximates the neutrino energy spectrum only leads to ~10% uncertainty in the composition and velocity of the ejecta, and ~20% uncertainty in the electron (anti)neutrino luminosities and energies. Here, the most significant disagreement found between M1 and Monte-Carlo results is a factor of ~2 difference in the luminosity of heavy-lepton neutrinos.

79 ASTRONOMY AND ASTROPHYSICS↗

Challenges in Markov Chain Monte Carlo for Bayesian Neural Networks

Markov chain Monte Carlo (MCMC) methods have not been broadly adopted in Bayesian neural networks (BNNs). This paper initially reviews the main challenges in sampling from the parameter posterior of a neural network via MCMC. Such challenges culminate to lack of convergence to the parameter posterior. Nevertheless, this paper shows that a nonconverged Markov chain, generated via MCMC sampling from the parameter space of a neural network, can yield via Bayesian marginalization a valuable posterior predictive distribution of the output of the neural network. Further, classification examples based on multilayer perceptrons showcase highly accurate posterior predictive distributions. The postulate of limited scope for MCMC developments in BNNs is partially valid; an asymptotically exact parameter posterior seems less plausible, yet an accurate posterior predictive distribution is a tenable research avenue.

97 MATHEMATICS AND COMPUTING↗

Derivation of the Future Time Equation for Analog, Non-Multiplying Monte Carlo Simulation

The expected computational time required to simulate a particle from a point in phase space through a Monte Carlo history, termed the expected future time, is found by solving the Future Time Equation (FTE). The expected future time may be useful when generating variance reduction parameters for a Monte Carlo simulation with a method such as Consistent Adjoint Driven Importance Sampling (CADIS). This report presents a detailed derivation of the Future Time Probability Density Function (FTPDF) and FTE for neutral particle Monte Carlo transport to aid future researchers. For simplicity, this derivation only considers analog transport in non-multiplying media.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Training neural networks using Metropolis Monte Carlo and an adaptive variant

Abstract We examine the zero-temperature Metropolis Monte Carlo (MC) algorithm as a tool for training a neural network by minimizing a loss function. We find that, as expected on theoretical grounds and shown empirically by other authors, Metropolis MC can train a neural net with an accuracy comparable to that of gradient descent (GD), if not necessarily as quickly. The Metropolis algorithm does not fail automatically when the number of parameters of a neural network is large. It can fail when a neural network’s structure or neuron activations are strongly heterogenous, and we introduce an adaptive Monte Carlo algorithm (aMC) to overcome these limitations. The intrinsic stochasticity and numerical stability of the MC method allow aMC to train deep neural networks and recurrent neural networks in which the gradient is too small or too large to allow training by GD. MC methods offer a complement to gradient-based methods for training neural networks, allowing access to a distinct set of network architectures and principles.

97 MATHEMATICS AND COMPUTING↗

High Accuracy Transition Metal Effective Cores for the Many-Body Diffusion Monte Carlo Method

Practical applications of the real-space diffusion Monte Carlo (DMC) method require the removal of core electrons, where currently localization approximations of semilocal potentials are generally used in the projector. Accurate calculations of complex solids and large molecules demand minimizing the impact of approximated atomic cores. Prior works have shown that the errors from such approximations can be sizable in both finite and periodic systems. In this work, we show that a class of differential pseudopotentials, known as pseudo-Hamiltonians, can be constructed for the 3d transition metal atoms, entirely removing the need for any localization scheme in the DMC projector. As a proof of principle, we demonstrate the approach for the case of Co. In order to minimize errors in the pseudo-Hamiltonian at the many-body level, we generalize the recently proposed correlation-consistent pseudopotential generation scheme to successively close semilocal representations of the differential potentials. Our generation scheme successfully produces potentials tailored specifically for real space projector quantum Monte Carlo methods with low error at the many-body level, i.e., with many-body scattering properties very close to relativistic all-electron results. In particular, we show that the agreement with respect to atomic and molecular quantities reach chemical accuracy in many cases-on par with the most accurate semilocal pseudopotentials available. Further, our pseudo-Hamiltonian generation scheme utilizes standard quantum chemistry codes designed only to work with semilocal pseudopotentials, enabling straightforward generation of pseudo-Hamiltonians for additional elements in future works.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Enhancing Monte Carlo Workflows for Nuclear Reactor Analysis with Metamodel-Driven Modeling

Monte Carlo codes are essential components of many reactor physics simulation workflows as high-fidelity continuous-energy neutron transport solvers. Among Monte Carlo radiation transport codes, MCNP is particularly notable due to its diverse simulation capabilities, large user base, and long validation history. Despite being a powerful simulation tool, MCNP provides limited capabilities to allow automated execution, model transformation, or support for user-defined logic and abstractions that limit its compatibility with modern workflows. Here, to better integrate MCNP into a modern scientific workflow, we have developed an intuitive yet full-featured MCNP Application Program Interface (API) in Python, named MCNPy, which provides a specialized set of classes for MCNP input development. Moreover, to guarantee that our reading, writing, and modeling capabilities remain self-consistent (and to render the huge scope of the MCNP API manageable), we have adopted a strategy of model-driven software development in which a generalized model of the MCNP input format has been created. From this generalized model, or “metamodel,” problem-specific implementations such as an engine for input validation or a codebase for programmatic operations may be automatically generated. Since MCNPy primarily acts as a Python front-end to the underlying Java API that directly interfaces with the metamodel, it is intrinsically linked to the metamodel and thus remains maintainable. With MCNPy, users can programmatically read, write, and modify any syntactically valid MCNP input file regardless of its origin. These capabilities allow users to automate complicated tasks like design optimization and model translation for nuclear systems. As examples, this work demonstrates the use of MCNPy to find the critical radius of a plutonium sphere and to translate a 9000+ line MCNP input file into a corresponding OpenMC model.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Reducing negative weights in Monte Carlo event generation with Sherpa

An increase in theoretical precision of Monte Carlo event generators is typically accompanied by an increased need for computational resources. One major obstacle are negative weighted events, which appear in Monte Carlo simulations with higher perturbative accuracy. While they can be handled somewhat easily in fixed-order calculations, they are a major concern for particle level event simulations. In this article, the origin of negative weights in the S-MC@NLO method is reviewed and mechanisms to reduce the negative weight fraction in simulations with the Sherpa event generator are presented, with a focus on V+jets and tt+jets simulations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Demonstration of Monte Carlo Reference Equilibrium Core Solutions for Pebble Bed Reactors Using Shift in kugelpy

This report describes how to produce reference solutions for the equilibrium core search of pebble bed reactors using the pyrates Python library. The pyrates library uses the kugelpy methodology to perform running-in calculations to reach an equilibrium core. This approach relies on full-core Monte Carlo neutron transport calculations and the shifting of fuel pebble inventory through the reactor to simulate pebble movement in the core from one step to the next of a running-in scenario. In addition to the use of Serpent for the Monte Carlo neutron transport calculations, as part of this work, updates for the use of the Shift Monte Carlo code were integrated into the official pyrates GitHub repository. Comparisons of running-in simulations for a generic pebble bed reactor produced by using pyrates with Serpent and Shift are shown. Although consistent trends are shown between the use of the two Monte Carlo codes, the limiting factor in either calculation is the computation time due to the need to perform several hundred full-core neutron transport calculations before an equilibrium core is reached.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Demonstration of Monte Carlo Reference Equilibrium Core Solutions for Pebble Bed Reactors Using Shift in kugelpy

This report describes how to produce reference solutions for the equilibrium core search of pebble bed reactors using the pyrates Python library. The pyrates library uses the kugelpy methodology to perform running-in calculations to reach an equilibrium core. This approach relies on full-core Monte Carlo neutron transport calculations and the shifting of fuel pebble inventory through the reactor to simulate pebble movement in the core from one step to the next of a running-in scenario. In addition to the use of Serpent for the Monte Carlo neutron transport calculations, as part of this work, updates for the use of the Shift Monte Carlo code were integrated into the official pyrates GitHub repository. Comparisons of running-in simulations for a generic pebble bed reactor produced by using pyrates with Serpent and Shift are shown. Although consistent trends are shown between the use of the two Monte Carlo codes, the limiting factor in either calculation is the computation time due to the need to perform several hundred full-core neutron transport calculations before an equilibrium core is reached.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Evaluation of the excitation spectra with diffusion Monte Carlo on an auxiliary bosonic ground state

We aim to improve upon the variational Monte Carlo (VMC) approach for excitations replacing the Jastrow factor by an auxiliary bosonic (AB) ground state and multiplying it by a fermionic component factor. The instantaneous change in imaginary time of an arbitrary excitation in the original interacting fermionic system is obtained by measuring observables via the ground-state distribution of walkers of an AB system that is subject to an auxiliary effective potential. The effective potential is used to (i) drive the AB system’s ground-state configuration space toward the configuration space of the excitations of the original fermionic system and (ii) subtract from a diffusion Monte Carlo (DMC) calculation contributions that can be included in conventional approximations, such as mean-field and configuration interaction (CI) methods. In this novel approach, the AB ground state is treated statistically in DMC, whereas the fermionic component of the original system is expanded in a basis. The excitation energies of the fermionic eigenstates are obtained by sampling a fermion–boson coupling term on the AB ground state. We show that this approach can take advantage of and correct for approximate eigenstates obtained via mean-field calculations or truncated interactions. We demonstrate that the AB ground-state factor incorporates the correlations missed by standard Jastrow factors, further reducing basis truncation errors. Relevant parts of the theory have been tested in soluble model systems and exhibit excellent agreement with exact analytical data and CI and VMC approaches. In particular, for limited basis set expansions and sufficient statistics, AB approaches outperform CI and VMC in terms of basis size for the same systems. The implementation of this method in current codes, despite being demanding, will be facilitated by reusing procedures already developed for calculating ground-state properties with DMC and excitations with VMC.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Quantum Monte Carlo benchmarking of large noncovalent complexes in the L7 benchmark set

We have used diffusion Monte Carlo (DMC) to perform calculations on the L7 benchmark set. DMC is a stochastic numerical integration scheme in real-space and part of a larger set of quantum Monte Carlo methods. The L7 set was designed to test the ability of electronic structure methods to include dispersive interactions. While the agreement between DMC and quantum-chemical state-of-the-art methods is excellent for some of the structures, there are significant differences in others. In contrast to wavefunction-based quantum chemical methods, DMC is a first-principle many-body method with the many-body wavefunction evolving in real space. It includes explicitly all electron–electron interactions and is relatively insensitive to the size of the basis set.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

The Impulse Approximation Scattering Function and Its Use in Monte Carlo Photon Transport Simulations

The viability of using the impulse approximation scattering function in Monte Carlo photon transport simulations is explored. This scattering function can be constructed from the double differential incoherent scattering cross section developed by Ribberfors and Berggren. A commonly used method for modeling photon Doppler broadening, which is referred to as the hybrid Doppler broadening method, can also be derived from this cross section. A new photon Doppler broadening method, called the consistent Doppler broadening method, is derived and discussed. This method eliminates some of the commonly employed approximations in the hybrid Doppler broadening method, in part, by using the impulse approximation scattering function. Integrated incoherent cross sections generated using the impulse approximation scattering function and the widely used Waller-Hartree scattering function are in good agreement above 20 keV. Below 20 keV, differences as high as 70% are observed, which differs from the roughly 5% differences observed by Ribberfors for some of the materials. Integral and spectral quantities for two problems are also generated using the Monte Carlo photon transport capabilities of the Framework for REsearch in Nuclear ScIence and Engineering (FRENSIE). Due to the small, relative result differences observed when using the impulse approximation scattering function, it is considered a viable alternative to the Waller-Hartree scattering function. In addition, some small, but expected, differences in spectral fluxes at low energies can be avoided by adopting the consistent Doppler broadening method.

42 ENGINEERING↗

Accelerating Ab Initio Simulation via Nested Monte Carlo and Machine Learned Reference Potentials

As a corollary of the rapid advances in computing, ab initio simulation is playing an increasingly important role in modeling materials at the atomic scale. Two strategies are possible, ab initio Monte Carlo (AIMC) and molecular dynamics (AIMD) simulation. The former benefits from exact sampling from the correct thermodynamic distribution, while the latter is typically more efficient with its collective all-atom coordinate updates. In this study, using a relatively simple test model comprised of helium and argon, we show that AIMC can be brought up to, and even above, the performance levels of AIMD via a hybrid nested sampling/machine learning (ML) strategy. Here, ML provides an accurate classical reference potential (up to three-body explicit interactions) that can pilot long collective Monte Carlo moves that are accepted or rejected in toto à la nested Monte Carlo (NMC); this is in contrast to the single move nature of a naive implementation. Our proposed method only requires a small up front expense from evaluating the ab initio energies and forces of (100) random configurations for training. Importantly, our method does not totally rely on the trained, assuredly imperfect, interaction. We show that high performance and exact sampling at the desired level of theory can be realized even when the trained interaction has appreciable differences from the ab initio potential. Remarkably, at the highest levels of performance realized via our approach, a pair of statistically uncorrelated atomic configurations can be generated with (1) ab initio calculations.

74 ATOMIC AND MOLECULAR PHYSICS↗

Neutronics Calculation Advances at Los Alamos: Manhattan Project to Monte Carlo

The history and advances of neutronics calculations at Los Alamos during the Manhattan Project through the present are reviewed. Substantial improvements to neutron diffusion methods and the invention of both the Monte Carlo neutron transport methods in 1947 and deterministic discrete ordinates Sn in 1953 were all made at Los Alamos just after the Manhattan Project. We briefly summarize early simpler and more approximate neutronics methods and then describe the need to better predict neutronics behavior through consideration of theoretical equations, models and algorithms, experimental measurements, and available computing capabilities and their limitations. This paper briefly covers key advances in deterministic methods during the Manhattan Project. These capabilities, coupled with increasing postwar defense needs and the invention of electronic computing with the Electronic Numeric Integrator and Computer, known as ENIAC, and the Mathematical Analyzer Numerical Integrator and Automatic Computer Model, known as MANIAC, led to the creation of Monte Carlo and deterministic discrete ordinates neutronics transport methods. We note the important role that the scientific comradery between the Los Alamos scientists played in the process. This paper briefly covers the early methods, algorithms, computers, and electronic and women pioneers that enabled Monte Carlo to spread to all areas of science. We focus heavily on these early developments and the subsequent creation of the MCNP® code, advances in its associated nuclear data, and its applications to problems of national defense at Los Alamos.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A variational Monte Carlo approach for core excitations

In this work, we present a systematically improvable approach to core excitations in variational Monte Carlo. Building on recent work in excited-state-specific Monte Carlo, we show how a straightforward protocol, starting from a quantum chemistry guess, is able to capture core state's strong orbital relaxations, maintain accuracy in the near-nuclear region during these relaxations, and explicitly balance accuracy between ground and core excited states. In water, ammonia, and methane, which serve as prototypical representatives for oxygen, nitrogen, and carbon core states, respectively, this approach predicts core excitation energies within 0.3 eV of experiment and core excitation peak separations within 0.1 eV of experiment.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Multi-fidelity microstructure-induced uncertainty quantification by advanced Monte Carlo methods

Quantifying uncertainty associated with the microstructure variation of a material can be a computationally daunting task, especially when dealing with advanced constitutive models and fine mesh resolutions in the crystal plasticity finite element method (CPFEM). Numerous studies have been conducted regarding the sensitivity of material properties and performance to the mesh resolution and choice of constitutive model. However, a unified approach that accounts for various fidelity parameters, such as mesh resolutions, integration time-steps and constitutive models simultaneously is currently lacking. Further, this paper proposes a novel uncertainty quantification (UQ) approach for computing the properties and performance of homogenized materials using CPFEM, that exploits a hierarchy of approximations with different levels of fidelity. In particular, we illustrate how multi-level sampling methods, such as multi-level Monte Carlo (MLMC) and multi-index Monte Carlo (MIMC), can be applied to assess the impact of variations in the microstructure of polycrystalline materials on the predictions of homogenized materials properties. We show that by adaptively exploiting the fidelity hierarchy, we can significantly reduce the number of microstructures required to reach a certain prescribed accuracy. Finally, we show how our approach can be extended to a multi-fidelity framework, where we allow the underlying constitutive model to be chosen from either a phenomenological plasticity model or a dislocation-density-based model.

36 MATERIALS SCIENCE↗