Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “rejection sampling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Rejection Sampling with Autodifferentiation -- Case study: Fitting a Hadronization Model

We present an autodifferentiable rejection sampling algorithm termed Rejection Sampling with Autodifferentiation (RSA). In conjunction with reweighting, we show that RSA can be used for efficient parameter estimation and model exploration. Additionally, this approach facilitates the use of unbinned machine-learning-based observables, allowing for more precise, data-driven fits. To showcase these capabilities, we apply an RSA-based parameter fit to a simplified hadronization model.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Adjoint Klein-Nishina Sampling Methods: Efficiency, Speed and Applications

Three new rejection sampling methods for generating samples from the adjoint Klein-Nishina cross section are discussed: the two-branch rejection sampling procedure, the three-branch linear rejection sampling procedure and the three-branch inverse rejection sampling procedure. These methods have all been implemented in the Framework for REsearch in Nuclear ScIence and Engineering (FRENSIE). The efficiency and sample generation rate of each of these methods are evaluated to characterize the methods and to make recommendations regarding their use. The use of these methods in realistic transport simulations is also evaluated by incorporating a scattering function into the sampling process. Furthermore, the results of an infinite medium problem are presented to verify that the sampling procedure can be used in an adjoint Monte Carlo simulation to generate results that are in agreement with an equivalent forward simulation.

97 MATHEMATICS AND COMPUTING↗

Deterministic Linear Time for Maximal Poisson‐Disk Sampling using Chocks without Rejection or Approximation

Abstract We show how to sample uniformly within the three‐sided region bounded by a circle, a radial ray, and a tangent, called a “chock.” By dividing a 2D planar rectangle into a background grid, and subtracting Poisson disks from grid squares, we are able to represent the available region for samples exactly using triangles and chocks. Uniform random samples are generated from chock areas precisely without rejection sampling. This provides the first implemented algorithm for precise maximal Poisson‐disk sampling in deterministic linear time. We prove O(n · M(b) log b), where n is the number of samples, b is the bits of numerical precision and M is the cost of multiplication. Prior methods have higher time complexity, take expected time, are non‐maximal, and/or are not Poisson‐disk distributions in the most precise mathematical sense. We fill this theoretical lacuna.

Mitchell, Scott A.↗

Evaluation of Naturally Occurring Be-7 Activity on LANL Stack Filter Clumps

Los Alamos National Laboratory (LANL) is responsible for providing solutions to challenging issues through multidisciplinary science, engineering, and technology that impact national security. As part of the Radioactive Air Emissions Management (RAEM) Team, it is our responsibility to ensure LANL operates within the requirements of the Code of Federal Regulations 40 CFR 61, Subpart H, National Emission Standards for Emissions of Radionuclides Other Than Radon From Department of Energy Facilities (Rad-NESHAP). The standard states, “Emissions of radionuclides to the ambient air from Department of Energy facilities shall not exceed those amounts that would cause any member of the public to receive in any year an effective dose equivalent of 10 mrem/yr” (EPA, 2002) During a routine assessment of LANL’s Rad-NESHAP compliance program, an opportunity for improvement was identified that addresses the evaluation of routine stack samples which potentially have naturally occurring radioactive materials (NORM) on the filter media. In the past and based on professional judgment, detections of NORM such as K-40 and Be-7 typically were rejected from the analytical results. The assessment finding suggested developing a technical criterion to ensure that such rejections were justified, comparing actual measured values with anticipated NORM concentrations for various stacks located at LANL. The significance of accepting or rejecting samples as “true” or “NORM” and its impact on the RAEM’s mission and compliance to the regulations is explained later in the document. Additionally, this document will describe the process and calculations for how such results are to be accepted as actual samples “true positive” or rejected as NORM.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Resonance Scattering Treatment with the Windowed Multipole Formalism

A new method for directly sampling the resonance upscattering effect is presented. Alternatives have relied on inefficient rejection sampling techniques or large tabular storage of relative velocities. None of these approaches, which require pointwise energy data, are particularly well suited to the windowed multipole cross-section representation. The new method, called multipole analytic resonance scattering, overcomes these limitations by inverse transform sampling from the target relative velocity distribution where the cross section is expressed in the multipole formalism. The closed-form relative speed distribution contains a novel special function we deem the incomplete Faddeeva function, and we present the first results on its efficient numerical evaluation.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

CORRLA-RS

The CORRLA-RS package provides a suite of statistical methods for sampling multidimensional distributions and to conduct sensitivity and correlation analysis of large scale data in the Rust programming language. The software provides a unique solution to multidimensional constrained sampling problems utilizing a combination of parallelized Markov Chain Monte Carlo methods and traditional rejection sampling. The sensitivity and correlation analysis methods are backed by a high performance randomized singular value decomposition implementation which enables datasets larger than the random access memory (RAM) size to be analyzed. Additionally, CORRLA-RS implements the active subspace identification method using a KD-Tree and the randomized singular value decomposition acting in concert.

Gurecky, William [Oak Ridge National Laboratory (O↗

Adjoint DSMC for nonlinear spatially-homogeneous Boltzmann equation with a general collision model

We derive an adjoint method for the Direct Simulation Monte Carlo (DSMC) method for the spatially homogeneous Boltzmann equation with a general collision law. This generalizes our previous results in Caflisch et al., which was restricted to the case of Maxwell molecules, for which the collision rate is constant. The main difficulty in generalizing the previous results is that a rejection sampling step is required in the DSMC algorithm in order to handle the variable collision rate. We find a new term corresponding to the so-called score function in the adjoint equation and a new adjoint Jacobian matrix capturing the dependence of the collision parameter on the velocities. The new formula works for a much more general class of collision models.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Hyperparameter Setting for a Marked Multidimensional Hawkes Process with Dissimilar Decays

We provide further details for using Lim, et al.'s marked multidimensional Hawkes processes with dissimilar decays. We first describe what makes these different from other Hawkes processes, then describe each model hyperparameter and how to initialize it informed by the input data and any prior biases. We derived tighter bounds than Lim, et al. for faster convergence of rejection sampling. The resulting hyperparameters and bounds have been helpful against both synthetic and real-world datasets.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

nautilus : boosting Bayesian importance nested sampling with deep learning

ABSTRACT We introduce a novel approach to boost the efficiency of the importance nested sampling (INS) technique for Bayesian posterior and evidence estimation using deep learning. Unlike rejection-based sampling methods such as vanilla nested sampling (NS) or Markov chain Monte Carlo (MCMC) algorithms, importance sampling techniques can use all likelihood evaluations for posterior and evidence estimation. However, for efficient importance sampling, one needs proposal distributions that closely mimic the posterior distributions. We show how to combine INS with deep learning via neural network regression to accomplish this task. We also introduce nautilus, a reference open-source python implementation of this technique for Bayesian posterior and evidence estimation. We compare nautilus against popular NS and MCMC packages, including emcee, dynesty, ultranest, and pocomc, on a variety of challenging synthetic problems and real-world applications in exoplanet detection, galaxy SED fitting and cosmology. In all applications, the sampling efficiency of nautilus is substantially higher than that of all other samplers, often by more than an order of magnitude. Simultaneously, nautilus delivers highly accurate results and needs fewer likelihood evaluations than all other samplers tested. We also show that nautilus has good scaling with the dimensionality of the likelihood and is easily parallelizable to many CPUs.

97 MATHEMATICS AND COMPUTING↗

Time-Gated Raman Spectroscopy (Intern Final Report)

Time-gated Raman spectroscopy is a powerful tool for rapid non-destructive analysis of chemical compounds, particularly when combined with other investigative methods. Time-gating the signal obtained from a sample during Raman spectroscopy allows for the removal of background emission and black body radiation, improving clarity and accuracy of scans. The main objectives of this project were to prove the lab’s time-gated Raman spectroscopy system works as proof of concept and to make select improvements to the in-house LabVIEW software used to run the time-gated system. This time-gated system will be added to the CTK’s TAP reactors in the future, but this is out of the scope of this internship project. This research is important, as understanding the mechanisms behind catalysts leads to designing better systems/materials and the perfection of catalysts, and energy-efficient chemical manufacturing is key when designing a greener future. The research for this project was done with samples at both ambient conditions in sample holders and at operando conditions (i.e., high temperature, unsteady-state) inside a small-volume chemical reactor. Numerous spectro-kinetic scans of the catalysts were obtained, but the advanced dynamics of these systems are still being interpreted. There is data that demonstrates that the time-gated system is correctly rejecting emission from samples, and one can observe real-time changes in the signal from the sample, due to coking or changes induced by redox chemistry. Chemical manufacturers and the planet are the main beneficiaries of catalysis research, as better catalysts will reduce carbon emissions.

36 MATERIALS SCIENCE↗

Performance of reverse osmosis membrane with large feed pressure fluctuations from a wave-driven desalination system

Wave-driven desalination systems are proposed water treatment systems that involve reverse osmosis of seawater powered directly by wave motion. Such a configuration would result in drastic feed pressure fluctuations. For a technology conventionally operated with a constant feed condition, the effect of these variable pressures on membrane integrity and performance is unknown. Here, experiments were conducted with spiral wound membranes coupled to a system capable of producing feed pressure fluctuations of more than 400 psi. Feed composition included 5, 20, and 35 g/L NaCl, and a synthetic seawater at normal and 1.5x concentration. The variable feed conditions included sine-like pressure waves swings of 200-500 and 500-900 psi with frequencies of 1.25, 7.5, and 12 waves/min, and a model-generated random waveform. Between each wave experiment we performed membrane integrity tests at 650 psi and 25 g/L NaCl feed, which showed a 7.4% drop in the membrane's water permeability coefficient, an 18.4% flux decline, and more than 99% salt rejection over 1770 h of cumulative experimental time. Analysis of permeate samples showed high salt rejection. In general, variable feed pressure had no significant deleterious effect on membrane integrity or performance.

16 TIDAL AND WAVE POWER↗

ATLAS flavour-tagging algorithms for the LHC Run 2 $pp$ collision dataset

The flavour-tagging algorithms developed by the ATLAS Collaboration and used to analyse its dataset of $\sqrt{s}$ = 13 TeV $pp$ collisions from Run 2 of the Large Hadron Collider are presented. These new tagging algorithms are based on recurrent and deep neural networks, and their performance is evaluated in simulated collision events. These developments yield considerable improvements over previous jet-flavour identification strategies. At the 77% $b$-jet identification efficiency operating point, light-jet (charm-jet) rejection factors of 170 (5) are achieved in a sample of simulated Standard Model $t\bar{t}$ events; similarly, at a $c$-jet identification efficiency of 30%, a light-jet ($b$-jet) rejection factor of 70 (9) is obtained.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Measuring Equality in Machine Learning Security Defenses: A Case Study in Speech Recognition

Over the past decade, the machine learning security community has developed a myriad of defenses for evasion attacks. An understudied question in that community is: for whom do these defenses defend? This work considers common approaches to defending learned systems and how security defenses result in performance inequities across different sub-populations. We outline appropriate parity metrics for analysis and begin to answer this question through empirical results of the fairness implications of machine learning security methods. We find that many methods that have been proposed can cause direct harm, like false rejection and unequal benefits from robustness training. The framework we propose for measuring defense equality can be applied to robustly trained models, preprocessing-based defenses, and rejection methods. We identify a set of datasets with a user-centered application and a reasonable computational cost suitable for case studies in measuring the equality of defenses. In our case study of speech command recognition, we show how such adversarial training and augmentation have non-equal but complex protections for social subgroups across gender, accent, and age in relation to user coverage. We present a comparison of equality between two rejection-based defenses: randomized smoothing and neural rejection, finding randomized smoothing more equitable due to the sampling mechanism for minority groups. This represents the first work examining the disparity in the adversarial robustness in the speech domain and the fairness evaluation of rejection-based defenses.

• Artificial intelligence (AI) / machine learning ↗

Variable resolution Poisson-disk sampling for meshing discrete fracture networks

Here, we present the near-Maximal Algorithm for Poisson-disk Sampling (nMAPS) to generate point distributions for variable resolution Delaunay triangular and tetrahedral meshes in two and three-dimensions, respectively. nMAPS consists of two principal stages. In the first stage, an initial point distribution is produced using a cell-based rejection algorithm. In the second stage, holes in the sample are detected using an efficient background grid and filled in to obtain a near-maximal covering. Extensive testing shows that nMAPS generates a variable resolution mesh in linear run time with the number of accepted points. We demonstrate nMAPS capabilities by meshing three-dimensional discrete fracture networks (DFN) and the surrounding volume. The discretized boundaries of the fractures, which are represented as planar polygons, are used as the seed of 2D-nMAPS to produce a conforming Delaunay triangulation. The combined mesh of the DFN is used as the seed for 3D-nMAPS, which produces conforming Delaunay tetrahedra surrounding the network. Under a set of conditions that naturally arise in maximal Poisson-disk samples and are satisfied by nMAPS, the two-dimensional Delaunay triangulations are guaranteed to only have well-behaved triangular faces. While nMAPS does not provide triangulation quality bounds in more than two dimensions, we found that low-quality tetrahedra in 3D are infrequent, can be readily detected and removed, and a high-quality balanced mesh is produced.

97 MATHEMATICS AND COMPUTING↗

The Dark Energy Survey supernova program: cosmological biases from supernova photometric classification

ABSTRACT Cosmological analyses of samples of photometrically identified type Ia supernovae (SNe Ia) depend on understanding the effects of ‘contamination’ from core-collapse and peculiar SN Ia events. We employ a rigorous analysis using the photometric classifier SuperNNova on state-of-the-art simulations of SN samples to determine cosmological biases due to such ‘non-Ia’ contamination in the Dark Energy Survey (DES) 5-yr SN sample. Depending on the non-Ia SN models used in the SuperNNova training and testing samples, contamination ranges from 0.8 to 3.5 per cent, with a classification efficiency of 97.7–99.5 per cent. Using the Bayesian Estimation Applied to Multiple Species (BEAMS) framework and its extension BBC (‘BEAMS with Bias Correction’), we produce a redshift-binned Hubble diagram marginalized over contamination and corrected for selection effects, and use it to constrain the dark energy equation-of-state, w. Assuming a flat universe with Gaussian ΩM prior of 0.311 ± 0.010, we show that biases on w are <0.008 when using SuperNNova, with systematic uncertainties associated with contamination around 10 per cent of the statistical uncertainty on w for the DES-SN sample. An alternative approach of discarding contaminants using outlier rejection techniques (e.g. Chauvenet’s criterion) in place of SuperNNova leads to biases on w that are larger but still modest (0.015–0.03). Finally, we measure biases due to contamination on w0 and wa (assuming a flat universe), and find these to be <0.009 in w0 and <0.108 in wa, 5 to 10 times smaller than the statistical uncertainties for the DES-SN sample.

79 ASTRONOMY AND ASTROPHYSICS↗

Novel data analysis method for obtaining better performance from a complex 3D-printed collimator

Additively manufactured scattered beam collimators are increasingly being employed to boost the sample to cell peak signal ratio in high pressure neutron diffraction studies because of manufacturing versatility and performance improvements. We study how the measured diffraction pattern is affected by the presence of a collimator downstream of the sample, and develop a novel protocol that provides more effective background rejection. This protocol takes into account critical performance-determinants that were identified in this study, namely: (i) effectively identifying the collimator pattern on the detector; (ii) understanding the dependence of this pattern on sample and cell composition; and (iii) accurately identifying and differentiating the different regions of the pattern on the detector based on the dependency of the cell or sample and finally (iv) resolving the intensities at regions of the detector where neutrons scattered from the sample are preferentially represented, in order to boost the sample to cell peak signal ratio. Application of this novel analysis protocol is shown to increase the collimator performance over the traditional method.

3D printing↗