Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “sampling statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,153 records · Page 64
All sourcesNASA NTRSDOE OSTI
DOE OSTI2016

A lower bound on the number of cosmic ray events required to measure source catalogue correlations

Recent analyses of cosmic ray arrival directions have resulted in evidence for a positive correlation with active galactic nuclei positions that has weak significance against an isotropic source distribution. In this paper, we explore the sample size needed to measure a highly statistically significant correlation to a parent source catalogue. We compare several scenarios for the directional scattering of ultra-high energy cosmic rays given our current knowledge of the galactic and intergalactic magnetic fields. We find significant correlations are possible for a sample of >1000 cosmic ray protons with energies above 60 EeV.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

DCTRGAN: improving the precision of generative models with reweighting

Significant advances in deep learning have led to more widely used and precise neural network-based generative models such as Generative Adversarial Networks (Gans). We introduce a post-hoc correction to deep generative models to further improve their fidelity, based on the Deep neural networks using the Classification for Tuning and Reweighting (Dctr) protocol. The correction takes the form of a reweighting function that can be applied to generated examples when making predictions from the simulation. We illustrate this approach using Gans trained on standard multimodal probability densities as well as calorimeter simulations from high energy physics. We show that the weighted Gan examples significantly improve the accuracy of the generated samples without a large loss in statistical power. This approach could be applied to any generative model and is a promising refinement method for high energy physics applications and beyond.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

A composite likelihood approach for inference under photometric redshift uncertainty

ABSTRACT Obtaining accurately calibrated redshift distributions of photometric samples is one of the great challenges in photometric surveys like LSST, Euclid, HSC, KiDS, and DES. We present an inference methodology that combines the redshift information from the galaxy photometry with constraints from two-point functions, utilizing cross-correlations with spatially overlapping spectroscopic samples, and illustrate the approach on CosmoDC2 simulations. Our likelihood framework is designed to integrate directly into a typical large-scale structure and weak lensing analysis based on two-point functions. We discuss efficient and accurate inference techniques that allow us to scale the method to the large samples of galaxies to be expected in LSST. We consider statistical challenges like the parametrization of redshift systematics, discuss and evaluate techniques to regularize the sample redshift distributions, and investigate techniques that can help to detect and calibrate sources of systematic error using posterior predictive checks. We evaluate and forecast photometric redshift performance using data from the CosmoDC2 simulations, within which we mimic a DESI-like spectroscopic calibration sample for cross-correlations. Using a combination of spatial cross-correlations and photometry, we show that we can provide calibration of the mean of the sample redshift distribution to an accuracy of at least 0.002(1 + z), consistent with the LSST-Y1 science requirements for weak lensing and large-scale structure probes.

(cosmology:) large-scale structure of Universe↗
DOE OSTI2017

Optimized clustering estimators for BAO measurements accounting for significant redshift uncertainty

Here, we determine an optimized clustering statistic to be used for galaxy samples with significant redshift uncertainty, such as those that rely on photometric redshifts. To do so, we study the baryon acoustic oscillation (BAO) information content as a function of the orientation of galaxy clustering modes with respect to their angle to the line-of-sight (LOS). The clustering along the LOS, as observed in a redshift-space with significant redshift uncertainty, has contributions from clustering modes with a range of orientations with respect to the true LOS. For redshift uncertainty $\sigma_z \geq 0.02(1+z)$ we find that while the BAO information is confined to transverse clustering modes in the true space, it is spread nearly evenly in the observed space. Thus, measuring clustering in terms of the projected separation (regardless of the LOS) is an efficient and nearly lossless compression of the signal for $\sigma_z \geq 0.02(1+z)$. For reduced redshift uncertainty, a more careful consideration is required. We then use more than 1700 realizations (combining two separate sets) of galaxy simulations mimicking the Dark Energy Survey Year 1 sample to validate our analytic results and optimized analysis procedure. We find that using the correlation function binned in projected separation, we can achieve uncertainties that are within 10 per cent of those predicted by Fisher matrix forecasts. We predict that DES Y1 should achieve a 5 per cent distance measurement using our optimized methods. We expect the results presented here to be important for any future BAO measurements made using photometric redshift data.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

First-principles calculation of the configurational energy density of states for a solid-state ion conductor with a variant of the Wang and Landau algorithm

In this work, a variant of the Wang and Landau algorithm for calculation of the configurational energy density of states is proposed. The algorithm was developed for the purpose of using first-principles simulations, such as density functional theory, to calculate the partition function of disordered sublattices in crystal materials. The expensive calculations of first-principles methods make a parallel algorithm necessary for a practical computation of the configurational energy density of states within a supercell approximation of a solid-state material. The algorithm developed in this work is tested with the two-dimensional (2d) Ising model to bench mark the algorithm and to help provide insight for implementation to a materials science application. Tests with the 2d Ising model revealed that the algorithm has good performance compared to the original Wang and Landau algorithm and the 1/$\textit{t}$ algorithm, in particular the short iteration performance. Further, a proof of convergence is presented within an adiabatic assumption, and the analysis is able to correctly predict the time dependence of the modification factor to the density of states. The algorithm was then applied to the lithium and lanthanum sublattice of the solid-state lithium ion conductor Li 0.5 La 0.5 TiO 3 . This was done to help understand the disordered nature of the lithium and lanthanum. The results find, overall, that the algorithm performs very well for the 2d Ising model and that the results for Li 0.5 La 0.5 TiO 3 are consistent with experiment while providing additional insight into the lithium and lanthanum ordering in the material. The primary result is that the lithium and lanthanum become more mixed between layers along the c axis for increasing temperature. In part, the simulation of the disordered Li 0.5 La 0.5 TiO 3 system serves as a benchmark for what size systems are currently and in the near future practical to calculate with density functional theory methods.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2016

Nano-XRF Analysis of Metal Impurities Distribution at PL Active Grain Boundaries During mc-Silicon Solar Cell Processing

Metal impurities are known to hinder the performance of commercial Si-based solar cells by inducing bulk recombination, increasing leakage current, and causing direct shunting. Recently, a set of photoluminescence (PL) images of neighboring multicrystalline silicon wafers taken from a cell production line at different processing stages has been acquired. Both band-to-band PL and sub-bandgap PL (subPL) images showed various regions with different PL signal intensity. Interestingly, in several of these regions a reversal of the subPL intensity was observed right after the deposition of the antireflective coating. In this paper, we present the results of the synchrotron-based nano-X-ray fluorescence imaging performed in areas characterized by the subPL reversal to evaluate the possible role of metal decoration in this uncommon behavior. Furthermore, the acquisition of a statistically meaningful set of data for samples taken at different stages of the solar cell manufacturing allows us to shine a light on the precipitation and rediffusion mechanisms of metal impurities at these grain boundaries.

14 SOLAR ENERGY↗
DOE OSTI2012

Extreme winds at northern mid-latitudes since 1871

Studying a sufficiently large sample of extremes or analysing the statistics of their occurrence, including trends, is hampered by the length of the existing observation-based record. New data sets such as the Twentieth Century Reanalysis (20CR), which consists of an ensemble of 56 members, significantly extend our record back in time. In this paper, we present examples of extremes of winds at northern hemisphere mid-latitudes in 20CR to illustrate challenges and opportunities for analysing extremes over a longer period than previously possible. For four representative storms from Europe and North America, 20CR provides a relatively good depiction of the synoptic-scale meteorological development, although it misses smaller scale features as well as local effects due to orography. For analysing trends of extreme winds, it is shown that the individual ensemble members should be used, rather than the ensemble mean, which appears to be biased towards lower wind speeds early in the record. For the studied locations, decadal variability and trends can best be characterised after around 1950, when the ensemble variance remains consistent. Different methodological approaches for studying changes in extreme winds are discussed. Finally, we show hemispheric maps of trends in extreme wind speeds since 1950.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

TuckerMPI: A Parallel C++/MPI Software Package for Large-scale Data Compression via the Tucker Tensor Decomposition

With this study, our goal is compression of massive-scale grid-structured data, such as the multi-terabyte output of a high-fidelity computational simulation. For such data sets, we have developed a new software package called TuckerMPI, a parallel C++/MPI software package for compressing distributed data. The approach is based on treating the data as a tensor, i.e., a multidimensional array, and computing its truncated Tucker decomposition, a higher-order analogue to the truncated singular value decomposition of a matrix. The result is a low-rank approximation of the original tensor-structured data. Compression efficiency is achieved by detecting latent global structure within the data, which we contrast to most compression methods that are focused on local structure. In this work, we describe TuckerMPI, our implementation of the truncated Tucker decomposition, including details of the data distribution and in-memory layouts, the parallel and serial implementations of the key kernels, and analysis of the storage, communication, and computational costs. We test the software on 4.5 and 6.7 terabyte data sets distributed across 100 s of nodes (1,000 s of MPI processes), achieving compression ratios between 100 and 200,000×, which equates to 99--99.999% compression (depending on the desired accuracy) in substantially less time than it would take to even read the same dataset from a parallel file system. Moreover, we show that our method also allows for reconstruction of partial or down-sampled data on a single node, without a parallel computer so long as the reconstructed portion is small enough to fit on a single machine, e.g., in the instance of reconstructing/visualizing a single down-sampled time step or computing summary statistics. The code is available at https://gitlab.com/tensors/TuckerMPI.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

Polynomial Chaos–Based Bayesian Inference of K -Profile Parameterization in a General Circulation Model of the Tropical Pacific

The authors present a polynomial chaos (PC)–based Bayesian inference method for quantifying the uncertainties of the K-profile parameterization (KPP) within the MIT general circulation model (MITgcm) of the tropical Pacific. The inference of the uncertain parameters is based on a Markov chain Monte Carlo (MCMC) scheme that utilizes a newly formulated test statistic taking into account the different components representing the structures of turbulent mixing on both daily and seasonal time scales in addition to the data quality, and filters for the effects of parameter perturbations over those as a result of changes in the wind. To avoid the prohibitive computational cost of integrating the MITgcm model at each MCMC iteration, a surrogate model for the test statistic using the PC method is built. Because of the noise in the model predictions, a basis-pursuit-denoising (BPDN) compressed sensing approach is employed to determine the PC coefficients of a representative surrogate model. The PC surrogate is then used to evaluate the test statistic in the MCMC step for sampling the posterior of the uncertain parameters. Results of the posteriors indicate good agreement with the default values for two parameters of the KPP model, namely the critical bulk and gradient Richardson numbers; while the posteriors of the remaining parameters were barely informative.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Multislice forward modeling of coherent surface scattering imaging on surface and interfacial structures

To study nanostructures on substrates, surface-sensitive reflection-geometry scattering techniques such as grazing incident small angle X-ray scattering are commonly used to yield an averaged statistical structural information of the surface sample. Grazing incidence geometry can probe the absolute three-dimensional structural morphology of the sample if a highly coherent beam is used. Coherent surface scattering imaging (CSSI) is a powerful yet non-invasive technique similar to coherent X-ray diffractive imaging (CDI) but performed at small angles and grazing-incidence reflection geometry. A challenge with CSSI is that conventional CDI reconstruction techniques cannot be directly applied to CSSI because the Fourier-transform-based forward models cannot reproduce the dynamical scattering phenomenon near the critical angle of total external reflection of the substrate-supported samples. To overcome this challenge, we have developed a multislice forward model which can successfully simulate the dynamical or multi-beam scattering generated from surface structures and the underlying substrate. The forward model is also demonstrated to be able to reconstruct an elongated 3D pattern from a single shot scattering image in the CSSI geometry through fast-performing CUDA-assisted PyTorch optimization with automatic differentiation.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2018

24.1.3.3 Quarterly Report FY18 Q1

Here, we will develop an enhanced statistical framework to evaluate environmental swipe samples collected at nuclear facilities with the goal of identifying anomalies associated with potential undeclared activities. Our approach will be based on Bayesian methodology and time series analysis. This overall framework should result in a more cost effective and operationally effective approach to environmental swipe sample analysis and interpretation.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2024

Tools for Water Ingress Testing

The Safety Storage and Engineering Team, as part of the Production Support Services division (PSS-2), is tasked with ensuring the safety of containers used for handling and storage of nuclear materials. As part of this work, water ingress tests are conducted to evaluate the water-tightness of containers intended for in-glovebox use. In collaboration, the statistics group of the Computer and Computational Sciences Division (CCS-6) provided support in developing a statistically defensible approach for determining appropriate sample sizes for water ingress testing. Water ingress testing involves multiple measurements on multiple containers. Our approach uses a simple random effects model to analyze a pilot data set, implementing prediction limits to evaluate the efficacy of collecting additional data. Although this study capitalizes on available data, our approach can be used with estimates of the ratio of between and within variability and average values, often available from past testing or expert knowledge. An interactive Shiny tool was developed as a final user-friendly product for future testing. The Shiny interface is an open-source package providing a framework for building web applications. Raw data exploration and prediction interval-based sample size assessments can quickly be conducted by the engineering team without needing to interact with the underlying code.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Statistical Framework for Planning a Shelf Life Program with Binary Performance Data

This document outlines a statistical framework for establishing a shelf-life program for components whose performance is measured by a binary response, usually ‘pass’ or ‘fail.’ The approach applies to both single measurement devices and repeated measurement devices. The high-level objective of these plans is to quickly detect any sizeable increase in fraction defective as the product ages. The statistical approach is to choose a sample size and monitoring technique that alarms when the fraction defective increases to an unacceptably high level, but does not alarm when the process is at nominal. The nominal (acceptable) fraction defective is used, and an increased fraction defective (unacceptable) is assumed as part of the control chart design. The control chart recommended for this problem is the Bernoulli Cumulative Sum (CUSUM) control chart.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Closure models for the feedback of energetic particles on plasma turbulence

Energetic particles interact with the plasma surrounding them, resonating with certain types of plasma waves to stabilize them while destabilizing others, and changing the character of the background turbulence in ways that have not been fully quantified or understood. Interaction with the turbulent background plasma is key to the acceleration of many types of energetic particles including high-energy cosmic rays, solar energetic particles, and pick-up ions. The acceleration of particles is a process that would ideally be described by a kinetic model, a type of model that follows a probability distribution function (PDF) for all particles in 7-dimensional (x, y, z, v x , v y , v z , t) space. Because of the high dimensionality of a kinetic model, simulations that solve kinetic equations use the largest computational resources currently available, and are yet unable to simulate a realistic number of particles, reach the large scales necessary for astrophysical problems, and use high-precision numerical methods. Two available alternatives to kinetic plasma models have been explored for this problem, with limited success. One is a multi-fluid model produced by a cumulant discarding closure, which evolves coupled equations for the velocity, magnetic field, and internal energy for both the background plasma and the fluid of energetic particles. However, simulations that solve multi-fluid magnetohydrodynamic (MHD) equations are able to include the interaction with energetic particles only in crude ways, typically as an add-on pressure term. The second alternative is to use a hybrid method to couple a fluid description of the background plasma to a kinetic model or a Fokker–Planck model for the energetic particles. These methods are hampered by the physical modeling of the coupling. In this work, we develop a new model, which follows the PDF for all particles; this can be viewed as a step toward physical realism above a multi-fluid MHD model, while also being more computationally efficient than a kinetic model. The equations we develop model both the background plasma and the energetic particles self-consistently. Over the last decade, similar PDF methods have been developed to a high level of sophistication to model reactive flows and turbulent combustion for engineering applications. For treatment of the feedback of the energetic particles on a background plasma, a PDF closure approach should evaluate the mean characteristics, including the density, with better statistical quality than will particle-sampling procedures.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2018

Geometry tagging for heavy ions at JLEIC

Geometry tagging is an experimental analysis technique for selecting event samples where one can, on a statistical basis, control the geometry of the collision in order to make more incisive physics measurements. Several physics measurements at the EIC would benefit significantly from the use of this technique, including studies of gluon anti-shadowing, studies of parton propagation, attenuation and hadronization in the nucleus, and ultimately the search for parton saturation. The JLEIC full-acceptance detector, with full acceptance to forward-going neutrons, protons and nuclear fragments and a high data-taking rate is ideally suited to such geometry tagging. We improve, tune, and apply existing modeling codes, BeAGLE, Sartre, and GEMC, and detector descriptions to study this physics.

Morozov, Vasiliy↗
DOE OSTI2019

An Adaptive Particle Tracking Algorithm for Lagrangian-Eulerian Simulations of Dispersed Multiphase Flows

The Lagrangian-Eulerian method is broadly used for simulations of dispersed multiphase flows by solving the continuous phase in the Eulerian framework while treating the dispersed phase as point particles in a Lagrangian framework. The accuracy of the Lagrangian-Eulerian method largely depends on the number of computational particles tracked for the Lagrangian phase. In this study, an adaptive Lagrangian particle tracking algorithm is proposed to balance the statistical error and the computational cost by dividing and merging the particles according to the local particle statistics in the computational domain. The computational particles are considered as weighted sampling points of the particle probability density functions (PDF) which represents a statistical equivalence of the Lagrangian phase. The algorithm is implemented as a part of a C++ library for Lagrangian particles, Grit, with performance portability to multi-core or many-core CPUs and Graphic Processing Unit (GPU) architectures. The accuracy of the proposed algorithm with two different schemes are studied through a test problem with analytical solutions for both the particle number density and momentum source term. The results are used to evaluate the proposed algorithm as well as to validate the parallel implementation.

Ge, Wenjun↗
DOE OSTI2026

Beyond microbial abundance: metadata integration enhances disease prediction in human microbiome studies

Multiple studies have highlighted the interaction of the human microbiome with physiological systems such as the gut, immune, liver, and skin, via key axes. Advances in sequencing technologies and high-performance computing have enabled the analysis of large-scale metagenomic data, facilitating the use of machine learning to predict disease likelihood from microbiome profiles. However, challenges such as compositionality, high dimensionality, sparsity, and limited sample sizes have hindered the development of actionable models. One strategy to improve these models is by incorporating key metadata from both the human host and sample collection/processing protocols. This remains challenging due to sparsity and inconsistency in metadata annotation and availability. In this paper, we introduce a machine learning-based pipeline for predicting human disease states by integrating host and protocol metadata with microbiome abundance profiles from 68 different studies, processed through a consistent pipeline. Our findings indicate that metadata can enhance machine learning predictions, particularly at higher taxonomic ranks like Kingdom and Phylum, though this effect diminishes at lower ranks. Our study leverages a large collection of microbiome datasets comprising 11,208 samples, therefore enhancing the robustness and statistical confidence of our findings. This work is a critical step toward utilizing microbiome and metadata for predicting diseases such as gastrointestinal infections, diabetes, cancer, and neurological disorders.

Mathematics and Computing↗
DOE OSTI2017

Star Formation Activity Beyond the Outer Arm. I. WISE -selected Candidate Star-forming Regions

The outer Galaxy beyond the Outer Arm provides a good opportunity to study star formation in an environment significantly different from that in the solar neighborhood. However, star-forming regions in the outer Galaxy have never been comprehensively studied or cataloged because of the difficulties in detecting them at such large distances. We studied 33 known young star-forming regions associated with 13 molecular clouds at R {sub G} ≥ 13.5 kpc in the outer Galaxy with data from the Wide-field Infrared Survey Explorer ( WISE ) mid-infrared all-sky survey. From their color distribution, we developed a simple identification criterion of star-forming regions in the outer Galaxy with the WISE color. We applied the criterion to all the WISE sources in the molecular clouds in the outer Galaxy at R {sub G} ≥ 13.5 kpc detected with the Five College Radio Astronomy Observatory (FCRAO) {sup 12}CO survey of the outer Galaxy, of which the survey region is 102.°49 ≤ l ≤ 141.°54, −3.°03 ≤ b ≤ 5.°41, and successfully identified 711 new candidate star-forming regions in 240 molecular clouds. The large number of samples enables us to perform the statistical study of star formation properties in the outer Galaxy for the first time. This study is crucial to investigate the fundamental star formation properties, including star formation rate, star formation efficiency, and initial mass function, in a primordial environment such as the early phase of the Galaxy formation.

79 ASTRONOMY AND ASTROPHYSICS↗