Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed inference”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

Unorthodox parallelization for Bayesian quantum state estimation

Quantum state tomography (QST) allows for the reconstruction of quantum states through measurements and some inference technique under the assumption of repeated state preparations. Bayesian inference provides a promising platform to achieve both efficient QST and accurate uncertainty quantification, yet is generally plagued by the computational limitations associated with long Markov chains. In this work, we present a novel Bayesian QST approach that leverages modern distributed parallel computer architectures to efficiently sample a D-dimensional Hilbert space. Using a parallelized preconditioned Crank–Nicholson Metropolis–Hastings algorithm, we demonstrate our approach on simulated data and experimental results from IBM Quantum systems up to four qubits, showing significant speedups through parallelization. Although highly unorthodox in pooling independent Markov chains, our method proves remarkably practical, with validation ex post facto via diagnostics like the intrachain autocorrelation time. We conclude by discussing scalability to higher-dimensional systems, offering a path toward efficient and accurate Bayesian characterization of large quantum systems.

Bayesian inference↗

Quantum-Inspired Bayesian Sampling for Uncertainty Quantification and Machine Learning (Final Technical Report)

With increasing simulation and measurement data, machine learning and artificial intelligence have been widely used in computational decision-making of complex engineering systems. The resulting tools, such as uncertainty quantification solvers, reinforcement learning, and physics-informed machine learning, have achieved great success in critical DOE tasks such as material discovery and design, energy system modeling and control, and numerical weather and climate prediction. A core topic in scientific machine learning and artificial intelligence is Bayesian inference: given an observed data set, people want to estimate the posterior distribution of a (possibly large) number of hidden parameters. Due to the flexibility and weak assumptions, Bayesian sampling has been the mainstream Bayesian inference solvers despite the rapid progress of approximate Bayesian inference. Classical Bayesian sampling methods such as Markov-chain Monte Carlo suffer from a low-acceptance rate due to the random walk nature, therefore state-of-the-art techniques use Hamiltonian Monte Carlo and its variants to efficiently draw posterior samples in a high dimension. The key idea of Hamiltonian Monte Carlo and its variants is to simulate the Hamiltonian dynamics of a classical particle with a fixed mass, and their performance significantly degrades when the posterior distribution is highly spiky or has multiple modes. Leveraging the idea of quantum physics, this project has investigated new theory, algorithms and applications of Bayesian inference (especially Bayesian sampling). The main results include: (1) novel quantum-inspired Bayesian sampling methods that can lead to better accuracy for challenging multi-modal or spiky distributions, (2) more scalable machine learning framework leveraging tensor-compressed Bayesian inference, and (3) Bayesian and sampling approaches for verifying the robustness of continuous and binary neural networks.

97 MATHEMATICS AND COMPUTING↗

Online MCMC Thinning with Kernelized Stein Discrepancy

A fundamental challenge in Bayesian inference is efficient representation of a target distribution. Many nonparametric approaches do so by sampling a large number of points using variants of Markov chain Monte Carlo (MCMC). Here, we propose an MCMC variant that retains only those posterior samples which exceed a kernelized Stein discrepancy (KSD) threshold, which we call KSD thinning. We establish the convergence and complexity trade-offs for several settings of KSD thinning as a function of the KSD threshold parameter, sample size, and other problem parameters. We provide experimental comparisons against other online nonparametric Bayesian methods that generate low-complexity posterior representations. We observe superior consistency/complexity trade-offs across a range of settings including MCMC sampling on two Bayesian inference problems from the biological sciences, and 10 × inference speedup and storage reduction for Bayesian neural networks with no loss of accuracy and no increase in training time. Our code is available at https://github.com/colehawkins/KSD-Thinning.

Bayesian inference↗

Studies of the Intrinsic Complexities of Magnetotail Ion Distributions: Theory and Observations

This year we have studied the relationship between the structure seen in measured distribution functions and the detailed magnetospheric configuration. Results from our recent studies using time-dependent large-scale kinetic (LSK) calculations are used to infer the sources of the ions in the velocity distribution functions measured by a single spacecraft (Geotail). Our results strongly indicate that the different ion sources and acceleration mechanisms producing a measured distribution function can explain this structure. Moreover, individual structures within distribution functions were traced back to single sources. We also confirmed the fractal nature of ion distributions.

Ashour-Abdalla, Maha↗

Studies of the Intrinsic Complexities of Magnetotail Ion Distributions: Theory and Observations

We have studied the relationship between the structure seen in measured distribution functions and the detailed magnetospheric configuration. Results from our recent studies using time-dependent large-scale kinetic (LSK) calculations are used to infer the sources of the ions in the velocity distribution functions measured by a single spacecraft (Geotail). Our results strongly indicate that the different ion sources and acceleration mechanisms producing a measured distribution function can explain this structure. Moreover, individual structures within distribution functions were traced back to single sources. We also examined the intrinsic variability of the magnetotail during quiet and steady solar wind conditions and found that the magnetotail possess an intrinsic variability caused by the non-adiabatic acceleration and loss of current-carrying ions from the magnetotail current sheet.

Ashour-Abdalla, M.↗

Four-dimensional phase space tomography from one-dimensional measurements of a hadron beam

In this paper, we use one-dimensional measurements to infer the four-dimensional phase space density of an accumulated proton beam in the Spallation Neutron Source (SNS) accelerator. The reconstruction was performed by maximizing the distribution’s entropy subject to the measurement constraints and thus represents the most conservative inference from the data. The reconstructed distribution reproduces the measured profiles down to the noise level, and simulations indicate that the problem is reasonably well constrained. Similar measurements could serve as benchmarks for beam dynamics simulations in the SNS or hadron accelerators.

43 PARTICLE ACCELERATORS↗

Adaptive mitigation of time-varying quantum noise

Current quantum computers suffer from non-stationary noise channels with high error rates, which undermines their reliability and reproducibility. We propose a Bayesian inference based adaptive algorithm that can learn and mitigate quantum noise in response to changing channel conditions. Our study emphasizes the need for dynamic inference of critical channel parameters to improve program accuracy. We use the Dirichlet distribution to model the stochasticity of the Pauli channel. This allows us to perform Bayesian inference, which can improve the performance of probabilistic error cancellation (PEC) under time-varying noise. Our work demonstrates the importance of characterizing and mitigating temporal variations in quantum noise, which is crucial for developing more accurate and reliable quantum technologies. Our results demonstrate that Bayesian PEC can outperform non-adaptive approaches by a factor of 4.5x when measured using Hellinger distance from the ideal distribution.

Dasgupta, Samudra↗

Inference of Precipitation in Warm Stratiform Clouds using Remotely Sensed Observations of the Cloud Top Droplet Size Distribution

Drizzle is a common feature of warm stratiform clouds and it influences their radiative effects by modulating their physical properties and lifecycle. An important component of drizzle formation are processes that lead to a broadening of the droplet size distribution (DSD). Here, we examine observations of cloud and drizzle properties retrieved using colocated airborne measurements from the Research Scanning Polarimeter and the Third Generation Airborne Precipitation Radar. We observe a bimodal DSD as the aircraft transects drizzling open-cells whereby the larger mode reaches a maximum size near cloud center and the smaller mode remains relatively constant in size. We review similarities between our observations with droplet growth processes and their connections with precipitation onset. We estimate droplet sedimentation using the cloud top DSD and find a correlation with rain water path of 0.82. We also examine how changes in liquid water paths and droplet concentrations may act to enhance or suppress precipitation.

Droplet size distribution↗

Determination of Particle Sources for a Geotail Distribution Function Observed on May 23, 1995

On May 23, 1995, the Comprehensive Plasma Instrumentation (CPI) onboard the Geotail spacecraft observed a complex and structured ion distribution function near the magnetotail midplane at x approximately -10 R(sub E). On the same day, the Wind spacecraft observed a very high density (approximately 40/cubic cm) solar wind and an interplanetary magnetic field (IMF) that was predominantly northward but had several southward turnings. We have inferred the sources of the ions in this distribution function by following approximately 90,000 ion trajectories backward in time using time-dependent electric and magnetic fields obtained from a global MHD (magnetohydrodynamic) simulation. Wind data were used as input for the MHD model. We found that three sources contributed to this distribution: the ionosphere, the plasma mantle which had near-Earth and distant tail components, and the low latitude boundary layer (LLBL). Moreover, distinct structures in the low energy part of the distribution function were found to be associated with individual sources. Structures near 0 deg pitch angle were made up of either ionospheric or plasma mantle ions, while structures near 90 deg pitch angle were dominated by ions from the LLBL source. Particles that underwent nonadiabatic acceleration were numerous in the higher energy part of the ion distribution function, whereas ionospheric and LLBL ions were mostly adiabatic. A large proportion of the near-Earth mantle ions underwent adiabatic acceleration, while most of the distant mantle ions experienced nonadiabatic acceleration.

Ashour-Abdalla, M.↗

Redshifts and absolute spectral energy distributions of galaxies in distant clusters.

Absolute spectral energy distributions were measured in galaxies of three distant clusters. Redshifts and information on evolutionary effects are inferred by a comparison of the results with the integrated light energy distribution for nearby giant elliptical galaxies. Evidence for evolution over the last 3 to 6 billion years could not be established for these galaxies.

Oke, J. B.↗

Bulk properties and velocity distributions of water group ions at Comet Halley - Giotto measurements

In the region upstream of Comet Halley, pickup heavy ions of cometary origin were directly observed by the implanted ion spectrometer on Giotto. Diffusion of this population in pitch angle and in energy, during the approach to the comet and on the outbound leg is discussed. The two data sets are compared and qualitative ideas on scattering timescales are inferred. In addition the bulk parameters of these distributions have been computed and a comparison of the observed speed in the solar wind frame and the observed density with expectations is presented. Pitch angle scattering occurs more slowly than expected with filled shells appearing at 2,500,000 km, and significant energy diffusion does not occur until the bow shock region. Also the shell distributions downstream of the shock flow at the bispherical bulk speed (related to the Alfven speed) along the magnetic field with respect to the solar wind in accordance with conservation of energy between the pickup ions and the wave turbulence.

Coates, A. J.↗

Applying Gaussian Process Machine Learning and Modern Probabilistic Programming to Satellite Data to Infer CO 2 Emissions

Satellite data provides essential insights into the spatiotemporal distribution of CO 2 concentrations. However, many atmospheric inverse models fail to adequately incorporate the spatial and temporal correlations inherent in satellite observations and often lack rigorous methods for estimating parameters like spatial length scales. We introduce an inference model that processes the spatiotemporal covariance in satellite data and estimates hyperparameters such as covariance length scales. Our approach uses the Gaussian process (GP) machine learning (ML) and modern probabilistic programming languages (PPLs) to perform atmospheric inversions of emissions from satellite data. We develop a GP ML inversion system based on modern PPLs and the GEOS-Chem chemical transport model, simulating atmospheric CO 2 concentrations corresponding to the Orbiting Carbon Observatory-2/3 (OCO-2/3) data for July 2020. In our supervised learning framework, we treat the GEOS-Chem simulated data set as the target, with predictors derived by scaling the target with sector-specific factors hidden from the GP machine. Our results show that the GP model, combined with GPU-enabled PPLs, effectively retrieves true emission scaling factors and infers noise levels concealed within the data. This suggests that our method could be applied over larger areas with more complex covariance structures, enabling comprehensive analysis of the spatiotemporal patterns observed in OCO-2/3 and similar satellite data sets.

54 ENVIRONMENTAL SCIENCES↗

Analysis of IUE observations of hydrogen in comets

The large body of hydrogen Lyman-alpha observations of cometary comae obtained with the International Ultraviolet Explorer satellite has gone generally unanalyzed because of two main modeling complications. First, the inner comae of many bright (gas productive) comets are often optically thick to solar Lyman-alpha radiation. Second, even in the case of a small comet (low gas production) the large IUE aperture is quite small as compared with the immense size of the hydrogen coma, so an accurate model which properly accounts for the spatial distribution of the coma is required to invert the inferred brightnesses to column densities and finally to H atom production rates. Our Monte Carlo particle trajectory model (MPTM), which for the first time provides the realistic full phase space distribution of H atoms throughout the coma was used as the basis for the analysis of IUE observations of the inner coma. The MCPTM includes the effects of the vectorial ejection of the H atoms upon dissociation of their parent species (H2O and OH) and of their partial collisional thermalization. Both of these effects are crucial to characterize the velocity distribution of the H atoms. A new spherical radiative transfer calculation based on our MCPTM was developed to analyze IUE observations of optically thick H comae. The models were applied to observations of comets P/Giacobini-Zinner and P/Halley.

Combi, Michael R.↗

Bayesian Estimation of Earth’s Undiscovered Mineralogical Diversity Using Noninformative Priors

Recently, statistical distributions have been explored to provide estimates of the mineralogical diversity of Earth, and Earth-like planets. In this paper, a Bayesian approach is introduced to estimate Earth’s undiscovered mineralogical diversity. Samples are generated from a posterior distribution of the model parameters using Markov chain Monte Carlo simulations such that estimates and inference are directly obtained. It was previously shown that the mineral species frequency distribution conforms to a generalized inverse Gauss–Poisson (GIGP) large number of rare events model. Even though the model fit was good, the population size estimate obtained by using this model was found to be unreasonably low by mineralogists. In this paper, several zero-truncated, mixed Poisson distributions are fitted and compared, where the Poisson-lognormal distribution is found to provide the best fit. Subsequently, the population size estimates obtained by Bayesian methods are compared to the empirical Bayes estimates. Species accumulation curves are constructed and employed to estimate the population size as a function of sampling size. Finally, the relative abundances, and hence the occurrence probabilities of species in a random sample, are calculated numerically for all mineral species in Earth’s crust using the Poisson-lognormal distribution. These calculations are connected and compared to the calculations obtained in a previous paper using the GIGP model for which mineralogical criteria of an Earth-like planet were given.

Bayesian statistics↗

A biology-informed similarity metric for simulated patches of human cell membrane

Complex scientific inquiries rely increasingly upon large and autonomous multiscale simulation campaigns, which fundamentally require similarity metrics to quantify ‘sufficient’ changes among data and/or configurations. However, subject matter experts are often unable to articulate similarity precisely or in terms of well-formulated definitions, especially when new hypotheses are to be explored, making it challenging to design a meaningful metric. Furthermore, the key to practical usefulness of such metrics to enable autonomous simulations lies in in situ inference, which requires generalization to possibly substantial distributional shifts in unseen, future data. Here, we address these challenges in a cancer biology application and develop a meaningful similarity metric for ‘patches’—regions of simulated human cell membrane that express interactions between certain proteins of interest and relevant lipids. In the absence of well-defined conditions for similarity, we leverage several biology-informed notions about data and the underlying simulations to impose inductive biases on our metric learning framework, resulting in a suitable similarity metric that also generalizes well to significant distributional shifts encountered during the deployment. We combine these intuitions to organize the learned embedding space in a multiscale manner, which makes the metric robust to incomplete and even contradictory intuitions. Our approach delivers a metric that not only performs well on the conditions used for its development and other relevant criteria, but also learns key spatiotemporal relationships without ever being exposed to any such information during training.

97 MATHEMATICS AND COMPUTING↗

Room-Temperature Mechanical Resonator with a Single Added or Subtracted Phonon

A room-temperature mechanical oscillator undergoes thermal Brownian motion with an amplitude much larger than the amplitude associated with a single phonon of excitation. This motion can be read out and manipulated using laser light using a cavity-optomechanical approach. By performing a strong quantum measurement (i.e., counting single photons in the sidebands imparted on a laser), we herald the addition and subtraction of single phonons on the 300 K thermal motional state of a 4 GHz mechanical oscillator. Further, to understand the resulting mechanical state, we implement a tomography scheme and observe highly non-Gaussian phase-space distributions. Using a maximum likelihood method, we infer the density matrix of the oscillator, and we confirm the counterintuitive doubling of the mean phonon number resulting from phonon addition and subtraction.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Practical Probabilistic Programming

Recent advances in probabilistic programming languages (PPLs) have provided the capability for exact inference: computing a closed-form probability distribution for a given probabilistic program. In particular, the new language Roulette uses a language oriented programming (LOP) approach, wherein analysts build new programming languages on top of a set of primitives provided by Roulette, which then translates these structures into a weighted model counting problem which can be solved by automated reasoning tools. However, because Roulette provides few convenience features, developing these new languages is challenging even for expert users. We developed a standard library of common probability functions for Roulette with the goal of improved usability. This included approximation of continuous probability density functions using discrete probability mass functions. We demonstrated this approach by modeling a cosmic ray striking a RAM controller. We found that Roulette provides a powerful interface for highly expressive probabilistic programs to be generated. In collaboration with the NNSA Advanced Simulation and Computing program, which resulted in development of a tool called Circulette, we were able to model complex circuits expressed in Verilog using probabilistic programs with an expressivity not previously possible. Our research question that motivated the development of a Roulette standard library was to determine whether non-experts could use a PPL to model relevant problems regarding radiation effects on microelectronics. This standard library improved the expressivity of Roulette by implementing common probability density functions, mathematical operators on distributions, and support for empirical distributions. While Roulette is a powerful modeling language, the untyped, LOP approach makes error messages difficult to understand and requires expert aid. We recommend further research on Roulette, especially with its error messages, to enable improved usability. At the same time, this project demonstrated that for users familiar with Roulette and the LOP approach, Roulette provides powerful new capabilities that can be integrated with other Sandia modeling capabilities.

97 MATHEMATICS AND COMPUTING↗

A Study of the Merging Dwarf Galaxy VCC322

Abstract Galaxy interactions and mergers can enhance or reduce star formation, but a complete understanding of the involved processes is still lacking. The effect of dwarf galaxy mergers is even less clear than their massive counterpart. We present a study on a dwarf merger remnant in the Virgo cluster, VCC322, which might form a triple system with VCC334 and VCC319. We identify a prominent long and straight tail-like substructure that has a size comparable to its host galaxy VCC322. By comparing the color–color (g−rversusr−H) distribution with simple stellar population models, we infer that the metallicity and stellar age of this tail areZ ⋆ ∼ 0.02Z ⊙ andt ⋆ ∼ 10 Gyr, respectively. In VCC319, we find a sign of isophotal twisting. This suggests that VCC319 may be subject to tidal interaction. An analysis of the Sloan Digital Sky Survey optical spectra of VCC322 indicates mass- and light-weighted ages of about 10 9.8 yr and 10 7.5 yr, respectively, indicating an ongoing star formation activity. However, the star formation in VCC322 seems suppressed when compared to other star-forming dwarfs of comparable stellar masses. Our finding of shock excitation of optical emission lines indicates that interaction-induced shock may contribute to the heating of cold gas and suppression of star formation.

Astronomy & Astrophysics↗