Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “probability distribution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

A practical and efficient approach for Bayesian quantum state estimation

Bayesian inference is a powerful paradigm for quantum state tomography, treating uncertainty in meaningful and informative ways. Yet the numerical challenges associated with sampling from complex probability distributions hampers Bayesian tomography in practical settings. In this article, we introduce an improved, self-contained approach for Bayesian quantum state estimation. Leveraging advances in machine learning and statistics, our formulation relies on highly efficient preconditioned Crank–Nicolson sampling and a pseudo-likelihood. We theoretically analyze the computational cost, and provide explicit examples of inference for both actual and simulated datasets, illustrating improved performance with respect to existing approaches.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Constraining dark matter microphysics with the annihilation signal from subhalos

In the cold dark matter scenario, galactic dark matter halos are populated with a large number of smaller subhalos. Previous work has shown that dark matter annihilations in subhalos can generate a distinctive, non-Poisson signal in the gamma-ray photon counts probability distribution function (PDF). Here we show that the gamma-ray PDF also carries information about the velocity dependence of the dark matter annihilation cross section. After calculating the PDF assuming s-wave and Sommerfeld-enhanced annihilation, we perform a mock data analysis to illustrate how current and future observations can constrain the microphysics of the dark matter annihilation. We find that, with current Fermi data, and assuming a dark matter annihilation cross section roughly at the limit of current bounds from annihilation in dwarf spheroidal galaxies, one can potentially distinguish the non-Poissonian fluctuations expected from dark matter annihilation in subhalos from Poisson sources, as well as from dark matter models with an incorrect velocity-dependence. Here we explore how robust these results are to assumptions about the modeling of the galactic gamma-ray background, but further work is needed to determine the impact of realistic astrophysical source populations on our results. We also point out a four-parameter degeneracy between the velocity dependence of the dark matter annihilation, the minimum subhalo mass, the power law index of the subhalo mass function, and the normalization of the dark matter signal. This degeneracy can be broken with priors from N-body simulations or from observational constraints on the subhalo mass function.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

CMB-PAInT: An inpainting tool for the cosmic microwave background

Abstract The presence of astrophysical emissions in microwave observations forces us to perform component separation to extract the Cosmic Microwave Background (CMB) signal. However, even in the most optimistic cases, there are still strongly contaminated regions, such as the Galactic plane or those with emission from extragalactic point sources, which require the use of a mask. Since many CMB analyses, especially the ones working in harmonic space, need the whole sky map, it is crucial to develop a reliable inpainting algorithm that replaces the values of the excluded pixels by others statistically compatible with the rest of the sky. This is especially important when working withQandUsky maps in order to obtainE- andB-mode maps which are free fromE-to-Bleakage. In this work we study a method based on Gaussian Constrained Realizations (GCR), that can deal with both intensity and polarization. Several tests have been performed to asses the validation of the method, including the study of the one-dimensional probability distribution function (1-PDF),E- andB-mode map reconstruction, and power spectra estimation. We have considered two scenarios for the input simulation: one case with only CMB signal and a second one including also Planck PR4 semi-realistic noise. Even if we are limited to low resolution maps, N side = 64 ifT,QandUare considered, we believe that this is a useful approach to be applied to future missions such as LiteBIRD, where the target are the largest scales.

Astronomy & Astrophysics↗
DOE OSTI2022

A Conditional Autoencoder for Galaxy Photometric Parameter Estimation

Astronomical photometric surveys routinely image billions of galaxies, and traditionally infer the parameters of a parametric model for each galaxy. This approach has served us well, but the computational expense of deriving a full posterior probability distribution function is a challenge for increasingly ambitious surveys. In this paper, we use deep learning methods to characterize galaxy images, training a conditional autoencoder on mock data. The autoencoder can reconstruct and denoise galaxy images via a latent space engineered to include semantically meaningful parameters, such as brightness, location, size, and shape. Our model recovers galaxy fluxes and shapes on mock data with a lower variance than the Hyper Suprime-Cam photometry pipeline, and returns reasonable answers even for inputs outside the range of its training data. When applied to data in the training range, the regression errors on all extracted parameters are nearly unbiased with a variance near the Cramr-Rao bound.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Gauges, loops, and polynomials for partition functions of graphical models

Graphical models represent multivariate and generally not normalized probability distributions. Computing the normalization factor, called the partition function, is the main inference challenge relevant to multiple statistical and optimization applications. The problem is #P-hard that is of an exponential complexity with respect to the number of variables. Here, aimed at approximating the partition function, we consider multi-graph models where binary variables and multivariable factors are associated with edges and nodes, respectively, of an undirected multi-graph. We suggest a new methodology for analysis and computations that combines the Gauge function technique from Chertkov and Chernyak with the technique developed in Anari and Oveis Gharan 2017 arXiv:1702.02937; Gurvits 2011 arXiv:1106.2844; Straszak and Vishnoi 2017 55th Annual Allerton Conf. on Communication, Control, and Computing, based on the recent progress in the field of real stable polynomials. We show that the Gauge function, representing a single-out term in a finite sum expression for the partition function which achieves extremum at the so-called belief-propagation gauge, has a natural polynomial representation in terms of gauges/variables associated with edges of the multi-graph. Moreover, Gauge function can be used to recover the partition function through a sequence of transformations allowing appealing algebraic and graphical interpretations. Algebraically, one step in the sequence consists of the application of a differential operator over gauges associated with an edge. Graphically, the sequence is interpreted as a repetitive elimination/contraction of edges resulting in multi-graph models on decreasing in size (number of edges) graphs with the same partition function as in the original multi-graph model. Even though the complexity of computing factors in the sequence of the derived multi-graph models and respective Gauge functions grow exponentially with the number of eliminated edges, polynomials associated with the new factors remain bi-stable if the original factors have this property. Moreover, we show that BP estimations in the sequence do not decrease, each low-bounding the partition function.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Evolution of global snow drought characteristics from 1850 to 2100

Abstract Seasonal snow is an integral part of the global water supply and storage system. Snow droughts impact ecological, agricultural, and urban systems by altering the amount and timing of meltwater delivery. These droughts are characterized by a lack of on-the-ground snow (snow water equivalent, SWE) that can be caused by low total precipitation (dry drought) or low proportion of precipitation falling as snowfall (warm drought), often combined with an early melt. The standardized SWE index (SWEI) ranks the current status of SWE for a given location compared to a baseline condition and identifies the existence, but not the cause, of snow drought. In this work, we use estimates of SWE, temperature, and precipitation from nine coupled model intercomparison project phase 6 (CMIP6) models to quantify the frequency, severity, and type of snow droughts globally for historical and future scenarios. Compared to a historical baseline (1850–1900) total snow drought frequency more than doubles under socio-economic pathway (SSP)2-4.5 and SSP5-8.5; all of the increase in snow drought frequency comes from an increase in warm droughts. The probability distribution of future SWEI in major snowy basins around the world are likely to be centered on more negative values, which corresponds to more severe drought and, with only moderate changes in distribution spread, more frequent drought. CMIP6 simulations pinpoint snow drought as an emerging global threat to water resources and highlight the need to explore higher resolution future models that better capture complex mountain topography, wildland fires, and snow-forest interactions.

CMIP6↗
DOE OSTI2024

Responses of summer mesoscale convective systems to irrigation over the North China Plain based on convection-permitting model simulations

Extensive irrigation activities in the North China Plain (NCP) significantly influence regional weather and climate. However, previous studies focusing on the NCP were primarily based on coarse-resolution models, which are unable to explicitly resolve convection systems, causing large uncertainty in precipitation simulations. In this study, a convection-permitting model coupled with a dynamic irrigation scheme is utilized to investigate the impacts of irrigation on summertime mesoscale convective systems (MCSs) over the NCP. Sensitivity experiments with irrigation off and on are conducted for 5 summers and an MCS identification and tracking algorithm is applied to both satellite observations and model simulations. We find that incorporating irrigation in the model increases MCS precipitation, which agrees more with observations. The probability distributions of MCS lifetime, area, propagation speed, and intensity are all better simulated with irrigation. Irrigation increases the occurrence frequency of MCSs throughout the entire day. The nighttime increase is partly because of more frequent local initiation of MCS developed from isolated deep convection, while the daytime increase is mainly attributed to the changes in MCSs initiating elsewhere and then propagating to the NCP. On average, irrigation induces additional moisture that is more thermodynamically favorable for precipitation, but this effect is partially offset by the weakened ascending air motion primarily caused by irrigation surface cooling. Compared to weak MCS precipitation events, strong MCS precipitation events experience greater enhancement in precipitation intensity when including irrigation because the offset effect from the change in large-scale ascending air motion is insignificant. In addition, irrigation makes the variation of MCS precipitation intensity more correlated with the variation in ascending motion but less correlated with that in atmospheric moisture. Our results suggest the pronounced impacts of irrigation on MCSs over the NCP which should be included in numerical models to improve regional precipitation simulation and prediction.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

A deep neural network to search for new long-lived particles decaying to jets

A tagging algorithm to identify jets that are significantly displaced from the proton-proton (pp) collision region in the CMS detector at the LHC is presented. Displaced jets can arise from the decays of long-lived particles (LLPs), which are predicted by several theoretical extensions of the standard model. The tagger is a multiclass classifier based on a deep neural network, which is parameterised according to the proper decay length $\mathrm{c}\tau_0$ of the LLP. A novel scheme is defined to reliably label jets from LLP decays for supervised learning. Samples of pp collision data, recorded by the CMS detector at a centre-of-mass energy of 13 TeV, and simulated events are used to train the neural network. Domain adaptation by backward propagation is performed to improve the simulation modelling of the jet class probability distributions observed in pp collision data. The potential performance of the tagger is demonstrated with a search for long-lived gluinos, a manifestation of split supersymmetric models. The tagger provides a rejection factor of 10 000 for jets from standard model processes, while maintaining an LLP jet tagging efficiency of 30-80% for gluinos with 1 mm $\leq$ $c\tau_0$ $\leq$ 10 m. The expected coverage of the parameter space for split supersymmetry is presented.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

Watch and learn—a generalized approach for transferrable learning in deep neural networks via physical principles

Transfer learning refers to the use of knowledge gained while solving a machine learning task and applying it to the solution of a closely related problem. Such an approach has enabled scientific breakthroughs in computer vision and natural language processing where the weights learned in state-of-the-art models can be used to initialize models for other tasks which dramatically improve their performance and save computational time. Here we demonstrate an unsupervised learning approach augmented with basic physical principles that achieves fully transferrable learning for problems in statistical physics across different physical regimes. By coupling a sequence model based on a recurrent neural network to an extensive deep neural network, we are able to learn the equilibrium probability distributions and inter-particle interaction models of classical statistical mechanical systems. Our approach, distribution-consistent learning, DCL, is a general strategy that works for a variety of canonical statistical mechanical models (Ising and Potts) as well as disordered interaction potentials. Using data collected from a single set of observation conditions, DCL successfully extrapolates across all temperatures, thermodynamic phases, and can be applied to different length-scales. This constitutes a fully transferrable physics-based learning in a generalizable approach.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Real-time confinement regime detection in fusion plasmas with convolutional neural networks and high-bandwidth edge fluctuation measurements

Abstract A real-time detection of the plasma confinement regime can enable new advanced plasma control capabilities for both the access to and sustainment of enhanced confinement regimes in fusion devices. For example, a real-time indication of the confinement regime can facilitate transition to the high-performing wide-pedestal (WP) quiescent H-mode, or avoid unwanted transitions to lower confinement regimes that may induce plasma termination. To demonstrate real-time confinement regime detection, we use the 2D beam emission spectroscopy (BES) diagnostic system to capture localized density fluctuations of long wavelength turbulent modes in the edge region at a 1 MHz sampling rate. BES data from 330 discharges in either L-mode, H-mode, quiescent H (QH)-mode, or WP QH-mode were collected from the DIII-D tokamak and curated to develop a high-quality database to train a deep-learning classification model for real-time confinement detection. We utilize the 6×8 spatial configuration with a time window of 1024 µ s and recast the input to obtain spectral-like features via fast Fourier transform preprocessing. We employ a shallow 3D convolutional neural network for the multivariate time-series classification task and utilize a softmax in the final dense layer to retrieve a probability distribution over the different confinement regimes. Our model classifies the global confinement state on 44 unseen test discharges with an average F 1 score of 0.94, using only ∼1 ms snippets of BES data at a time. This activity demonstrates the feasibility for real-time data analysis of fluctuation diagnostics in future devices such as ITER, where the need for reliable and advanced plasma control is urgent.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

Hypothesis tests on Rayleigh wave radiation pattern shapes: a theoretical assessment of idealized source screening

SUMMARY Shallow seismic sources excite Rayleigh wave ground motion with azimuthally dependent radiation patterns. We place binary hypothesis tests on theoretical models of such radiation patterns to screen cylindrically symmetric sources (like explosions) from non-symmetric sources (like non-vertical dip-slip or non-VDS faults). These models for data include sources with several unknown parameters, contaminated by Gaussian noise and embedded in a layered half-space. The generalized maximum likelihood ratio tests that we derive from these data models produce screening statistics and decision rules that depend on measured, noisy ground motion at discrete sensor locations. We explicitly quantify how the screening power of these statistics increase with the size of any dip-slip and strike-slip components of the source, relative to noise (faulting signal strength) and how they vary with network geometry. As applications of our theory, we apply these tests to (1) find optimal sensor locations that maximize the probability of screening non-circular radiation patterns and (2) invert for the largest non-VDS faulting signal that could be mistakenly attributed to an explosion with damage, at a particular attribution probability. Finally, we quantify how certain errors that are sourced by opening cracks increase screening rate errors. While such theoretical solutions are ideal and require future validation, they remain important in underground explosion monitoring scenarios because they provide fundamental physical limits on the discrimination power of tests that screen explosive from non-VDS faulting sources.

58 GEOSCIENCES↗
DOE OSTI2020

Fisher for complements: extracting cosmology and neutrino mass from the counts-in-cells PDF

In this work, we comprehensively analyse the cosmology dependence of counts-in-cells statistics. Furthermore, we focus on the shape of the one-point probability distribution function (PDF) of the matter density field at mildly non-linear scales. Based on large-deviation statistics, we parametrize the cosmology dependence of the matter PDF in terms of the linear power spectrum, the growth factor, the spherical collapse dynamics, and the non-linear variance. We extend our formalism to include massive neutrinos, finding that the total matter PDF is highly sensitive to the total neutrino mass Mν and can disentangle it from the clustering amplitude σ 8 . Additionally, using more than a million PDFs extracted from the Quijote simulations, we determine the response of the matter PDF to changing parameters in the νΛCDM model and successfully cross-validate the theoretical model and the simulation measurements. We present the first νΛCDM Fisher forecast for the matter PDF at multiple scales and redshifts, and its combination with the matter power spectrum. We establish that the matter PDF and the matter power spectrum are highly complementary at mildly non-linear scales. The matter PDF is particularly powerful for constraining the matter density Ωm, clustering amplitude σ 8 and the total neutrino mass Mν. Adding the mildly non-linear matter PDF to the mildly non-linear matter power spectrum improves constraints on Ω m by a factor of 5 and σ 8 by a factor of 2 when considering the three lowest redshifts. In our joint analysis of the matter PDF and matter power spectrum at three redshifts, the total neutrino mass is constrained to better than 0.01 eV with a total volume of 6 (Gpc h -1 ) 3 . We discuss how density-split statistics can be used to translate those encouraging results for the matter PDF into realistic observables in galaxy surveys.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

The PAU Survey: Photometric redshifts using transfer learning from simulations

In this paper, we introduce the DEEPZ deep learning photometric redshift (photo-z) code. As a test case, we apply the code to the PAU survey (PAUS) data in the COSMOS field. DEEPZ reduces the σ68 scatter statistic by 50 percent at iAB = 22.5 compared to existing algorithms. This improvement is achieved through various methods, including transfer learning from simulations where the training set consists of simulations as well as observations, which reduces the need for training data. The redshift probability distribution is estimated with a mixture density network (MDN), which produces accurate redshift distributions. Our code includes an autoencoder to reduce noise and extract features from the galaxy SEDs. It also benefits from combining multiple networks, which lowers the photo-z scatter by 10 percent. Furthermore, training with randomly constructed coadded fluxes adds information about individual exposures, reducing the impact of photometric outliers. In addition to opening up the route for higher redshift precision with narrow bands, these machine learning techniques can also be valuable for broad-band surveys.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

STRIDES: Spectroscopic and photometric characterization of the environment and effects of mass along the line of sight to the gravitational lenses DES J0408–5354 and WGD 2038–4008

In time-delay cosmography, three of the key ingredients are (1) determining the velocity dispersion of the lensing galaxy, (2) identifying galaxies and groups along the line of sight with sufficient proximity and mass to be included in the mass model, and (3) estimating the external convergence κ_ext from less massive structures that are not included in the mass model. We present results on all three of these ingredients for two time-delay lensed quad quasar systems, DES J0408–5354 and WGD 2038–4008 . We use the Gemini, Magellan, and VLT telescopes to obtain spectra to both measure the stellar velocity dispersions of the main lensing galaxies and to identify the line-of-sight galaxies in these systems. Next, we identify 10 groups in DES J0408–5354 and two groups in WGD 2038–4008 using a group-finding algorithm. We then identify the most significant galaxy and galaxy-group perturbers using the ‘flexion shift’ criterion. We determine the probability distribution function of the external convergence κ_ext for both of these systems based on our spectroscopy and on the DES-only multiband wide-field observations. Using weighted galaxy counts, calibrated based on the Millennium Simulation, we find that DES J0408–5354 is located in a significantly underdense environment, leading to a tight (width |$\sim 3{{\ \rm per\ cent}}$|⁠), negative-value κ_ext distribution. On the other hand, WGD 2038–4008 is located in an environment of close to unit density, and its low source redshift results in a much tighter κ_ext of |$\sim 1{{\ \rm per\ cent}}$|⁠, as long as no external shear constraints are imposed.

WGD 2038-4008↗
DOE OSTI2021

The PAU Survey: narrow-band photometric redshifts using Gaussian processes

Here, we study the performance of the hybrid template machine learning photometric redshift (photo- z ) algorithm delight , which uses Gaussian processes, on a subset of the early data release of the Physics of the Accelerating Universe Survey (PAUS). We calibrate the fluxes of the 40 PAUS narrow bands with six broad-band fluxes ( uBVriz ) in the Cosmic Evolution Survey (COSMOS) field using three different methods, including a new method that utilizes the correlation between the apparent size and overall flux of the galaxy. We use a rich set of empirically derived galaxy spectral templates as guides to train the Gaussian process, and we show that our results are competitive with other standard photometric redshift algorithms. delight achieves a photo- z 68th percentile error of σ 68 = 0.0081(1 + z ) without any quality cut for galaxies with i auto < 22.5 as compared to 0.0089(1 + z ) and 0.0202(1 + z ) for the bpz and annz 2 codes, respectively. delight is also shown to produce more accurate probability distribution functions for individual redshift estimates than bpz and annz 2. Common photo- z outliers of delight and bcnz 2 (previously applied to PAUS) are found to be primarily caused by outliers in the narrow-band fluxes, with a small number of cases potentially indicating spectroscopic redshift failures in the reference sample. In the process, we introduce performance metrics derived from the results of bcnz 2 and delight , allowing us to achieve a photo- z quality of σ 68 < 0.0035(1 + z ) at a magnitude of i auto < 22.5 while keeping 50 per cent objects of the galaxy sample.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Parameter inference with non-linear galaxy clustering: accounting for theoretical uncertainties

ABSTRACT We implement euclidemulator (version 1), an emulator for the non-linear correction of the matter power spectrum, into the Markov chain Monte Carlo forecasting code montepython. We compare the performance of halofit, hmcode, and euclidemulator1, both at the level of power spectrum prediction and at the level of posterior probability distributions of the cosmological parameters, for different cosmological models and different galaxy power spectrum wavenumber cut-offs. We confirm that the choice of the power spectrum predictor has a non-negligible effect on the computed sensitivities when doing cosmological parameter forecasting, even for a conservative wavenumber cut-off of $0.2\, h\, {\rm Mpc}^{-1}$. We find that euclidemulator1 is on average up to 17 per cent more sensitive to the cosmological parameters than the other two codes, with the most significant improvements being for the Hubble parameter of up to 42 per cent and the equation of state of dark energy of up to 26 per cent, depending on the case. In addition, we point out that the choice of the power spectrum predictor contributes to the risk of computing a significantly biased mean cosmology when doing parameter estimations. For the four tested scenarios we find biases, averaged over the cosmological parameters, of between 0.5σ and 2σ (from below 1σ up to 6σ for individual parameters). This paper provides a proof of concept that this risk can be mitigated by taking a well-tailored theoretical uncertainty into account as this allows to reduce the bias by a factor of 2 to 5, depending on the case under consideration, while keeping posterior credibility contours small: the standard deviations are amplified by a factor of ≤1.4 in all cases.

Astronomy & Astrophysics↗
DOE OSTI2022

Optical selection bias and projection effects in stacked galaxy cluster weak lensing

ABSTRACT Cosmological constraints from current and upcoming galaxy cluster surveys are limited by the accuracy of cluster mass calibration. In particular, optically identified galaxy clusters are prone to selection effects that can bias the weak lensing mass calibration. We investigate the selection bias of the stacked cluster lensing signal associated with optically selected clusters, using clusters identified by the redMaPPer algorithm in the Buzzard simulations as a case study. We find that at a given cluster halo mass, the residuals of redMaPPer richness and weak lensing signal are positively correlated. As a result, for a given richness selection, the stacked lensing signal is biased high compared with what we would expect from the underlying halo mass probability distribution. The cluster lensing selection bias can thus lead to overestimated mean cluster mass and biased cosmology results. We show that the lensing selection bias exhibits a strong scale dependence and is approximately 20–60 per cent for ΔΣ at large scales. This selection bias largely originates from spurious member galaxies within ±20–60 $h^{-1}\, \rm Mpc$ along the line of sight, highlighting the importance of quantifying projection effects associated with the broad redshift distribution of member galaxies in photometric cluster surveys. While our results qualitatively agree with those in the literature, accurate quantitative modelling of the selection bias is needed to achieve the goals of cluster lensing cosmology and will require synthetic catalogues covering a wide range of galaxy–halo connection models.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Accelerating astronomical and cosmological inference with preconditioned Monte Carlo

ABSTRACT We introduce preconditioned Monte Carlo (PMC), a novel Monte Carlo method for Bayesian inference that facilitates efficient sampling of probability distributions with non-trivial geometry. PMC utilizes a Normalizing Flow (NF) in order to decorrelate the parameters of the distribution and then proceeds by sampling from the preconditioned target distribution using an adaptive Sequential Monte Carlo (SMC) scheme. The results produced by PMC include samples from the posterior distribution and an estimate of the model evidence that can be used for parameter inference and model comparison, respectively. The aforementioned framework has been thoroughly tested in a variety of challenging target distributions achieving state-of-the-art sampling performance. In the cases of primordial feature analysis and gravitational wave inference, PMC is approximately 50 and 25 times faster, respectively, than nested sampling (NS). We found that in higher dimensional applications, the acceleration is even greater. Finally, PMC is directly parallelisable, manifesting linear scaling up to thousands of CPUs.

79 ASTRONOMY AND ASTROPHYSICS↗