Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Likelihood Functions”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Mobile sensing of point-source gas emissions using Bayesian inference: An empirical examination of the likelihood function

This paper evaluates likelihood function forms for Bayesian inference of point-source gas emissions using a mobile sensor. Whereas Bayesian inference has been successfully used to estimate emission rates from time-averaged concentration data measured by stationary sensors, data collected by mobile sensors do not represent ensemble or time-averaged conditions. To examine the potential impact of this contrast, controlled release experiments were conducted with a mobile sensor measuring concentrations repeatedly along transverse cross sections of the downwind plumes. Experiments were conducted with measurements made at different downwind distances, different sensor heights, and with different obstacle states. An examination is made between two commonly-used likelihood functions, the Gaussian and the log-normal. For experiments conducted in the absence of obstacles, the Bayesian estimates using the log-normal likelihood function yield a much smaller bias than those based on the Gaussian likelihood function. This finding is consistent with the non-Gaussian nature of concentration fluctuations near a point-source. For experiments conducted in the presence of obstacles, the Bayesian inference based on the Gaussian likelihood function exhibits a better performance. This can be explained by the enhanced turbulent mixing due to the obstacle-introduced wake eddies. Overall, we find that the selection of the likelihood function can be physically related to the underlying conditions, and the proper selection is critical to ensure the performance of the Bayesian inference for source characterization using mobile sensing data.

54 ENVIRONMENTAL SCIENCES↗

Evaluating crystallographic likelihood functions using numerical quadratures

Intensity-based likelihood functions in crystallographic applications have the potential to enhance the quality of structures derived from marginal diffraction data. Their usage, however, is complicated by the ability to efficiently compute these target functions. Here, a numerical quadrature is developed that allows the rapid evaluation of intensity-based likelihood functions in crystallographic applications. By using a sequence of change-of-variable transformations, including a nonlinear domain-compression operation, an accurate, robust and efficient quadrature is constructed. The approach is flexible and can incorporate different noise models with relative ease.

59 BASIC BIOLOGICAL SCIENCES↗

Copula cosmology: Constructing a likelihood function

To estimate cosmological parameters from a given data set, we need to construct a likelihood function, which sometimes has a complicated functional form. We introduce the copula, a mathematical tool to construct an arbitrary multivariate distribution function from one-dimensional marginal distribution functions with any given dependence structure. It is shown that a likelihood function constructed by the so-called Gaussian copula can reproduce very well the n-dimensional probability distribution of the cosmic shear power spectrum obtained from a large number of ray-tracing simulations. This suggests that the Copula likelihood will be a powerful tool for future weak lensing analyses, instead of the conventional multivariate Gaussian likelihood.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Improved renormalization group computation of likelihood functions for cosmological data sets

Evaluation of likelihood functions for cosmological large scale structure data sets (including CMB, galaxy redshift surveys, etc.) naturally involves marginalization, i.e., integration, over an unknown underlying random signal field. Recently, I showed how a renormalization group method can be used to carry out this integration efficiently by first integrating out the smallest scale structure, i.e., localized structure on the scale of differences between nearby data cells, then combining adjacent cells in a coarse graining step, then repeating this process over and over until all scales have been integrated. Here I extend the formulation in several ways in order to reduce the prefactor on the method's linear scaling with data set size. The key improvement is showing how to integrate out the difference between specific adjacent cells before summing them in the coarse graining step, compared to the original formulation in which small-scale fluctuations were integrated more generally. I suggest some other improvements in details of the scheme, including showing how to perform the integration around a maximum likelihood estimate for the underlying random field. In the end, an accurate likelihood computation for a million-cell Gaussian test data set runs in two minutes on my laptop, with room for further optimization and straightforward parallelization.

79 ASTRONOMY AND ASTROPHYSICS↗

Likelihood Functions for Supersymmetric Observables in Frequentist Analyses of the CMSSM and NUHM1

On the basis of frequentist analyses of experimental constraints from electroweak precision data, g-2, B physics and cosmological data, we investigate the parameters of the constrained MSSM (CMSSM) with universal soft supersymmetry-breaking mass parameters, and a model with common non-universal Higgs masses (NUHM1). We present chi^2 likelihood functions for the masses of supersymmetric particles and Higgs bosons, as well as b to s gamma, b to mu mu and the spin-independent dark matter scattering cross section. In the CMSSM we find preferences for sparticle masses that are relatively light. In the NUHM1 the best-fit values for many sparticle masses are even slightly smaller, but with greater uncertainties. The likelihood functions for most sparticle masses are cut off sharply at small masses, in particular by the LEP Higgs mass constraint. Both in the CMSSM and the NUHM1, the coannihilation region is favoured over the focus-point region at about the 3-sigma level, largely but not exclusively because of g-2. Many sparticle masses are highly correlated in both the CMSSM and NUHM1, and most of the regions preferred at the 95% C.L. are accessible to early LHC running. Some slepton and chargino/neutralino masses should be in reach at the ILC. The masses of the heavier Higgs bosons should be accessible at the LHC and the ILC in portions of the preferred regions in the (M_A, tan beta) plane. In the CMSSM, the likelihood function for b to mu mu is peaked close to the Standard Model value, but much larger values are possible in the NUHM1. We find that values of the DM cross section > 10^{-10} pb are preferred in both the CMSSM and the NUHM1. We study the effects of dropping the g-2, b to s gamma, relic density and M_h constraints.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

CONSTRUCTING A FLEXIBLE LIKELIHOOD FUNCTION FOR SPECTROSCOPIC INFERENCE

We present a modular, extensible likelihood framework for spectroscopic inference based on synthetic model spectra. The subtraction of an imperfect model from a continuously sampled spectrum introduces covariance between adjacent datapoints (pixels) into the residual spectrum. For the high signal-to-noise data with large spectral range that is commonly employed in stellar astrophysics, that covariant structure can lead to dramatically underestimated parameter uncertainties (and, in some cases, biases). We construct a likelihood function that accounts for the structure of the covariance matrix, utilizing the machinery of Gaussian process kernels. This framework specifically addresses the common problem of mismatches in model spectral line strengths (with respect to data) due to intrinsic model imperfections (e.g., in the atomic/molecular databases or opacity prescriptions) by developing a novel local covariance kernel formalism that identifies and self-consistently downweights pathological spectral line “outliers.” By fitting many spectra in a hierarchical manner, these local kernels provide a mechanism to learn about and build data-driven corrections to synthetic spectral libraries. An open-source software implementation of this approach is available at http://iancze.github.io/Starfish, including a sophisticated probabilistic scheme for spectral interpolation when using model libraries that are sparsely sampled in the stellar parameters. We demonstrate some salient features of the framework by fitting the high-resolution V-band spectrum of WASP-14, an F5 dwarf with a transiting exoplanet, and the moderate-resolution K-band spectrum of Gliese 51, an M5 field dwarf.

79 ASTRONOMY AND ASTROPHYSICS↗

Renormalization group computation of likelihood functions for cosmological data sets

I show how a renormalization group (RG) method can be used to incrementally integrate the information in cosmological large-scale structure data sets (including CMB, galaxy redshift surveys, etc.). I show numerical tests for Gaussian fields, where the method allows arbitrarily close to exact computation of the likelihood function in order N time, even for problems with no symmetry, compared to N 3 for brute force linear algebra (where N is the number of data points - to be fair, methods already exist to solve the Gaussian problem in at worst N log N time, and this method will not necessarily be faster in practice). The method requires no sampling or other Monte Carlo (random) element. Nonlinearity/non-Gaussianity can be accounted for to the extent that terms generated by integrating out small scale modes can be projected onto a sufficient basis, e.g., at least in the sufficiently perturbative regime. The formulas to evaluate are straightforward and require no understanding of quantum field theory, but this paper may also serve as a pedagogical introduction to Wilsonian RG for astronomers.

79 ASTRONOMY AND ASTROPHYSICS↗

Non-Gaussianity in the weak lensing correlation function likelihood – implications for cosmological parameter biases

ABSTRACT We study the significance of non-Gaussianity in the likelihood of weak lensing shear two-point correlation functions, detecting significantly non-zero skewness and kurtosis in 1D marginal distributions of shear two-point correlation functions in simulated weak lensing data. We examine the implications in the context of future surveys, in particular LSST, with derivations of how the non-Gaussianity scales with survey area. We show that there is no significant bias in 1D posteriors of Ωm and σ8 due to the non-Gaussian likelihood distributions of shear correlations functions using the mock data (100 deg2). We also present a systematic approach to constructing approximate multivariate likelihoods with 1D parametric functions by assuming independence or more flexible non-parametric multivariate methods after decorrelating the data points using principal component analysis (PCA). While the use of PCA does not modify the non-Gaussianity of the multivariate likelihood, we find empirically that the 1D marginal sampling distributions of the PCA components exhibit less skewness and kurtosis than the original shear correlation functions. Modelling the likelihood with marginal parametric functions based on the assumption of independence between PCA components thus gives a lower limit for the biases. We further demonstrate that the difference in cosmological parameter constraints between the multivariate Gaussian likelihood model and more complex non-Gaussian likelihood models would be even smaller for an LSST-like survey. In addition, the PCA approach automatically serves as a data compression method, enabling the retention of the majority of the cosmological information while reducing the dimensionality of the data vector by a factor of ∼5.

79 ASTRONOMY AND ASTROPHYSICS↗

The Use of Dynamic Stochastic Social Behavior Models to Produce Likelihood Functions for Risk Modeling of Proliferation and Terrorist Attacks

The ability to estimate the likelihood of future events based on current and historical data is essential to the decision making process of many government agencies. Successful predictions related to terror events and characterizing the risks will support development of options for countering these events. The predictive tasks involve both technical and social component models. The social components have presented a particularly difficult challenge. This paper outlines some technical considerations of this modeling activity. Both data and predictions associated with the technical and social models will likely be known with differing certainties or accuracies – a critical challenge is linking across these model domains while respecting this fundamental difference in certainty level. This paper will describe the technical approach being taken to develop the social model and identification of the significant interfaces between the technical and social modeling in the context of analysis of diversion of nuclear material.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

A strategy for improved computational efficiency of the method of anchored distributions

This paper proposes a strategy for improving the computational efficiency of model inversion using the method of anchored distributions by “bundling” similar model parametrizations in the likelihood function. Inferring the likelihood function typically requires a large number of forward model simulations for each possible model parametrization; as a result, the process is quite expensive. To ease this prohibitive cost, we present an approximation for the likelihood function – called “bundling” – that relaxes the requirement for high quantities of forward model simulations. This approximation redefines the conditional statement of the likelihood function as the probability of sets of similar model parametrizations – “bundles” – replicating field measurements. To evaluate the effectiveness of these modifications, we compare the quality of predictions and computational cost of bundling relative to a baseline method of anchored distributions inversion of three-dimensional flow and transport model parameters. For our synthetic experiment, bundling achieved a 35% reduction in overall computational cost and had a limited negative on predicted probability distributions of the model parameters. Strategies for minimizing error in the bundling approximation, for enforcing similarity amongst the sets of model parametrizations, and for identifying convergence of the likelihood function are also presented.

Bayesian Inversion, SVD, computational efficiency↗

Dwarf spheroidal J-factor likelihoods for generalized NFW profiles

ABSTRACT Indirect detection strategies of particle dark matter (DM) in Dwarf spheroidal satellite galaxies (dSphs) typically entail searching for annihilation signals above the astrophysical background. To robustly compare model predictions with the observed fluxes of product particles, most analyses of astrophysical data – which are generally frequentist – rely on estimating the abundance of DM by calculating the so-called J factor. This quantity is usually inferred from the kinematic properties of the stellar population of a dSph using the Jeans equation, commonly by means of Bayesian techniques that entail the presence (and additional systematic uncertainty) of prior choice. Here, extending earlier work, we develop a scheme to derive the profile likelihood for J factors of dwarf spheroidals for models with five or more free parameters. We validate our method on a publicly available simulation suite, released by the Gaia Challenge, finding satisfactory statistical properties for bias and probability coverage. We present the profile likelihood function and maximum likelihood estimates for the J-factor of 10 dSphs. As an illustration, we apply these profile likelihoods to recently published analyses of γ-ray data with the Fermi Large Area Telescope to derive new, consistent upper limits on the DM annihilation cross-section. We do this for a subset of systems, generally referred to as classical dwarfs. The implications of these findings for DM searches are discussed, together with future improvements and extensions of this technique.

79 ASTRONOMY AND ASTROPHYSICS↗

AN EFFICIENT APPROXIMATION TO THE LIKELIHOOD FOR GRAVITATIONAL WAVE STOCHASTIC BACKGROUND DETECTION USING PULSAR TIMING DATA

Direct detection of gravitational waves by pulsar timing arrays will become feasible over the next few years. In the low frequency regime (10{sup -7} Hz-10{sup -9} Hz), we expect that a superposition of gravitational waves from many sources will manifest itself as an isotropic stochastic gravitational wave background. Currently, a number of techniques exist to detect such a signal; however, many detection methods are computationally challenging. Here we introduce an approximation to the full likelihood function for a pulsar timing array that results in computational savings proportional to the square of the number of pulsars in the array. Through a series of simulations we show that the approximate likelihood function reproduces results obtained from the full likelihood function. We further show, both analytically and through simulations, that, on average, this approximate likelihood function gives unbiased parameter estimates for astrophysically realistic stochastic background amplitudes.

79 ASTRONOMY AND ASTROPHYSICS↗

A BAYESIAN ASSESSMENT OF P-VALUES FOR SIGNIFICANCE ESTIMATION OF POWER SPECTRA AND AN ALTERNATIVE PROCEDURE, WITH APPLICATION TO SOLAR NEUTRINO DATA

The usual procedure for estimating the significance of a peak in a power spectrum is to calculate the probability of obtaining that value or a larger value by chance (known as the 'p-value'), on the assumption that the time series contains only noise-typically that the measurements are derived from random samplings of a Gaussian distribution. However, since the use of p-values in other contexts is known to be misleading, it seems prudent to examine the implications of using p-values for significance estimation of power spectra. We really need to know the probability that the time series is-or is not-compatible with the 'null hypothesis' that the measurements are derived from noise. This probability can be calculated by Bayesian analysis, but this requires one to specify and evaluate a second hypothesis that the time series does contain a contribution other than noise. We show that the requirement that the p-value should be identical to the probability that the null hypothesis is true leads to an unacceptable form for the likelihood function associated with this hypothesis. We claim that, for this reason, the p-value is not an acceptable method for significance estimation of a power spectrum. In order to obtain an acceptable significance estimate, it is necessary to explicitly consider a second hypothesis, and the key challenge is to identify an appropriate likelihood function for this hypothesis. We first propose four simple conditions that it seems reasonable to impose on this function. We then examine a general functional form for the function, and find the simplest form (which has one free parameter) that meets these conditions. We then define two different ways of combining information derived from two independent power estimates. One procedure is to calculate the post-probabilities of the null hypothesis, convert these to odds-values, and sum the log-odds. The second procedure is to combine the p-values using a procedure due to R.A. Fisher, and to calculate the corresponding post-probability and hence the corresponding log-odds. It seems sensible-even if not logically essential-to seek a likelihood function for which the two procedures lead to the same answer. We find that this consistency condition may be satisfied, to good approximation, by a special case of the previously proposed likelihood function. We find that the resulting significance estimates are considerably more conservative than those usually associated with the p-values. As two examples, we apply the new procedure to two recent analyses of solar neutrino data: (1) power spectrum analysis of Super-Kamiokande data and (2) the combined analysis of radiochemical neutrino data and irradiance data.

79 ASTRONOMY AND ASTROPHYSICS↗

Determining frequentist confidence limits using a directed parameter space search

We consider the problem of inferring constraints on a high-dimensional parameter space with a computationally expensive likelihood function. We propose a machine learning algorithm that maps out the Frequentist confidence limit on parameter space by intelligently targeting likelihood evaluations so as to quickly and accurately characterize the likelihood surface in both low- and high-likelihood regions. We compare our algorithm to Bayesian credible limits derived by the well-tested Markov Chain Monte Carlo (MCMC) algorithm using both multi-modal toy likelihood functions and the seven yr Wilkinson Microwave Anisotropy Probe cosmic microwave background likelihood function. We find that our algorithm correctly identifies the location, general size, and general shape of high-likelihood regions in parameter space while being more robust against multi-modality than MCMC.

79 ASTRONOMY AND ASTROPHYSICS↗

Bayesian optimization of generalized data

Direct application of Bayes' theorem to generalized data yields a posterior probability distribution function (PDF) that is a product of a prior PDF of generalized data and a likelihood function, where generalized data consists of model parameters, measured data, and model defect data. The prior PDF of generalized data is defined by prior expectation values and a prior covariance matrix of generalized data that naturally includes covariance between any two components of generalized data. A set of constraints imposed on the posterior expectation values and covariances of generalized data via a given model is formally solved by the method of Lagrange multipliers. Posterior expectation values of the constraints and their covariance matrix are conventionally set to zero, leading to a likelihood function that is a Dirac delta function of the constraining equation. It is shown that setting constraints to values other than zero is analogous to introducing a model defect. Since posterior expectation values of any function of generalized data are integrals of that function over all generalized data weighted by the posterior PDF, all elements of generalized data may be viewed as nuisance parameters marginalized by this integration. One simple form of posterior PDF is obtained when the prior PDF and the likelihood function are normal PDFs. For linear models without a defect this PDF becomes equivalent to constrained least squares (CLS) method, that is, the χ2 minimization method.

Arbanas, Goran↗

ASCR Workshop Position Paper: Challenges and Opportunities in High Energy Physics

High energy particle physics and cosmology concern themselves with estimating fundamental parameters of nature, such as the masses and interactions of fundamental particles like the Higgs boson and the rate of expansion of the universe. In doing so, they analyze exabyte-scale datasets, some of the largest in all of science, and face many challenges in subsequent data analysis. These challenges are shared between the two disciplines, but we focus on particle physics to highlight one specific domain. In particle physics, the standard method for estimating parameters involves performing Monte Carlo (MC) integration as a function of both parameters of interest and nuisance parameters using an expensive simulator, counting the number of observed collision events (i.i.d. samples) from an experiment in the corresponding integration domains, and forming a Poisson likelihood function. This likelihood function is then used in a Frequentist manner to construct a maximum likelihood point estimate (MLE) and confidence set for the parameters. To sufficiently populate the high-dimensional integration domains, simulators consume billions of CPU-hours annually and produce hundreds of petabytes of intermediate output data. Several techniques have been developed to: optimize definitions of the integration domains so as to be maximally sensitive to a particular subset of parameters, efficiently estimate the integrals, and build robust surrogate models by interpolating between integral evaluations at different parameter points. One can view this whole endeavor as classical Simulation-Based Inference (SBI).

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗