Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Likelihood Functions”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

STUDIES IN ASTRONOMICAL TIME SERIES ANALYSIS. VI. BAYESIAN BLOCK REPRESENTATIONS

This paper addresses the problem of detecting and characterizing local variability in time series and other forms of sequential data. The goal is to identify and characterize statistically significant variations, at the same time suppressing the inevitable corrupting observational errors. We present a simple nonparametric modeling technique and an algorithm implementing it-an improved and generalized version of Bayesian Blocks-that finds the optimal segmentation of the data in the observation interval. The structure of the algorithm allows it to be used in either a real-time trigger mode, or a retrospective mode. Maximum likelihood or marginal posterior functions to measure model fitness are presented for events, binned counts, and measurements at arbitrary times with known error distributions. Problems addressed include those connected with data gaps, variable exposure, extension to piecewise linear and piecewise exponential representations, multivariate time series data, analysis of variance, data on the circle, other data modes, and dispersed data. Simulations provide evidence that the detection efficiency for weak signals is close to a theoretical asymptotic limit derived by Arias-Castro et al. In the spirit of Reproducible Research all of the code and data necessary to reproduce all of the figures in this paper are included as supplementary material.

79 ASTRONOMY AND ASTROPHYSICS↗

Prospects for direct detection of dark matter in an effective theory approach

We perform the first comprehensive analysis of the prospects for direct detection of dark matter with future ton-scale detectors in the general 11-dimensional effective theory of isoscalar dark matter-nucleon interactions mediated by a heavy spin-1 or spin-0 particle. The theory includes 8 momentum and velocity dependent dark matter-nucleon interaction operators, besides the familiar spin-independent and spin-dependent operators. From a variegated sample of 27 benchmark points selected in the parameter space of the theory, we simulate independent sets of synthetic data for ton-scale Germanium and Xenon detectors. From the synthetic data, we then extract the marginal posterior probability density functions and the profile likelihoods of the model parameters. The associated Bayesian credible regions and frequentist confidence intervals allow us to assess the prospects for direct detection of dark matter at the 27 benchmark points. First, we analyze the data assuming the knowledge of the correct dark matter nucleon-interaction type, as it is commonly done for the familiar spin-independent and spin-dependent interactions. Then, we analyze the simulations extracting the dark matter-nucleon interaction type from the data directly, in contrast to standard analyses. This second approach requires an extensive exploration of the full 11-dimensional parameter space of the dark matter-nucleon effective theory. Interestingly, we identify 5 scenarios where the dark matter mass and the dark matter-nucleon interaction type can be reconstructed from the data simultaneously. We stress the importance of extracting the dark matter nucleon-interaction type from the data directly, discussing the main challenges found addressing this complex 11-dimensional problem.

79 ASTRONOMY AND ASTROPHYSICS↗

EVIDENCE FOR NON-EVOLVING Fe II/Mg II RATIOS IN RAPIDLY ACCRETING z {approx} 6 QSOs

Quasars (QSOs) at the highest known redshift (z {approx} 6) are unique probes of the early growth of supermassive black holes (BHs). Until now, only the most luminous QSOs have been studied, often one object at a time. Here we present the most extensive consistent analysis to date of 4 < z < 6.5 QSOs with observed near-infrared spectra, combining three new z {approx} 6 objects from our ongoing Very Large Telescope-Infrared Spectrometer And Array Camera program with nineteen sources from the literature. The new sources extend the existing Sloan Digital Sky Survey (SDSS) sample toward the faint end of the QSO luminosity function. Using a maximum likelihood fitting routine optimized for our spectral decomposition, we estimate the BH mass (M{sub BH}), the Eddington ratio (defined as L{sub bol}/L{sub Edd}), and the Fe II/Mg II line ratio, a proxy for the chemical abundance, to characterize both the central object and the broad-line region gas. The QSOs in our sample host BHs with masses of {approx}10{sup 9} M{sub sun} that are accreting close to the Eddington luminosity, consistent with earlier results. We find that the distribution of observed Eddington ratios is significantly different than that of a luminosity-matched comparison sample of SDSS QSOs at lower redshift (0.35 < z < 2.25): the average (log (L{sub bol}/L{sub Edd})) = -0.37 (L{sub bol}/L{sub Edd} {approx} 0.43) with a scatter of 0.20 dex for the z > 4 sample and the (log (L{sub bol}/L{sub Edd})) = -0.80 (L{sub bol}/L{sub Edd} {approx} 0.16) with a scatter of 0.24 dex for the 0.35 < z < 2.25 sample. This implies that, at a given luminosity, the M{sub BH} at high-z is typically lower than the average M{sub BH} of the lower-redshift population, i.e., the z > 4 sources are accreting significantly faster than the lower-redshift ones. We show that the derived Fe II/Mg II ratios depend sensitively on the analysis performed: our self-consistent, homogeneous analysis significantly reduces the Fe II/Mg II scatter found in previous studies. The measured Fe II/Mg II line ratios show no sign of evolution with cosmic time in the redshift range 4 < z < 6.5. If the Fe II/Mg II line ratio is used as a secondary proxy of the Fe/Mg abundance ratio, this implies that the QSOs in our sample have undergone a major episode of Fe enrichment in the few 100 Myr preceding the cosmic age at which they are observed.

79 ASTRONOMY AND ASTROPHYSICS↗

SkyFACT: high-dimensional modeling of gamma-ray emission with adaptive templates and penalized likelihoods

We present SkyFACT (Sky Factorization with Adaptive Constrained Templates), a new approach for studying, modeling and decomposing diffuse gamma-ray emission. Like most previous analyses, the approach relies on predictions from cosmic-ray propagation codes like GALPROP and DRAGON. However, in contrast to previous approaches, we account for the fact that models are not perfect and allow for a very large number (∼> 10{sup 5}) of nuisance parameters to parameterize these imperfections. We combine methods of image reconstruction and adaptive spatio-spectral template regression in one coherent hybrid approach. To this end, we use penalized Poisson likelihood regression, with regularization functions that are motivated by the maximum entropy method. We introduce methods to efficiently handle the high dimensionality of the convex optimization problem as well as the associated semi-sparse covariance matrix, using the L-BFGS-B algorithm and Cholesky factorization. We test the method both on synthetic data as well as on gamma-ray emission from the inner Galaxy, |ℓ|<90{sup o} and | b |<20{sup o}, as observed by the Fermi Large Area Telescope. We finally define a simple reference model that removes most of the residual emission from the inner Galaxy, based on conventional diffuse emission components as well as components for the Fermi bubbles, the Fermi Galactic center excess, and extended sources along the Galactic disk. Variants of this reference model can serve as basis for future studies of diffuse emission in and outside the Galactic disk.

79 ASTRONOMY AND ASTROPHYSICS↗

Reduction of density-modification bias by β correction

A cross-validation-based method for bias reduction in ‘classical’ iterative density modification of experimental X-ray crystallography maps provides significantly more accurate phase-quality estimates and leads to improved automated model building. Density modification often suffers from an overestimation of phase quality, as seen by escalated figures of merit. A new cross-validation-based method to address this estimation bias by applying a bias-correction parameter ‘β’ to maximum-likelihood phase-combination functions is proposed. In tests on over 100 single-wavelength anomalous diffraction data sets, the method is shown to produce much more reliable figures of merit and improved electron-density maps. Furthermore, significantly better results are obtained in automated model building iterated with phased refinement using the more accurate phase probability parameters from density modification.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

PET Imaging Agents (FES, FFNP, and FDHT) for Estrogen, Androgen, and Progesterone Receptors to Improve Management of Breast and Prostate Cancers by Functional Imaging

Many breast and prostate cancers are driven by the action of steroid hormones on their cognate receptors in primary tumors and in metastases, and endocrine therapies that inhibit hormone production or block the action of these receptors provide clinical benefit to many but not all of these cancer patients. Because it is difficult to predict which individuals will be helped by endocrine therapies and which will not, positron emission tomography (PET) imaging of estrogen receptor (ER) and progesterone receptor (PgR) in breast cancer, and androgen receptor (AR) in prostate cancer can provide useful, often functional, information on the likelihood of endocrine therapy response in individual patients. This review covers our development of three PET imaging agents, 16α-[ 18 F]fluoroestradiol (FES) for ER, 21-[ 18 F]fluoro-furanyl-nor-progesterone (FFNP) for PgR, and 16β-[ 18 F]fluoro-5α-dihydrotestosterone (FDHT) for AR, and the evolution of their clinical use. For these agents, the pathway from concept through development tracks with an emerging understanding of critical performance criteria that is needed for successful PET imaging of these low-abundance receptor targets. Progress in the ongoing evaluation of what they can add to the clinical management of breast and prostate cancers reflects our increased understanding of these diseases and of optimal strategies for predicting the success of clinical endocrine therapies.

60 APPLIED LIFE SCIENCES↗

Integration and Assessment of Component Health Prognostics in Supervisory Control Systems

Enhanced risk monitors (ERMs) for active components in advanced reactor concepts use predictive estimates of component failure to update, in real time, predictive safety and economic risk metrics. These metrics have been shown to be capable of use in optimizing maintenance scheduling and managing plant maintenance costs. Integrating this information with plant supervisory control systems increases the potential for making control decisions that utilize real-time information on component conditions. Such decision making would limit the possibility of plant operations that increase the likelihood of degrading the functionality of one or more components while maintaining the overall functionality of the plant. ERM uses sensor data for providing real-time information about equipment condition for deriving risk monitors. This information is used to estimate the remaining useful life and probability of failure of these components. By combining this information with plant probabilistic risk assessment models, predictive estimates of risk posed by continued plant operation in the presence of detected degradation may be estimated. In this paper, we describe this methodology in greater detail, and discuss its integration with a prototypic software-based plant supervisory control platform. In order to integrate these two technologies and evaluate the integrated system, software to simulate the sensor data was developed, prognostic models for feedwater valves were developed, and several use cases defined. The full paper will describe these use cases, and the results of the initial evaluation.

Ramuhalli, Pradeep↗

Integration and assessment of component health prognostics in supervisory control systems - 291

Enhanced risk monitors (ERMs) for active components in advanced reactor concepts use predictive estimates of component failure to update, in real time, predictive safety and economic risk metrics. These metrics have been shown to be capable of use in optimizing maintenance scheduling and managing plant maintenance costs. Integrating this information with plant supervisory control systems increases the potential for making control decisions that utilize realtime information on component conditions. Such decision making would limit the possibility of plant operations that increase the likelihood of degrading the functionality of one or more components while maintaining the overall functionality of the plant. ERM uses sensor data for providing real-time information about equipment condition for deriving risk monitors. This information is used to estimate the remaining useful life and probability of failure of these components. By combining this information with plant probabilistic risk assessment models, predictive estimates of risk posed by continued plant operation in the presence of detected degradation may be estimated. In this paper, we describe this methodology in greater detail, and discuss its integration with a prototypic software-based plant supervisory control platform. In order to integrate these two technologies and evaluate the integrated system, software to simulate the sensor data was developed, prognostic models for feedwater valves were developed, and several use cases defined. The full paper will describe these use cases, and the results of the initial evaluation. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Finding Cryptography in Object Code

Finding and identifying Cryptography is a growing concern in the malware analysis community. In this paper, a heuristic method for determining the likelihood that a given function contains a cryptographic algorithm is discussed and the results of applying this method in various environments is shown. The algorithm is based on frequency analysis of opcodes that make up each function within a binary.

97 MATHEMATICS AND COMPUTING↗

The Multi-Mission Maximum Likelihood framework (3ML)

The age of multi-wavelength and multi-messenger astronomy has arrived and with it, new tools are needed to analyze data from multiple instruments properly and with ease. The Multi-Mission Maximum Likelihood framework (3ML) provides this functionality via the novel use of instrument plugins which allow for every instrument’s unique data to be treated independently with an appropriate likelihood. Under the 3ML framework, users can design plugins that handle instrument specific data routines transparently in the background. When multiple instruments are used together, their independent likelihoods are treated under a common minimization or Bayesian sampling framework. 3ML provides a multitude of minimization algorithm for maximum likelihood estimation (MLE) as well as several popular Bayesian posterior samplers. The entire framework is provided via a modern Python interface providing the user with a modern and easily transportable analysis framework well suited for modern astronomy. New models can be added easily. It is also possible to perform time-energy modeling. We present the framework and its main functionalities.

79 ASTRONOMY AND ASTROPHYSICS↗

Caching and interpolated likelihoods: accelerating cosmological Monte Carlo Markov chains

We describe a novel approach to accelerating Monte Carlo Markov Chains. Our focus is cosmological parameter estimation, but the algorithm is applicable to any problem for which the likelihood surface is a smooth function of the free parameters and computationally expensive to evaluate. We generate a high-order interpolating polynomial for the log-likelihood using the first points gathered by the Markov chains as a training set. This polynomial then accurately computes the majority of the likelihoods needed in the latter parts of the chains. We implement a simple version of this algorithm as a patch (InterpMC) to CosmoMC and show that it accelerates parameter estimatation by a factor of between two and four for well-converged chains. The current code is primarily intended as a ''proof of concept'', and we argue that there is considerable room for further performance gains. Unlike other approaches to accelerating parameter fits, we make no use of precomputed training sets or special choices of variables, and InterpMC is almost entirely transparent to the user.

79 ASTRONOMY AND ASTROPHYSICS↗

Effect of likelihood misspecification in Gaussian process-driven autonomous experimentation

In recent years, several groups have designed Autonomous Experiment (AE) models with the aim of using them as an alternative method for neutron scattering scanning. In an AE, Gaussian processes (GPs) are most frequently used due to their interpretability, their non-parametric nature, their universal approximation, and their closed-form predictive distribution. GPs have two key components, namely, the model for the likelihood of a neutron count knowing the underlying dynamic structure factor and the acquisition function. In this paper, we investigate the impact, on the quality of an AE, of the likelihood and acquisition function choices, in energy scans and (Q, ω) ones, with respect to the signal-over-noise ratio. While we hypothesized that the quality of GP predictions would decrease when the normal to Poisson likelihood approximation breaks down at low count rates, we found that the use of the correct Poisson likelihood does not improve the quality of the data collected, as well as yields very poor results in (Q, ω) scans at low count rates. In fact, the best results are obtained with a combination of normal likelihood, including the observation noise, and the change in variance acquisition function. In addition, we find that the performance, or quality of the predictive distribution, is a misleading measure of efficiency, that is, of the quality of the data collected.

Perryman, David Elliott [Inst. Laue-Langevin (ILL)↗

Precision measurement of the top quark mass in the lepton + jets channel using a matrix element method with Quasi-Monte Carlo integration

This thesis presents a measurement of the top quark mass obtained from p$\bar{p}$ collisions at √s = 1.96 TeV at the Fermilab Tevatron using the CDF II detector. The measurement uses a matrix element integration method to calculate a t$\bar{t}$ likelihood, employing a Quasi-Monte Carlo integration, which enables us to take into account effects due to finite detector angular resolution and quark mass effects. We calculate a t$\bar{t}$ likelihood as a 2-D function of the top pole mass m t and Δ JES , where Δ JES parameterizes the uncertainty in our knowledge of the jet energy scale; it is a shift applied to all jet energies in units of the jet-dependent systematic error. By introducing Δ JES into the likelihood, we can use the information contained in W boson decays to constrain Δ JES and reduce error due to this uncertainty. We use a neural network discriminant to identify events likely to be background, and apply a cut on the peak value of individual event likelihoods to reduce the effect of badly reconstructed events. This measurement uses a total of 4.3 fb -1 of integrated luminosity, requiring events with a lepton, large E T , and exactly four high-energy jets in the pseudorapidity range |η| < 2.0, of which at least one must be tagged as coming from a b quark. In total, we observe 738 events before and 630 events after applying the likelihood cut, and measure m t = 172.6 ± 0.9 (stat.) ± 0.7 (JES) ± 1.1 (syst.) GeV/c 2 , or m t = 172.6 ± 1.6 (tot.) GeV/c 2 .

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

CODEX weak lensing mass catalogue and implications on the mass–richness relation

The COnstrain Dark Energy with X-ray clusters (CODEX) sample contains the largest flux limited sample of X-ray clusters at 0.35 < z < 0.65. It was selected from ROSAT data in the 10 000 square degrees of overlap with BOSS, mapping a total number of 2770 high-z galaxy clusters. We present here the full results of the CFHT CODEX programme on cluster mass measurement, including a reanalysis of CFHTLS Wide data, with 25 individual lensing-constrained cluster masses. We employ lensfit shape measurement and perform a conservative colour–space selection and weighting of background galaxies. Using the combination of shape noise and an analytic covariance for intrinsic variations of cluster profiles at fixed mass due to large-scale structure, miscentring, and variations in concentration and ellipticity, we determine the likelihood of the observed shear signal as a function of true mass for each cluster. We combine 25 individual cluster mass likelihoods in a Bayesian hierarchical scheme with the inclusion of optical and X-ray selection functions to derive constraints on the slope α, normalization β, and scatter σln λ|μ of our richness–mass scaling relation model in log-space: ${\langle {\rm In}\,\, \lambda\!\!\mid\!\!\mu\rangle = \alpha\mu + \beta,} $ with μ = ln (M 200c /M piv ), and M piv = 10 14.81 M ⊙ . We find a slope $\alpha = 0.49^{+0.20}_{-0.15}$, normalization $\exp (\beta) = 84.0^{+9.2}_{-14.8}$, and $\sigma _{\ln \lambda | \mu } = 0.17^{+0.13}_{-0.09}$ using CFHT richness estimates. In comparison to other weak lensing richness–mass relations, we find the normalization of the richness statistically agreeing with the normalization of other scaling relations from a broad redshift range (0.0 < z < 0.65) and with different cluster selection (X-ray, Sunyaev–Zeldovich, and optical).

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

New Machine Learning Techniques for Simulation-Based Inference: InferoStatic Nets, Kernel Score Estimation, and Kernel Likelihood Ratio Estimation

We propose an intuitive, machine-learning approach to multiparameter inference, dubbed the InferoStatic Networks (ISN) method, to model the score and likelihood ratio estimators in cases when the probability density can be sampled but not computed directly. The ISN uses a backend neural network that models a scalar function called the inferostatic potential $\varphi$. In addition, we introduce new strategies, respectively called Kernel Score Estimation (KSE) and Kernel Likelihood Ratio Estimation (KLRE), to learn the score and the likelihood ratio functions from simulated data. We illustrate the new techniques with some toy examples and compare to existing approaches in the literature. We mention en passant some new loss functions that optimally incorporate latent information from simulations into the training procedure.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Joint inference of multiplicative and additive systematics in galaxy density fluctuations and clustering measurements

Galaxy clustering measurements are a key probe of the matter density field in the Universe. With the era of precision cosmology upon us, surveys rely on precise measurements of the clustering signal for meaningful cosmological analysis. However, the presence of systematic contaminants can bias the observed galaxy number density, and thereby bias the galaxy two-point statistics. As the statistical uncertainties get smaller, correcting for these systematic contaminants becomes increasingly important for unbiased cosmological analysis. We present and validate a new method for understanding and mitigating both additive and multiplicative systematics in galaxy clustering measurements (two-point function) by joint inference of contaminants in the galaxy overdensity field (one-point function) using a maximum-likelihood estimator (MLE). We test this methodology with Kilo-Degree Survey-like mock galaxy catalogues and synthetic systematic template maps. We estimate the cosmological impact of such mitigation by quantifying uncertainties and possible biases in the inferred relationship between the observed and the true galaxy clustering signal. Our method robustly corrects the clustering signal to the sub-percent level and reduces numerous additive and multiplicative systematics from 1.5σ to less than 0.1σ for the scenarios we tested. In addition, we provide an empirical approach to identifying the functional form (additive, multiplicative, or other) by which specific systematics contaminate the galaxy number density. Even though this approach is tested and geared towards systematics contaminating the galaxy number density, the methods can be extended to systematics mitigation for other two-point correlation measurements.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

New machine learning techniques for simulation-based inference: InferoStatic nets, kernel score estimation, and kernel likelihood ratio estimation

We propose an intuitive, machine-learning approach to multiparameter inference, dubbed the InferoStatic Networks (ISN) method, to model the score and likelihood ratio estimators in cases when the probability density can be sampled but not computed directly. The ISN uses a backend neural network that models a scalar function called the inferostatic potential \varphi φ . In addition, we introduce new strategies, respectively called Kernel Score Estimation (KSE) and Kernel Likelihood Ratio Estimation (KLRE), to learn the score and the likelihood ratio functions from simulated data. We illustrate the new techniques with some toy examples and compare to existing approaches in the literature. We mention en passant some new loss functions that optimally incorporate latent information from simulations into the training procedure.

Kong, Kyoungchul↗

Codebase release 0.1 for infstat

We propose an intuitive, machine-learning approach to multiparameter inference, dubbed the InferoStatic Networks (ISN) method, to model the score and likelihood ratio estimators in cases when the probability density can be sampled but not computed directly. The ISN uses a backend neural network that models a scalar function called the inferostatic potential \varphi φ . In addition, we introduce new strategies, respectively called Kernel Score Estimation (KSE) and Kernel Likelihood Ratio Estimation (KLRE), to learn the score and the likelihood ratio functions from simulated data. We illustrate the new techniques with some toy examples and compare to existing approaches in the literature. We mention en passant some new loss functions that optimally incorporate latent information from simulations into the training procedure.

Kong, Kyoungchul↗