A likelihood ratio test for shrinkage covariance estimators
Explore the source record for details and available documents.
Anderson, Dylan Zachary↗
SEARCH · Engineering Papers
Results for “likelihood ratio test”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Assessing the Effectiveness of Generalized Likelihood Ratio Test Detector Schemes in Seismic Event Detection and the Avoidance of Nontarget Signals
Cross-correlation techniques have played a long-standing and pivotal role in seismic event monitoring. However, the performance of correlation-based detectors is challenged by nuisance seismicity, or nontarget signals. Such detections are a problem when the mission is to automatically map events to the correct source region. Using aftershocks of the 2014 $M_w$ 6.0 South Napa, California, earthquake, we demonstrate the effectiveness of utilizing a dynamic correlation processor framework in a generalized likelihood ratio test (GLRT) detector configuration to minimize nontarget detections. A GLRT maximizes a detection statistic with respect to one or more unknown parameters. In this case, the detection statistic is a template signal match against the waveform in a window sliding over a data stream, and the unknown parameter is an index variable indicating group membership of the template event or events. Detected events are assigned to the event group that yields the largest detection statistic. In this work, our results show that a GLRT detector will outperform a suite of independently operating correlation and subspace detectors in terms of having a lower nontarget detection rate at a given missed detection rate. We also show that a GLRT detector composed of a few high-rank subspace detectors has a slightly higher nontarget detection rate, but a significantly lower missed detection rate, than a GLRT detector composed of many low-rank subspace detectors. The high-rank GLRT configuration produced impressive results even with marginal data (single channel, single station, and very low time bandwidth product), which bodes well for the utility of building efficient aftershock classification systems and global monitoring systems at larger scales. However, future work is required to assess performance at the regional scale and to assess the performance of the system at detecting target events not used in the detector template creation.
58 GEOSCIENCES↗
A Likelihood Ratio Test of a Homoscedastic Multivariate Normal Mixture Against a Heteroscedastic Multivariate Normal Mixture
Not Available
Cong, Lin (ORCID:0000000319456203)↗
Penalized Logistic Regression Likelihood Ratio Test Analysis to Detect Signals of Adverse Events From Interactions in Postmarket Safety Surveillance
Not provided.
Mathematical & Computational Biology↗
Detection of DoS Attacks Using ARFIMA Modeling of GOOSE Communication in IEC 61850 Substations
Integration of Information and Communication Technology (ICT) in modern smart grids (SGs) offers many advantages including the use of renewables and an effective way to protect, control and monitor the energy transmission and distribution. To reach an optimal operation of future energy systems, availability, integrity and confidentiality of data should be guaranteed. Research on the cyber-physical security of electrical substations based on IEC 61850 is still at an early stage. In the present work, we first model the network traffic data in electrical substations, then, we present a statistical Anomaly Detection (AD) method to detect Denial of Service (DoS) attacks against the Generic Object Oriented Substation Event (GOOSE) network communication. According to interpretations on the self-similarity and the Long-Range Dependency (LRD) of the data, an Auto-Regressive Fractionally Integrated Moving Average (ARFIMA) model was shown to describe well the GOOSE communication in the substation process network. Based on this ARFIMA-model and in view of cyber-physical security, an effective model-based AD method is developed and analyzed. Two variants of the statistical AD considering statistical hypothesis testing based on the Generalized Likelihood Ratio Test (GLRT) and the cumulative sum (CUSUM) are presented to detect flooding attacks that might affect the availability of the data. Our work presents a novel AD method, with two different variants, tailored to the specific features of the GOOSE traffic in IEC 61850 substations. The statistical AD is capable of detecting anomalies at unknown change times under the realistic assumption of unknown model parameters. The performance of both variants of the AD method is validated and assessed using data collected from a simulation case study. We perform several Monte-Carlo simulations under different noise variances. The detection delay is provided for each detector and it represents the number of discrete time samples after which an anomaly is detected. In fact, our statistical AD method with both variants (CUSUM and GLRT) has around half the false positive rate and a smaller detection delay when compared with two of the closest works found in the literature. Our AD approach based on the GLRT detector has the smallest false positive rate among all considered approaches. Whereas, our AD approach based on the CUSUM test has the lowest false negative rate thus the best detection rate. Depending on the requirements as well as the costs of false alarms or missed anomalies, both variants of our statistical detection method can be used and are further analyzed using composite detection metrics.
IEC 61850 electrical substations↗
Absorptive Weak Plume Detection on Gaussian and Non-Gaussian Background Clutter
For additive signals on Gaussian clutter, the optimal detector is a linear matched filter that is adapted to the known signal and the covariance of the background. This adaptive matched filter is widely used for gas-phase plume detection, even though the effect of the plume on the background is not strictly additive. Here, a derivation of the matched filter for a strictly absorptive plume produces, in the weak plume limit, a quadratic filter. This quadratic matched filter is extended in two ways: an elliptically-contoured multivariate t distribution is used to generalize the Gaussian background clutter, and a generalized likelihood ratio test detector is derived to extend applicability to stronger plumes. In addition to detectors whose purpose is to identify presence versus absence of a plume, expressions are also derived for estimating plume strength. The performance of these various detectors is evaluated by implanting simulated plume into background images that are either real hyperspectral images or simulated images based on different (Gaussian, multivariate t, and lognormal) clutter distributions.
79 ASTRONOMY AND ASTROPHYSICS↗
Learning epistatic polygenic phenotypes with Boolean interactions
Detecting epistatic drivers of human phenotypes is a considerable challenge. Traditional approaches use regression to sequentially test multiplicative interaction terms involving pairs of genetic variants. For higher-order interactions and genome-wide large-scale data, this strategy is computationally intractable. Moreover, multiplicative terms used in regression modeling may not capture the form of biological interactions. Building on the Predictability, Computability, Stability (PCS) framework, we introduce the epiTree pipeline to extract higher-order interactions from genomic data using tree-based models. The epiTree pipeline first selects a set of variants derived from tissue-specific estimates of gene expression. Next, it uses iterative random forests (iRF) to search training data for candidate Boolean interactions (pairwise and higher-order). We derive significance tests for interactions, based on a stabilized likelihood ratio test, by simulating Boolean tree-structured null (no epistasis) and alternative (epistasis) distributions on hold-out test data. Finally, our pipeline computes PCS epistasis p-values that probabilisticly quantify improvement in prediction accuracy via bootstrap sampling on the test set. We validate the epiTree pipeline in two case studies using data from the UK Biobank: predicting red hair and multiple sclerosis (MS). In the case of predicting red hair, epiTree recovers known epistatic interactions surrounding MC1R and novel interactions, representing non-linearities not captured by logistic regression models. In the case of predicting MS, a more complex phenotype than red hair, epiTree rankings prioritize novel interactions surrounding HLA-DRB1 , a variant previously associated with MS in several populations. Taken together, these results highlight the potential for epiTree rankings to help reduce the design space for follow up experiments.
59 BASIC BIOLOGICAL SCIENCES↗
Bearing Fault Detection on Wind Turbine Gearbox Vibrations Using Generalized Likelihood Ratio-Based Indicators: Preprint
Studies in condition monitoring literature often aim to detect rolling element bearing faults because they have one of the biggest shares among defects in turbo machinery. Accordingly, several prognosis and diagnosis methods have been devised to identify fault signatures from vibration signals. The underlying idea behind traditional indicators often revolves around tracking both cyclostationarity and abnormal impulses in the vibration signals without distinguishing the two. A recently proposed method to capture the rolling element bearing degradation lays out the groundwork for new indicator families utilizing generalized likelihood ratio test. This novel approach exploits the cyclostationarity and the impulsiveness of vibration signals independently in order to estimate the most suitable indicators for a given fault. However, the method has yet to be tested on complex experimental vibration signals such as those of a wind turbine gearbox. In this study, the approach is applied to the NREL Wind Turbine Gearbox Condition Monitoring Round Robin Study data set for bearing fault detection purposes. The data set is measured on an experimental test rig of a wind turbine gearbox, hence the complexity of the vibration signals is similar to a real case. Furthermore, the new indicators are also tested with signals that carry multiple fault signatures. The outcome demonstrates that the proposed method is capable of distinguishing between healthy and damaged vibration signals measured on a complex wind turbine gearbox.
condition monitoring↗
Bearing Fault Detection on Wind Turbine Gearbox Vibrations Using Generalized Likelihood Ratio-Based Indicators
Studies in condition monitoring literature often aim to detect rolling element bearing faults because they have one of the biggest shares among defects in turbo machinery. Accordingly, several prognosis and diagnosis methods have been devised to identify fault signatures from vibration signals. A recently proposed method to capture the rolling element bearing degradation provides the groundwork for new indicator families utilizing the generalized likelihood ratio test. This novel approach exploits the cyclostationarity and the impulsiveness of vibration signals independently in order to estimate the most suitable indicators for a given fault. However, the method has yet to be tested on complex experimental vibration signals such as those of a wind turbine gearbox. In this study, the approach is applied to the National Renewable Energy Laboratory Wind Turbine Gearbox Condition Monitoring Round Robin Study data set for bearing fault detection purposes. The data set is measured on an experimental test rig of a wind turbine gearbox; hence the complexity of the vibration signals is similar to a real case. The outcome demonstrates that the proposed method is capable of distinguishing between healthy and damaged vibration signals measured on a complex wind turbine gearbox.
condition monitoring↗
Statistical Significance Testing for Mixed Priors: A Combined Bayesian and Frequentist Analysis
In many hypothesis testing applications, we have mixed priors, with well-motivated informative priors for some parameters but not for others. The Bayesian methodology uses the Bayes factor and is helpful for the informative priors, as it incorporates Occam’s razor via the multiplicity or trials factor in the look-elsewhere effect. However, if the prior is not known completely, the frequentist hypothesis test via the false-positive rate is a better approach, as it is less sensitive to the prior choice. We argue that when only partial prior information is available, it is best to combine the two methodologies by using the Bayes factor as a test statistic in the frequentist analysis. We show that the standard frequentist maximum likelihood-ratio test statistic corresponds to the Bayes factor with a non-informative Jeffrey’s prior. We also show that mixed priors increase the statistical power in frequentist analyses over the maximum likelihood test statistic. We develop an analytic formalism that does not require expensive simulations and generalize Wilks’ theorem beyond its usual regime of validity. In specific limits, the formalism reproduces existing expressions, such as the p-value of linear models and periodograms. We apply the formalism to an example of exoplanet transits, where multiplicity can be more than 10 7 . We show that our analytic expressions reproduce the $p$-values derived from numerical simulations. We offer an interpretation of our formalism based on the statistical mechanics. We introduce the counting of states in a continuous parameter space using the uncertainty volume as the quantum of the state. We show that both the $p$-value and Bayes factor can be expressed as an energy versus entropy competition.
97 MATHEMATICS AND COMPUTING↗
Data-directed search for new physics based on symmetries of the SM
We propose exploiting symmetries (exact or approximate) of the Standard Model (SM) to search for physics Beyond the Standard Model (BSM) using the data-directed paradigm (DDP). Symmetries are very powerful because they provide two samples that can be compared without requiring simulation. Focusing on the data, exclusive selections which exhibit significant asymmetry can be identified efficiently and marked for further study. Using a simple and generic test statistic which compares two matrices already provides good sensitivity, only slightly worse than that of the profile likelihood ratio test statistic which relies on the exact knowledge of the signal shape. This can be exploited for rapidly scanning large portions of the measured data, in an attempt to identify regions of interest. We also demonstrate that weakly supervised Neural Networks could be used for this purpose as well.
72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
Characterizing a supernova’s standing accretion shock instability with neutrinos and gravitational waves
Here, we perform a novel multi-messenger analysis for the identification and parameter estimation of the Standing Accretion Shock Instability (SASI) in a core collapse supernova with neutrino and gravitational wave (GW) signals. In the neutrino channel, this method performs a likelihood ratio test for the presence of SASI in the frequency domain. For gravitational wave signals we process an event with a modified constrained likelihood method. Using simulated supernova signals, the properties of the Hyper-Kamiokande neutrino detector, and O3 LIGO Interferometric data, we produce the two-dimensional probability density distribution (PDF) of the SASI activity indicator and calculate the probability of detection P D as well as the false identification probability P FI . We discuss the probability to establish the presence of the SASI as a function of the source distance in each observational channel, as well as jointly. Compared to a single-messenger approach, the joint analysis results in P D (at P FI = 0.1) of SASI activities that is larger by up to ≈ 40% for a distance to the supernova of 5 kpc. We also discuss how accurately the frequency and duration of the SASI activity can be estimated in each channel separately. Our methodology is suitable for implementation in a realistic data analysis and a multi-messenger setting.
79 ASTRONOMY AND ASTROPHYSICS↗
Hypothesis tests on Rayleigh wave radiation pattern shapes: a theoretical assessment of idealized source screening
SUMMARY Shallow seismic sources excite Rayleigh wave ground motion with azimuthally dependent radiation patterns. We place binary hypothesis tests on theoretical models of such radiation patterns to screen cylindrically symmetric sources (like explosions) from non-symmetric sources (like non-vertical dip-slip or non-VDS faults). These models for data include sources with several unknown parameters, contaminated by Gaussian noise and embedded in a layered half-space. The generalized maximum likelihood ratio tests that we derive from these data models produce screening statistics and decision rules that depend on measured, noisy ground motion at discrete sensor locations. We explicitly quantify how the screening power of these statistics increase with the size of any dip-slip and strike-slip components of the source, relative to noise (faulting signal strength) and how they vary with network geometry. As applications of our theory, we apply these tests to (1) find optimal sensor locations that maximize the probability of screening non-circular radiation patterns and (2) invert for the largest non-VDS faulting signal that could be mistakenly attributed to an explosion with damage, at a particular attribution probability. Finally, we quantify how certain errors that are sourced by opening cracks increase screening rate errors. While such theoretical solutions are ideal and require future validation, they remain important in underground explosion monitoring scenarios because they provide fundamental physical limits on the discrimination power of tests that screen explosive from non-VDS faulting sources.
58 GEOSCIENCES↗
Target Detection via Cognitive Radars Using Change-Point Detection, Learning, and Adaptation
Many radar detection algorithms that assume a stationary environment (clutter) have been proposed and analyzed over the years. However, in practice, changes in the nonstationary environment can perturb the parameters of the clutter distribution, or even alter the clutter distribution family, which can greatly deteriorate the target detection capability. To avoid such potential performance degradation, cognitive radar systems are envisioned which are required to rapidly realize the nonstationarity, accurately learn the new characteristics of the environments, and adaptively update the detector. In this paper, aiming to develop a fully cognitive radar for target detection in nonstationary environments, we propose a unifying framework that integrates (i) change-point detection of clutter distributions by using a data-driven cumulative sum (CUSUM) algorithm and its extended version, (ii) learning/identification of clutter distribution by applying sparse theory and kernel density estimation methods, and (iii) adaptive target detection by automatically modifying the likelihood-ratio test and corresponding detection threshold. Further, with extensive numerical examples, we demonstrate the achieved improvements in detection performance due to the proposed framework in comparison to a nonadaptive case, an adaptive matched filter (AMF) method, and the clairvoyant case. Herein, we also use Wilcoxon rank-sum tests to evaluate the statistical significance of the performance improvements
42 ENGINEERING↗
Microphysical Sensitivity of Superparameterized Precipitation Extremes in the Contiguous United States Due to Feedbacks on Large-Scale Circulation
Superparameterized (SP) global climate models have been shown to better simulate various features of precipitation relative to conventional models, including its diurnal cycle as well as its extremes. While various studies have focused on the effect of differing microphysics parameterizations on precipitation within limited-area cloud-resolving models, we examine here the effect on contiguous U.S. (CONUS) extremes in a global SP model. We vary the number of predicted moments for hydrometeor distributions, the character of the rimed ice species, and the representation of raindrop self-collection and breakup. Using a likelihood ratio test and accounting for the effects of multiple hypothesis testing, we find that there are some regional differences, particularly during spring and summer in the Southwest and the Midwest, in both the current climate and a warmer climate with uniformly increased sea surface temperatures. These differences are most statistically significant and widespread when the number of moments is changed. To determine whether these results are due to (fast) local effects of the different microphysics or the (slower) ensuing feedback on the large-scale atmospheric circulation, we run a series of short, 5-day simulations initialized from reanalysis data. We find that the differences largely disappear in these runs and therefore infer that the different parameterizations impact precipitation extremes indirectly via the large-scale circulation. Finally, we compare the present-day results with hourly rain gauge data and find that SP underestimates extremes relative to observations regardless of which microphysics scheme is used given a fixed model configuration and resolution.
54 ENVIRONMENTAL SCIENCES↗
Grid-based minimization at scale: Feldman-Cousins corrections for light sterile neutrino search
High Energy Physics (HEP) experiments generally employ sophisticated statistical methods to present results in searches of new physics. In the problem of searching for sterile neutrinos, likelihood ratio tests are applied to short-baseline neutrino oscillation experiments to construct confidence intervals for the parameters of interest. The test statistics of the form Δχ2 is often used to form the confidence intervals, however, this approach can lead to statistical inaccuracies due to the small signal rate in the region-of-interest. In this paper, we present a computational model for the computationally expensive Feldman-Cousins corrections to construct a statistically accurate confidence interval for neutrino oscillation analysis. The program performs a grid-based minimization over oscillation parameters and is written in C++. Our algorithms make use of vectorization through Eigen3, yielding a single-core speed-up of 350 compared to the original implementation, and achieve MPI data parallelism by employing DIY. We demonstrate the strong scaling of the application at High-Performance Computing (HPC) sites. We utilize HDF5 along with HighFive to write the results of the calculation to file.
Wospakrik, Marianette↗
Probing the PeV region in the astrophysical neutrino spectrum using 𝜈 𝜇 from the Southern sky
IceCube has observed a diffuse astrophysical neutrino flux over the energy region from a few TeV to a few PeV. At PeV energies, the spectral shape is not yet well measured due to the low statistics of the data. This analysis probes the gap between 1 and 10 PeV by using high-energy downgoing muon neutrinos. Here, to reject the large atmospheric muon background, two complementary techniques are combined. The first technique selects events with high stochasticity to reject atmospheric muon bundles whose stochastic energy losses are smoothed due to high muon multiplicity. The second technique vetoes atmospheric muons with the IceTop surface array. Using 9 yrs of data, we found two neutrino candidate events in the signal region, consistent with expectation from background, each with relatively high signal probabilities. A joint maximum likelihood estimation is performed using this sample and an independent 9.5-yr sample of tracks to measure the neutrino spectrum. A likelihood ratio test is done to compare the single power-law (SPL) vs SPL+cutoff hypothesis; the SPL+cutoff model is not significantly better than the SPL. High-energy astrophysical objects from four source catalogs are also checked around the direction of the two events. No significant coincidence was found.
Abbasi, R. [Loyola University Chicago] (ORCID:0000↗
Fast estimation of the look-elsewhere effect using Gaussian random fields
Abstract We discuss the use of Gaussian random fields to estimate the look-elsewhere effect correction. We show that Gaussian random fields can be used to model the null-hypothesis significance maps from a large set of statistical problems commonly encountered in physics, such as template matching and likelihood ratio tests. Some specific examples are searches for dark matter using pixel arrays, searches for astronomical transients, and searches for fast-radio bursts. Gaussian random fields can be sampled efficiently in the frequency domain, and the excursion probability can be fitted with these samples to extend any estimation of the look-elsewhere effect to lower p values. In addition, in cases where the Gaussian random field is stationary and the parameter space is Euclidean, the look-elsewhere effect correction can be computed analytically. We demonstrate these methods using two example template matching problems. Finally, we apply these methods to estimate the trial factor of a $$4^3$$ 4 3 accelerometer array for the detection of dark matter tracks in the Windchime project. When a global significance of $$3\sigma $$ 3 σ is required, the estimated trial factor for such an accelerometer array is $$10^{14}$$ 10 14 for a one-second search, and $$10^{22}$$ 10 22 for a 1-year search.
Qin, Juehang (ORCID:0000000182288949)↗