Evaluation of Traditional and Deep Clustering Algorithms for Multivariate Spatio-Temporal Data
Explore the source record for details and available documents.
Mathematics and Computing↗
SEARCH · Engineering Papers
Results for “data clustering”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Galaxy kinematics and mass calibration in massive SZE-selected galaxy clusters to z = 1.3
Not Available
79 ASTRONOMY AND ASTROPHYSICS↗
A test for spatial clustering in the presence of auxiliary information
A technique is proposed to test for the presence of clusters when both spatial and auxiliary information is available. The test is based on randomizing the auxiliary information over the spatial locations. It requires no model assumptions (such as a Poisson process) for the spatial distribution. The procedure may be used to screen data for possible clustering.
Banfield, Jeff↗
SDSS-III Baryon Oscillation Spectroscopic Survey data release 12: Galaxy target selection and large-scale structure catalogues
The Baryon Oscillation Spectroscopic Survey (BOSS), part of the Sloan Digital Sky Survey (SDSS) III project, has provided the largest survey of galaxy redshifts available to date, in terms of both the number of galaxy redshifts measured by a single survey, and the effective cosmological volume covered. Key to analysing the clustering of these data to provide cosmological measurements is understanding the detailed properties of this sample. Potential issues include variations in the target catalogue caused by changes either in the targeting algorithm or properties of the data used, the pattern of spectroscopic observations, the spatial distribution of targets for which redshifts were not obtained, and variations in the target sky density due to observational systematics. We document here the target selection algorithms used to create the galaxy samples that comprise BOSS. We also present the algorithms used to create large-scale structure catalogues for the final Data Release (DR12) samples and the associated random catalogues that quantify the survey mask. The algorithms are an evolution of those used by the BOSS team to construct catalogues from earlier data, and have been designed to accurately quantify the galaxy sample. Furthermore, the code used, designated mksample, is released with this paper.
(cosmology:) large-scale structure of Universe↗
Unsupervised phase mapping of X-ray diffraction data by nonnegative matrix factorization integrated with custom clustering
Abstract Analyzing large X-ray diffraction (XRD) datasets is a key step in high-throughput mapping of the compositional phase diagrams of combinatorial materials libraries. Optimizing and automating this task can help accelerate the process of discovery of materials with novel and desirable properties. Here, we report a new method for pattern analysis and phase extraction of XRD datasets. The method expands the Nonnegative Matrix Factorization method, which has been used previously to analyze such datasets, by combining it with custom clustering and cross-correlation algorithms. This new method is capable of robust determination of the number of basis patterns present in the data which, in turn, enables straightforward identification of any possible peak-shifted patterns. Peak-shifting arises due to continuous change in the lattice constants as a function of composition and is ubiquitous in XRD datasets from composition spread libraries. Successful identification of the peak-shifted patterns allows proper quantification and classification of the basis XRD patterns, which is necessary in order to decipher the contribution of each unique single-phase structure to the multi-phase regions. The process can be utilized to determine accurately the compositional phase diagram of a system under study. The presented method is applied to one synthetic and one experimental dataset and demonstrates robust accuracy and identification abilities.
36 MATERIALS SCIENCE↗
STELLAR COLLISIONS AND BLUE STRAGGLER STARS IN DENSE GLOBULAR CLUSTERS
Blue straggler stars (BSSs) are abundantly observed in all Galactic globular clusters (GGCs) where data exist. However, observations alone cannot reveal the relative importance of various formation channels or the typical formation times for this well-studied population of anomalous stars. Using a state-of-the-art Hénon-type Monte Carlo code that includes all relevant physical processes, we create 128 models with properties typical of the observed GGCs. These models include realistic numbers of single and binary stars, use observationally motivated initial conditions, and span large ranges in central density, concentration, binary fraction, and mass. Their properties can be directly compared with those of observed GGCs. We can easily identify the BSSs in our models and determine their formation channels and birth times. We find that for central densities above ∼10{sup 3} M{sub ☉} pc{sup –3}, the dominant formation channel is stellar collisions, while for lower density clusters, mass transfer in binaries provides a significant contribution (up to 60% in our models). The majority of these collisions are binary-mediated, occurring during three-body and four-body interactions. As a result, a strong correlation between the specific frequency of BSSs and the binary fraction in a cluster can be seen in our models. We find that the number of BSSs in the core shows only a weak correlation with the collision rate estimator Γ traditionally used by observers, in agreement with the latest Hubble Space Telescope Advanced Camera for Surveys data. Using an idealized 'full mixing' prescription for collision products, our models indicate that the BSSs observed today may have formed several Gyr ago. However, denser clusters tend to have younger (∼1 Gyr) BSSs.
79 ASTRONOMY AND ASTROPHYSICS↗
Discovery of Activities via Statistical Clustering of Fixation Patterns
Human behavior often consists of a series of distinct activities, each characterized by a unique pattern of interaction with the visual environment. This is true even in a restricted domain, such as a piloting an aircraft, where activities with distinct visual signatures might be things like communicating, navigating, and monitoring. We propose a novel analysis method for gaze-tracking data, to perform blind discovery of these hypothetical activities. The method is in some respects similar to recurrence analysis, but here we compare not individual fixations, but groups of fixations aggregated over a fixed time interval. The duration of this interval is a parameter that we will refer to as delta. We assume that the environment has been divided into a set of N different areas-of-interest (AOIs). For a given interval of time of duration delta, we compute the proportion of time spent fixating each AOI, resulting in an N-dimensional vector. These proportions can be converted to integer counts by multiplying by delta divided by the average fixation duration (another parameter that we fix at 280 milliseconds). We compare different intervals by computing the chi-square statistic. The p-value associated with the statistic is the likelihood of observing the data under the hypothesis that the data in the two intervals were generated by a single process with a single set of probabilities governing the fixation of each AOI. The method has been applied to approximately 100 hours of eye movement data collected from pilots in a high-fidelity B747 flight simulator, and the results have been compared to synthetic data in which the each activity is represented as first-order Markov process with random probabilities assigned to the AOIs. Randomly-generated synthetic activities can require thousands of fixations to be discriminated with statistical significance, while the human data can be clustered using averaging windows of some 10's of seconds, suggesting that the actual activities are much more narrowly focused than random Markov models.
activity analysis↗
Environmental Effects in Herschel Observations of the Ionized Carbon Content of Star-forming Dwarf Galaxies in the Virgo Cluster
We use archival Herschel data to examine the singly ionized carbon ([C II]) content of 14 star-forming dwarf galaxies in the Virgo cluster. We use spectral energy distribution fits to far-infrared, mid-infrared, near-infrared, optical, and ultraviolet data to derive the total infrared continuum (TIR) for these galaxies. We compare the [C II]/TIR ratio for dwarf galaxies in the central part of Virgo to those in the southern part of the cluster and to galaxies with similar TIR luminosities and metallicities in the Herschel Dwarf Galaxy Survey (DGS) sample of field dwarf galaxies to look for signs of [C II] formation independent of star formation. Our analysis indicates that the sample of Virgo dwarfs in the central part of the cluster has significantly higher values of [C II]/TIR than the sample from the southern part of the cluster and the sample from the DGS, while the southern sample is consistent with the DGS. This [C II]/TIR excess implies that a significant fraction of the [C II] in the dwarf galaxies in the cluster center has an origin other than star formation and is likely to be due to environmental processes in the central part of the cluster. We also find a surprisingly strong correlation between [C II]/TIR and the local ram pressure felt by the dwarf galaxies in the cluster. In this respect, we claim that the excess [C II] we see in these galaxies is likely to be due to formation in ram-pressure shocks.
79 ASTRONOMY AND ASTROPHYSICS↗
Dark radiation sterile neutrino candidates after Planck data
Recent Cosmic Microwave Background (CMB) results from the Planck satellite, combined with previous CMB data and Hubble constant measurements from the Hubble Space Telescope, provide a constraint on the effective number of relativistic degrees of freedom 3.62{sup +0.50}{sub −0.48} at 95% CL. New Planck data provide a unique opportunity to place limits on models containing relativistic species at the decoupling epoch. We present here the bounds on sterile neutrino models combining Planck data with galaxy clustering information. Assuming N{sub eff} active plus sterile massive neutrino species, in the case of a Planck+WP+HighL+HST analysis we find m{sub ν,} {sub sterile}{sup eff} < 0.36 eV and 3.14 < N{sub eff} < 4.15 at 95% CL, while using Planck+WP+HighL data in combination with the full shape of the galaxy power spectrum from the Baryon Oscillation Spectroscopic Survey BOSS Data Relase 9 measurements, we find that 3.30 < N{sub eff} < 4.43 and m{sub ν,} {sub sterile}{sup eff} < 0.33 eV both at 95% CL with the three active neutrinos having the minimum mass allowed in the normal hierarchy scheme, i.e. ∑m{sub ν} ∼ 0.06 eV. These values compromise the viability of the (3+2) massive sterile neutrino models for the parameter region indicated by global fits of neutrino oscillation data. Within the (3+1) massive sterile neutrino scenario, we find m{sub ν,} {sub sterile}{sup eff} < 0.34 eV at 95% CL. While the existence of one extra sterile massive neutrino state is compatible with current oscillation data, the values for the sterile neutrino mass preferred by oscillation analyses are significantly higher than the current cosmological bound. We review as well the bounds on extended dark sectors with additional light species based on the latest Planck CMB observations.
79 ASTRONOMY AND ASTROPHYSICS↗
Tidal radii and destruction rates of globular clusters in the Milky Way due to bulge-bar and disk shocking
We calculate orbits, tidal radii, and bulge-bar and disk shocking destruction rates for 63 globular clusters in our Galaxy. Orbits are integrated in both an axisymmetric and a nonaxisymmetric Galactic potential that includes a bar and a three-dimensional model for the spiral arms. With the use of a Monte Carlo scheme, we consider in our simulations observational uncertainties in the kinematical data of the clusters. In the analysis of destruction rates due to the bulge-bar, we consider the rigorous treatment of using the real Galactic cluster orbit instead of the usual linear trajectory employed in previous studies. We compare results in both treatments. We find that the theoretical tidal radius computed in the nonaxisymmetric Galactic potential compares better with the observed tidal radius than that obtained in the axisymmetric potential. In both Galactic potentials, bulge-shocking destruction rates computed with a linear trajectory of a cluster at its perigalacticons give a good approximation of the result obtained with the real trajectory of the cluster. Bulge-shocking destruction rates for clusters with perigalacticons in the inner Galactic region are smaller in the nonaxisymmetric potential than those in the axisymmetric potential. For the majority of clusters with high orbital eccentricities (e > 0.5), their total bulge+disk destruction rates are smaller in the nonaxisymmetric potential.
79 ASTRONOMY AND ASTROPHYSICS↗
Utah FORGE: Seismic DAS and Geophone Borehole Data Processing and 3D Imaging of Vp/Vs Ratio in the 2024 Stimulated Reservoir
This dataset includes a final report and a 3D velocity model derived from seismic DAS and geophone borehole data collected during the April 2024 stimulation of the reservoir at Utah FORGE. The report details the processing of over 50,000 P- and S-wave travel times used in a tomographic inversion to estimate the Vp/Vs ratio, revealing anomalies adjacent to wells 16A and 16B that may be associated with injected fracturing fluids. Additionally, Wadati analysis of more than 27,000 pairs of differential P- and S-wave travel times supports this interpretation with a high Vp/Vs estimate of 1.86, averaged over the dimensions of the earthquake cluster. The accompanying data file provides a 3D model of P- and S-wave velocities and Vp/Vs ratios, structured with spatial coordinates and velocity values.
15 GEOTHERMAL ENERGY↗
A Novel Data Segmentation Method for Data-driven Phase Identification
This paper presents a smart meter phase identification algorithm for two cases: meter-phase-label-known and meter-phase-label-unknown. To improve the identification accuracy, a data segmentation method is proposed to exclude data segments that are collected when the voltage correlation between smart meters on the same phase is weakened. Then, using the selected data segments, a hierarchical clustering method is used to calculate the correlation distances and cluster the smart meters. If the phase labels are unknown, a Connected-Triple-based Similarity (CTS) method is adapted to further improve the phase identification accuracy of the ensemble clustering method. The methods are developed and tested on both synthetic and real feeder data sets. Here, simulation results show that the proposed phase identification algorithm outperforms the state-of-the-art methods in both accuracy and robustness.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Ruprecht 147: A Paradigm of Dissolving Star Cluster
We employed recent Gaia/DR2 data to investigate the dynamical status of the nearby (300 pc), old (2.5 Gyr) open cluster Ruprecht 147. We found prominent leading and trailing tails of stars along the cluster orbit, which demonstrates that Ruprecht 147 is losing stars at fast pace. Star counts indicate the cluster has a core radius of 33.3 arcmin and a tidal radius of 137.5 arcmin. The cluster also possesses an extended corona, which cannot be reproduced by a simple King model. We computed the present-day cluster mass using its luminosity and mass function, and derived an estimate of 234 ± 52 M {sub ⊙}. We also estimated the cluster original mass using available recipes extracted from N-body simulations obtaining a mass at birth of 50,000 ± 6500 M {sub ⊙}. Therefore dynamical mass loss, mostly caused by tidal interaction with the Milky Way, reduced the cluster mass by about 99%. We then conclude that Ruprecht 147 is rapidly dissolving into the general Galactic disk.
79 ASTRONOMY AND ASTROPHYSICS↗
HST Imaging of the Globular Clusters in the Formax Cluster: Color and Luminosity Distributions
We examine the luminosity and B - I color distribution of globular clusters for three early-type galaxies in the Fornax cluster using imaging data from the Wide Field/Planetary Camera 2 on the Hubble Space Telescope.
luminosity color distribution evolution elliptical↗
RESOLVING THE COSMIC FAR-INFRARED BACKGROUND AT 450 AND 850 μm WITH SCUBA-2
We use the SCUBA-2 submillimeter camera mounted on the James Clerk Maxwell Telescope to obtain extremely deep number counts at 450 and 850 μm. We combine data on two cluster lensing fields, A1689 and A370, and three blank fields, CDF-N, CDF-S, and COSMOS, to measure the counts over a wide flux range at each wavelength. We use statistical fits to broken power law representations to determine the number counts. This allows us to probe to the deepest possible level in the data. At both wavelengths our results agree well with the literature in the flux range over which they have been measured, with the exception of the 850 μm counts in CDF-S, where we do not observe the counts deficit found by previous single-dish observations. At 450 μm, we detect significant counts down to ∼1 mJy, an unprecedented depth at this wavelength. By integrating the number counts above this flux limit, we measure 113.9{sup +49.7}{sub -28.4} Jy deg{sup –2} of the 450 μm extragalactic background light (EBL). The majority of this contribution is from sources with S{sub 450{sub μm}} between 1-10 mJy, and these sources are likely to be the ones that are analogous to the local luminous infrared galaxies. At 850 μm, we measure 37.3{sup +21.1}{sub -12.9} Jy deg{sup –2} of the EBL. Because of the large systematic uncertainties on the COBE measurements, the percentage of the EBL we resolve could range from 48%-153% (44%-178%) at 450 (850) μm. Based on high-resolution Submillimeter Array observations of around half of the 4 σ 850 μm sample in CDF-N, we find that 12.5{sup +12.1}{sub -6.8}% of the sources are blends of multiple fainter sources. This is a low multiple fraction, and we find no significant difference between our original SCUBA-2 850 μm counts and the multiplicity-corrected counts.
79 ASTRONOMY AND ASTROPHYSICS↗
Online anomaly detection for multi‐source VMware using a distributed streaming framework
Summary Anomaly detection refers to the identification of patterns in a dataset that do not conform to expected patterns. Such non‐conformant patterns typically correspond to samples of interest and are assigned to different labels in different domains, such as outliers, anomalies, exceptions, and malware. A daunting challenge is to detect anomalies in rapid voluminous streams of data. This paper presents a novel, generic real‐time distributed anomaly detection framework for multi‐source stream data. As a case study, we investigate anomaly detection for a multi‐source VMware‐based cloud data center, which maintains a large number of virtual machines (VMs). This framework continuously monitors VMware performance stream data related to CPU statistics (e.g., load and usage). It collects data simultaneously from all of the VMs connected to the network and notifies the resource manager to reschedule its CPU resources dynamically when it identifies any abnormal behavior from its collected data. A semi‐supervised clustering technique is used to build a model from benign training data only. During testing, if a data instance deviates significantly from the model, then it is flagged as an anomaly. Effective anomaly detection in this case demands a distributed framework with high throughput and low latency. Distributed streaming frameworks like Apache Storm, Apache Spark, S4, and others are designed for a lower data processing time and a higher throughput than standard centralized frameworks. We have experimentally compared the average processing latency of a tuple during clustering and prediction in both Spark and Storm and demonstrated that Spark processes a tuple much quicker than storm on average. Copyright © 2016 John Wiley & Sons, Ltd.
Solaimani, Mohiuddin↗
The metal abundance and specific energy of intracluster gas
The hot gas in the cores of rich galaxy clusters is metal-rich with nearly solar abundances of metals. It is not clear whether the metals were shed from galaxies via protogalactic winds or via ram-pressure stripping. It has been suggested that if metals were injected via centrally concentrated stripping, the overall abundances could be much less than those observed in cluster cores, diminishing the degree of stellar processing required. The observed energetics of intracluster gas can be used to deduce the metal injection mechanism, which in turn may allow the global metal abundance uncertainty to be resolved in the absence of spatially resolved X-ray spectra. Existing X-ray spectral and surface brightness data for galaxy clusters indicate that the gas in cool clusters has substantially greater specific energy than could have been gained through cluster collapse. Supernovae-driven protogalactic winds can provide this extra energy, while ram-pressure stripping cannot. Such protogalactic winds will distribute metals fairly homogeneously. Much processing of gas through stars is then required, with protogalaxies losing perhaps one-half of their initial luminous mass in metal-rich winds. Furthermore, the oxygen-to-iron ratio observed in two clusters indicates that the bulk of the iron in cluster gas was produced by Type II supernovae, not Type I supernovae, as is usually supposed.
White, Raymond E., III↗
Cluster observations of quasi-periodic impulsive signatures in the dayside northern lobe: High-latitude flux transfer events?
We report on a series of quasi-periodic reversals in GSM B(sub Z) observed by the four Cluster spacecraft in the northern dayside lobe poleward of the cusp on 23 February 2001. During an interval of about 35 min, multiple reversals (negative to positive) in B(sub Z) of approximately 1-min duration with an approximate 8-min recurrence time were observed. The individual structures do not resemble low-latitude flux transfer events (FTE) [Russell and Elphic, 1979] but the 8-min recurrence frequency suggests that intermittent reconnection may be occurring .Measurements (appropriately lagged) of the solar wind at ACE show that the IMF was southward-oriented with a strong B(sub X) and that a modest dynamic pressure increased as the events started. The multi-point observations afforded by the Cluster spacecraft were used to infer the motion (direction and speed) of the observed magnetic field reversals. The associated currents were also calculated and they are consistent with the spatial confinement of the observed magnetic field reversals. We propose that the observed reversals are due to flux tubes reconnecting with closed field lines on the dayside. Ancillary data from the Cluster Ion Spectrometry (CIS) and Plasma Electron And Current Experiment (PEACE) instruments were used to develop a physical picture of the reversals.
Thompson, S. M.↗