Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data clustering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

VoroClust

SAND2025-11465O VoroClust, also known as Voronoi Clustering, is a fast, density-based unsupervised clustering algorithm applicable to high-resolution and high-dimensional data. It operates as quickly as distance-based clustering methods while effectively capturing complex regional geometries, matching the performance of current density-based methods. VoroClust employs a data-centered sphere cover to reduce computational demands while preserving data topology. It propagates clusters outward from local density peaks. Although supervised machine learning is powerful for applications like image classification and segmentation, it requires comprehensive, consistent datasets, which many applications lack. Unsupervised clustering algorithms analyze the structure of each dataset rather than relying on similarities with other examples, making them well-suited for practical applications with insufficient or inappropriate data for supervised learning. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Ebeida, Mohamed [Sandia National Lab. (SNL-CA), Li↗
DOE OSTI2017

Parallel Multivariate Spatio-Temporal Clustering of Large Ecological Datasets on Hybrid Supercomputers

A proliferation of data from vast networks of remote sensing platforms (satellites, unmanned aircraft systems (UAS), airborne etc.), observational facilities (meteorological, eddy covariance etc.), state-of-the-art sensors, and simulation models offer unprecedented opportunities for scientific discovery. Unsupervised classification is a widely applied data mining approach to derive insights from such data. However, classification of very large data sets is a complex computational problem that requires efficient numerical algorithms and implementations on high performance computing (HPC) platforms. Additionally, increasing power, space, cooling and efficiency requirements has led to the deployment of hybrid supercomputing platforms with complex architectures and memory hierarchies like the Titan system at Oak Ridge National Laboratory. The advent of such accelerated computing architectures offers new challenges and opportunities for big data analytics in general and specifically, large scale cluster analysis in our case. Although there is an existing body of work on parallel cluster analysis, those approaches do not fully meet the needs imposed by the nature and size of our large data sets. Moreover, they had scaling limitations and were mostly limited to traditional distributed memory computing platforms. We present a parallel Multivariate Spatio-Temporal Clustering (MSTC) technique based on k-means cluster analysis that can target hybrid supercomputers like Titan. We developed a hybrid MPI, CUDA and OpenACC implementation that can utilize both CPU and GPU resources on computational nodes. We describe performance results on Titan that demonstrate the scalability and efficacy of our approach in processing large ecological data sets.

Sreepathi, Sarat↗
DOE OSTI2014

APASS Landolt-Sloan BVgri photometry of Rave stars. I. Data, effective temperatures, and reddenings

We provide AAVSO Photometric All-Sky Survey (APASS) photometry in the Landolt BV and Sloan g'r'i' bands for all 425,743 stars included in the fourth RAVE Data Release. The internal accuracy of the APASS photometry of RAVE stars, expressed as the error of the mean of data obtained and separately calibrated over a median of four distinct observing epochs and distributed between 2009 and 2013, is 0.013, 0.012, 0.012, 0.014, and 0.021 mag for the B, V, g', r', and i' bands, respectively. The equally high external accuracy of APASS photometry has been verified on secondary Landolt and Sloan photometric standard stars not involved in the APASS calibration process and on a large body of literature data on field and cluster stars, confirming the absence of offsets and trends. Compared with the Carlsberg Meridian Catalog (CMC-15), APASS astrometry of RAVE stars is accurate to a median value of 0.098 arcsec. Brightness distribution functions for the RAVE stars have been derived in all bands. APASS photometry of RAVE stars, augmented by 2MASS JHK infrared data, has been χ{sup 2} fitted to a densely populated synthetic photometric library designed to widely explore temperature, surface gravity, metallicity, and reddening. Resulting T {sub eff} and E {sub B–V}, computed over a range of options, are provided and discussed, and will be kept updated in response to future APASS and RAVE data releases. In the process, we find that the reddening caused by a homogeneous slab of dust, extending for 140 pc on either side of the Galactic plane and responsible for E{sub B−V}{sup poles} = 0.036 ± 0.002 at the Galactic poles, is a suitable approximation of the actual reddening encountered at Galactic latitudes |b| ≥ 25°.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1978

OSO-8 X-ray spectra of clusters of galaxies. 2: Discussion

X-ray spectral parameters obtained from 2 to 20 keV OSO-8 data on X-ray clusters and optical cluster properties were examined to obtain information for restricting models for hot intracluster gas structures. Topics discussed include the radius of the X-ray core in relation to the galaxy core radius, the viral mass of hotter clusters, and galaxy density and optical central cluster properties. A population of cool, dim X-ray clusters which have not been observed is predicted. The iron abundance determinations recently quoted for intracluster gas are uncertain by 50 to greater than 100 percent from this nonstatistical cause alone.

Smith, B. W.↗
DOE OSTI2017

A multi-frequency analysis of possible dark matter contributions to M31 gamma-ray emissions

We examine the possibility of a dark matter (DM) contribution to the recently observed gamma-ray spectrum seen in the M31 galaxy. In particular, we apply limits on Weakly Interacting Massive Particle DM annihilation cross-sections derived from the Coma galaxy cluster and the Reticulum II dwarf galaxy to determine the maximal flux contribution by DM annihilation to both the M31 gamma-ray spectrum and that of the Milky-Way Galactic Centre. We limit the energy range between 1 and 12 GeV in M31 and Galactic Centre spectra due to the limited range of former's data, as well as to encompass the high-energy gamma-ray excess observed in the latter target. In so doing, we will make use of Fermi-LAT data for all mentioned targets, as well as diffuse radio data for the Coma cluster. The multi-target strategy using both Coma and Reticulum II to derive cross-section limits, as well as multi-frequency data, ensures that our results are robust against the various uncertainties inherent in modelling of indirect DM emissions. Our results indicate that, when a Navarro-Frenk-White (or shallower) radial density profile is assumed, severe constraints can be imposed upon the fraction of the M31 and Galactic Centre spectra that can be accounted for by DM, with the best limits arising from cross-section constraints from Coma radio data and Reticulum II gamma-ray limits. These particular limits force all the studied annihilation channels to contribute 1% or less to the total integrated gamma-ray flux within both M31 and Galactic Centre targets. In contrast, considerably more, 10−100%, of the flux can be attributed to DM when a contracted Navarro-Frenk-White profile is assumed. This demonstrates how sensitive DM contributions to gamma-ray emissions are to the possibility of cored profiles in galaxies. The only channel consistently excluded for all targets and profiles (except for ∼ 10 GeV WIMPs) is the direct annihilation into photons. Finally, we discuss the ramifications of evidence in favour of cored halo density profiles for DM explanations of galactic gamma-ray emission.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2016

The clustering of galaxies in the completed SDSS-III Baryon Oscillation Spectroscopic Survey: Observational systematics and baryon acoustic oscillations in the correlation function

We present baryon acoustic oscillation (BAO) scale measurements determined from the clustering of 1.2 million massive galaxies with redshifts 0.2 < z < 0.75 distributed over 9300 deg 2 , as quantified by their redshift-space correlation function. In order to facilitate these measurements, we define, describe, and motivate the selection function for galaxies in the final data release (DR12) of the SDSS III Baryon Oscillation Spectroscopic Survey (BOSS). This includes the observational footprint, masks for image quality and Galactic extinction, and weights to account for density relationships intrinsic to the imaging and spectroscopic portions of the survey. We simulate the observed systematic trends in mock galaxy samples and demonstrate that they impart no bias on BAO scale measurements and have a minor impact on the recovered statistical uncertainty. We measure transverse and radial BAO distance measurements in 0.2 < z < 0.5, 0.5 < z < 0.75, and (overlapping) 0.4 < z < 0.6 redshift bins. In each redshift bin, we obtain a precision that is 2.7 per cent or better on the radial distance and 1.6 per cent or better on the transverse distance. The combination of the redshift bins represents 1.8 per cent precision on the radial distance and 1.1 per cent precision on the transverse distance. This paper is part of a set that analyses the final galaxy clustering data set from BOSS. The measurements and likelihoods presented here are combined with others in Alam et al. to produce the final cosmological constraints from BOSS.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Measurements of cosmic expansion and growth rate of structure from voids in the Sloan Digital Sky Survey between redshift 0.07 and 1.0

ABSTRACT We present measurements of the anisotropic cross-correlation of galaxies and cosmic voids in data from the Sloan Digital Sky Survey (SDSS) Main Galaxy Sample, Baryon Oscillation Spectroscopic Survey (BOSS), and extended BOSS luminous red galaxy catalogues from SDSS Data Releases 7, 12, and 16, covering the redshift range 0.07 < z < 1.0. As in our previous work analysing voids in subsets of these data, we use a reconstruction method applied to the galaxy data before void finding in order to remove selection biases when constructing the void samples. We report results of a joint fit to the multipole moments of the measured cross-correlation for the growth rate of structure, fσ8(z), and the ratio DM(z)/DH(z) of the comoving angular diameter distance to the Hubble distance, in six redshift bins. For DM/DH, we are able to achieve a significantly higher precision than that obtained from analyses of the baryon acoustic oscillations and galaxy clustering in the same data sets. Our growth rate measurements are of lower precision but still comparable with galaxy clustering results. For both quantities, the results agree well with the expectations for a Λ cold dark matter model. Assuming a flat Universe, our results correspond to a measurement of the matter density parameter $\Omega _\mathrm{m}=0.337^{+0.026}_{-0.029}$. For more general models, the degeneracy directions obtained are consistent with and complementary to those from other cosmological probes. These results consolidate void–galaxy cross-correlation measurements as a pillar of modern observational cosmology.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Coincident learning for beam-based rf station fault identification using phase information at the SLAC linac coherent light source

Anomalies in radio-frequency (rf) stations can result in unplanned downtime and performance degradation in linear accelerators such as SLAC’s Linac Coherent Light Source (LCLS). Detecting these anomalies is challenging due to the complexity of accelerator systems, high data volume, and scarcity of labeled fault data. Prior work identified faults using beam-based detection, combining rf amplitude and beam position monitor data. Due to the simplicity of the rf amplitude data, classical methods are sufficient to identify faults, but the recall is constrained by the low-frequency and asynchronous characteristics of the data. In this work, we leverage high-frequency, time-synchronous rf phase data to enhance anomaly detection in the LCLS accelerator. Due to the complexity of phase data, classical methods fail, and we instead train deep neural networks within the Coincident Anomaly Detection (CoAD) framework. We find that applying CoAD to phase data detects nearly 3 times as many anomalies as when applied to amplitude data, while achieving broader coverage across rf stations. Furthermore, the rich structure of phase data enables us to cluster anomalies into distinct physical categories. Through the integration of auxiliary system status bits, we link clusters to specific fault signatures, providing additional granularity for uncovering the root cause of faults. We also investigate interpretability via Shapley values, confirming that the learned models focus on the most informative regions of the data and providing insight for cases where the model makes mistakes. This work demonstrates that phase-based anomaly detection for rf stations improves both diagnostic coverage and root cause analysis in accelerator systems and that deep neural networks are essential for effective analysis.

Accelerator Physics (physics.acc-ph)↗
DOE OSTI2022

S-PLUS DR1 galaxy clusters and groups catalogue using PzWav

ABSTRACT We present a catalogue of 4499 groups and clusters of galaxies from the first data release of the multi-filter (5 broad, 7 narrow) Southern Photometric Local Universe Survey (S-PLUS). These groups and clusters are distributed over 273 deg2 in the Stripe 82 region. They are found using the PzWav algorithm, which identifies peaks in galaxy density maps that have been smoothed by a cluster scale difference-of-Gaussians kernel to isolate clusters and groups. Using a simulation-based mock catalogue, we estimate the purity and completeness of cluster detections: at S/N > 3.3, we define a catalogue that is 80 per cent pure and complete in the redshift range 0.1 < z < 0.4, for clusters with M200 > 1014 M⊙. We also assessed the accuracy of the catalogue in terms of central positions and redshifts, finding scatter of σR = 12 kpc and σz = 8.8 × 10−3, respectively. Moreover, less than 1 per cent of the sample suffers from fragmentation or overmerging. The S-PLUS cluster catalogue recovers ∼80 per cent of all known X-ray and Sunyaev-Zel’dovich selected clusters in this field. This fraction is very close to the estimated completeness, thus validating the mock data analysis and paving an efficient way to find new groups and clusters of galaxies using data from the ongoing S-PLUS project. When complete, S-PLUS will have surveyed 9300 deg2 of the sky, representing the widest uninterrupted areas with narrow-through-broad multi-band photometry for cluster follow-up studies.

Astronomy & Astrophysics↗
DOE OSTI2013

A new life for sterile neutrinos: resolving inconsistencies using hot dark matter

Within the standard ΛCDM model of cosmology, the recent Planck measurements have shown discrepancies with other observations, e.g., measurements of the current expansion rate H{sub 0}, the galaxy shear power spectrum and counts of galaxy clusters. We show that if ΛCDM is extended by a hot dark matter component, which could be interpreted as a sterile neutrino, the data sets can be combined consistently. A combination of Planck data, WMAP-9 polarisation data, measurements of the BAO scale, the HST measurement of H{sub 0}, Planck galaxy cluster counts and galaxy shear data from the CFHTLens survey yields ΔN{sub eff} = 0.61±0.30 and m{sub s}{sup eff} = (0.41±0.13)eV at 1σ. The former is driven mainly by the large H{sub 0} of the HST measurement, while the latter is driven by cluster data. CFHTLens galaxy shear data prefer ΔN{sub eff}> 0 and a non-zero mass. Taken together, we find hints for the presence of a hot dark matter component at 3σ. A sterile neutrino motivated by the reactor and gallium anomalies appears rejected at even higher significance and an accelerator anomaly sterile neutrino is found in tension at 2σ.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2015

STAR FORMATION AND RELAXATION IN 379 NEARBY GALAXY CLUSTERS

We investigate the relationship between star formation (SF) and level of relaxation in a sample of 379 galaxy clusters at z < 0.2. We use data from the Sloan Digital Sky Survey to measure cluster membership and level of relaxation, and to select star-forming galaxies based on mid-infrared emission detected with the Wide-Field Infrared Survey Explorer. For galaxies with absolute magnitudes M{sub r} < −19.5, we find an inverse correlation between SF fraction and cluster relaxation: as a cluster becomes less relaxed, its SF fraction increases. Furthermore, in general, the subtracted SF fraction in all unrelaxed clusters (0.117 ± 0.003) is higher than that in all relaxed clusters (0.097 ± 0.005). We verify the validity of our SF calculation methods and membership criteria through analysis of previous work. Our results agree with previous findings that a weak correlation exists between cluster SF and dynamical state, possibly because unrelaxed clusters are less evolved relative to relaxed clusters.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2015

THE EXTENDED VIRGO CLUSTER CATALOG

We present a new catalog of galaxies in the wider region of the Virgo cluster, based on the Sloan Digital Sky Survey (SDSS) Data Release 7. The Extended Virgo Cluster Catalog (EVCC) covers an area of 725 deg{sup 2} or 60.1 Mpc{sup 2}. It is 5.2 times larger than the footprint of the classical Virgo Cluster Catalog (VCC) and reaches out to 3.5 times the virial radius of the Virgo cluster. We selected 1324 spectroscopically targeted galaxies with radial velocities less than 3000 km s{sup –1}. In addition, 265 galaxies that have been overlooked in the SDSS spectroscopic survey but have available redshifts in the NASA Extragalactic Database are also included. Our selection process secured a total of 1589 galaxies, 676 of which are not included in the VCC. The certain and possible cluster members are defined by means of redshift comparison with a cluster infall model. We employed two independent and complementary galaxy classification schemes: the traditional morphological classification based on the visual inspection of optical images and a characterization of galaxies from their spectroscopic features. SDSS u, g, r, i, and z passband photometry of all EVCC galaxies was performed using Source Extractor. We compare the EVCC galaxies with the VCC in terms of morphology, spatial distribution, and luminosity function. The EVCC defines a comprehensive galaxy sample covering a wider range in galaxy density that is significantly different from the inner region of the Virgo cluster. It will be the foundation for forthcoming galaxy evolution studies in the extended Virgo cluster region, complementing ongoing and planned Virgo cluster surveys at various wavelengths.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2015

Comparative I/O workload characterization of two leadership class storage clusters. In: PDSW '15 Proceedings of the 10th Parallel Data Storage Workshop

The Oak Ridge Leadership Computing Facility (OLCF) is a leader in large-scale parallel file system development, design, deployment and continuous operation. For the last decade, the OLCF has designed and deployed two large center-wide parallel file systems. The first instantiation, Spider 1, served the Jaguar supercomputer and its predecessor, Spider 2, now serves the Titan supercomputer, among many other OLCF computational resources. The OLCF has been rigorously collecting file and storage system statistics from these Spider systems since their transition to production state. In this paper we present the collected I/O workload statistics from the Spider 2 system and compare it to the Spider 1 data. Our analysis show that the Spider 2 workload is more more write-heavy I/O compared to Spider 1 (75% vs. 60%, respectively). The data also show the OLCF storage policies such as periodic purges are effectively managing the capacity resource of Spider 2. Furthermore, due to improvements in tdm_multipath and ib_srp software, we are utilizing the Spider 2 system bandwidth and latency resources more effectively. The Spider 2 bandwidth usage statistics shows that our system is working within the design specifications. However, it is also evident that our scientific applications can be more effectively served by a burst buffer storage layer. All the data has been collected by monitoring tools developed for the Spider ecosystem. We believe the observed data set and insights will help us better design the next-generation Spider file and storage system. It will also be helpful to the larger community for building more effective large-scale file and storage systems.

Gunasekaran, Raghul↗
NASA NTRS1972

The structure of the coma cluster of galaxies.

Analysis of radial velocities in the coma cluster (many of them new) in conjunction with previous data on the density distribution. The cluster extends more than 200 min in radius, with bright and faint galaxies distributed in nearly the same way. Some spirals are members. Several different determinations of M/L give values around 250. The cluster is stabilized by a 'missing mass' some seven times the mass of the galaxies, which must be distributed in the same way as the galaxies.

Rood, H. J.↗
NASA NTRS2002

VIZARD: analysis of Affymetrix Arabidopsis GeneChip data

SUMMARY: The Affymetrix GeneChip Arabidopsis genome array has proved to be a very powerful tool for the analysis of gene expression in Arabidopsis thaliana, the most commonly studied plant model organism. VIZARD is a Java program created at the University of California, Berkeley, to facilitate analysis of Arabidopsis GeneChip data. It includes several integrated tools for filtering, sorting, clustering and visualization of gene expression data as well as tools for the discovery of regulatory motifs in upstream sequences. VIZARD also includes annotation and upstream sequence databases for the majority of genes represented on the Affymetrix Arabidopsis GeneChip array. AVAILABILITY: VIZARD is available free of charge for educational, research, and not-for-profit purposes, and can be downloaded at http://www.anm.f2s.com/research/vizard/ CONTACT: moseyko@uclink4.berkeley.edu.

Non-NASA Center↗