Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data clustering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,351 records · Page 75
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

A Versatile Simulated Data Transport Layer for in Situ Workflows Performance Evaluation

In situ processing does not only allow scientific applications to face the explosion in data volume and velocity but also to address the time constraints of many simulation-analysis workflows by providing scientists with early insights about their applications at runtime. Multiple frameworks implement the concept of a data transport layer (DTL) to enable such in situ workflows. These tools are very versatile, directly or indirectly access the data generated on the same node, another node of the same compute cluster, or a completely distinct node, and allow data publishers and subscribers to run on the same computing resources or not. This versatility puts on researchers the onus of taking key decisions related to resource allocation and how to transport data to ensure the most efficient execution of their in situ workflows. However, domain scientists and workflow practitioners lack the appropriate tools to assess the respective performance of particular design and deployment options. In this paper we introduce a versatile simulated DTL designed to provide researchers with insights on the respective performance of different execution scenarios of in situ workflows. This open-source, standalone library builds on the SimGrid toolkit and can be linked to any SimGrid-based simulator. It facilitates the evaluation of the performance behavior, at scale, of different data transport configurations and the study of the effects of resource allocation strategies. We demonstrate the scalability, versatility, and accuracy of this simulated DTL by reproducing the execution of two synthetic benchmarks and of a real-world in situ workflow composed of an MPI application and a parallel data analysis. Results of simulations run on a single core show that the proposed library can simulate the interactions of tens of thousands of simulated processes deployed on two interconnected commodity clusters in a few seconds, and the execution by a thousand simulated processes of an in situ workflow in less than three minutes.

Suter, Fred [ORNL] (ORCID:0000000319021955)↗
NASA NTRS2003

Cluster Masses Derived from X-ray and Sunyaev-Zeldovich Effect Measurements

We infer the gas mass and total gravitational mass of 11 clusters using two different methods; analysis of X-ray data from the Chandra X-ray Observatory and analysis of centimeter-wave Sunyaev-Zel'dovich Effect (SZE) data from the BIMA and OVRO interferometers. This flux-limited sample of clusters from the BCS cluster catalogue was chosen so as to be well above the surface brightness limit of the ROSAT All Sky Survey; this is therefore an orientation unbiased sample. The gas mass fraction, f_g, is calculated for each cluster using both X-ray and SZE data, and the results are compared at a fiducial radius of r_500. Comparison of the X-ray and SZE results for this orientation unbiased sample allows us to constrain cluster systematics, such as clumping of the intracluster medium. We derive an upper limit on Omega_M assuming that the mass composition of clusters within r_500 reflects the universal mass composition Omega_M h_100 is greater than Omega _B / f-g. We also demonstrate how the mean f_g derived from the sample can be used to estimate the masses of clusters discovered by upcoming deep SZE surveys.

Laroque, S.↗
DOE OSTI2022

Possibilities and Limitations of Kinematically Identifying Stars from Accreted Ultra-faint Dwarf Galaxies

Abstract The Milky Way has accreted many ultra-faint dwarf galaxies (UFDs), and stars from these galaxies can be found throughout our Galaxy today. Studying these stars provides insight into galaxy formation and early chemical enrichment, but identifying them is difficult. Clustering stellar dynamics in 4D phase space ( E , L z , J r , J z ) is one method of identifying accreted structure that is currently being utilized in the search for accreted UFDs. We produce 32 simulated stellar halos using particle tagging with the Caterpillar simulation suite and thoroughly test the abilities of different clustering algorithms to recover tidally disrupted UFD remnants. We perform over 10,000 clustering runs, testing seven clustering algorithms, roughly twenty hyperparameter choices per algorithm, and six different types of data sets each with up to 32 simulated samples. Of the seven algorithms, HDBSCAN most consistently balances UFD recovery rates and cluster realness rates. We find that, even in highly idealized cases, the vast majority of clusters found by clustering algorithms do not correspond to real accreted UFD remnants and we can generally only recover 6% of UFDs remnants at best. These results focus exclusively on groups of stars from UFDs, which have weak dynamic signatures compared to the background of other stars. The recoverable UFD remnants are those that accreted recently, z accretion ≲ 0.5. Based on these results, we make recommendations to help guide the search for dynamically linked clusters of UFD stars in observational data. We find that real clusters generally have higher median energy and J r , providing a way to help identify real versus fake clusters. We also recommend incorporating chemical tagging as a way to improve clustering results.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

MIBiG 3.0: a community-driven effort to annotate experimentally validated biosynthetic gene clusters

Abstract With an ever-increasing amount of (meta)genomic data being deposited in sequence databases, (meta)genome mining for natural product biosynthetic pathways occupies a critical role in the discovery of novel pharmaceutical drugs, crop protection agents and biomaterials. The genes that encode these pathways are often organised into biosynthetic gene clusters (BGCs). In 2015, we defined the Minimum Information about a Biosynthetic Gene cluster (MIBiG): a standardised data format that describes the minimally required information to uniquely characterise a BGC. We simultaneously constructed an accompanying online database of BGCs, which has since been widely used by the community as a reference dataset for BGCs and was expanded to 2021 entries in 2019 (MIBiG 2.0). Here, we describe MIBiG 3.0, a database update comprising large-scale validation and re-annotation of existing entries and 661 new entries. Particular attention was paid to the annotation of compound structures and biological activities, as well as protein domain selectivities. Together, these new features keep the database up-to-date, and will provide new opportunities for the scientific community to use its freely available data, e.g. for the training of new machine learning models to predict sequence-structure-function relationships for diverse natural products. MIBiG 3.0 is accessible online at https://mibig.secondarymetabolites.org/.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1973

Analysis of Mossbauer Fe-57 absorption in an F.C.C. Fe-Co-V alloy

Mossbauer Fe-57 absorption spectra of superparamagnetic F.C.C. Fe sub .34 Co sub .52 V sub 14 (Vicalloy II) have been analyzed using a cluster model and magnetic resonance relaxation theory. The number and magnetic moment of the clusters were determined from magnetization data. A least squares fit to the spectrum at 4.2 K gives sub Hhyp = 175. kG, substantially greater than the value 55 kG inferred just from the observed broadening of the single line spectrum. From this broadening an estimate of 40 kG is obtained for the width of the distribution in Hhyp at 4.2 K arising from compositional fluctuations sub and small cluster effects.

Bambakidis, G.↗
NASA NTRS2003

Confirmation of a radio-selected galaxy overdensity at z = 1.11¹

We report the discovery of a galaxy overdensity at z = 1.11 associated with the z = 1.110 high-redshift radio galaxy MG1 J04426+0202 (hereafterMG0442+0202). The group, Cl 0442+0202, was found in a near-infrared survey of z > 1 radio galaxies undertaken to identify spatially coincident regions with a high density of objects red in I-K' color, typical of z > 1 elliptical galaxies. Spectroscopic observations from the Keck I telescope reveal five galaxies within 3500 of MG 0442+0202 at 1.10 < z < 1.11. These member galaxies have broadband colors and optical spectra consistent with passively evolving elliptical galaxies formed at high redshift. Archival ROSAT observations reveal a 3 detection of soft X-ray emission coincident with Cl 0442+0202 at a level 5 times greater than expected for the radio galaxy. These data suggest a rich galaxy cluster and inspired a 45 ks Chandra X-Ray Observatory observation. As expected, the radio galaxy is unresolved by Chandra but is responsible for approximately half the observed X-ray flux. The remaining ROSAT flux is resolved into four point sources within 1500 of the radio galaxy, corresponding to a surface density 2 orders of magnitude higher than average for X-ray sources at these flux levels [S(0.5–2 keV) > 5 X 10¯16 ergs cm¯² s¯¹]. One of these point sources is identified with a radio-quiet type II quasar at z = 1.863, akin to sources recently reported in deep Chandra surveys. The limit on an extended hot intracluster medium in the Chandra data is S(1–6 keV) < 1.9 X 10¯15 ergs cm¯² s¯¹ (3 σ, 30˝ radius aperture). Though the X-ray observations do not confirm the existence of a massive bound cluster at z > 1, the success of the optical=near-infrared targeting of early-type systems near the radio galaxy validates searches using radio galaxies as beacons for highredshift large-scale structure.We interpret Cl 0442+0202 as a massive cluster in the process of formation.

Spinard, Hyron↗
DOE OSTI2017

Weak-lensing calibration of a stellar mass-based mass proxy for redMaPPer and Voronoi Tessellation clusters in SDSS Stripe 82

Here, we present the first weak lensing calibration of μ*, a new galaxy cluster mass proxy corresponding to the total stellar mass of red and blue members, in two cluster samples selected from the SDSS Stripe 82 data: 230 red-sequence Matched-filter Probabilistic Percolation (redMaPPer) clusters at redshift 0.1 ≤ z < 0.33 and 136 Voronoi Tessellation (VT) clusters at 0.1 ≤ z < 0.6. We use the CS82 shear catalogue and stack the clusters in μ* bins to measure a mass-observable power-law relation. For redMaPPer clusters we obtain M0 = (1.77 ± 0.36) × 10 14 h –1 M ⊙ , α = 1.74 ± 0.62. For VT clusters, we find M 0 = (4.31 ± 0.89) × 10 14 h –1 M ⊙ , α = 0.59 ± 0.54 and M0 = (3.67 ± 0.56) × 10 14 h –1 M ⊙ , α = 0.68 ± 0.49 for a low and a high redshift bin, respectively. Our results are consistent, internally and with the literature, indicating that our method can be applied to any cluster-finding algorithm. In particular, we recommend that μ* be used as the mass proxy for VT clusters. Catalogues including μ* measurements will enable its use in studies of galaxy evolution in clusters and cluster cosmology.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Association between optically identified galaxy clusters and the underlying dark matter halos

Clusters of galaxies trace massive dark matter halos in the Universe, but they can include multiple halos projected along lines of sight. Here, we study the halos contributing to clusters using the Cardinal simulation, which mimics the Dark Energy Survey data. We use the red-sequence-based cluster finding algorithm redMaPPer as a case study. For each cluster, we identify the halos hosting its member galaxies, and we define the main halo as the one contributing the most to the cluster's richness ($λ$, the estimated number of member galaxies). At $z=0.3$, for clusters with $λ> 60$, the main halo typically contributes to $92\%$ of the richness, and this fraction drops to $67\%$ for $λ\approx 20$. Defining "clean" clusters as those with $\geq50\%$ of the richness contributed by the main halo, we find that $100\%$ of the $λ> 60$ clusters are clean, while $73\%$ of the $λ\approx 20$ clusters are clean. Three halos can usually account for more than $80\%$ of the richness of a cluster. The main halos associated with redMaPPer clusters have a completeness ranging from $98\%$ at virial mass $10^{14.6}~h^{-1}M_{\odot}$ to $64\%$ at $10^{14}~h^{-1}M_{\odot}$. In addition, we compare the inferred cluster centers with true halo centers, finding that $30\%$ of the clusters are miscentered with a mean offset $40\%$ of the cluster radii, in agreement with recent X-ray studies. These systematics worsen as redshift increases, but we expect that upcoming surveys extending to longer wavelengths will improve the cluster finding at high redshifts. Our results affirm the robustness of the redMaPPer algorithm and provide a framework for benchmarking other cluster-finding strategies.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1983

Remote Sensing techniques used to characterize soil erosion in southwestern Sao Paulo state

Within randomly sampled squares of a 1 km x 1 km grid, rill/gullies frequency, land cover/land use type and shape of the slopes were extracted from aerial photographs of the Ribeirao Anhumas drainage basin. Mean slope gradient, stream frequency and slope length were calculated on topographic maps. Ground truth data on fine sand/coarse sand ratio and vegetation cover densities were obtained. The MSS-LANDSAT-2 data (CCTs) were analyzed using single-cell, cluster synthesis and slicer algorithms. Graphical and statistical analyses of the data indicate that different slope gradients and land cover/land use types are the most significant factors related to the soil erosion process. The digital analysis of MSS data allowed the association among gray level classes and vegetation cover classes, which defined seven classes. These gray level classes and slope gradient classes were used to rank erosion risk.

Parada, N. D. J.↗
NASA NTRS1990

60 micron luminosity evolution of rich clusters of galaxies

The average 60-micron flux has been determined for a collection of optically selected galaxy clusters at redshifts ranging from 0.30 to 0.92. The result, 26 mJy per cluster, represents the faintest flux determination known of using the IRAS data base. The flux from this set of clusters has been compared to the 60-micron flux from a sample of nearby galaxy clusters. It is found that the far-infrared luminosity evolution in cluster galaxies can be no more than a factor of 1.7 from z = 0.4 to the present epoch. This upper limit is close to the evolution predicted for simple aging of the stellar populations. Additional processes such as mergers, cannibalism, or enhanced rates of starbursts appear to occur at a low enough level that they have little influence on the far-infrared emission from clusters over this redshift range.

Kelly, Douglas M.↗
DOE OSTI2012

EVIDENCE FOR TWO DISTINCT STELLAR INITIAL MASS FUNCTIONS

We present velocity dispersion measurements of 20 Local Group stellar clusters (7 < log(age [yr]) <10.2) from integrated light spectra and examine the evolution of the stellar mass-to-light ratio, Y{sub *}. We find that the clusters deviate from the evolutionary tracks corresponding to simple stellar populations drawn from standard stellar initial mass functions (IMFs). The nature of this failure, in which Y{sub *} is at first underestimated and then overestimated with age, invalidates potential simple solutions involving a rescaling of either the measured masses or modeled luminosities. A range of possible shortcomings in the straightforward interpretation of the data, including subtleties arising from cluster dynamical evolution on the present-day stellar mass functions and from stellar binarity on the measured velocity dispersions, do not materially affect this conclusion given the current understanding of those effects. Independent of further conjectures regarding the origin of this problem, this result highlights a basic failing of our understanding of the integrated stellar populations of these systems. We propose the existence of two distinct IMFs, one primarily, but not exclusively, valid for older, metal-poor clusters and the other for primarily, but not exclusively, younger, metal-rich clusters. The young (log(age [yr]) < 9.5) clusters are well described by a bottom-heavy IMF, such as a Salpeter IMF, while the older clusters are better described by a top-heavy IMF, such as a light-weighted Kroupa IMF, although neither of these specific forms is a unique solution. The sample is small, with the findings currently depending on the results for four key clusters, but doubling the sample is within reach.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Platelet cloaking of circulating tumour cells in patients with metastatic prostate cancer: Results from ExPeCT, a randomised controlled trial

Background: Circulating tumour cells (CTCs) represent a morphologically distinct subset of cancer cells, which aid the metastatic spread. The ExPeCT trial aimed to examine the effectiveness of a structured exercise programme in modulating levels of CTCs and platelet cloaking in patients with metastatic prostate cancer. Methods: Participants (n = 61) were randomised into either standard care (control) or exercise arms. Whole blood was collected for all participants at baseline (T0), three months (T3) and six months (T6), and analysed for the presence of CTCs, CTC clusters and platelet cloaking. CTC data was correlated with clinico-pathological information. Results: Changes in CTC number were observed within group over time, however no significant difference in CTC number was observed between groups over time. Platelet cloaking was identified in 29.5% of participants. A positive correlation between CTC number and white cell count (WCC) was observed (p = 0.0001), in addition to a positive relationship between CTC clusters and PSA levels (p = 0.0393). Conclusion: The presence of platelet cloaking has been observed in this patient population for the first time, in addition to a significant correlation between CTC number and WCC. Trial registration: ClincalTrials.gov identifier NCT02453139 .

60 APPLIED LIFE SCIENCES↗
DOE OSTI2014

A Cluster-based Method to Map Urban Area from DMSP/OLS Nightlights

Accurate information of urban areas at regional and global scales is important for both the science and policy-making communities. The Defense Meteorological Satellite Program/Operational Linescan System (DMSP/OLS) nighttime stable light data (NTL) provide a potential way to map urban area and its dynamics economically and timely. In this study, we developed a cluster-based method to estimate the optimal thresholds and map urban extents from the DMSP/OLS NTL data in five major steps, including data preprocessing, urban cluster segmentation, logistic model development, threshold estimation, and urban extent delineation. Different from previous fixed threshold method with over- and under-estimation issues, in our method the optimal thresholds are estimated based on cluster size and overall nightlight magnitude in the cluster, and they vary with clusters. Two large countries of United States and China with different urbanization patterns were selected to map urban extents using the proposed method. The result indicates that the urbanized area occupies about 2% of total land area in the US ranging from lower than 0.5% to higher than 10% at the state level, and less than 1% in China, ranging from lower than 0.1% to about 5% at the province level with some municipalities as high as 10%. The derived thresholds and urban extents were evaluated using high-resolution land cover data at the cluster and regional levels. It was found that our method can map urban area in both countries efficiently and accurately. Compared to previous threshold techniques, our method reduces the over- and under-estimation issues, when mapping urban extent over a large area. More important, our method shows its potential to map global urban extents and temporal dynamics using the DMSP/OLS NTL data in a timely, cost-effective way.

Cities↗
NASA NTRS1974

An analysis of pilot error-related aircraft accidents

A multidisciplinary team approach to pilot error-related U.S. air carrier jet aircraft accident investigation records successfully reclaimed hidden human error information not shown in statistical studies. New analytic techniques were developed and applied to the data to discover and identify multiple elements of commonality and shared characteristics within this group of accidents. Three techniques of analysis were used: Critical element analysis, which demonstrated the importance of a subjective qualitative approach to raw accident data and surfaced information heretofore unavailable. Cluster analysis, which was an exploratory research tool that will lead to increased understanding and improved organization of facts, the discovery of new meaning in large data sets, and the generation of explanatory hypotheses. Pattern recognition, by which accidents can be categorized by pattern conformity after critical element identification by cluster analysis.

Kowalsky, N. B.↗
DOE OSTI2018

Clustering Methods and Validation of Representative Distribution Feeders

Clustering has received a lot of focus globally in recent years to determine representative feeders for validating smart grid technologies; however, clear reasoning on why a particular technique was used to accomplish a clustering step and whether similar results can be obtained from different techniques has not been reported. Further, and most importantly, validating final representative feeders and clusters when a sizeable feeder data set is used has not been completed. This paper addresses these issues. This paper also highlights the parameters that were determined to be critical for photovoltaic hosting capacity based on this analysis.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Measurement of the photometric baryon acoustic oscillations with self-calibrated redshift distribution

ABSTRACT We use a galaxy sample derived from the Dark Energy Camera Legacy Survey Data Release 9 to measure the baryonic acoustic oscillations (BAO). The magnitude-limited sample consists of 10.6 million galaxies in an area of 4974 deg2 over the redshift range of [0.6, 1]. A key novelty of this work is that the true redshift distribution of the photo-z sample is derived from the self-calibration method, which determines the true redshift distribution using the clustering information of the photometric data alone. Through the angular correlation function in four tomographic bins, we constrain the BAO scale dilation parameter α to be 1.025 ± 0.033, consistent with the fiducial Planck cosmology. Alternatively, the ratio between the comoving angular diameter distance and the sound horizon, DM/rs, is constrained to be 18.94 ± 0.61 at the effective redshift of 0.749. We corroborate our results with the true redshift distribution obtained from a weighted spectroscopic sample, finding very good agreement. We have conducted a series of tests to demonstrate the robustness of the measurement. Our work demonstrates that the self-calibration method can effectively constrain the true redshift distribution in cosmological applications, especially in the context of photometric BAO measurement.

Astronomy & Astrophysics↗
NASA NTRS2006

Observations of High-Redshift X-Ray Selected Clusters with the Sunyaev-Zel'dovich Array

We report measurements of the Sunyaev-Zel'dovich (SZ) effect in three highredshift (0.89 less than or equal to z less than or equal to 1.03), X-ray selected galaxy clusters. The observations were obtained at 30 GHz during the commissioning period of a new, eight-element interferometer - the Sunyaev-Zel dovich Array (SZA) - built for dedicated SZ effect observations. The SZA observations are sensitive to angular scales larger than those subtended by the virial radii of the clusters. Assuming isothermality and hydrostatic equilibrium for the intracluster medium, and gas-mass fractions consistent with those for clusters at moderate redshift, we calculate electron temperatures, gas masses, and total cluster masses from the SZ data. The SZ-derived masses, integrated approximately to the virial radii, are 1.9(sup +0.5)(sub -0.4) x 10(sup 14) solar mass for ClJ1415.1+3612, 3.4 (sup +0.6)(sup -0.5) x 10(sup 14) solar mass for ClJ1429.0+4241 and 7.2(sup +1.3)(sub -0.9) x 10(sup 14) solar mass for ClJ1226.9+3332. The SZ-derived quantities are in good agreement with the cluster properties derived from X-ray measurements.

Muchovej, Stephen↗
NASA NTRS2003

Confirmation of a Radio-Selected Galaxy Overdensity at z=1.11

We report the discovery of a galaxy overdensity at z = 1.11 associated with the z = 1.110 high-redshift radio galaxy MG1 J04426+0202 (hereafter MG 0442+0202). The group, Cl 0442+0202, was found in a near-infrared survey of z > 1 radio galaxies undertaken to identify spatially coincident regions with a high density of objects red in I-K' color, typical of z > 1 elliptical galaxies. Spectroscopic observations from the Keck I telescope reveal five galaxies within 35" of MG 0442+0202 at 1.10 < z < 1.11. These member galaxies have broadband colors and optical spectra consistent with passively evolving elliptical galaxies formed at high redshift. Archival ROSAT observations reveal a 3 (sigma) detection of soft X-ray emission coincident with Cl 0442+0202 at a level 5 times greater than expected for the radio galaxy. These data suggest a rich galaxy cluster and inspired a 45 ks Chandra X-Ray Observatory observation. As expected, the radio galaxy is unresolved by Chandra but is responsible for approximately half the observed X-ray flux. The remaining ROSAT flux is resolved into four point sources within 15' of the radio galaxy, corresponding to a surface density 2 orders of magnitude higher than average for X-ray sources at these flux levels [S(0.5-2 keV) > 5 x 10(exp -16) ergs cm (exp -2) s(exp -1)]. One of these point sources is identified with a radio-quiet type II quasar at z = 1.863, akin to sources recently reported in deep Chandra surveys. The limit on an extended hot intracluster medium in the Chandra data is S(1-6 keV) < 1.9 x 10-15 ergs cm (exp -2) s(exp -1) (3 (sigma), 30" radius aperture). Though the X-ray observations do not confirm the existence of a massive bound cluster at z > 1, the success of the optical/near-infrared targeting of early-type systems near the radio galaxy validates searches using radio galaxies as beacons for high-redshift large-scale structure. We interpret Cl 0442+0202 as a massive cluster in the process of formation.

galaxies↗