SEARCH · Engineering Papers

Results for “data clustering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Functional Data Analysis for Extracting the Intrinsic Dimensionality of Spectra: Application to Chemical Homogeneity in the Open Cluster M67

High-resolution spectroscopic surveys of the Milky Way have entered the Big Data regime and have opened avenues for solving outstanding questions in Galactic archeology. However, exploiting their full potential is limited by complex systematics, whose characterization has not received much attention in modern spectroscopic analyses. In this work, we present a novel method to disentangle the component of spectral data space intrinsic to the stars from that due to systematics. Using functional principal component analysis on a sample of 18,933 giant spectra from APOGEE, we find that the intrinsic structure above the level of observational uncertainties requires ≈10 functional principal components (FPCs). Our FPCs can reduce the dimensionality of spectra, remove systematics, and impute masked wavelengths, thereby enabling accurate studies of stellar populations. To demonstrate the applicability of our FPCs, we use them to infer stellar parameters and abundances of 28 giants in the open cluster M67. We employ Sequential Neural Likelihood, a simulation-based Bayesian inference method that learns likelihood functions using neural density estimators, to incorporate non-Gaussian effects in spectral likelihoods. By hierarchically combining the inferred abundances, we limit the spread of the following elements in M67: Fe ≲ 0.02 dex; C ≲ 0.03 dex; O, Mg, Si, Ni ≲ 0.04 dex; Ca ≲ 0.05 dex; N, Al ≲ 0.07 dex (at 68% confidence). Our constraints suggest a lack of self-pollution by core-collapse supernovae in M67, which has promising implications for the future of chemical tagging to understand the star formation history and dynamical evolution of the Milky Way.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2025

Comparison of the Distribution of the In Situ Ring Current Density Based on Magnetic Field Observations From THEMIS, MMS and Cluster

Abstract We review and extend previous work on the ring current density distribution by applying the curlometer technique to multi‐spacecraft magnetic field data on different spatial scales, directly comparing the results of three space missions: Time History of Events and Macroscale Interactions during Substorms (THEMIS), The Magnetospheric Multiscale (MMS) and Cluster, that have so far accrued decades of data on a range of spatial separation scales. We suggest that the statistical results of Cluster data over two decades can illustrate well the overall form of the ring current (in the ring plane), but can underestimate the current density, while THEMIS (partially) and MMS are able to observe the detailed structure of the ring current and indeed show different behavior on some (smaller) spatial scales. These results suggest that, in addition to the local time and radial form, reported previously, the morphology of the ring current may also depend on magnetic latitude, as influenced by the tilt angle between the inner and outer magnetic fields.

Tan, X. [School of Space and Earth Sciences Beihan↗

DOE OSTI2015

Density-Aware Clustering Based on Aggregated Heat Kernel and Its Transformation

Current spectral clustering algorithms suffer from the sensitivity to existing noise, and parameter scaling, and may not be aware of different density distributions across clusters. If these problems are left untreated, the consequent clustering results cannot accurately represent true data patterns, in particular, for complex real world datasets with heterogeneous densities. This paper aims to solve these problems by proposing a diffusion-based Aggregated Heat Kernel (AHK) to improve the clustering stability, and a Local Density Affinity Transformation (LDAT) to correct the bias originating from different cluster densities. AHK statistically\ models the heat diffusion traces along the entire time scale, so it ensures robustness during clustering process, while LDAT probabilistically reveals local density of each instance and suppresses the local density bias in the affinity matrix. Our proposed framework integrates these two techniques systematically. As a result, not only does it provide an advanced noise-resisting and density-aware spectral mapping to the original dataset, but also demonstrates the stability during the processing of tuning the scaling parameter (which usually controls the range of neighborhood). Furthermore, our framework works well with the majority of similarity kernels, which ensures its applicability to many types of data and problem domains. The systematic experiments on different applications show that our proposed algorithms outperform state-of-the-art clustering algorithms for the data with heterogeneous density distributions, and achieve robust clustering performance with respect to tuning the scaling parameter and handling various levels and types of noise.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2016

Star-forming brightest cluster galaxies at 0.25 < z < 1.25: A transitioning fuel supply

We present a multiwavelength study of the 90 brightest cluster galaxies (BCGs) in a sample of galaxy clusters selected via the Sunyaev Zel’dovich effect by the South Pole Telescope, utilizing data from various ground- and space-based facilities. We infer the star-formation rate (SFR) for the BCG in each cluster—based on the UV and IR continuum luminosity, as well as the [O ii]λλ3726,3729 emission line luminosity in cases where spectroscopy is available—and find seven systems with SFR > 100 M{sub ⊙} yr{sup −1}. We find that the BCG SFR exceeds 10 M{sub ⊙} yr{sup −1} in 31 of 90 (34%) cases at 0.25 < z < 1.25, compared to ∼1%–5% at z ∼ 0 from the literature. At z ≳ 1, this fraction increases to 92{sub −31}{sup +6}%, implying a steady decrease in the BCG SFR over the past ∼9 Gyr. At low-z, we find that the specific SFR in BCGs is declining more slowly with time than for field or cluster galaxies, which is most likely due to the replenishing fuel from the cooling ICM in relaxed, cool core clusters. At z ≳ 0.6, the correlation between the cluster central entropy and BCG star formation—which is well established at z ∼ 0—is not present. Instead, we find that the most star-forming BCGs at high-z are found in the cores of dynamically unrelaxed clusters. We use data from the Hubble Space Telescope to investigate the rest-frame near-UV morphology of a subsample of the most star-forming BCGs, and find complex, highly asymmetric UV morphologies on scales as large as ∼50–60 kpc. The high fraction of star-forming BCGs hosted in unrelaxed, non-cool core clusters at early times suggests that the dominant mode of fueling star formation in BCGs may have recently transitioned from galaxy–galaxy interactions to ICM cooling.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2019

Dark Energy Survey Year 1 results: weak lensing mass calibration of redMaPPer galaxy clusters

We constrain the mass-richness scaling relation of redMaPPer galaxy clusters identified in the Dark Energy Survey Year 1 data using weak gravitational lensing. We split clusters into 4 x 3 bins of richness lambda and redshift z for lambda >= 20 and 0.2 <= z <= 0.65 and measure the mean masses of these bins using their stacked weak lensing signal. By modelling the scaling relation as M-200m|lambda, M-0(lambda/40)(F)((1 + /1.35)(G), we constrain the normalization of the scaling relation at the 5.0 per cent level, finding M-0 = [3.081 +/- 0.075(stat) +/- 0.133(sys)] center dot 10(14) M-aS (TM) at lambda = 40 and = 0.35. The recovered richness scaling index is F = 1.356 +/- 0.051 (stat) +/- 0.008 (sys) and the redshift scaling index G = -0.30 +/- 0.30 (stat) +/- 0.06 (sys). These are the tightest measurements of the normalization and richness scaling index made to date from a weak lensing experiment. We use a semi-analytic covariance matrix to characterize the statistical errors in the recovered weak lensing profiles. Our analysis accounts for the following sources of systematic error: shear and photometric redshift errors, cluster miscentring, cluster member dilution of the source sample, systematic uncertainties in the modelling of the halo-mass correlation function, halo triaxiality, and projection effects. We discuss prospects for reducing our systematic error budget, which dominates the uncertainty on M-0. Our result is in excellent agreement with, but has significantly smaller uncertainties than, previous measurements in the literature, and augurs well for the power of the DES cluster survey as a tool for precision cosmology and upcoming galaxy surveys such as LSST, Euclid, and WFIRST

clusters↗

DOE OSTI2016

MC 2 : Mapping the dark matter distribution of the “Toothbrush” cluster RX J0603.3+4214 with Hubble Space Telescope and Subaru weak lensing

The galaxy cluster RX J0603.3+4214 at z = 0:225 is one of the rarest clusters boasting an extremely large ( 2 Mpc) radio relic. Because of the remarkable morphology of the relic, the cluster is nicknamed the \Toothbrush Cluster". Although the cluster's underlying mass distribution is one of the critical pieces of information needed to reconstruct the merger scenario responsible for the puzzling radio relic morphology, its proximity to the Galactic plane b 10 has imposed signi cant observational challenges. We present a high-resolution weak-lensing study of the cluster with Subaru/Suprime Cam and Hubble Space Telescope imaging data. Our mass reconstruction reveals that the cluster is composed of complicated dark matter substructures closely tracing the galaxy distribution, in contrast, however, with the relatively simple binary X-ray morphology. Nevertheless, we nd that the cluster mass is still dominated by the two most massive clumps aligned north-south with a 3:1 mass ratio (M 200 = 6:29 +2:24 -1:62 X 10 14 M⊙ and 1:98 +1:24 -0:74 X 10 14 M⊙ for the northern and southern clumps, respectively). The southern mass peak is 20 o set toward the south with respect to the corresponding X-ray peak, which has a \bullet"-like morphology pointing south. Comparison of the current weak- lensing result with the X-ray, galaxy, and radio relic suggests that perhaps the dominant mechanism responsible for the observed relic may be a high-speed collision of the two most massive subclusters, although the peculiarity of the morphology necessitates involvement of additional subclusters. Careful numerical simulations should follow in order to obtain more complete understanding of the merger scenario utilizing all existing observations.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2020

Variations in the Width, Density, and Direction of the Palomar 5 Tidal Tails

Stars that escape globular clusters form tidal tails that are predominantly shaped by the global distribution of mass in the Galaxy, but also preserve a historical record of small-scale perturbations. Using deep grz photometry from DECaLS, we present highly probable members of the tidal tails associated with the evaporating globular cluster Palomar 5. These data yield the cleanest view of a stellar stream beyond ≈20 kpc and reveal: (1) a wide, low surface-brightness extension of the leading tail; (2) significant density variations along the stream; and (3) sharp changes in the direction of both the leading and the trailing tail. In the fiducial Milky Way model, a rotating bar perturbs the Palomar 5 tails and can produce streams with similar width and density profiles to those observed. However, the deviations of the stream track in this simple model do not match those observed in the Palomar 5 trailing tail, indicating the need for an additional source of perturbation. These discoveries open up the possibility of measuring the population of perturbers in the Milky Way, including dark-matter subhalos, with an ensemble of stellar streams and deep photometry alone.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS1982

The curvature of radio jets and tails in the intracluster media of Abell 1446 and 2220

X-ray observations are reported for two rich clusters which contain prominent tailed radio galaxies. These X-ray data are used as probes of the cluster gas to explore mechanisms which may distort radio jets and tails. A nonrelativistic hydrodynamic flow model is invoked to examine the plasma beam parameters needed to bend the radio streams in a manner consistent with the radio and X-ray data. Within the context of this model, the wide-angle tailed radio structure of 1159 + 583 in A1446 is explained by a combination of a buoyancy pressure gradient in the cluster gas and dynamic pressure arising from slow galaxy motion (200 km/sec). The second cluster observed, A2220, contains a clumped X-ray structure with peaks near two dominant galaxies. The strongly bent radio jets of 1638 + 538 (associated with one of the bright galaxies) are consistent with about 1000 km/sec motion, possibly in a binary orbit, through the X-ray emitting cluster gas; a curved feature in the northern tail, however, may be attributable to buoyancy forces. These X-ray data also suggest that the radio jets and tails are thermally confined by the hot intracluster media.

Burns, J. O.↗

DOE OSTI2023

Robust clustering of the local Milky Way stellar kinematic substructures with Gaia eDR3

Understanding local stellar kinematic substructures in the solar neighbourhood helps build a complete picture of the formation of the Milky Way, as well as an empirical phase space distribution of dark matter that would inform detection experiments. We apply the clustering algorithm HDBSCAN on the Gaia early third data release to identify a list of stable clusters in velocity space and action-angle space by taking into account the measurement uncertainties and studying the stability of the clustering results. We find 1405 (497) stars in 23 (6) robust clusters in velocity space (action-angle space) that are consistently not associated with noise. We discuss the kinematic properties of these structures and study whether many of the small clusters belong to a similar larger cluster based on their chemical abundances. They are attributed to the known structures: the Gaia Sausage-Enceladus, the Helmi Stream, and globular cluster NGC 3201 are found in both spaces, while NGC 104 and the thick disc (Sequoia) are identified in velocity space (action-angle space). Although we do not identify any new structures, we find that the HDBSCAN member selection of already known structures is unstable to input kinematics of the stars when resampled within their uncertainties. We therefore present the stable subset of local kinematic structures, which are consistently identified by the clustering algorithm, and emphasize the need to take into account error propagation during both the manual and automated identification of stellar structures, both for existing ones as well as future discoveries.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2024

Simulating water dynamics related to pedogenesis across space and time: Implications for four-dimensional digital soil mapping

Digital soil mapping (DSM) relies on machine-learning and geostatistics to represent soil property observations across space. DSM techniques are powerful but often empirical, being limited to the quality and density of point samples. Water dynamics are closely related to soil variability, and the physics that govern water movement are well known. Hydrological properties can hence be simulated by physical models through space and time, unveiling key characteristics about soils. We propose the use of hydrologic models to map soils across the surface (2D), depth (1D), and time (1D)–which provides a 4D approach to digital soil mapping (4DSM). The Distributed Hydrology Soil Vegetation Model (DHSVM) was applied to a watershed currently under pasture. Moisture sensors and wells were installed at different depths in the watershed on summit, sideslope and toeslope positions to validate the model. DHSVM simulations of soil moisture distribution and depth to saturation were performed during the hydrological year (October 2008-September 2009). Clusters of similar pixels based on soil moisture values were determined using Dynamic Time Warping (DTW) to align temporal data and K-means. Clustering was performed both seasonally and for the entire year. Temporal patterns simulated by DHSVM matched measurements given by moisture sensors and wells. Seasonal clusters differed from the annual cluster. Distinct clusters were observed for each season and with depth, showing that spatiotemporal soil variability is lost when statically assessing soils. Spatiotemporal clusters corroborated field observations of fragipan occurrence not explicitly spatially mapped by Soil Survey Geographic Database (SSURGO). If a connection can be made between water and soils, static and dynamic soil variability can be predicted using physically based hydrologic models. Hydrologic models can benefit soil mapping by enabling reliable 4D simulation of water dynamics, which are fundamental to soil variability and soil classification and directly relate to biological, physical and chemical soil processes not captured by typical soil sampling protocols.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Identifying geological structures through microseismic cluster and burst analyses complementing active seismic interpretation

At the Decatur carbon capture and storage site (IL, USA) CO 2 has been injected from 2011–2014 and from 2017 to present near the base of the Lower Mt. Simon Sandstone saline reservoir, resulting in microseismicity. Microseismicity is mainly located in the basement and distributed in distinct spatial clusters. The lack of significant impedance contrasts within the basement makes the interpretation of active-source seismic reflection data challenging, however, recent reprocessing allowed to resolve faults above and at the top of the basement. These faults generally do not coincide with the location of microseismic events and their continuation to the general depth of the seismic events cannot be assumed. This paper shows how the interpretation of the microseismicity can complement structural interpretations of active-source seismic reflection data. In particular, we analyze clusters and bursts (abrupt increases) of microseismicity, identify unresolved, smaller-scale weaknesses and extract statistical parameters. These parameters allow comparisons with the interpreted faults, and with fracture sets intercepted by boreholes. During injection at the Decatur site, the injection pressure was kept far below fracture pressure, nevertheless, seismic events were induced and spread far beyond the expected extent of the CO 2 plume. We argue that local stress transfers related to the CO 2 injection reactivated pre-existing fractures within the critically stressed basement. Finally, we conducted a slip tendency analysis for faults interpreted from active seismic, selected cluster, bursts and nodal planes from focal mechanisms to determine if the interpreted structures are optimally oriented with respect to the stress regime. Our results suggest that the orientation of fractures close to the injection well, generally shows slight deviations from the optimal orientation for slip. This might indicate either slight local deviations of the maximum horizontal stress azimuth from the average direction used in the analysis, or the lack of optimally oriented fractures at this location.

58 GEOSCIENCES↗

NASA NTRS1974

The extended X-ray source in Virgo and its relation to M87

Spectral data in the 0.2-1.6 keV range are presented for the extended X-ray source in the Virgo cluster. When combined with Uhuru data, the simplest function which fits the composite spectrum from 0.2 to 10 keV is one describing bremsstrahlung from an isothermal plasma at 36 million deg K. Production of the X-rays by inverse compton scattering is also considered, and models relating the X-ray source to M87 are discussed.

Catura, R. C.↗

DOE OSTI2020

The completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: N -body mock challenge for the quasar sample

ABSTRACT The growth rate and expansion history of the Universe can be measured from large galaxy redshift surveys using the Alcock–Paczynski effect. We validate the Redshift Space Distortion models used in the final analysis of the Sloan Digital Sky Survey (SDSS) extended Baryon Oscillation Spectroscopic Survey (eBOSS) Data Release 16 quasar clustering sample, in configuration and Fourier space, using a series of halo occupation distribution mock catalogues generated using the OuterRim N-body simulation. We test three models on a series of non-blind mocks, in the OuterRim cosmology, and blind mocks, which have been rescaled to new cosmologies, and investigate the effects of redshift smearing and catastrophic redshifts. We find that for the non-blind mocks, the models are able to recover fσ8 to within 3 per cent and α∥ and α⊥ to within 1 per cent. The scatter in the measurements is larger for the blind mocks, due to the assumption of an incorrect fiducial cosmology. From this mock challenge, we find that all three models perform well, with similar systematic errors on fσ8, α∥, and α⊥ at the level of $\sigma _{f\sigma _8}=0.013$, $\sigma _{\alpha _\parallel }=0.012$, and $\sigma _{\alpha _\bot }=0.008$. The systematic error on the combined consensus is $\sigma _{f\sigma _8}=0.011$, $\sigma _{\alpha _\parallel }=0.008$, and $\sigma _{\alpha _\bot }=0.005$, which is used in the final DR16 analysis. For baryon acoustic oscillation fits in configuration and Fourier space, we take conservative systematic errors of $\sigma _{\alpha _\parallel }=0.010$ and $\sigma _{\alpha _\bot }=0.007$.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2019

Managing variations among nodes in parallel system frameworks

Systems, apparatuses, and methods for managing variations among nodes in parallel system frameworks. Sensor and performance data associated with the nodes of a multi-node cluster may be monitored to detect variations among the nodes. A variability metric may be calculated for each node of the cluster based on the sensor and performance data associated with the node. The variability metrics may then be used by a mapper to efficiently map tasks of a parallel application to the nodes of the cluster. In one embodiment, the mapper may assign the critical tasks of the parallel application to the nodes with the lowest variability metrics. In another embodiment, the hardware of the nodes may be reconfigured so as to reduce the node-to-node variability.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2015

A METHOD TO SEARCH FOR BULK MOTIONS IN THE ICM WITH CHANDRA CCD SPECTRA: APPLICATION TO THE BULLET CLUSTER

We propose a strategy to search for bulk motions in the intracluster medium (ICM) of merging clusters based on Chandra CCD data. Our goal is to derive robust measurements of the average redshift of projected ICM regions obtained from the centroid of the K{sub α} line emission. We thoroughly explore the effect of the unknown temperature structure along the line of sight to accurately evaluate the systematic uncertainties on the ICM redshift. We apply our method to the “Bullet cluster” (1E 0657-56). We directly identify 23 independent regions on the basis of the surface brightness contours, and measure the redshift of the ICM averaged along the line of sight in each. We find that the redshift distribution across these regions is marginally inconsistent with the null hypothesis of a constant redshift or no bulk motion in the ICM, at a confidence level of about 2σ. We tentatively identify the regions most likely affected by bulk motions and find a maximum velocity gradient of about (46 ± 13) km s{sup −1} kpc{sup −1} along the line of sight on a scale of ∼260 kpc along the path of the “bullet.” We interpret this as the possible signature of a significant mass of ICM pushed away along a direction perpendicular to the merging. This preliminary result is promising for a systematic search for bulk motions in bright, moderate-redshift clusters based on spatially resolved spectral analysis of Chandra CCD data.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS2012

Cold Fronts in Clusters of Galaxies: Observations and Modeling

Mergers of galaxy clusters -- some of the most energetic events in the Universe -- produce disturbances in hot intracluster medium, such as shocks and cold fronts, that can be used as tools to study the physics of galaxy clusters. Cold fronts may constrain viscosity and the structure and strength of the cluster magnetic fields. Combined with radio data, these observations also shed light on the production of ultrarelativistic particles that are known to coexist with the cluster thermal plasma. This talk will summarize the current X-ray observations of cluster mergers, as well as some recent radio data and high resolution hydrodynamic simulations.

Markevitch, Maxim↗

NASA NTRS2001

Efficiency of parallel direct optimization

Tremendous progress has been made at the level of sequential computation in phylogenetics. However, little attention has been paid to parallel computation. Parallel computing is particularly suited to phylogenetics because of the many ways large computational problems can be broken into parts that can be analyzed concurrently. In this paper, we investigate the scaling factors and efficiency of random addition and tree refinement strategies using the direct optimization software, POY, on a small (10 slave processors) and a large (256 slave processors) cluster of networked PCs running LINUX. These algorithms were tested on several data sets composed of DNA and morphology ranging from 40 to 500 taxa. Various algorithms in POY show fundamentally different properties within and between clusters. All algorithms are efficient on the small cluster for the 40-taxon data set. On the large cluster, multibuilding exhibits excellent parallel efficiency, whereas parallel building is inefficient. These results are independent of data set size. Branch swapping in parallel shows excellent speed-up for 16 slave processors on the large cluster. However, there is no appreciable speed-up for branch swapping with the further addition of slave processors (>16). This result is independent of data set size. Ratcheting in parallel is efficient with the addition of up to 32 processors in the large cluster. This result is independent of data set size. c2001 The Willi Hennig Society.

NASA Discipline Evolutionary Biology↗

DOE OSTI2023

Data-driven analysis and prediction of wastewater treatment plant performance: Insights and forecasting for sustainable operations

Here this study presents a comprehensive performance and forecasting analysis of the As-Samra wastewater treatment plant (WWTP) in Jordan, with two main objectives. Firstly, a thorough evaluation of the plant's performance is conducted. The analysis involves independently assessing historical operational conditions, plant production, and their statistical correlations using various statistical techniques. The second objective focuses on developing a data-driven forecasting approach to predict the plant's production one month in advance, using multiple machine learning models. The results highlight the effectiveness of principal component analysis (PCA) in simplifying operational data, revealing distinct operational clusters, and identifying seasonal production patterns while showing correlations between operational conditions and overall power production. The support vector machine (SVM) forecasting model emerged as the top performer, showcasing the potential of a hybrid forecasting approach. The findings offer valuable perspectives for enhancing operational efficiency, refining production planning, and ultimately improving the environmental impact of the plant.

42 ENGINEERING↗