Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “clustering statistics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Full Modeling and parameter compression methods in configuration space for DESI 2024 and beyond

In the contemporary era of high-precision spectroscopic surveys, led by projects like DESI, there is an increasing demand for optimizing the extraction of cosmological information from clustering data. This work conducts a thorough comparison of various methodologies for modeling the full shape of the two-point statistics in configuration space. We investigate the performance of both direct fits (Full Modeling) and the parameter compression approaches (ShapeFit and Standard). We utilize the ABACUS-SUMMIT simulations, tailored to exceed DESI's precision requirements. Particularly, we fit the two-point statistics of three distinct tracers (LRG, ELG, and QSO), by employing a Gaussian Streaming Model in tandem with Convolution Lagrangian Perturbation Theory and Effective Field Theory. We explore methodological setup variations, including the range of scales, the set of galaxy bias parameters, the inclusion of the hexadecapole, as well as model extensions encompassing varying ns and allowing for w 0 w a CDM dark energy model. Throughout these varied explorations, while precision levels fluctuate and certain configurations exhibit tighter parameter constraints, our pipeline consistently recovers the parameter values of the mocks within 1σ in all cases for a 1-year DESI volume. Additionally, we compare the performance of configuration space analysis with its Fourier space counterpart using three models: PyBird, FOLPS and velocileptors, presented in companion papers. We find good agreement with the results from all these models.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Unsupervised Machine Learning for Exploratory Data Analysis of Exoplanet Transmission Spectra

Abstract Transit spectroscopy is a powerful tool for decoding the chemical compositions of the atmospheres of extrasolar planets. In this paper, we focus on unsupervised techniques for analyzing spectral data from transiting exoplanets. After cleaning and validating the data, we demonstrate methods for: (i) initial exploratory data analysis, based on summary statistics (estimates of location and variability); (ii) exploring and quantifying the existing correlations in the data; (iii) preprocessing and linearly transforming the data to its principal components; (iv) dimensionality reduction and manifold learning; (v) clustering and anomaly detection; and (vi) visualization and interpretation of the data. To illustrate the proposed unsupervised methodology, we use a well-known public benchmark data set of synthetic transit spectra. We show that there is a high degree of correlation in the spectral data, which calls for appropriate low-dimensional representations. We explore a number of different techniques for such dimensionality reduction and identify several suitable options in terms of summary statistics, principal components, etc. We uncover interesting structures in the principal component basis, namely well-defined branches corresponding to different chemical regimes of the underlying atmospheres. We demonstrate that those branches can be successfully recovered with a K-means clustering algorithm in a fully unsupervised fashion. We advocate for lower-dimensional representations of the spectroscopic data in terms of the main principal components, in order to reveal the existing structure in the data and quickly characterize the chemical class of a planet.

Matchev, Konstantin T. (ORCID:0000000341829096)↗
DOE OSTI2021

Photometric and Kinematic Study of the Open Clusters SAI 44 and SAI 45

We carry out a detailed photometric and kinematic study of the poorly studied sparse open clusters SAI 44 and SAI 45 using ground-based BVR {sub c} I {sub c} data supplemented by archival data from Gaia eDR3 and Pan-STARRS. The stellar memberships are determined using a statistical method based on Gaia eDR3 kinematic data, and we found 204 members in SAI 44 while only 74 members are identified in SAI 45. The average distances to SAI 44 and SAI 45 are calculated to be 3670 ± 184 and 1668 ± 47 pc. The logarithmic age of the clusters are determined to be 8.82 ± 0.10 and 9.07 ± 0.10 yr for SAI 44 and SAI 45, respectively. The color–magnitude diagram of SAI 45 hosts an extended main-sequence turnoff (eMSTO). The apparent age spread is found to be similar to the apparent age spread predicted on the basis of the age spread and cluster age relation predicted by rotation models. This indicates that eMSTO is a stellar evolution rather than star formation phenomenon in SAI 45. We conclude that eMSTO in SAI 45 is mainly caused by the different rotation rates of stars as the SYCLIST synthetic population with different rotation rates was able to reproduce the observed eMSTO, and stars in the red part of the eMSTO were preferentially concentrated in the inner region, which again hints at different rotations being the reason for the extension in the upper MS. This finding supports the theory attributing the origin of eMSTO to the different rotations of eMSTO stars. The mass function slopes are obtained as -2.24 ± 0.66 and -2.58 ± 3.20 in the mass rages 2.426–0.990 M{sub ⊙} and 2.167–1.202 M{sub ⊙} for SAI 44 and SAI 45, respectively. SAI 44 exhibits the signature of mass segregation while we found weak evidence of mass segregation in SAI 45 possibly due to tidal stripping. The dynamical relaxation times of these clusters indicate that both clusters are in a dynamically relaxed state. Using the AD-diagram method, the apex coordinates are found to be ([[Formula]], -[[Formula]]) for SAI 44 and (-[[Formula]], -[[Formula]]) for SAI 45. The average space velocity components of the clusters SAI 44 and SAI 45 are calculated in units of km s{sup -1} as (-15.14 ± 3.90, -19.43 ± 4.41, -20.85 ± 4.57) and (28.13 ± 5.30, -9.78 ± 3.13, -19.59 ± 4.43), respectively.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

Measuring H 0 using X-ray and SZ effect observations of dynamically relaxed galaxy clusters

ABSTRACT We use a sample of 14 massive, dynamically relaxed galaxy clusters to constrain the Hubble constant, H0, by combining X-ray and Sunyaev–Zel’dovich (SZ) effect signals measured with Chandra, Planck, and Bolocam. This is the first such analysis to marginalize over an empirical, data-driven prior on the overall accuracy of X-ray temperature measurements, while our restriction to the most relaxed, massive clusters also minimizes astrophysical systematics. For a cosmological-constant model with Ωm = 0.3 and ΩΛ = 0.7, we find $H_0 = 67.3^{+21.3}_{-13.3}\, \mathrm{km}\, \mathrm{s}^{-1}\, \mathrm{Mpc}^{-1}$, limited by the temperature calibration uncertainty (compared to the statistically limited constraint of $H_0 = 72.3^{+7.6}_{-7.6}\, \mathrm{km}\, \mathrm{s}^{-1}\, \mathrm{Mpc}^{-1}$). The intrinsic scatter in the X-ray/SZ pressure ratio is found to be 13 ± 4 per cent (10 ± 3 per cent when two clusters with significant galactic dust emission are removed from the sample), consistent with being primarily due to triaxiality and projection. We discuss the prospects for reducing the dominant systematic limitation to this analysis, with improved X-ray calibration and/or precise measurements of the relativistic SZ effect providing a plausible route to per cent level constraints on H0.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Personalized Tucker Decomposition: Modeling Commonality and Peculiarity on Tensor Data

In this paper, we propose a personalized Tucker decomposition (perTucker) to address the limitations of traditional tensor decomposition methods in capturing heterogeneity across different datasets. perTucker decomposes tensor data into shared global components and personalized local components. We introduce an order orthogonality assumption and develop a proximal gradient regularized block coordinate descent algorithm guaranteed to converge to a stationary point. The unique and common representations learned by perTucker reveal intrinsic statistical patterns in data and provide valuable information for a wide range of downstream analytics, including anomaly detection, source classification, and clustering. We demonstrate perTucker’s effectiveness through a simulation study and two case studies on solar flare detection and tonnage signal classification.

14 SOLAR ENERGY↗
DOE OSTI2023

A probabilistic-phase field model for the fracture of brittle materials

Abstract We develop a computational method to determine the failure probability of brittle materials under general mechanical loading conditions. The method is a combination of two parts: (1) numerical simulations of materials with multiple cracks using phase field theory, where the complete fracture process is viewed as ‘damage percolation’ along critical paths or clusters of cracks, rather than the traditional weak-link failure mechanism of Weibull, and (2) an extension of the Batdorf statistical theory of fracture to finite domains, where it is implemented within the finite element framework. The results of phase-field simulations at the ‘percolation threshold’ are used as failure data in the Batdorf theory to determine the overall probability of failure. The input to this approach is the size distribution of cracks in a pristine material. An example is shown, where alumina samples that were previously tested by Abe and coworkers (Abeet al2003J. Am. Ceram. Soc.861019–21) in four-point loading are compared to the results of our numerical simulations. The approach developed here has the advantage of being extendable to more complex thermomechanical loading.

Materials Science↗
DOE OSTI2026

SPT-3G D1: Compton-$y$ maps using data from the SPT-3G and Planck surveys

We present thermal Sunyaev-Zel'dovich (tSZ) Compton-$y$ parameter maps constructed from two years (2019-2020) of observations with the South Pole Telescope (SPT) third-generation camera, SPT-3G, combined with data from the Planck satellite. Using a linear combination (LC) pipeline, we obtain a suite of reconstructions that explore different trade-offs between statistical sensitivity and suppression of astrophysical contaminants, including minimum-variance, CMB-deprojected, and CIB-deprojected $y$-maps. We validate these maps through different statistical techniques such as auto- and cross-power spectra with large-scale structure tracers as well as stacking on cluster locations. These tests are used to understand the balance between noise and astrophysical foreground residuals (such as the CIB) in combination with the recovery of the tSZ signal for different maps. For example, results from stacking at the location of clusters confirm the robustness of the recovered tSZ signal over the $\sim 1500\: {\rm deg}^2$ SPT-3G survey field used in this analysis. The high-resolution and low-noise maps produced here provide an important cosmological tool for future studies, including measurements of the Compton-$y$ map power spectrum, cross-correlations with other tracers of the large-scale structure, detailed modeling of cluster pressure profiles, and study of the thermodynamic state of the baryons in the Universe.

Maniyar, A. S. [Harvard-Smithsonian Ctr. Astrophys↗
DOE OSTI2022

The Global Dynamical Atlas of the Milky Way Mergers: Constraints from Gaia EDR3–based Orbits of Globular Clusters, Stellar Streams, and Satellite Galaxies

The Milky Way halo was predominantly formed by the merging of numerous progenitor galaxies. However, our knowledge of this process is still incomplete, especially in regard to the total number of mergers, their global dynamical properties and their contribution to the stellar population of the Galactic halo. Here, we uncover the Milky Way mergers by detecting groupings of globular clusters, stellar streams, and satellite galaxies in action (J) space. While actions fully characterize the orbits, we additionally use the redundant information on their energy (E) to enhance the contrast between the groupings. For this endeavor, we use Gaia EDR3–based measurements of 170 globular clusters, 41 streams, and 46 satellites to derive their J and E. To detect groups, we use the ENLINK software, coupled with a statistical procedure that accounts for the observed phase-space uncertainties of these objects. We detect a total of N = 6 groups, including the previously known mergers Sagittarius, Cetus, Gaia–Sausage/Enceladus, LMS-1/Wukong, Arjuna/Sequoia/I'itoi, and one new merger that we call Pontus. All of these mergers, together, comprise 62 objects (≈25% of our sample). We discuss their members, orbital properties, and metallicity distributions. We find that the three most-metal-poor streams of our galaxy—"C-19" ([Fe/H] = –3.4 dex), "Sylgr" ([Fe/H] = –2.9 dex), and "Phoenix" ([Fe/H] = –2.7 dex)—are associated with LMS-1/Wukong, showing it to be the most-metal-poor merger. The global dynamical atlas of Milky Way mergers that we present here provides a present-day reference for galaxy formation models.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Combination of cluster number counts and two-point correlations: validation on mock Dark Energy Survey

ABSTRACT We present a method of combining cluster abundances and large-scale two-point correlations, namely galaxy clustering, galaxy–cluster cross-correlations, cluster autocorrelations, and cluster lensing. This data vector yields comparable cosmological constraints to traditional analyses that rely on small-scale cluster lensing for mass calibration. We use cosmological survey simulations designed to resemble the Dark Energy Survey Year 1 (DES-Y1) data to validate the analytical covariance matrix and the parameter inferences. The posterior distribution from the analysis of simulations is statistically consistent with the absence of systematic biases detectable at the precision of the DES-Y1 experiment. We compare the χ2 values in simulations to their expectation and find no significant difference. The robustness of our results against a variety of systematic effects is verified using a simulated likelihood analysis of DES-Y1-like data vectors. This work presents the first-ever end-to-end validation of a cluster abundance cosmological analysis on galaxy catalogue level simulations.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Functional Data Analysis for Extracting the Intrinsic Dimensionality of Spectra: Application to Chemical Homogeneity in the Open Cluster M67

High-resolution spectroscopic surveys of the Milky Way have entered the Big Data regime and have opened avenues for solving outstanding questions in Galactic archeology. However, exploiting their full potential is limited by complex systematics, whose characterization has not received much attention in modern spectroscopic analyses. In this work, we present a novel method to disentangle the component of spectral data space intrinsic to the stars from that due to systematics. Using functional principal component analysis on a sample of 18,933 giant spectra from APOGEE, we find that the intrinsic structure above the level of observational uncertainties requires ≈10 functional principal components (FPCs). Our FPCs can reduce the dimensionality of spectra, remove systematics, and impute masked wavelengths, thereby enabling accurate studies of stellar populations. To demonstrate the applicability of our FPCs, we use them to infer stellar parameters and abundances of 28 giants in the open cluster M67. We employ Sequential Neural Likelihood, a simulation-based Bayesian inference method that learns likelihood functions using neural density estimators, to incorporate non-Gaussian effects in spectral likelihoods. By hierarchically combining the inferred abundances, we limit the spread of the following elements in M67: Fe ≲ 0.02 dex; C ≲ 0.03 dex; O, Mg, Si, Ni ≲ 0.04 dex; Ca ≲ 0.05 dex; N, Al ≲ 0.07 dex (at 68% confidence). Our constraints suggest a lack of self-pollution by core-collapse supernovae in M67, which has promising implications for the future of chemical tagging to understand the star formation history and dynamical evolution of the Milky Way.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Inference of the linear matter power spectrum at z = 0 using DESI DR1 Full-Shape data

Measurements of galaxy distributions at large cosmic distances capture clustering from the past. In this study, we use a cosmological model to translate these observations into the present-day galaxy distribution. Specifically, we reconstruct the 3D linear matter power spectrum at redshift z = 0 using Dark Energy Spectroscopic Instrument (DESI) Year 1 (DR1) galaxy clustering data and Cosmic Microwave Background (CMB) observations, assuming the ΛCDM model, and compare it to the result assuming the w 0 w a CDM model. Building on previous state-of-the-art methods, we apply Effective Field Theory (EFT) modelling of the galaxy power spectrum to account for small-scale effects in the 2-point statistics of galaxy data. Implementation of the EFT approach improves the modelling of the galaxy power spectrum, providing a more robust consistency test of the assumed cosmological model. By casting both CMB and galaxy clustering observations, spanning distinct redshift regimes, into k-space, we can identify discrepancies between the datasets of different redshifts, which would indicate potential inaccuracies in the assumed expansion history. While previous studies have shown consistency with ΛCDM, this work extends the analysis with higher-quality data to further test the expansion histories of both ΛCDM and w 0 w a CDM. Our findings show that both ΛCDM and w 0 w a CDM provide consistent fits to the linear matter power spectrum recovered from DESI DR1 data.

cosmological parameters from LSS↗
DOE OSTI2020

Range-separated stochastic resolution of identity: Formulation and application to second-order Green’s function theory

We develop a range-separated stochastic resolution of identity (RS-SRI) approach for the four-index electron repulsion integrals, where the larger terms (above a predefined threshold) are treated using a deterministic RI and the remaining terms are treated using a SRI. The approach is implemented within a second-order Green’s function formalism with an improved O(N 3 ) scaling with the size of the basis set, N. Moreover, the RS approach greatly reduces the statistical error compared to the full stochastic version [T. Y. Takeshita et al., J. Chem. Phys. 151, 044114 (2019)], resulting in computational speedups of ground and excited state energies of nearly two orders of magnitude, as demonstrated for hydrogen dimer chains and water clusters.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Three dimensional cluster analysis for atom probe tomography using Ripley’s K-function and machine learning

The size and structure of spatial molecular and atomic clustering can significantly impact material properties and is therefore important to accurately quantify. Ripley’s K-function (K(r)), a measure of spatial correlation, can be used to perform such quantification when the material system of interest can be represented as a marked point pattern. This work demonstrates how machine learning models based on K (r)-derived metrics can accurately estimate cluster size and intra-cluster density in simulated three dimensional (3D) point patterns containing spherical clusters of varying size; over 90% of model estimates for cluster size and intra-cluster density fall within 11% and 18% error of the true values, respectively. These K (r)-based size and density estimates are then applied to an experimental APT reconstruction to characterize MgZn clusters in a 7000 series aluminum alloy. Here we find that the estimates are more accurate, consistent, and robust to user interaction than estimates from the popular maximum separation algorithm. Using K (r) and machine learning to measure clustering is an accurate and repeatable way to quantify this important material attribute.

36 MATERIALS SCIENCE↗
DOE OSTI2025

High-significance detection of correlation between the unresolved gamma-ray background and the large-scale cosmic structure

Our understanding of the γ-ray sky has improved dramatically in the past decade, however, the unresolved γ-ray background (UGRB) still has a potential wealth of information about the faintest γ-ray sources pervading the Universe. Statistical cross-correlations with tracers of cosmic structure can indirectly identify the populations that most characterize the γ-ray background. In this study, we analyze the angular correlation between the γ-ray background and the matter distribution in the Universe as traced by gravitational lensing, leveraging more than a decade of observations from the Fermi-Large Area Telescope (LAT) and 3 years of data from the Dark Energy Survey (DES). We detect a correlation at signal-to-noise ratio of 8.9. Most of the statistical significance comes from large scales, demonstrating, for the first time, that a substantial portion of the UGRB aligns with the mass clustering of the Universe as traced by weak lensing. Blazars provide a plausible explanation for this signal, especially if those contributing to the correlation reside in halos of large mass (∼ 10 14 M ⊙ ) and account for approximately 30–40% of the UGRB above 10 GeV. Additionally, we observe a preference for a curved γ-ray energy spectrum, with a log-parabolic shape being favored over a power-law. We also discuss the possibility of modifications to the blazar model and the inclusion of additional γ-ray sources, such as star-forming galaxies, misalinged active galactic nuclei, or particle dark matter.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Measurement-based quantum simulation of Abelian lattice gauge theories

Numerical simulation of lattice gauge theories is an indispensable tool in high energy physics, and their quantum simulation is expected to become a major application of quantum computers in the future. In this work, for an Abelian lattice gauge theory in d d spacetime dimensions, we define an entangled resource state (generalized cluster state) that reflects the spacetime structure of the gauge theory. We show that sequential single-qubit measurements with the bases adapted according to the former measurement outcomes induce a deterministic Hamiltonian quantum simulation of the gauge theory on the boundary. Our construction includes the (2+1) ( 2 + 1 ) -dimensional Abelian lattice gauge theory simulated on three-dimensional cluster state as an example, and generalizes to the simulation of Wegner’s lattice models M_{(d,n)} M ( d , n ) that involve higher-form Abelian gauge fields. We demonstrate that the generalized cluster state has a symmetry-protected topological order with respect to generalized global symmetries that are related to the symmetries of the simulated gauge theories on the boundary.Our procedure can be generalized to the simulation of Kitaev’s Majorana chain on a fermionic resource state. We also study the imaginary-time quantum simulation with two-qubit measurements and post-selections, and a classical-quantum correspondence, where the statistical partition function of the model M_{(d,n)} M ( d , n ) is written as the overlap between the product of two-qubit measurement bases and the wave function of the generalized cluster state.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Differentially Private K -Means Clustering Applied to Meter Data Analysis and Synthesis

The proliferation of smart meters has resulted in a large amount of data being generated. It is increasingly apparent that methods are required for allowing a variety of stakeholders to leverage the data in a manner that preserves the privacy of the consumers. The sector is scrambling to define policies, such as the so called ‘15/15 rule’, to respond to the need. However, the current policies fail to adequately guarantee privacy. Here, in this paper, we address the problem of allowing third parties to apply K-means clustering, obtaining customer labels and centroids for a set of load time series by applying the framework of differential privacy. We leverage the method to design an algorithm that generates differentially private synthetic load data consistent with the labeled data. We test our algorithm’s utility by answering summary statistics such as average daily load profiles for a 2-dimensional synthetic dataset and a real-world power load dataset.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Understanding protein-complex assembly through grand canonical maximum entropy modeling

Inside a cell, heterotypic proteins assemble in inhomogeneous, crowded systems where the abundance of these proteins vary with cell types. While some protein complexes form putative structures that can be visualized with imaging, there are far more protein complexes that are yet to be solved because of their dynamic associations with one another. Nevertheless, it is possible to infer these protein complexes through a physical model. However, it is often not clear to physicists what kind of data from biology is necessary for such a modeling endeavor. Here, we aim to model these clusters of coarse-grained protein assemblies from multiple subunits through the constraints of interactions among the subunits and the chemical potential of each subunit. We obtained the constraints on the interactions among subunits from the known protein structures. We inferred the chemical potential that dictates the particle number distribution of each protein subunit from the knowledge of protein abundance from experimental data. Guided by the maximum entropy principle, we formulated an inverse statistical mechanical method to infer the distribution of particle numbers from the data of protein abundance as chemical potentials for a grand canonical multicomponent mixture. Using grand canonical Monte Carlo simulations, we captured a distribution of high-order clusters in a protein complex of succinate dehydrogenase with four known subunits. The complexity of hierarchical clusters varies with the relative protein abundance of each subunit in distinctive cell types such as lung, heart, and brain. When the crowding content increases, we observed that crowding stabilizes emergent clusters that do not exist in dilute conditions. We, therefore, proposed a testable hypothesis that the hierarchical complexity of protein clusters on a molecular scale is a plausible biomarker of predicting the phenotypes of a cell.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Stochastic GW -GPU: Rapid Quasi-Particle Energies for Molecules beyond 10,000 Atoms

StochasticGW is a code for computing accurate quasi-particle (QP) energies of molecules and material systems in the GW approximation. StochasticGW utilizes the stochastic Resolution of the Identity (sROI) technique to enable a massively parallel implementation with computational costs that scale semilinearly with system size, allowing the method to access systems with tens of thousands of electrons. Here, we introduce a new implementation, StochasticGW-GPU, for which the main bottleneck steps have been ported to GPUs and give substantial performance improvements over previous versions of the code. We showcase the new code by computing band gaps of hydrogenated silicon clusters (Si x H y ) containing up to 10,001 atoms and 35,144 electrons, and we obtain individual QP energies with a statistical precision of better than ±0.03 eV with times-to-solution of less than 1 h.

Thomas, Phillip S. [Lawrence Berkeley National Lab↗