Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed clustering methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

586 records · Page 33
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Using graph neural networks to reconstruct charged pion showers in the CMS High Granularity Calorimeter

A novel method to reconstruct the energy of hadronic showersin the CMS High Granularity Calorimeter (HGCAL) is presented. TheHGCAL is a sampling calorimeter with very fine transverse andlongitudinal granularity. The active media are silicon sensors andscintillator tiles readout by SiPMs and the absorbers are acombination of lead and Cu/CuW in the electromagnetic section, andsteel in the hadronic section. The shower reconstruction method isbased on graph neural networks and it makes use of a dynamicreduction network architecture. It is shown that the algorithm isable to capture and mitigate the main effects that normally hinderthe reconstruction of hadronic showers using classicalreconstruction methods, by compensating for fluctuations in themultiplicity, energy, and spatial distributions of the shower'sconstituents. The performance of the algorithm is evaluated usingtest beam data collected in 2018 prototype of the CMS HGCALaccompanied by a section of the CALICE AHCAL prototype. Thecapability of the method to mitigate the impact of energy leakagefrom the calorimeter is also demonstrated.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Fisher for complements: extracting cosmology and neutrino mass from the counts-in-cells PDF

In this work, we comprehensively analyse the cosmology dependence of counts-in-cells statistics. Furthermore, we focus on the shape of the one-point probability distribution function (PDF) of the matter density field at mildly non-linear scales. Based on large-deviation statistics, we parametrize the cosmology dependence of the matter PDF in terms of the linear power spectrum, the growth factor, the spherical collapse dynamics, and the non-linear variance. We extend our formalism to include massive neutrinos, finding that the total matter PDF is highly sensitive to the total neutrino mass Mν and can disentangle it from the clustering amplitude σ 8 . Additionally, using more than a million PDFs extracted from the Quijote simulations, we determine the response of the matter PDF to changing parameters in the νΛCDM model and successfully cross-validate the theoretical model and the simulation measurements. We present the first νΛCDM Fisher forecast for the matter PDF at multiple scales and redshifts, and its combination with the matter power spectrum. We establish that the matter PDF and the matter power spectrum are highly complementary at mildly non-linear scales. The matter PDF is particularly powerful for constraining the matter density Ωm, clustering amplitude σ 8 and the total neutrino mass Mν. Adding the mildly non-linear matter PDF to the mildly non-linear matter power spectrum improves constraints on Ω m by a factor of 5 and σ 8 by a factor of 2 when considering the three lowest redshifts. In our joint analysis of the matter PDF and matter power spectrum at three redshifts, the total neutrino mass is constrained to better than 0.01 eV with a total volume of 6 (Gpc h -1 ) 3 . We discuss how density-split statistics can be used to translate those encouraging results for the matter PDF into realistic observables in galaxy surveys.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Boosting H I -Galaxy Cross-Clustering Signal through Higher-Order Cross-Correlations

After reionization, neutral hydrogen (${\rm H\, \small {I}}$) traces the large-scale structure (LSS) of the Universe, enabling ${\rm H\, \small {I}}$ intensity mapping (IM) to capture the LSS in 3D and constrain key cosmological parameters. We present a new framework utilizing higher-order cross-correlations to study ${\rm H\, \small {I}}$ clustering around galaxies, tested using real-space data from the IllustrisTNG300 simulation. This approach computes the joint distributions of k-nearest neighbor (kNN) optical galaxies and the ${\rm H\, \small {I}}$ brightness temperature field smoothed at relevant scales (the kNN-field framework), providing sensitivity to all higher-order cross-correlations, unlike two-point statistics. To simulate ${\rm H\, \small {I}}$ data from actual surveys, we add random thermal noise and apply a simple foreground cleaning model, filtering out Fourier modes of the brightness temperature field with k ∥ < k min,∥ . Under current levels of thermal noise and foreground cleaning, typical of a Canadian Hydrogen Intensity Mapping Experiment (CHIME)-like survey, the ${\rm H\, \small {I}}$-galaxy cross-correlation signal in our simulations, using the kNN-field framework, is detectable at >30σ across r = [3, 12] h –1 Mpc. In contrast, the detectability of the standard two-point correlation function (2PCF) over the same scales depends strongly on the foreground filter: a sharp k ∥ filter can spuriously boost detection to 8σ due to position-space ringing, whereas a less sharp filter yields no detection. Nonetheless, we conclude that kNN-field cross-correlations are robustly detectable across a broad range of foreground filtering and thermal noise conditions, suggesting their potential for enhanced constraining power over 2PCFs.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Optimal Electrification Using Renewable Energies: Microgrid Installation Model with Combined Mixture k-Means Clustering Algorithm, Mixed Integer Linear Programming, and Onsset Method

Optimal planning and design of microgrids are priorities in the electrification of off-grid areas. Indeed, in one of the Sustainable Development Goals (SDG 7), the UN recommends universal access to electricity for all at the lowest cost. Several optimization methods with different strategies have been proposed in the literature as ways to achieve this goal. This paper proposes a microgrid installation and planning model based on a combination of several techniques. The programming language Python 3.10 was used in conjunction with machine learning techniques such as unsupervised learning based on K-means clustering and deterministic optimization methods based on mixed linear programming. These methods were complemented by the open-source spatial method for optimal electrification planning: onsset. Four levels of study were carried out. The first level consisted of simulating the model obtained with a cluster, which is considered based on the elbow and k-means clustering method as a case study. The second level involved sizing the microgrid with a capacity of 40 kW and optimizing all the resources available on site. The example of the different resources in the Togo case was considered. At the third level, the work consisted of proposing an optimal connection model for the microgrid based on voltage stability constraints and considering, above all, the capacity limit of the source substation. Finally, the fourth level involved a planning study of electrification strategies based mainly on microgrids according to the study scenario. The results of the first level of study enabled us to obtain an optimal location for the centroid of the cluster under consideration, according to the different load positions of this cluster. Then, the results of the second level of study were used to highlight the optimal resources obtained and proposed by the optimization model formulated based on the various technology costs, such as investment, maintenance, and operating costs, which were based on the technical limits of the various technologies. In these results, solar systems account for 80% of the maximum load considered, compared to 7.5% for wind systems and 12.5% for battery systems. Next, an optimal microgrid connection model was proposed based on the constraints of a voltage stability limit estimated to be 10% of the maximum voltage drop. The results obtained for the third level of study enabled us to present selective results for load nodes in relation to the source station node. Finally, the last results made it possible to plan electrification using different network technologies and systems in the short and long term. The case study of Togo was taken into account. The various results obtained from the different techniques provide the necessary leads for a feasibility study for optimal electrification of off-grid areas using microgrid systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Scalable Generation of High-fidelity Synthetic Population Ensembles

Used within social simulations, synthetic population ensembles enable uncertainty quantification (UQ) methods for obtaining more robust model inference and prediction. A synthetic population ensemble is a series of plausible virtual reconstructions of an area’s population at the granularity of people and residences, generated stochastically to preserve privacy of the source population survey’s respondents. In this paper, we demonstrate the production of large synthetic population ensembles for the U.S. via Oak Ridge National Laboratory’s UrbanPop framework to support modeling of high spatial resolution energy affordability metrics from nationwide social surveys in collaboration with the fusionACS project. The study involves two scenarios: creating ensembles for (1) 17 U.S. metropolitan areas in 2019 and (2) full U.S. Census Divisions in 2023, with each scenario consisting of 41 population instances (a base realization and 40 replicates). To accomplish this task at scale, we configured an integrated system within a research cloud, comprised of virtual containerizations, GPU-enhanced functionality, and orchestrated deployments of UrbanPop’s maturing Likeness Python ecosystem. Results demonstrate we maintained high-fidelity approximations of residential totals by areas of interest and the demographic characteristics of neighborhoods while reducing manual workflow burdens. Finally, we discuss plans to fine-tune and further develop our automated workflows for truly distributed job orchestration to increase computational efficiency, as well as provide an outlook for broadening applications of the ensembles.

Cluster computing↗
NASA NTRS2019

Predicting Cancer Risk from Ionizing Radiation

The ability to predict cancer risk associated with exposure to low doses of high-LET ionizing radiation (IR) remains a challenge. Epidemiological methods lack the sensitivity and power to provide detailed risk estimates for cancer and ignore individual variance in IR sensitivity. We have hypothesized that DNA repair capacity can be used as a marker to evaluate and differentiate individual radiation sensitivity. More specifically, this work is based on the concept that the combined time-dose dependence of radiation-induced foci (RIF) of p53-binding protein 1 (53BP1) following low-LET exposure contains sufficient information to infer sensitivity to any other LET. Our hypothesis was tested in 15 different mouse strains as well as in primary human immune cells. We first approached individual ionizing radiation sensitivity in a mouse model by culturing primary skin fibroblasts extracted from 76 mice of 15 different genetic backgrounds and exposing them to HZE particles and X-rays. This work is one of the most extensive studies on the kinetics and possible genetic underpinnings of radiation-induced DNA damage and repair. Our results is in agreement with a DNA repair model we previously postulated, where nearby DNA double strand breaks (DSB) in the nucleus are brought together for more efficient repair, leading to RIF clustering. Such mechanism was evidenced by a specific dose and LET dependence of RIF numbers. Briefly, RIF quantification after low-LET X-ray exposure showed an asymptotic saturation for doses between 1 Gy and 4 Gy 4 hours post-irradiation across all 15 strains. The clustering of DSB across all strains also led to more RIF/Gy for lower LET (X-ray and 350 MeV/n Ar) than for higher LET (600 MeV/n Fe) 4 hours post-exposure. Considering the fact that the number of DSB/Gy should be independent of LET, our data suggest there are more DSB in individual RIF as the LET increases. RIF numbers for 24 and 48 hours post-exposure led to the inverse trend, with more remaining RIF/Gy for higher LET (by 600 MeV/n Fe). This result suggests cells have more difficulty resolving RIF from higher LET as they the number DSB/RIF increases. Note that for most conditions, the variance of RIF/Gy was small within individual animals of the same strain and large between strains, suggesting a strong genetics component. Furthermore, we present our preliminary data from an ongoing study on human genetic associations with IR sensitivity. To address the human variability in responses to HZE particle irradiation in a maximally comprehensive manner, we are in the process of collecting and isolating primary blood mononuclear cells from 768 healthy subjects of European descent, 18-75 years of age, 50/50 male/female distribution. We have analyzed 53BP1+ RIF formation as well as oxidative stress and cell death in primary cells from 192 subjects in response to the same HZE particles as used in mice: 600 MeV/n Fe, 350 MeV/n Ar and 350 MeV/n Si, 1.1 and 3 particles/100m2, 4 and 24 hours after irradiation. We will next complete the quantification of HZE particle-induced DNA and cellular damage in the remaining subjects and compare it to their responses to low-LET irradiation. Finally, we will perform GWAS analysis to identify human genomic associations with IR sensitivity and potential targets for biomarker development.

High-LET radiation↗
DOE OSTI2025

Accelerating Embedding Potential Optimization by Reconstructing the Pseudo-Valence Electron Density

Density functional embedding theory (DFET) enables use of electronic structure methods with higher accuracy than density functional theory in a local region, with applications thus far ranging from (photo/electro)catalysis to reactions in solution. DFET partitions a large collection of atoms into smaller groups that interact via a shared embedding (interaction) potential V emb , determined via functional optimization. The optimized effective potential (OEP) process used to optimize V emb is time-consuming and becomes a computational bottleneck due to sharp, oscillating features of V emb near nuclei. Here, similar to pseudopotential theory, by reconstructing electron densities used in the OEP process from smoother pseudo-valence-only (PVO) electron densities as proxies for total densities of the full system and subsystems, we can retain accuracy in the embedded electronic structure calculations while potentially reducing the overhead of V emb construction, within the projector augmented-wave (PAW) formalism. We explore three different chemical reactions as exemplars to test PVO–DFET, namely, H 2 dissociative adsorption on a Cu(111) surface, H 2 O adsorption on a Pt(111) surface, and aqueous [Ca 2+ –SO 4 2– ] ion-pair formation. The PVO approximation works well for all three systems with minimal loss of accuracy (∼10–70 meV error relative to the original exact-derivative (ED) approach) while accelerating V emb generation for the Cu and Pt systems respectively by 20× and 5×. Given proper numerical convergence parameters, the spatial distributions of differences between PVO- and ED-based V emb outside the core regions are small, explaining the exceptional agreement between the two approaches. Finally, we anticipate that this more efficient PVO–DFET approximation will be useful whenever computation of V emb is much more expensive than subsequent embedded high-level electron correlation calculations.

approximation↗
DOE OSTI2024

The DESI one-per cent survey: exploring the halo occupation distribution of luminous red galaxies and quasi-stellar objects with AbacusSummit

ABSTRACT We present the first comprehensive halo occupation distribution (HOD) analysis of the Dark Energy Spectroscopic Instrument (DESI) One-Percent Survey luminous red galaxy (LRG) and Quasi Stellar Object (QSO) samples. We constrain the HOD of each sample and test possible HOD extensions by fitting the redshift-space galaxy 2-point correlation functions in 0.15 < r < 32 h−1 Mpc in a set of fiducial redshift bins. We use AbacusSummit cubic boxes at Planck 2018 cosmology as model templates and forward model galaxy clustering with the AbacusHOD package. We achieve good fits with a standard HOD model with velocity bias, and we find no evidence for galaxy assembly bias or satellite profile modulation at the current level of statistical uncertainty. For LRGs in 0.4 < z < 0.6, we infer a satellite fraction of $f_\mathrm{sat} = 11\pm 1~{y{\ \mathrm{per\,cent}}}$, a mean halo mass of $\log _{10}\overline{M}_h/M_\odot =13.40^{+0.02}_{-0.02}$, and a linear bias of $b_\mathrm{lin} = 1.93_{-0.04}^{+0.06}$. For LRGs in 0.6 < z < 0.8, we find $f_\mathrm{sat}=14\pm 1~{{\ \mathrm{per\,cent}}}$, $\log _{10}\overline{M}_h/M_\odot =13.24^{+0.02}_{-0.02}$, and $b_\mathrm{lin}=2.08_{-0.03}^{+0.03}$. For QSOs, we infer $f_\mathrm{sat}=3^{+8}_{-2}\mathrm{per\,cent}$, $\log _{10}\overline{M}_h/M_\odot = 12.65^{+0.09}_{-0.04}$, and $b_\mathrm{lin} = 2.63_{-0.26}^{+0.37}$ in redshift range 0.8 < z < 2.1. Using these fits, we generate a large suite of high fidelity galaxy mocks, forming the basis of systematic tests for DESI Y1 cosmological analyses. We also study the redshift-evolution of the DESI LRG sample from z = 0.4 up to z = 1.1, revealling significant and interesting trends in mean halo mass, linear bias, and satellite fraction.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Galaxy-multiplet clustering from DESI DR2

We present an efficient estimator for higher-order galaxy clustering using small groups of nearby galaxies, or multiplets. Using the Luminous Red Galaxy (LRG) sample from the Dark Energy Spectroscopic Instrument (DESI) Data Release 2, we identify galaxy multiplets as discrete objects and measure their cross-correlations with the general galaxy field. Our results show that the multiplets exhibit stronger clustering bias as they trace more massive dark matter halos than individual galaxies. When comparing the observed clustering statistics with the mock catalogs generated from the N-body simulation AbacusSummit, we find that the mocks underpredict multiplet clustering despite reproducing the galaxy two-point auto-correlation reasonably well. This discrepancy indicates that the standard Halo Occupation Distribution (HOD) model is insufficient to describe the properties of galaxy multiplets, revealing the greater constraining power of this higher-order statistic on galaxy-halo connection and the possibility that multiplets are specific to additional assembly bias. We demonstrate that incorporating secondary biases into the HOD model improves agreement with the observed multiplet statistics, specifically by allowing galaxies to preferentially occupy halos in denser environments. Our results highlight the potential of utilizing multiplet clustering, beyond traditional two-point correlation measurements, to break degeneracies in models describing the galaxy-dark matter connection.

cosmology↗
DOE OSTI2025

Unraveling emission line galaxy conformity at z ∼ 1 with DESI early data

Emission line galaxies (ELGs) are now the preeminent tracers of large-scale structure at z > 0.8 due to their high density and strong emission lines, which enable accurate redshift measurements. However, relatively little is known about ELG evolution and the ELG–halo connection, exposing us to potential modelling systematics in cosmology inference using these sources. In this paper, we use a variety of observations and simulated galaxy models to propose a physical picture of ELGs and improve ELG–halo connection modelling in a halo occupation distribution framework. We investigate Dark Energy Spectroscopic Instrument (DESI)-selected ELGs in COSMOS data, and infer that ELGs are rapidly star-forming galaxies with a large fraction exhibiting disturbed morphology, implying that many of them are likely to be merger-driven starbursts. We further postulate that the tidal interactions from mergers lead to correlated star formation in central–satellite ELG pairs, a phenomenon dubbed ‘conformity’. We argue for the need to include conformity in the ELG–halo connection using galaxy models such as IllustrisTNG, and by combining observations such as the DESI ELG autocorrelation, ELG cross-correlation with luminous red galaxies, and ELG–cluster cross-correlation. We also explore the origin of conformity using the UniverseMachine model and elucidate the difference between conformity and the well-known galaxy assembly bias effect.

79 ASTRONOMY AND ASTROPHYSICS↗