SEARCH · Engineering Papers

Results for “distributed clustering methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

All sources NASA NTRS DOE OSTI

DOE OSTI2021

The persistence of large scale structures. Part I. Primordial non-Gaussianity

Abstract We develop an analysis pipeline for characterizing the topology of large scale structure and extracting cosmological constraints based on persistent homology . Persistent homology is a technique from topological data analysis that quantifies the multiscale topology of a data set, in our context unifying the contributions of clusters, filament loops, and cosmic voids to cosmological constraints. We describe how this method captures the imprint of primordial local non-Gaussianity on the late-time distribution of dark matter halos, using a set of N-body simulations as a proxy for real data analysis. For our best single statistic, running the pipeline on several cubic volumes of size 40 (Gpc/h) 3 , we detect f NL loc =10 at 97.5% confidence on ~ 85% of the volumes. Additionally wetest our ability to resolve degeneracies betweenthe topological signature of f NL loc and variation of σ 8 and argue that correctly identifying nonzero f NL loc in this case is possible via an optimal template method. Our method relies on information living at $\mathcal{O}$(10) Mpc/h, a complementary scale with respect to commonly used methods such as the scale-dependent bias in the halo/galaxy power spectrum. Therefore, while still requiring a large volume, our method does not require sampling long-wavelength modes to constrain primordial non-Gaussianity. Moreover, our statistics are interpretable: we are able to reproduce previous results in certain limits and we make new predictions for unexplored observables, such as filament loops formed by dark matter halos in a simulation box.

Astronomy & Astrophysics↗

DOE OSTI2022

Data augmentation for disruption prediction via robust surrogate models

The goal of this work is to generate large statistically representative datasets to train machine learning models for disruption prediction provided by data from few existing discharges. Such a comprehensive training database is important to achieve satisfying and reliable prediction results in artificial neural network classifiers. Here, we aim for a robust augmentation of the training database for multivariate time series data using Student-t process regression. We apply Student-t process regression in a state space formulation via Bayesian filtering to tackle challenges imposed by outliers and noise in the training data set and to reduce the computational complexity. Thus, the method can also be used if the time resolution is high. We use an uncorrelated model for each dimension and impose correlations afterwards via coloring transformations. We demonstrate the efficacy of our approach on plasma diagnostics data of three different disruption classes from the DIII-D tokamak. To evaluate if the distribution of the generated data is similar to the training data, we additionally perform statistical analyses using methods from time series analysis, descriptive statistics, and classic machine learning clustering algorithms.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Unsupervised Power System Event Detection and Classification Using Unlabeled PMU Data

This paper proposes a novel data-driven power system event detection and classification method based on 5TB of actual PMU measurements collected from the US western interconnect. Firstly, a set of comprehensive power quality rules are proposed to pre-filter the raw data and extract the regions of interest (ROI). Six distinct event categories are defined and corresponding patterns are chosen as references. Meanwhile, detailed characteristics of patterns are summarized to enhance our understanding of the actual events. Then, the time-independent feature vectors are generated by extracting the statistical, temporal, and spectral features from the raw time-series data. Furthermore, an ensemble model is proposed to cluster the events by combining multiple K-means clustering models using a voting strategy. Besides, both system-level and PMU-level clustering models are developed. The accuracy and robustness of the event detection method are further improved through interactive evaluation of the two-level clustering results. This paper summarizes the actual characteristics of each event category and provides a reliable basis for accurate label generation. The experiments demonstrate the effectiveness of the proposed event detection and classification method.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2021

Unsupervised Power System Event Detection and Classification Using Unlabeled PMU Data

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2026

Classifying biophysical subpopulations of insulin secretory granules using quantitative whole-cell structure analysis

Pancreatic beta cells contain insulin secretory granules (ISGs), organelles where proinsulin is converted into insulin. As ISGs mature, they undergo extensive biophysical remodeling, producing a spectrum of subpopulations with heterogeneous molecular and spatial characteristics. However, systematic methods to define ISG subpopulations remain underdeveloped. To address this gap in knowledge, we employed soft X-ray tomography (SXT), which can quantitatively measure the biochemical density of ISGs within whole beta cells. Using unsupervised clustering, we classified subpopulations based on molecular density, size, and spatial positioning. Across different insulin secretory stimuli, we observed shifts toward mature and releasable subtypes, demonstrating that exogenous signals can dynamically remodel ISG subpopulation distributions. We extended this methodology to primary beta cells characterized using volume electron microscopy (vEM). Integrating subpopulations from SXT and vEM uncovered insights inaccessible by a single method in isolation. This strategy establishes a framework for defining therapeutic approaches aimed at enriching physiologically beneficial ISG subpopulations.

dense-core granules↗

DOE OSTI2026

Investigation of the isoscalar monopole response in the proton-rich nucleus 14 O

Deuteron inelastic scattering on 14 O was measured in inverse kinematics using an active-target time projection chamber and a magnetic spectrograph. The experimental technique enabled precise measurements of deuteron recoiling particles in coincidence with beam-like fragments detected in the spectrograph focal plane. The double differential cross section was reconstructed for scattering angles of 3–6 degrees and excitation energies up to 26 MeV. The monopole strength distribution was obtained from the data using a multipole decomposition analysis. The results were compared to quasiparticle random-phase approximation (QRPA) and generator coordinate method (GCM) calculations. The QRPA calculation accurately describes experimental data in the energy range of 13 to 26 MeV. GCM calculations assuming a 12 C (g . s .) + p + p cluster configuration were used to determine the 0 + strength in 14 O below 13 MeV. The monopole transition strength of these cluster states provides a good description of the experimental distribution in the 9–11 MeV region, while the 0$^{+}_{2}$ state accounts for only a small fraction of the experimental strength around 6 MeV.

Active target↗

DOE OSTI2021

Structural Changes during the Growth of Atomically Precise Metal Oxido Nanoclusters from Combined Pair Distribution Function and Small-Angle X-ray Scattering Analysis

The combination of in situ pair distribution function (PDF) analysis and small-angle X-ray scattering (SAXS) enables analysis of the formation mechanism of metal oxido nanoclusters and cluster–solvent interactions as they take place. Herein, we demonstrate the method for the formation of clusters with a [Bi 38 O 45 ] core. Upon dissolution of crystalline [Bi 6 O 5 (OH) 3 (NO 3 ) 5 ]∙3 H 2 O in DMSO, an intermediate rapidly forms, which slowly grows to stable [Bi 38 O 45 ] clusters. To identify the intermediate, we developed an automated modeling method, where smaller [Bi x O y ] structures based on the [Bi 38 O 45 ] framework are tested against the data. [Bi 22 O 26 ] was identified as the main intermediate species, illustrating how combined PDF and SAXS analysis is a powerful tool to gain insight into nucleation on an atomic scale. PDF also provides information on the interaction between nanoclusters and solvent, which is shown to depend on the nature of the ligands on the cluster surface.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2022

Constraining IGM enrichment and metallicity with the C iv forest correlation function

ABSTRACT The distribution and abundance of metals in the diffuse intergalactic medium (IGM) have implications for galaxy formation and evolution models, and has been argued to be sensitive to the Universe’s reionization history. However, reduced sensitivity in the near-IR implies that probing IGM metals at z > 4 is currently out of reach with the traditional method of detecting individual absorbers. We present a new technique based on clustering analysis that enables the detection of these weak IGM absorbers. We investigate the two-point correlation function (2PCF) of the ${\rm C\, {\small IV}}$ forest as a probe of IGM metallicity and enrichment topology by simulating the z = 4.5 IGM with models of inhomogeneous metal distributions. The 2PCF of the ${\rm C\, {\small IV}}$ forest demonstrates a clear peak at a characteristic separation corresponding to the doublet separation of the ${\rm C\, {\small IV}}$ line.The peak amplitude scales quadratically with metallicity, while enrichment topology affects both the shape and amplitude of the 2PCF. For models consistent with the distribution of metals at z ∼ 3, we find that we can constrain [C/H] to within 0.2 dex, log$\, M_{\rm {min}}$ to within 0.4 dex, and R to within 15 per cent. We show that CGM absorbers can be reliably identified and masked, thus recovering the underlying IGM signal. The auto-correlation of the metal-line forest presents a compelling avenue to constrain the IGM metallicity and enrichment topology with high precision at z > 4, thereby pushing such measurements into the Epoch of Reionization.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2025

Mapping causal patterns in crystalline solids

The evolution of the atomic structures of the combinatorial library of Sm-substituted thin film BiFeO 3 along the phase transition boundary from the ferroelectric rhombohedral phase to the non-ferroelectric orthorhombic phase is explored using scanning transmission electron microscopy. Localized properties, including polarization, lattice parameter, and chemical composition, are parameterized from atomic-scale imaging, and their causal relationships are reconstructed using a linear non-Gaussian acyclic model. This approach is further extended to explore the spatial variability of the causal coupling using the sliding window transform method, which revealed that new causal relationships emerged at both the expected locations, such as domain walls and interfaces, and at additional regions forming clusters in the vicinity of the walls or spatially distributed features. While the exact physical origins of these relationships are unclear, they likely represent nanophase-separated regions in the morphotropic phase boundaries. Overall, we posit that an in-depth understanding of complex disordered materials away from thermodynamic equilibrium necessitates understanding not only the generative processes that can lead to observed microscopic states but also the causal links between multiple interacting subsystems.

Causal inference↗

DOE OSTI2021

Dark Energy Survey Year 3 results: redshift calibration of the weak lensing source galaxies

ABSTRACT Determining the distribution of redshifts of galaxies observed by wide-field photometric experiments like the Dark Energy Survey (DES) is an essential component to mapping the matter density field with gravitational lensing. In this work we describe the methods used to assign individual weak lensing source galaxies from the DES Year 3 Weak Lensing Source Catalogue to four tomographic bins and to estimate the redshift distributions in these bins. As the first application of these methods to data, we validate that the assumptions made apply to the DES Y3 weak lensing source galaxies and develop a full treatment of systematic uncertainties. Our method consists of combining information from three independent likelihood functions: self-organizing map p(z) (sompz), a method for constraining redshifts from galaxy photometry; clustering redshifts (WZ), constraints on redshifts from cross-correlations of galaxy density functions; and shear ratios (SRs), which provide constraints on redshifts from the ratios of the galaxy-shear correlation functions at small scales. Finally, we describe how these independent probes are combined to yield an ensemble of redshift distributions encapsulating our full uncertainty. We calibrate redshifts with combined effective uncertainties of σ〈z〉 ∼ 0.01 on the mean redshift in each tomographic bin.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2023

Detecting low-mass perturbers in cluster lenses using curved arc bases

ABSTRACT Strong gravitationally lensed arcs produced by galaxy clusters have been observationally detected for several decades now. These strong lensing constraints provided high-fidelity mass models for cluster lenses that include substructure down to $10^{9{-}10}\, \mathrm{M}_\odot$. Optimizing lens models, where the cluster mass distribution is modelled by a smooth component and subhaloes associated with the locations of individual cluster galaxies, has enabled deriving the subhalo mass function, providing important constraints on the nature and granularity of dark matter. In this work, we explore and present a novel method to detect and measure individual perturbers (subhaloes, line-of-sight haloes, and wandering supermassive black holes) by exploiting their proximity to highly distorted lensed arcs in galaxy clusters, and by modelling the local lensing distortions with curved arc bases. This method offers the possibility of detecting individual low-mass perturber subhaloes in clusters and haloes along the line of sight down to a mass resolution of $10^8\, \mathrm{M}_\odot$. We quantify our sensitivity to low-mass perturbers ($M\sim 10^{7{-}9}\, \mathrm{M}_\odot$) in clusters (M ∼ 1014–15 M⊙), by creating realistic mock data. Using three lensed images of a background galaxy in the cluster SMACS J0723, taken by JWST, we study the retrieval of the properties of potential perturbers with masses $M=10^{7{-}9}\, \mathrm{M}_\odot$. From the derived posterior probability distributions for the perturber, we constrain its concentration, redshift, and ellipticity. By allowing us to probe lower mass substructures, the use of curved arc bases can lead to powerful constraints on the nature of dark matter as discrimination between dark matter models appears on smaller scales.

Astronomy & Astrophysics↗

DOE OSTI2022

A Novel Data Segmentation Method for Data-driven Phase Identification

This paper presents a smart meter phase identification algorithm for two cases: meter-phase-label-known and meter-phase-label-unknown. To improve the identification accuracy, a data segmentation method is proposed to exclude data segments that are collected when the voltage correlation between smart meters on the same phase is weakened. Then, using the selected data segments, a hierarchical clustering method is used to calculate the correlation distances and cluster the smart meters. If the phase labels are unknown, a Connected-Triple-based Similarity (CTS) method is adapted to further improve the phase identification accuracy of the ensemble clustering method. The methods are developed and tested on both synthetic and real feeder data sets. Here, simulation results show that the proposed phase identification algorithm outperforms the state-of-the-art methods in both accuracy and robustness.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2024

Characterization of Fuel Cladding Chemical Interaction on a High Burnup U-10Zr Metallic Fuel via Electron Energy Loss Spectroscopy Enhanced by Machine Learning

Fuel cladding chemical interaction (FCCI) is one of the main performance limiting factors for metallic nuclear fuels. The interaction destabilizes the martensitic microstructure and deteriorates mechanical properties of HT-9 cladding. The detection of low atomic number elements (Z<10) and overlapping of elemental peaks can be problematic in interpreting energy dispersive X-ray spectroscopy (EDS) data. Electron energy loss spectroscopy (EELS) provides precise elemental edge energy values and can detect elements with a low atomic number. This work utilizes EELS to study the distribution of lanthanides and light elements at the interaction region. The sample was prepared from the FCCI region of a U-10Zr (wt.%) solid fuel with HT-9 cladding, irradiated to a burnup of 13.2 at.%. Processing the EELS data included three major steps: 1) enhance the signal to noise ratio by denoising the spectrum with principal component analysis (PCA) method, removing background and performing deconvolution; 2) identify chemical elements with core energy loss edges; 3) confirm different phases using a popular machine learning method, K-means. This work presents qualitative assessment of lanthanides and light elements like carbon (C) and oxygen (O) enhanced by the application of machine learning algorithms. By comparing with EDS elemental maps, EELS provides higher resolution chemical maps, reveals the distribution of carbon at the interaction region supporting the formation of zirconium carbide, a rind-like microstructure feature that was proposed to mitigate the chemical interaction. Furthermore, the plasmon peak map was also found to indicate an energy shift associated with the formation of phases/compounds. K-means clustering method was used on the processed electron energy loss (EEL) spectrum to automatically reveal different phases. The resulting clustered maps from K-means clustering align well with elemental maps confirming certain phases, especially Fe-Ce and Zr-C, in the FCCI region.

EELS↗

DOE OSTI2024

Measurement and calibration of non-linear shear terms in galaxy cluster fields

Introduction Galaxy cluster lensing is a powerful tool for measuring the mass of galaxy clusters, but accurate shear measurement and calibration are critical to obtaining reliable results. This study focuses on the measurement and calibration of weak lensing shears to improve mass estimates in cluster lensing. To deal with the problem, we first developed an image simulation pipeline, jedisim, which utilizes galaxy images extracted from the Hubble Space Telescope (HST) Ultra Deep Field (UDF) and the Cosmic Assembly Near-infrared Deep Extragalactic Legacy Survey (CANDELS). Methods The simulations represent realistic galaxy distributions and morphologies as input sources. The foreground halo with a Navarro–Frenk–White (NFW) profile is constructed such that the lensing signals of background galaxies can be measured by the Vera C. Rubin Observatory’s Legacy Survey of Space and Time (LSST) Science Pipelines. By comparing the measured reduced shear g meas and the true reduced shear g true , we observe non-linearity up to g ≲ 0.6 . We fit polynomials to the data with quadratic correction adequate to g ≲ 0.4 . Meanwhile, we conduct mass estimates using the pzmassfitter code on four different clusters. Results The mass estimate results are significantly improved after applying the shear calibration derived from the present work—from 4.954 ± 0.504 × 1 0 14 M ⊙ to 10.507 ± 0.498 × 1 0 14 M ⊙ after calibration for a simulated cluster with the mass of 10 × 1 0 14 M ⊙ . In multiple cases of validation, the estimated results are all consistent with true cluster mass. Discussion This study yields the first relationship between reality and shape measurement of the LSST Science Pipelines and serves as the first step toward the overall goal of mass calibration in cluster lensing. By addressing the challenges in shear measurement and calibration, we aim to enhance the accuracy and reliability of mass estimates in galaxy cluster lensing studies.

Astronomy & Astrophysics↗

DOE OSTI2021

The $^3$He+$^5$He$\rightarrow $ $\alpha $+$\alpha $ reaction below the Coulomb barrier via the Trojan Horse Method

For the first time in an application to nuclear astrophysics, a process induced by the unstable 5 He = ( 4 He-n) nucleus, the 3 He+ 5 He→2α reaction, has been studied through the Trojan Horse Method (THM). For that purpose, the quasi-free (QF) contribution of the 9 Be( 3 He,αα) 4 He reaction was selected at E 3 He =4 MeV incident energy. The reaction was studied in a kinematically complete experiment following a recent publication, where for the quasi free contribution the momentum distribution between α and 5 He particle cluster in the 9 Be nucleus in the ground state have been extracted. The angular distribution of the QF 3 He+ 5 He→2α reaction was measured at θ cm = 78°–115°. The energy dependence of the differential cross section of the 3 He+ 5 He→2α virtual reaction was extracted in the energy range E cm = 0–650 keV. In conclusion, the total cross section obtained from the Trojan-horse method was normalized to absolute cross sections from a theoretical calculation in the energy range E cm =300–620 keV.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2025

Enhancing Cluster Identification in Atom Probe Tomography Data Using Transfer Learning

Atom Probe Tomography (APT) is a powerful technique for visualizing the atomic-scale distribution of solutes in materials, but quantitative cluster analysis of APT datasets remains a challenge due to the need for subjective parameter selection in clustering algorithms. While distance-based and density-based methods such as HDBSCAN are widely used, their performance is highly sensitive to user-defined parameters, which undermines reproducibility and accuracy. This study proposes an image-based, deep learning-aided workflow for automating parameter selection and cluster detection in APT data analysis. By projecting 3D APT point clouds onto 2D planes, we leverage pretrained convolutional neural networks (ConvNeXt-Tiny and ResNet-50) through transfer learning to predict the number of clusters present in synthetic datasets. The output is used to guide K-means clustering and estimate HDBSCAN parameters, specifically minimum cluster size and minimum sample points. This approach reduces reliance on manual parameter tuning, improving consistency and scalability. The methodology demonstrates the feasibility of using image-based deep learning for interpreting complex spatial patterns in APT data, enabling faster and more objective analysis. The complete workflow and code are made publicly available to support reproducibility and future research.

Density-based clustering↗

DOE OSTI2024

Correlated Anion Disorder in Heteroanionic Cubic TiOF 2

Resolving anion configurations in heteroanionic materials is crucial for understanding and controlling their properties. For anion-disordered oxyfluorides, conventional Bragg diffraction cannot fully resolve the anionic structure, necessitating alternative structure determination methods. We have investigated the anionic structure of anion-disordered cubic (ReO 3 -type) TiOF 2 using X-ray pair distribution function (PDF), 19 F MAS NMR analysis, density functional theory (DFT), cluster expansion modeling, and genetic-algorithm structure prediction. Our computational data predict short-range anion ordering in TiOF 2 , characterized by predominant cis-[O 2 F 4 ] titanium coordination, resulting in correlated anion disorder at longer ranges. To validate our predictions, we generated partially disordered supercells using genetic-algorithm structure prediction and computed simulated X-ray PDF data and 19 F MAS NMR spectra, which we compared directly to experimental data. To construct our simulated 19 F NMR spectra, we derived new transformation functions for mapping calculated magnetic shieldings to predicted magnetic chemical shifts in titanium (oxy)fluorides, obtained by fitting DFT-calculated magnetic shieldings to previously published experimental chemical shift data for TiF 4 . We find good agreement between our simulated and experimental data, which supports our computationally predicted structural model and demonstrates the effectiveness of complementary experimental and computational techniques in resolving anionic structure in anion-disordered oxyfluorides. From additional DFT calculations, we predict that increasing anion disorder makes lithium intercalation more favorable by, on average, up to 2 eV, highlighting the significant effect of variations in short-range order on the intercalation properties of anion-disordered materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2026

Sequential surface synthesis of dispersed sub-nanometer iridium on titanium nitride for acidic water oxidation

Maximizing iridium utilization while maintaining high oxygen evolution reaction (OER) performance remains a persistent challenge in acidic water electrolysis. Immobilizing Ir on conductive, acid-stable supports is promising, yet simultaneously achieving sub-nanometer size, high area coverage, and strong electronic coupling is difficult. Here, we report a sequential surface synthesis on titanium nitride (TiN) that yields uniformly distributed sub-nanometer Ir arrays (∼0.7 nm). Our method uses ethylenediaminetetraacetic acid (EDTA) as a temporal scaffold: it chemisorbs to TiN to install dense chelating sites, captures Ir 3+ ions, and confines Ir cluster growth. A subsequent thermal treatment at 500 °C in a reducing atmosphere removes the ligand shell, while preserving ultrasmall particle size and establishing direct Ir–TiN electronic coupling. The optimized catalyst exhibits mixed Ir 0 /Ir x+ coordination with low charge-transfer resistance (R ct = 19.2 Ω), delivering a mass activity of 342 A g Ir −1 at 1.54 V in acidic electrolyte. In situ X-ray absorption spectroscopy reveals irreversible surface oxidation as the primary stability-limiting factor. This stepwise strategy provides a general framework for supported catalysts that maximize precious metal utilization via sub-nanometer dispersion.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗