SEARCH · Engineering Papers

Results for “distributed clustering methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

All sources NASA NTRS DOE OSTI

DOE OSTI2022

Physics-Informed Sparse Gaussian Process for Probabilistic Stability Analysis of Large-Scale Power System with Dynamic PVs and Loads

This work proposes a physics-informed sparse Gaussian process (SGP) for probabilistic stability assessment of large-scale power systems in the presence of uncertain dynamic PVs and loads. The differential and algebraic equations considering uncertainties from dynamic PVs and loads are reformulated to a nonlinear mapping relationship that allows the application of SGP. Thanks to the nonparametric characteristic of Gaussian process, the proposed framework does not require distributions of uncertain inputs and this distinguishes it from existing approaches. As the original Gaussian process is not scalable to large-scale systems with high dimensional uncertain inputs, this paper develops the SGP with a stochastic variational inference technique. It leads to approximately two orders of complex reduction. A data pre-processing step is also introduced to tackle the coexistence of stable and unstable cases by sample clustering and constructing separate SGPs. The probabilistic transient stability index is analyzed to assess system stability under different uncertain dynamics loads and PVs. Comparisons are performed with the sampling-based, the polynomial chaos expansion-based, and traditional Gaussian process-based methods on the modified IEEE 118-bus and Texas 2000-bus systems under various scenarios, including different levels of uncertainties and the existence of nonlinear correlations among dynamic PVs. The impacts of data quality and quantity issues are also investigated. It is shown that the proposed SGP achieves significantly improved computational efficiency while maintaining high accuracy with a limited number of data.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2024

An Empirical Model For Intrinsic Alignments: Insights From Cosmological Simulations

We extend current models of the halo occupation distribution (HOD) to include a flexible, empirical framework for the forward modeling of the intrinsic alignment (IA) of galaxies. A primary goal of this work is to produce mock galaxy catalogs for the purpose of validating existing models and methods for the mitigation of IA in weak lensing measurements. This technique can also be used to produce new, simulation-based predictions for IA and galaxy clustering. Our model is probabilistically formulated, and rests upon the assumption that the orientations of galaxies exhibit a correlation with their host dark matter (sub)halo orientation or with their position within the halo. We examine the necessary components and phenomenology of such a model by considering the alignments between (sub)halos in a cosmological dark matter only simulation. We then validate this model for a realistic galaxy population in a set of simulations in the Illustris-TNG suite. We create an HOD mock with Illustris-like correlations using our method, constraining the associated IA model parameters, with the $\mathcal{X}$$^{2}_{dof}$ between our model’s correlations and those of Illustris matching as closely as 1.4 and 1.1 for orientation–position and orientation–orientation correlation functions, respectively. By modeling the misalignment between galaxies and their host halo, we show that the 3-dimensional two-point position and orientation correlation functions of simulated (sub)halos and galaxies can be accurately reproduced from quasi-linear scales down to 0.1 $\mathcal{h}$ –1 Mpc. We also find evidence for environmental influence on IA within a halo. Our publicly-available software provides a key component enabling efficient determination of Bayesian posteriors on IA model parameters using observational measurements of galaxy-orientation correlation functions in the highly nonlinear regime.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

NASA NTRS1976

Digital processing of satellite imagery application to jungle areas of Peru

The author has identified the following significant results. The use of clustering methods permits the development of relatively fast classification algorithms that could be implemented in an inexpensive computer system with limited amount of memory. Analysis of CCTs using these techniques can provide a great deal of detail permitting the use of the maximum resolution of LANDSAT imagery. Potential cases were detected in which the use of other techniques for classification using a Gaussian approximation for the distribution functions can be used with advantage. For jungle areas, channels 5 and 7 can provide enough information to delineate drainage patterns, swamp and wet areas, and make a reasonable broad classification of forest types.

Pomalaza, J. C.↗

DOE OSTI2026

Tomography of the gamma-ray sky from cross-correlation with DESI DR2 and unWISE galaxies

We study the origin of extragalactic gamma-ray emission observed by Fermi-LAT, using the cross-correlation of the gamma-ray sky with maps of large-scale structure provided by the DESI and unWISE surveys. Tomographic cross-correlation reveals the bias-weighted redshift distributions of gamma-ray sources. We first illustrate this method by cross-correlating detected gamma-ray point sources with large-scale structure. We find a significant cross-correlation and infer a point source redshift distribution broadly consistent with the distribution of identified optical counterparts previously reported in the literature, as well as a similar linear bias ($b \approx 2$) to massive galaxies that host bright active galactic nuclei. We then study the clustering of the Fermi unresolved gamma-ray background (UGRB), both in auto-correlation and in cross-correlation with large-scale structure. We detect the cross-correlation of the UGRB and LSS at $\sim 10σ$ in total, with highly significant detections from both DESI and unWISE. Our measurements suggest that the redshift distribution of the UGRB is broadly consistent with the redshift distribution of detected point sources. Additionally, we find a relatively weak amplitude for the cross-correlation with large-scale structure at z < 2, suggesting a significant fraction of the UGRB does not come from z < 2 large-scale structure. A natural candidate is contamination of from residual Galactic emission, and our best estimate of the contamination level derived from the UGRB auto-spectrum suggests that the mean bias of UGRB sources is indeed quite similar to the bias of detected Fermi point sources. However, we cannot exclude additional emission from gamma-ray sources at high redshift, z > 2, and we suggest that cross-correlation with tracers at z > 2, including CMB lensing, would be the ideal way to determine the fraction of z > 2 emission.

Krolewski, Alex [Waterloo U., Math. Dept.; Waterlo↗

DOE OSTI2025

Multi-GPU porting of a phase-change cascaded lattice Boltzmann method for three-dimensional pool boiling simulations

The Lattice Boltzmann method (LBM) has proven effective in simulating phase-change phenomena, such as melting, solidification, evaporation, and boiling. In this work, we develop a highly parallelized multi-GPU implementation of LBM for three-dimensional pool boiling simulations. The code is based on the OpenACC programming model, which enables the code to be deployed efficiently on multi-core CPUs, GPUs, and potentially other accelerators, without the need for architecture-specific rewrites. To support large-scale simulations, the domain is decomposed and distributed across multiple compute nodes using MPI. We demonstrate that the code exhibits excellent scaling properties, with ideal strong-scaling running with up to 256 GPUs on the MareNostrum5 cluster.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Resilience-Oriented DG Siting and Sizing Considering Stochastic Scenario Reduction

In this paper, a fuel-based distributed generator (DG) allocation strategy is proposed to enhance the distribution system resilience against extreme weather. The long-term planning problem is formulated as a two-stage stochastic mixed-integer programming (SMIP). The first stage is to make decisions of DG siting and sizing under the given budget constraint. In the second stage, a post-extreme-event-restoration (PEER) is employed to minimize the operating cost in an uncertain fault scenario. In particular, this study proposes a method to select the most representative scenarios for the SMIP. First, a Monte Carlo Simulation (MCS) is introduced to generate sufficient scenarios considering random fault locations and load profiles. Then, the number of scenarios is reduced by the K-means clustering algorithm. The advantage of scenario reduction is to make a trade-off between accuracy and computational efficiency. Finally, the SMIP is solved by the progressive hedging algorithm. Here, the case studies of the IEEE 33-bus and 123-bus test systems demonstrate the effectiveness of the proposed algorithm in reducing the expected energy not served (EENS), which is a critical criterion of resilience.

42 ENGINEERING↗

DOE OSTI2020

Distributed non-negative matrix factorization with determination of the number of latent features

The holistic analysis and understanding of the latent (that is, not directly observable) variables and patterns buried in large datasets is crucial for data-driven science, decision making and emergency response. Such exploratory analyses require devising unsupervised learning methods for data mining and extraction of the latent features, and non-negative matrix factorization (NMF) is one of the prominent such methods. NMF is based on compute-intense non-convex constrained minimization, which, for large datasets requires fast and distributed algorithms. However, current parallel implementations of NMF fail to estimate the number of latent features. In practice, identifying these features is both difficult and significant for pattern recognition and latent feature analysis, especially for large dense matrices. Here, we introduce a distributed NMF algorithm coupled with distributed custom clustering followed by a stability analysis on dense data, which we call DnMFk, to determine the number of latent variables. The results on synthetic data and the classical Swimmer data set demonstrate the accuracy of model determination while scaling nearly linearly across multiple processors for large data. Further, we employ DnMFk to determine the number of hidden features from a terabyte matrix.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1982

X-ray observations of Abell 2218 and implications for the Sunyaev-Zel'dovich effect

The Einstein Observatory was used to obtain a high-resolution X-ray image and an X-ray flux measurement of the galaxy cluster Abell 2218. The combined system of intracluster medium and galaxies is modeled as a gas in hydrostatic equilibrium in a common gravitational potential with an isothermal galaxy component. This model is then fitted in the least-squares sense to the X-ray surface brightness distribution and to the optically determined galaxy surface density profile to determine model parameters. The gas is found to be nominally isothermal, moderately dense, and very hot (10-30 keV); these conditions are consistent with the Sunyaev-Zel'dovich effect, i.e., the diminution in the cosmic microwave background radiation intensity in the direction of this cluster. It is noted that the considerable imprecision inherent in the method of distance measurement based on the combination of microwave measurements with X-ray and optical data makes it impossible to make a definitive statement about the distance to Abell 2218.

Boynton, P. E.↗

NASA NTRS1993

Galaxy tracers in N-body simulations

Using the method of smoothed particle hydrodynamics, we have modeled the formation of a compact group of galaxies with sufficient resolution to trace galaxies. Radiative cooling allows the baryons to dissipate their thermal energy and collapse to overdensities characteristic of real galaxies. With their cross section greatly reduced, these galaxy tracers remain distinct during cluster formation while their dark matter halos merge. In addition, the number density, the mass distribution function, and even the morphology of these objects are similar to those of observed galaxies. A viable population of galaxy tracers can be unambiguously defined.

Summers, F. J.↗

DOE OSTI2020

A Clustering-Based Scenario Generation Framework for Power Market Simulation with Wind Integration

A critical step in stochastic optimization models of power system analysis is to select a set of appropriate scenarios and significant numbers of scenario generation methods exist in the literature. This paper develops a clustering based scenario generation method, which aims to improve the performance of existing scenario generation techniques by grouping a set of correlated wind sites into clusters according to their cross-correlations. Copula based models are utilized to model spatiotemporal correlations and the Gibbs sampling is then used to generate scenarios for day-ahead markets. Our results show that the generated scenarios based on clustered wind sites outperform existing approaches in terms of reliability and sharpness and can reduce the total computational time for scenario generation and reduction significantly. The clustering-based framework can therefore provide a better support for real-world market simulations with high wind penetration.

data visualization↗

DOE OSTI2024

Quest for Multifunctionality: Current Progress in the Characterization of Heterometallic Metal–Organic Frameworks

Metal–organic frameworks (MOFs) are a class of porous, crystalline materials that have been systematically developed for a broad range of applications. Incorporation of two or more metals into a single crystalline phase to generate heterometallic MOFs has been shown to lead to synergistic effects, in which the whole is oftentimes greater than the sum of its parts. Because geometric proximity is typically required for metals to function cooperatively, deciphering and controlling metal distributions in heterometallic MOFs is crucial to establish structure–function relationships. However, determination of short- and long-range metal distributions is nontrivial and requires the use of specialized characterization techniques. Advancements in the characterization of metal distributions and interactions at these length scales is key to rapid advancement and rational design of functional heterometallic MOFs. Further, this perspective summarizes the state-of-the-art in the characterization of heterometallic MOFs, with a focus on techniques that allow metal distributions to be better understood. Using complementary analyses, in conjunction with computational methods, is critical as this field moves toward increasingly complex, multifunctional systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2023

The cosmic DANCe of Perseus

Context. Star-forming regions are excellent benchmarks for testing and validating theories of star formation and stellar evolution. The Perseus star-forming region, being one of the youngest (< 10 Myr), closest (280-320 pc), and most studied in the literature, is a fundamental benchmark. Aims. We aim to study the membership, phase-space structure, mass, and energy (kinetic plus potential) distribution of the Perseus star-forming region using public catalogues (Gaia, APOGEE, 2MASS, and Pan-STARRS). Methods. We used Bayesian methodologies that account for extinction to identify the Perseus physical groups in the phase-space, retrieve their candidate members, derive their properties (age, mass, 3D positions, 3D velocities, and energy), and attempt to reconstruct their origin. Results. We identify 1052 candidate members in seven physical groups (one of them new) with ages between 3 and 10 Myr, dynamical super-virial states, and large fractions of energetically unbounded stars. Their mass distributions are broadly compatible with that of Chabrier for masses ≳0.1 M ⊙ and do not show hints of over-abundance of low-mass stars in NGC 1333 with respect to IC 348. These groups’ ages, spatial structure, and kinematics are compatible with at least three generations of stars. Future work is still needed to clarify if the formation of the youngest was triggered by the oldest. Conclusions. The exquisite Gaia data complemented with public archives and mined with comprehensive Bayesian methodologies allow us to identify 31% more members than previous studies, discover a new physical group (Gorgophone: 7 Myr, 191 members, and 145 M ⊙ ), and confirm that the spatial, kinematic, and energy distributions of these groups support the hierarchical star formation scenario.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

DOE OSTI2023

Critical magnetic Reynolds number of the turbulent dynamo in collisionless plasmas

The intracluster medium of galaxy clusters is an extremely hot and diffuse, nearly collisionless plasma, which hosts dynamically important magnetic fields of ~μG strength. Seed magnetic fields of much weaker strength of astrophysical or primordial origin can be present in the intracluster medium. In collisional plasmas, which can be approximated in the magnetohydrodynamical (MHD) limit, the turbulent dynamo mechanism can amplify weak seed fields to strong dynamical levels efficiently by converting turbulent kinetic energy into magnetic energy. However, the viability of this mechanism in weakly collisional or completely collisionless plasma is much less understood. In this study, we explore the properties of the collisionless turbulent dynamo using three-dimensional hybrid-kinetic particle-in-cell simulations. We explore the properties of the collisionless turbulent dynamo in the kinematic regime for different values of the magnetic Reynolds number, Rm, initial magnetic-to-kinetic energy ratio, (E mag /E kin ) i , and initial Larmor ratio, (r Larmor /L box ) i , i.e. the ratio of the Larmor radius to the size of the turbulent system. We find that in the ‘un-magnetized’ regime, (r Larmor /L box ) i > 1, the critical magnetic Reynolds number for the dynamo action Rm crit ≈ 107 ± 3. In the ‘magnetized’ regime, (r Larmor /L box ) i ≲ 1, we find a marginally higher Rm crit = 124 ± 8. We find that the growth rate of the magnetic energy does not depend on the strength of the seed magnetic field when the initial magnetization is fixed. We also study the distribution and evolution of the pressure anisotropy in the collisionless plasma and compare our results with the MHD turbulent dynamo.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2023

Q-BEEP: Quantum Bayesian Error Mitigation Employing Poisson Modeling over the Hamming Spectrum

Quantum computing technology has grown rapidly in recent years, with new technologies being explored, error rates being reduced, and quantum processor’s qubit capacity growing. However, near-term quantum algorithms are still unable to be induced without compounding consequential levels of noise, leading to non-trivial erroneous results. Quantum Error Correction (in-situ error mitigation) and Quantum Error Mitigation (post-induction error mitigation) are promising fields of research within the quantum algorithm scene, aiming to alleviate quantum errors, increasing the overall fidelity and hence the overall quality of circuit induction. Earlier this year, a pioneering work, namely HAMMER, published in ASPLOS-22 demonstrated the existence of a latent structure regarding post-circuit induction errors when mapping to the Hamming spectrum. However, they intuitively assumed that errors occur in local clusters, and that at higher average Hamming distances this structure falls away. In this work, we show that such a correlation structure is not only local but extends certain non-local clustering patterns which can be precisely described by a Poisson distribution model taking the input circuit, the device run time status (i.e., calibration statistics) and qubit topology into consideration. Using this quantum error characterizing model, we developed an iterative algorithm over the generated Bayesian network state-graph for post-induction error mitigation. Thanks to more precise modeling of the error distribution latent structure and the new iterative method, our Q-Beep approach provides state of the art performance and can boost circuit execution fidelity by up to 234.6% on Bernstein-Vazirani circuits and on average 71.0% on QAOA solution quality, using 16 practical IBMQ quantum processors. For other benchmarks such as those in QASMBench, the fidelity improvement is up to 17.8%. Q-Beep is a light-weight post-processing technique that can be performed offline and remotely, making it a useful tool for quantum vendors to integrate and provide more reliable circuit induction results.

Stein, Samuel A.↗

NASA NTRS2011

Imaging the Moon's Core with Seismology

Constraining the structure of the lunar core is necessary to improve our understanding of the present-day thermal structure of the interior and the history of a lunar dynamo, as well as the origin and thermal and compositional evolution of the Moon. We analyze Apollo deep moonquake seismograms using terrestrial array processing methods to search for the presence of reflected and converted energy from the lunar core. Although moonquake fault parameters are not constrained, we first explore a suite of theoretical focal spheres to verify that fault planes exist that can produce favorable core reflection amplitudes relative to direct up-going energy at the Apollo stations. Beginning with stacks of event seismograms from the known distribution of deep moonquake clusters, we apply a polarization filter to account for the effects of seismic scattering that (a) partitions energy away from expected components of ground motion, and (b) obscures all but the main P- and S-wave arrivals. The filtered traces are then shifted to the predicted arrival time of a core phase (e.g. PcP) and stacked to enhance subtle arrivals associated with the Moon s core. This combination of filtering and array processing is well suited for detecting deep lunar seismic reflections, since we do not expect scattered wave energy from near surface (or deeper) structure recorded at varying epicentral distances and stations from varying moonquakes at varying depths to stack coherently. Our results indicate the presence of a solid inner and fluid outer core, overlain by a partial-melt-containing boundary layer (Table 1). These layers are consistently observed among stacks from four classes of reflections: P-to-P, S-to-P, P-to-S, and S-to-S, and are consistent with current indirect geophysical estimates of core and deep mantle properties, including mass, moment of inertia, lunar laser ranging, and electromagnetic induction. Future refinements are expected following the successful launch of the GRAIL lunar orbiter and SELENE 2 lunar lander missions.

Weber, Renee C.↗

DOE OSTI2025

Introducing the SLICE Method for estimating pebble-bed reactor inventories at equilibrium operation with SCALE

This paper introduces the SCALE Leap-In method for Cores at Equilibrium (SLICE) for estimating pebble-bed reactor equilibrium core isotopic inventories using capabilities in the SCALE code system, requiring only a small computational cluster and a few days of computation. This method uses an iterative approach that relies on (1) a surrogate spectrum model that captures spatial and time-dependent spectral conditions, (2) a multi-pass model that captures the pebble’s evolving nuclide inventory as a function of location and time in the core, and (3) a full-core model that captures the core’s spatial neutron flux distribution. The SLICE approach is applied to a generic fluoride salt–cooled high-temperature reactor, demonstrating fuel inventory convergence through nuclide concentration inspection across iterations and comparisons for core realizations with varying discretizations. Results agree within ~5% with another state-of-the-art code, with differences attributed to input parameter or modeling assumption variations in the equilibrium generation methods.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2020

Distributed-Memory Parallel Symmetric Nonnegative Matrix Factorization

We develop the first distributed-memory parallel implementation of Symmetric Nonnegative Matrix Factorization (SymNMF), a key data analytics kernel for clustering and dimensionality reduction. Our implementation includes two different algorithms for SymNMF, which give comparable results in terms of time and accuracy. The first algorithm is a parallelization of an existing sequential approach that uses solvers for non symmetric NMF. The second algorithm is a novel approach based on the Gauss-Newton method. It exploits second-order information without incurring large computational and memory costs. We evaluate the scalability of our algorithms on the Summit system at Oak Ridge National Laboratory, scaling up to 128 nodes (4,096 cores) with 70% efficiency. Additionally, we demonstrate our software on an image segmentation task.

Eswar, Srinivas↗

DOE OSTI2025

Electronic Spin Relaxation and Clustering in High-Pressure High-Temperature Synthesized Microcrystalline Diamond Particles with Reduced Nitrogen Content

The negatively charged nitrogen-vacancy (NV – ) color center in diamonds is widely studied because of numerous applications of this unique quantum system in sensing and quantum information sciences. While substitutional nitrogen is required to form the NV – centers in diamond, it also yields other paramagnetic defects─primarily the neutrally charged substitutional nitrogen centers (P1)─that decrease NV – spin coherence, which in turn degrades performance in applications. Herein, we investigate high-pressure high-temperature synthesized diamond microparticles (ca. 140–185 μm) having lower─ranging from 3 to 38 ppm─than the typical nitrogen content of type 1b diamond ( ca. 100 ppm and higher) typically used for the production of fluorescent diamond particles with NV – centers. A suite of electron paramagnetic resonance, optically detected magnetic resonance, and nuclear magnetic resonance methods are used to characterize spin properties of P1 and NV – centers in the particles. Upon decreasing the nitrogen content from 29 to 3 ppm, the ensemble NV – T 2 relaxation time increased by about 3-fold as measured directly in the Hahn Echo experiment at magnetic field of 1.2 T. Analysis of electronic relaxation of P1 centers revealed the existence of at least two distinct populations of P1 centers, consisting of fast and slower relaxing spins and allowed for an estimation of local concentrations. Even with <10 ppm nitrogen contents, the analysis indicated a highly heterogeneous distribution of P1 centers, suggesting the possibility of P1 spin clustering even at low nitrogen concentrations. The combined data demonstrate that the particles prepared from HPHT diamond with a low nitrogen content offer improved spin properties that are beneficial for NV – sensing applications.

Carbon↗