Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “spectral clustering approach”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Phase identification using co‐association matrix ensemble clustering

Calibrating distribution system models to aid in the accuracy of simulations such as hosting capacity analysis is increasingly important in the pursuit of the goal of integrating more distributed energy resources. The recent availability of smart meter data is enabling the use of machine learning tools to automatically achieve model calibration tasks. This research focuses on applying machine learning to the phase identification task, using a co‐association matrix‐based, ensemble spectral clustering approach. The proposed method leverages voltage time series from smart meters and does not require existing or accurate phase labels. This work demonstrates the success of the proposed method on both synthetic and real data, surpassing the accuracy of other phase identification research.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Tri-Level Linear Programming Model for Automatic Load Shedding Using Spectral Clustering

Traditional load shedding schemes can be inadequate in grids with high renewable penetration, leading to unstable events and unnecessary grid islanding. Although for both manual and automatic operating modes load shedding areas have been predefined by grid operators, they have remained fixed, and may be sub-optimal due to dynamic operating conditions. In this work, a distributed tri-level linear programming model for automatic load shedding to avoid system islanding is presented. Preventing islanding is preferred because it reduces the need for additional load shedding besides the disconnection of transmission lines between islands. This is crucial as maintaining the local generation-demand balance is necessary to preserve frequency stability. Furthermore, uneven distribution of generation resources among islands can lead to increased load shedding, causing economic and reliability challenges. This issue is further compounded in modern power systems heavily dependent on non-dispatchable resources like wind and solar. The upper-level model uses complex power flow measurements to determine the system areas to shed load depending on actual operating conditions using a spectral clustering approach. The mid-level model estimates the area system state, while the lower-level model determines the locations and load values to be shed. The solution is practical and promising for real-world applications.

Baquedano-Aguilar, Mario D.↗
DOE OSTI2022

Improved galactic foreground removal for B-mode detection with clustering methods

ABSTRACT Characterizing the sub-mm Galactic emission has become increasingly critical especially in identifying and removing its polarized contribution from the one emitted by the cosmic microwave background (CMB). In this work, we present a parametric foreground removal performed on to sub-patches identified in the celestial sphere by means of spectral clustering. Our approach takes into account efficiently both the geometrical affinity and the similarity induced by the measurements and the accompanying errors. The optimal partition is then used to parametrically separate the Galactic emission encoding thermal dust and synchrotron from the CMB one applied on two nominal observations of forthcoming experiments from the ground and from the space. Moreover, the clustering is performed on tracers that are different from the data used for component separation, e.g. the spectral index maps of dust and synchrotron. Performing the parametric fit singularly on each of the clustering derived regions results in an overall improvement: both controlling the bias and the uncertainties in the CMB B-mode recovered maps. We finally apply this technique using the map of the number of clouds along the line of sight, $\mathcal {N}_c$, as estimated from H i emission data and perform parametric fitting on to patches derived by clustering on this map. We show that adopting the $\mathcal {N}_c$ map as a tracer for the patches related to the thermal dust emission, results in reducing the B-mode residuals post-component separation. The code is made publicly available https://github.com/giuspugl/fgcluster.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Defensive Islanding to Enhance the Resilience of Distribution Systems Against Cyber-Induced Failures

The extensive integration of communication, computation, and control technologies into cyber-physical power systems (CPPSs) has increased the vulnerabilities of CPPSs to cyberattacks. This calls for developing solutions that assess and reduce the impacts of cyber-induced failures on CPPSs. This paper proposes a defensive islanding strategy to isolate impacted parts of the CPPS and form self-sufficient islanded grids with an objective of minimum load curtailment. The defensive islanding aims to split a power system into smaller grids to improve its resilience against a potential extreme event. A clustering approach that leverages the hierarchical spectral clustering method is utilized for the optimal defensive islanding. The proposed approach captures the fragility behavior and loading conditions of power system components due to cyber-induced failures. A graphical-based coupling framework is used to map the impacts of cyber failures into operation of power system components. The proposed method is demonstrated on a modified 33-node distribution feeder system integrated with distributed energy resources. The amount of load curtailment and radiality constraints have been used to evaluate the performance of the proposed clustering strategies. The results show the capability of the proposed algorithm to create islands considering the cyber-induced failures for enhanced resilience.

cyber-induced failures↗
DOE OSTI2025

Coherency-Constrained Spectral Clustering for Power Network Reduction

This paper presents a methodology for reducing the complexity of large-scale power network models using spectral clustering, aggregation of electrical components, and cost function approximation. Two approaches are explored using unconstrained and constrained spectral clustering to determine areas for effective system reduction. Once the system areas are determined, both loads and generators by type are aggregated, and their new cost function is approximated through polynomial curve-fitting or statistical methods. The performance of reduced networks is evaluated in terms of their ability to follow the true daily cost of the original system over a 24-hour period considering a set of several days. Two test systems are taken as test beds. Application of the methodology to a modified version of the IEEE 39-bus system reduces it from 17 generators to a 4-bus system and 9 generators with about 93% of accuracy. Similarly, the IEEE 118-bus system is reduced from 19 generators to a 3-bus system with three aggregated units achieving over 99% of accuracy. These findings address scalability challenges and enhance accuracy for high and mid-loading level conditions, and by aggregating thermal units with similar cost functions.

42 ENGINEERING↗
DOE OSTI2025

Unsupervised Clustering of Microseismic Events and Focal Mechanism Analysis at the CO 2 Injection Site in Decatur, Illinois

Characterization of induced microseismicity at a carbon dioxide (CO 2 ) storage site is critical for preserving reservoir integrity and mitigating seismic hazards. We apply a multilevel machine learning (ML) approach that combines the nonnegative matrix factorization and hidden Markov model to extract spectral representations of microseismic events and cluster them to identify seismic patterns at the Illinois Basin-Decatur Project. Unlike traditional waveform correlation methods, this approach leverages spectral characteristics of first arrivals to improve event classification and detect previously undetected planes of weakness. By integrating ML-based clustering with focal mechanism analysis, we resolve small-scale fault structures that are below the detection limits of conventional seismic imaging. Our findings reveal temporal bursts of microseismicity associated with brittle failure, providing insights into the spatio-temporal evolution of fault reactivation during CO 2 injection. This approach enhances seismic monitoring capabilities at CO 2 injection sites by improving fault characterization beyond the resolution of standard geophysical surveys.

Willis, Rachel Marie [Sandia National Laboratories↗
DOE OSTI2022

Long- and short-term temporal variability in cloud condensation nuclei spectra over a wide supersaturation range in the Southern Great Plains site

Abstract. When aerosol particles seed the formation of liquid water droplets in the atmosphere, they are called cloud condensation nuclei (CCN). Different aerosols will act as CCN under different degrees of water supersaturation (relative humidity above 100 %), depending on their size and composition. In this work, we build and analyze a best-estimate CCN spectrum product, tabulated at ∼ 45 min resolution, generated using high quality data from seven independent instruments at the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) Southern Great Plains site. The data product spans a large supersaturation range, from 0.0001 % to ∼ 30 %, and time period of 5 years, from 2009–2013, and is available on the ARM data archive. We leverage this added statistical power to examine relationships that are unclear in smaller datasets. Our analysis is performed in three main areas. First, probability distributions of many aerosol and CCN metrics are found to exhibit skewed log-normal distribution shapes. Second, clustering analyses of CCN spectra reveal that the primary drivers of CCN differences are aerosol number size distributions, rather than hygroscopicity or composition, especially at supersaturations above 0.2 %, while also allowing for a simplified understanding of seasonal and diurnal variations in CCN behavior. The predictive ability of using limited hygroscopicity data with accurate number size distributions to estimate CCN spectra is investigated, and the uncertainties of this approach are estimated. Third, the dynamics of CCN spectral clusters and concentrations are examined with cross-correlation and autocorrelation analyses. We find that CCN concentrations change rapidly on the timescale of 1–3 h, with some conservation beyond that which is greatest for the lower supersaturation region of the spectrum.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Development of Multimodal Few-Shot Analytics for Electron Micrographs

Recent advances in materials data analytics have provided new avenues for determining process-structure-property (PSP) linkages in a variety of materials. Machine learning techniques including few-shot learning have increased the efficiency of classifying microscopy images for the purposes of material characterization. Attempts at creating a multimodal approach can provide further improvements to current models and help extract more salient features from data. In this vein, raw spectrum data was taken to provide an additional modality to our current pyCHIP classifier. Modifications in segmentation also show potential in improving the accuracy of the pyCHIP classifier. Classifier output was analyzed using network graphs and unsupervised clustering algorithms such as spectral clustering to detect better segmentation methods than the current “chipping” approach. We suggest that the chip selection process can be automated in the future using a combination of these techniques to enable high-throughput analyses.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Comment on “Microhydration of Biomolecules: Revealing the Native Structures by Cold Ion IR Spectroscopy”

This paper presents a re-examination of the conclusions of a study reported in The Journal of Physical Chemistry Letters (Saparbaev et al., 2021, 12, 907) that compared the structure of microsolvated ions formed by electrospray ionization to those formed in the gas-phase via a previously published cryogenic ion trap approach. We conducted additional experiments that clearly show that most of the observed differences in the IR spectra can be accounted for by considering the different spectroscopic action schemes used to obtain them. In particular, the presence of the D 2 -tag induces shifts in some of the N-H and O-H peaks which need to be carefully considered before comparing spectra. Furthermore, once these spectral effects are taken into account, we show that both clustering approaches yields similar clusters structures for the small GlyH + (H 2 O)n species. Using unimolecular reaction rate theory, we also show that for the small complexes considered here, only the gas-phase equilibrium distribution of conformers should be expected in both experimental approaches. In addition, the barrier heights necessary to kinetically trap high-energy conformers at 298K is explored using a series of model polyalanine chains.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Exploring the exact limits of the real-time equation-of-motion coupled cluster cumulant Green’s functions

In this paper, we analyze the properties of the recently proposed real-time equation-of-motion coupled-cluster (RT-EOM-CC) cumulant Green’s function approach [Rehr et al., J. Chem. Phys. 152, 174113 (2020)]. We specifically focus on identifying the limitations of the original time-dependent coupled cluster (TDCC) ansatz and propose an enhanced double TDCC ansatz, ensuring the exactness in the expansion limit. In addition, we introduce a practical cluster-analysis-based approach for characterizing the peaks in the computed spectral function from the RT-EOM-CC cumulant Green’s function approach, which is particularly useful for the assignments of satellite peaks when many-body effects dominate the spectra. Our preliminary numerical tests focus on reproducing, approximating, and characterizing the exact impurity Green’s function of the three-site and four-site single impurity Anderson models using the RT-EOM-CC cumulant Green’s function approach. The numerical tests allow us to have a direct comparison between the RT-EOM-CC cumulant Green’s function approach and other Green’s function approaches in the numerical exact limit.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Spectral Clustering-Based Partitioning of Large-Scale Power Electronics-Based Power Systems for Small-Signal Stability Analysis

The nodal admittance matrix (NAM)-based approach is well-suited for small-signal stability analysis of large-scale power electronics-based power systems (PEPSs), as it preserves the system structure through its admittance matrix. Previous studies have explored partitioning such systems into subareas and interconnections to reduce computational burden; however, they lacked a formal algorithmic procedure for determining feasible partitions. While several grid partitioning methods, such as those based on graph theory or machine learning, exist in the literature, they cannot be directly applied to NAM-based analysis due to differing objectives and constraints. Here, this paper addresses this gap by presenting a systematic, step-by-step procedure for applying a spectral partitioning algorithm that yields a division of the system into subareas suitable for NAM-based analysis. The computational complexity of the proposed method is also derived to demonstrate its efficiency and justify the practicality of the resulting subarea decomposition. The performance of the partitioning method is evaluated by applying the spectral clustering-derived subareas and interconnections to the NAM-based partitioning approach on a 140-bus system. Computational times for the full-system and partitioned NAM analyses are compared using MATLAB. Additionally, PSCAD simulations of the complete system and partitioned subareas are carried out to verify the effectiveness of the proposed method.

Nupur [Univ. of Tennessee, Knoxville, TN (United S↗
DOE OSTI2020

Coupled Cluster Green's function formulations based on the effective Hamiltonians

In this work, we demonstrate that the effective Hamiltonians obtained with the downfolding procedure based on double unitary coupled cluster (DUCC) ansatz can be used in the context of Green’s function coupled cluster (GFCC) formalism to calculate spectral functions of molecular systems. This combined approach (DUCC-GFCC) provides a significant reduction of numerical effort and good agreement with the corresponding all-orbital GFCC methods in energy windows that are consistent with the choice of active space. These features are demonstrated on the example of two benchmark systems: H 2 O and N 2 , where DUCC-GFCC calculations were performed for active spaces of various sizes.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2021

Numerically exact generalized Green's function cluster expansions for electron-phonon problems

We generalize the family of approximate momentum average methods to formulate a numerically exact, convergent hierarchy of equations whose solution provides an efficient algorithm to compute the Green's function of a particle dressed by bosons suitable in the entire parameter regime. We use this approach to extract ground-state properties and spectral functions. Our approximation-free framework, dubbed the generalized Green's function cluster expansion (GGCE), allows access to exact numerical results in the extreme adiabatic limit, where many standard methods struggle or completely fail. We showcase the performance of the method, specializing three important models of charge-boson coupling in solids and molecular complexes: the molecular Holstein model, which describes coupling between charge density and local distortions, the Peierls model, which describes modulation of charge hopping due to intersite distortions, and a more complex Holstein + Peierls system with couplings to two different phonon modes, paradigmatic of charge-lattice interactions in organic crystals. Furthermore, the GGCE serves as an efficient approach that can be systematically extended to different physical scenarios, thus providing a tool to model the frequency dependence of dressed particles in realistic settings.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2025

Accelerating the Structure Exploration of Diverse Bi–Pt Nanoclusters via Physics‐Informed Machine Learning Potential and Particle Swarm Optimization

Bimetallic Bi–Pt nanoclusters exhibit diverse structural motifs, including core-shell, Janus, and mixed alloy configurations, due to the unique bonding characteristics between Bi and Pt atoms. Using density functional theory refinements from ChIMES physically machine-learned potential and CALYPSO particle swarm optimization global searches, 34 Bi20-Pt20 nanoclusters are systematically classified. The results reveal that Bi atoms predominantly occupy surface sites, driven by charge transfer effects. Cohesive energy trends alone prove insufficient for structure differentiation, necessitating a data-driven approach employing principal component analysis and K-means clustering. Furthermore, vibrational, electronic, and infrared spectral analyses provide additional insights into structure-property relationships. The findings offer an original framework for the automated classification and analysis of bimetallic nanoclusters, enhancing the understanding of their stability and functional properties.

bimetallic nanoparticles↗
DOE OSTI2023

Multiclustering needlet ILC for CMB B -mode component separation

ABSTRACT The Cosmic Microwave Background (CMB) primordial B-mode signal is predicted to be much lower than the polarized Galactic emission (foregrounds) in any region of the sky pointing to the need for sophisticated component separation methods. Among them, the blind Needlet Internal Linear Combination (NILC) has great relevance given our current poor knowledge of the B-mode foregrounds. However, the expected level of spatial variability of the foreground spectral properties complicates the NILC subtraction of the Galactic contamination. We therefore propose a novel extension of the NILC approach, the Multiclustering NILC (MC-NILC), which performs NILC variance minimization on separate regions of the sky (clusters) properly chosen to have similar spectral properties of the B-mode Galactic emission within them. Clusters are identified thresholding either the ratio of simulated foregrounds-only B modes (ideal case) or the one of cleaned templates of Galactic emission obtained from realistic simulations. In this work we present an application of MC-NILC to the future LiteBIRD satellite, which targets the observation of both reionization and recombination peaks of the primordial B-mode angular power spectrum with a total error on the tensor-to-scalar ratio δr < 0.001. We show that MC-NILC provides a CMB solution with residual foreground and noise contamination that is significantly lower than the NILC one and the primordial signal targeted by LiteBIRD at all angular scales for the ideal case and at the reionization peak for a realistic ratio. Thus, MC-NILC will represent a powerful method to mitigate B-mode foregrounds for future CMB polarization experiments.

Astronomy & Astrophysics↗
DOE OSTI2021

Equation-of-Motion Coupled-Cluster Cumulant Green’s Function for Excited States and X-ray Spectra

Green’s function methods within many-body perturbation theory provide a general framework for treating electronic correlations in excited states and spectra. Conventional methods using the Dyson equation or the cumulant expansion are typically based on the GW self-energy approximation. In order to extend this approximation in molecular systems, a non-perturbative real-time coupled-cluster cumulant Green’s function approach has been introduced, where the cumulant is obtained as the solution to a set of coupled first order, non-linear differential equations. This approach naturally includes non-linear corrections to conventional cumulant Green’s function techniques where the cumulant is linear in the GW self-energy. The method yields the spectral function associated with the core Green’s function, which is directly related to the x-ray photoemission spectra (XPS) of molecular systems. The approach also yields very good results for binding energies and satellite excitations. The x-ray absorption spectrum (XAS) is then obtained as a convolution of the core spectral function and an effective one-body absorption spectrum. Here this approach is extended to include the full coupled-cluster-singles (CCS) core Green’s function by including the complete form of the non-linear contributions to the cumulant as well as all single, double, and triple cluster excitations in the CC amplitude equations. This approach naturally builds in orthogonality and shake-up effects analogous to those in the Mahan-Noizeres-de Dominicis edge singularity corrections that enhance the XAS near the edge. Themethod is illustrated for the XPS and XAS of NH 3 .

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Detection of Anomalies in Gamma Background Radiation Data with K-Means and Self-Organizing Map Clustering Algorithms (Consortium on Nuclear Security Technologies (CONNECT) Q1 Report)

Environmental screening of gamma radiation consists of detecting weak nuisance and anomaly signal in the presence of strong and highly varying background. In a typical scenario, a mobile detector-spectrometer continuously measures gamma radiation spectra in short, e.g., one-second, signal acquisition intervals. The measurement data is a 2D matrix, where one dimension is gamma ray energy, and the other dimension is the number of measurements or total time. In principle, gamma radiation sources can be detected and identified from the measured data by their unique spectral lines. Detecting sources from data measured in a search scenario is difficult due to the highly varying background because of naturally occurring radioactive material (NORM), and low signal-to-noise ratio (S/N) of spectral signal measured during one-second acquisition intervals. The objective of this work is to explore unsupervised machine learning (ML) algorithms for detection and identification of weak nuisances and anomalies events in the presence of highly fluctuating background. The challenge is that spectral lines of isotopes are difficult to observe in one-second measurements. Averaging over the entire measurement campaign data set reveals spectral lines of most common background isotopes. Spectral lines of orphan sources, which might appear only in a few measurements during the campaign, will be washed out if averaging is performed over the entire measurement data set. The approach we have explored consists of extracting one-second measurements containing weak spectral features through data clustering. Averaging one-second spectra in a cluster should reveal the presence of anomaly sources. We created two ML models using K-means clustering and Neural Network Self-organizing Map (SOM). Performance of these ML models was benchmarked using search data. One data set contained 137 Cs source, and another dataset contained 131 I source.

61 RADIATION PROTECTION AND DOSIMETRY↗