Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “density-based clustering analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

17 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Enhancing Cluster Identification in Atom Probe Tomography Data Using Transfer Learning

Atom probe tomography (APT) has enabled the direct visualization of solute clusters, providing valuable insights into material structures. This clustering is crucial for understanding the nanoscale composition and behavior of materials, which can significantly influence their mechanical and physical properties. However, the widely used clustering methods in the APT community face challenges such as subjective parametric selection and limited applicability, particularly in dealing with overlapping clusters, nested clusters, and artifacts across different scales, such as precipitates and dislocations. To address these challenges, we present a framework based on density-based cluster analysis that aims to be less dependent on user input, reproducible, and robust.

Density-based clustering↗
DOE OSTI2019

The Application of the OPTICS Algorithm to Cluster Analysis in Atom Probe Tomography Data

Atom probe tomography (APT) is a powerful technique to characterize buried 3D nanostructures in a variety of materials. Accurate characterization of those nanometer-scale clusters and precipitates is of great scientific significance to understand the structure-property relationships and the microstructural evolution. The current widely used cluster analysis method, a variant of the DBSCAN algorithm, can only accurately extract clusters of the same atomic density, neglecting several experimental realities, such as density variations within and between clusters and the non-uniformity of the atomic density in the APT reconstruction itself (e.g. crystallographic poles and other field evaporation artifacts). The clustering results of DBSCAN-like method rely heavily on multiple input parameters, but ideal selection of those parameters is challenging and oftentimes ambiguous. In this study, we present a new cluster analysis method consisting of a well-known algorithm, called OPTICS, and a cluster extraction algorithm we developed to enable accurate detection of clusters of varying atomic density in APT data. The new method requires only one free parameter, and other inputs can be estimated based on physical parameters of the material. The effectiveness of this method is demonstrated by application to several small-scale model datasets and a real APT dataset obtained from an oxide-dispersion strengthened ferritic alloy specimen. The method’s sensitivity with respect to parameter selection is discussed and compared with the current widely used methods.

atom probe tomography, cluster analysis, density-b↗
DOE OSTI2016

Data depth based clustering analysis

Here, this paper proposes a new algorithm for identifying patterns within data, based on data depth. Such a clustering analysis has an enormous potential to discover previously unknown insights from existing data sets. Many clustering algorithms already exist for this purpose. However, most algorithms are not affine invariant. Therefore, they must operate with different parameters after the data sets are rotated, scaled, or translated. Further, most clustering algorithms, based on Euclidean distance, can be sensitive to noises because they have no global perspective. Parameter selection also significantly affects the clustering results of each algorithm. Unlike many existing clustering algorithms, the proposed algorithm, called data depth based clustering analysis (DBCA), is able to detect coherent clusters after the data sets are affine transformed without changing a parameter. It is also robust to noises because using data depth can measure centrality and outlyingness of the underlying data. Further, it can generate relatively stable clusters by varying the parameter. The experimental comparison with the leading state-of-the-art alternatives demonstrates that the proposed algorithm outperforms DBSCAN and HDBSCAN in terms of affine invariance, and exceeds or matches the ro-bustness to noises of DBSCAN or HDBSCAN. The robust-ness to parameter selection is also demonstrated through the case study of clustering twitter data.

58 GEOSCIENCES↗
DOE OSTI2020

A robust clustering algorithm for analysis of composition-dependent organic aerosol thermal desorption measurements

Abstract. One of the challenges of understanding atmospheric organic aerosol (OA) particles stems from its complex composition. Mass spectrometry is commonly used to characterize the compositional variability of OA. Clustering of a mass spectral dataset helps identify components that exhibit similar behavior or have similar properties, facilitating understanding of sources and processes that govern compositional variability. Here, we developed an algorithm for clustering mass spectra, the noise-sorted scanning clustering (NSSC), appropriate for application to thermal desorption measurements of collected OA particles from the Filter Inlet for Gases and AEROsols coupled to a chemical ionization mass spectrometer (FIGAERO-CIMS). NSSC, which extends the common density-based special clustering of applications with noise (DBSCAN) algorithm, provides a robust, reproducible analysis of the FIGAERO temperature-dependent mass spectral data. The NSSC allows for the determination of thermal profiles for compositionally distinct clusters of mass spectra, increasing the accessibility and enhancing the interpretation of FIGAERO data. Applications of NSSC to several laboratory biogenic secondary organic aerosol (BSOA) systems demonstrate the ability of NSSC to distinguish different types of thermal behaviors for the components comprising the particles along with the relative mass contributions and chemical properties (e.g., average molecular formula) of each mass spectral cluster. For each of the systems examined, more than 80 % of the total mass is clustered into 9–13 mass spectral clusters. Comparison of the average thermograms of the mass spectral clusters between systems indicates some commonality in terms of the thermal properties of different BSOA, although with some system-specific behavior. Application of NSSC to sets of experiments in which one experimental parameter, such as the concentration of NO, is varied demonstrates the potential for mass spectral clustering to elucidate the chemical factors that drive changes in the thermal properties of OA particles. Further quantitative interpretation of the thermograms of the mass spectral clusters will allow for a more comprehensive understanding of the thermochemical properties of OA particles.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2017

Building Halo Merger Trees from the Q Continuum Simulation

Cosmological N-body simulations rank among the most computationally intensive efforts today. A key challenge is the analysis of structure, substructure, and the merger history for many billions of compact particle clusters, called halos. Effectively representing the merging history of halos is essential for many galaxy formation models used to generate synthetic sky catalogs, an important application of modern cosmological simulations. Generating realistic mock catalogs requires computing the halo formation history from simulations with large volumes and billions of halos over many time steps, taking hundreds of terabytes of analysis data. We present fast parallel algorithms for producing halo merger trees and tracking halo substructure from a single-level, density-based clustering algorithm. Merger trees are created from analyzing the halo-particle membership function in adjacent snapshots, and substructure is identified by tracking the "cores" of merging halos - sets of particles near the halo center. Core tracking is performed after creating merger trees and uses the relationships found during tree construction to associate substructures with hosts. The algorithms are implemented with MPI and evaluated on a Cray XK7 supercomputer using up to 16,384 processes on data from HACC, a modern cosmological simulation framework. We present results for creating merger trees from 101 analysis snapshots taken from the Q Continuum, a large volume, high mass resolution, cosmological simulation evolving half a trillion particles.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2019

pnnl/apt

The current scripts utilize a well-known cluster analysis algorithm, called ordering points to identify the clustering structures (OPTICS), and an automatic cluster extraction algorithm for clustering analysis of 3D spatial data, specifically for the Atom Probe Tomography data. A hierarchical clustering scheme, together with density-based clustering, were implemented.

Wang, Jing↗
DOE OSTI2018

Association rule mining based quantitative analysis approach of household characteristics impacts on residential electricity consumption patterns

The comprehensive understanding of the residential electricity consumption patterns (ECPs) and how they relate to household characteristics can contribute to energy efficiency improvement and electricity consumption reduction in the residential sector. After recognizing the limitations of current studies (i.e. unreasonable typical ECP (TECP) extraction method and the problem of multicollinearity and interpretability for regression and machine learning models), this paper proposes an association rule mining based quantitative analysis approach of household characteristics impact on residential ECPs trying to address them together. First, an adaptive density-based spatial clustering of applications with noise (DBSCAN) algorithm is utilized to create seasonal TECP of each individual customer only for weekdays. K-means is then adopted to group all the TECPs into several clusters. An enhanced Apriori algorithm is proposed to reveal the relationships between TECPs and thirty five factors covering four categories of household characteristics including dwelling characteristics, socio-demographic, appliances and heating and attitudes towards energy. Results of the case study using 3326 records containing smart metering data and survey information in Ireland suggest that socio-demographic and cooking related factors such as employment status, occupants and whether cook by electricity have strong significant associations with TECPs, while attitudes related factors almost have no effect on TECPs. The results also indicate that those households with more than one person are more likely to change ECP across seasons. The proposed approach and the findings of this study can help to support decisions about how to reduce electricity consumption and CO2 emissions.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

Exploring Continuous Seismic Data at an Industry Facility Using Unsupervised Machine Learning

Seismic data recorded at industrial sites contain valuable information on anthropogenic activities. With advances in machine learning and computing power, new opportunities have emerged to explore the seismic wavefield in these complex environments. We applied two unsupervised machine learning algorithms to analyze continuous seismic data collected from an industrial facility in Texas, United States. The Uniform Manifold Approximation and Projection for Dimension Reduction algorithm was used to reduce the dimensionality of the data and generate 2D embeddings. Then, the Hierarchical Density-Based Spatial Clustering of Applications with Noise method was employed to automatically group these embeddings into distinct signal clusters. Our analysis of over 1400 hr (around 59 days) of continuous seismic data revealed five and seven signal clusters at two separate stations. At both stations, we identified clusters associated with background noise and vehicle traffic, with the latter’s temporal patterns aligning closely with the facility’s work schedule. Furthermore, the algorithms detected signal clusters from unknown sources and underline the ability of unsupervised machine learning for uncovering previously unrecognized patterns. Our analysis demonstrates the effectiveness of unsupervised approaches in examining continuous seismic data without requiring prior knowledge or pre-existing labels.

58 GEOSCIENCES↗
DOE OSTI2024

Advances in ArborX to support exascale applications

ArborX is a performance portable geometric search library developed as part of the Exascale Computing Project (ECP). In this paper, we explore a collaboration between ArborX and a cosmological simulation code HACC. Large cosmological simulations on exascale platforms encounter a bottleneck due to the in-situ analysis requirements of halo finding, a problem of identifying dense clusters of dark matter (halos). This problem is solved by using a density-based DBSCAN clustering algorithm. With each MPI rank handling hundreds of millions of particles, it is imperative for the DBSCAN implementation to be efficient. In addition, the requirement to support exascale supercomputers from different vendors necessitates performance portability of the algorithm. We describe how this challenge problem guided ArborX development, and enhanced the performance and the scope of the library. We explore the improvements in the basic algorithms for the underlying search index to improve the performance, and describe several implementations of DBSCAN in ArborX. Further, we report the history of the changes in ArborX and their effect on the time to solve a representative benchmark problem, as well as demonstrate the real world impact on production end-to-end cosmology simulations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Formation and Reconnection of Electron Scale Current Layers in the Turbulent Outflows of a Primary Reconnection Site

We simulate with 3D particle in cell, the spontaneous formation of turbulent outflows in an initially laminar 3D reconnecting current layer. We observe the formation of many secondary current layers and reconnection sites in the outflow. The approach we follow is to study each individual feature within the turbulent outflow. To identify all clusters of current in the outflow we use a clustering technique widely used in unsupervised machine learning: density-based spatial clustering of applications with noise. Once the clusters are identified we measure their size and compute reconnection indicators to establish which are undergoing reconnection. With this analysis we establish that the size of the current clusters reaches all the way from its initial system scale down to subelectron skin depth scale. We observe that the smaller current clusters are more prone to reconnecting and to releasing energy. We then find the process of reconnection of the smaller current cluster to be of the recently observed electron-only type that leaves the ions essentially unaffected.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Enhancing Cluster Identification in Atom Probe Tomography Data Using Transfer Learning

Atom Probe Tomography (APT) is a powerful technique for visualizing the atomic-scale distribution of solutes in materials, but quantitative cluster analysis of APT datasets remains a challenge due to the need for subjective parameter selection in clustering algorithms. While distance-based and density-based methods such as HDBSCAN are widely used, their performance is highly sensitive to user-defined parameters, which undermines reproducibility and accuracy. This study proposes an image-based, deep learning-aided workflow for automating parameter selection and cluster detection in APT data analysis. By projecting 3D APT point clouds onto 2D planes, we leverage pretrained convolutional neural networks (ConvNeXt-Tiny and ResNet-50) through transfer learning to predict the number of clusters present in synthetic datasets. The output is used to guide K-means clustering and estimate HDBSCAN parameters, specifically minimum cluster size and minimum sample points. This approach reduces reliance on manual parameter tuning, improving consistency and scalability. The methodology demonstrates the feasibility of using image-based deep learning for interpreting complex spatial patterns in APT data, enabling faster and more objective analysis. The complete workflow and code are made publicly available to support reproducibility and future research.

Density-based clustering↗
DOE OSTI2026

FY 2026 Midyear Report: Seismic Monitoring of Underground Vibration Sources Using Distributed Acoustic Sensing and Seismometers

Safeguards-relevant temporal changes in underground facilities can be observed using geophysical monitoring techniques. Seismic waves, in particular, provide valuable insights into subsurface activities and can serve as an important tool for detecting anomalous events that may indicate containment breaches at geological repositories. This midyear report summarizes ongoing efforts to automatically and rapidly detect and locate anomalous vibration signals that could be indicative of potential containment breaches. Previous work during FY25 focused on compiling continuous seismic datasets from two underground sites and developing a database of continuous waveforms and ground-truth event data derived from multiple sensing modalities. Building on this foundation, we are adapting anomaly detection and geolocation algorithms to explore methods for monitoring underground activities using two relatively low-maintenance sensing technologies: a dense surface geophone array deployed at the Pleasant Gap mine in Pennsylvania, and a three-dimensional fiber-optic cable array for distributed acoustic sensing (DAS) installed in the subsurface at the Sanford Underground Research Facility (SURF) in South Dakota. This report summarizes work conducted during the first two quarters of FY26, during which we refined a dynamic power spectral density (PSD)-based detector, applied it independently to each geophone station, and then combined the per‑station detections with density-based spatial clustering of applications with noise (DBSCAN) to cluster events and produce spatial maps over a nine‑day interval. In addition, we outline plans for a field trial at the Waste Isolation Pilot Plant (WIPP) in New Mexico to compare traditional seismic monitoring approaches with DAS techniques and to evaluate the benefits of combined data analysis. Activities during the past two quarters have included the preparation and submission of a Field Test Plan to WIPP for approval, as well as submission to headquarters for review and feedback.

58 GEOSCIENCES↗
DOE OSTI2024

Calibrating LArPix for TinyTPC

LArTPCs provide sensitivity to GeV signals, such as accelerator neutrinos and part of the supernova neutrino spectrum. TinyTPC is a LArTPC test stand for R&D of LAr doping to expand the reach of LArTPCs down to the 1-10 MeV range, which would substantially enhance the flagship analyses of experiments like DUNE, while enabling low energy analyses. We aim to dope LAr with Xe and pho- tosensitive dopants to expand the LArTPC range by converting hard-to-detect scintillation light to efficiently detected ionization charge. A critical element of the data analysis in TinyTPC is calibrating the readout. This poster will cover the calibration of TinyTPC, a pixelated liquid argon detector, where we find the distance a muon travels through each pixel. We then calculate the energy loss of muons traveling through the detector from cosmic data. We can reconstruct the path of the particles through the TPC using a density-based clustering algorithm designed to sort straight cosmic muon tracks from low energy radioactive decay curled paths and electronic noise

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2017

Data-driven analysis of ultrasonic pressure tube inspection data - 220

Pressure tubes are critical components of the CANDU reactors and other pressurized heavy water type reactors, as they contain the nuclear fuel and the coolant. Manufacturing flaws, as well as defects developed during the in-service operation, can lead to coolant leakage and can potentially damage the reactor. The current inspection process of these flaws is based on manually analyzing ultrasonic data received from multiple probes during planned, statutory outages. Recent advances on ultrasonic inspection tools enable the provision of high resolution data of significantly large volumes. This is highlighting the need for an efficient autonomous signal analysis process. Typically, the automation of ultrasonic inspection data analysis is approached by knowledge-based or supervised data-driven methods. This work proposes an unsupervised data-driven framework that requires no explicit rules, nor individually labeled signals. The framework follows a two-stage clustering procedure that utilizes the DBSCAN density-based clustering algorithm and aims to provide decision support for the assessment of potential defects in a robust and consistent way. Nevertheless, verified defect dimensions are essential in order to assess the results and train the framework for unseen defects. Initial results of the implementation are presented and discussed, with the method showing promise as a means of assessing ultrasonic inspection data. (authors)

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2019

CONSTRUCTING A NETWORK FUNDAMENTAL DIAGRAM: A SYNTHETIC ORIGIN-DESTINATION APPROACH

The Network Fundamental Diagram (NFD) is increasingly used in traffic monitoring and control. One obstacle to a wider application of NFDs in network control is the difficulty of obtaining data from all vehicles traveling in the network to construct an accurate NFD. One solution is to estimate the NFD using data from only a fraction of vehicles (i.e., probe vehicles), where the probe vehicle market penetration rate (MPR) needs to be estimated. A previous study conducted by the authors demonstrated that a distance or time weighted harmonic mean was needed to estimate the flow- and density-based MPRs, respectively using a pairing k-mean clustering approach. This paper proposes another approach that utilizes probe vehicle and observed link volume data to estimate the MPR. A heuristic model is proposed to identify the optimum locations from which to collect link traffic volume data for use in the MPR estimation. The estimated MPR can then be used to construct the NFD. Results show that these models can accurately estimate the NFD with limited probe vehicle and link traffic volume data. Accordingly, the models can be used in the field to estimate the NFD using readily available loop detector and probe vehicle data. The ideal locations for traffic volume data collection can also be proactively chosen to generate optimum estimation results. Since the models proposed here show no significant gains with an increased magnitude of collected data after a certain threshold, they will be helpful, particularly when large-scale data collection is not affordable or realistic.

Spatial Analysis, Market Penetration Rate, NFD, Sy↗
DOE OSTI2019

Constructing a Network Fundamental Diagram: Synthetic Origin–Destination Approach

The Network Fundamental Diagram (NFD) is significantly used in traffic monitoring and control. One obstacle to a wider application of NFDs in network control is the difficulty of obtaining data from all vehicles traveling in the network to construct an accurate NFD. One solution is to estimate the NFD using data from only a fraction of vehicles (i.e., probe vehicles), where the probe vehicle market penetration rate (MPR) needs to be estimated. A previous study conducted by the authors demonstrated that a distance or time weighted harmonic mean was needed to estimate the flow- and density-based MPRs, respectively using a pairing k-mean clustering approach. This paper introduces another approach that utilizes probe vehicle and observed link volume data to estimate the MPR. A heuristic model is proposed to identify the optimum locations from which to collect link traffic volume data for use in the MPR estimation. The estimated MPR can then be used to construct the NFD. Results show that these models can accurately estimate the NFD with limited probe vehicle and link traffic volume data. Accordingly, the models can be used in the field to estimate the NFD using readily available loop detector and probe vehicle data. The ideal locations for traffic volume data collection can also be proactively chosen to generate optimum estimation results. Since the models proposed here show no significant gains with an increased magnitude of collected data after a certain threshold, they will be helpful, particularly when large-scale data collection is not affordable or realistic.

42 ENGINEERING↗
DOE OSTI2024

Condition-Based Maintenance of a Circulating Water System of a Canadian Nuclear Power Plant using Machine Learning and Statistical Tools

Canada Deuterium Uranium pressurized-heavy-water reactors (PHWR) are a type of nuclear power plant that generate clean and reliable energy. The scope of this work is to automate data analysis methodologies to inform a condition-based maintenance strategy of a circulating water system (CWS) of a PHWR. The multiunit CWS provides a continuous supply of water to cool steam condensers, even during transient scenarios, thereby improving the thermal efficiency. This work aims to develop a machine learning (ML) based approach to detect anomalies in heterogeneous data of a CWS in a PHWR to help inform a predictive maintenance strategy. The heterogeneous data include textual and numeric time series data for a PHWR. Natural-language-processing (NLP)-based models are used to analyze textual data contained in work orders and operator logs and an event-timeseries correlation detection method is applied to assist anomalies diagnoses for CWS. An ML model Robust Linear Model (RLM) is also used to remove the seasonal variations in the system variable distributions based on distributions of environmental variables. A machine learning model, Density-Based Spatial Clustering of Applications with Noise (DBSCAN), trained on both original data and data without any seasonal variations will then be used to detect if an anomaly exists. Thus, by moving to an automated methodology to detect, classify, and forecast anomalies, the maintenance strategy would be based on component condition instead of a time-based schedule.

97 - MATHEMATICS AND COMPUTING↗