Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analysis cluster”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

GeoCricket

SAND2025-12229O Geospatial Critical Infrastructure and Census Data Stockpile Tool (GeoCricket) is a set of functions that collect critical infrastructure and census data for use in the Resilient Node Cluster Analysis Tool (ReNCAT) and Quantum Geographic Information System Social Burden Calculator. It can also act to inform other place-based work. The code queries public-facing Representational State Transfer (REST) servers to collect geospatial data related to a specific area. It then exports that data as standard geographic information system file types or as a .csv file. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Haines, John↗
DOE OSTI2024

Fast mass spectrometry search and clustering of untargeted metabolomics data

The throughput of mass spectrometers and the amount of publicly available metabolomics data are growing rapidly, but analysis tools such as molecular networking and Mass Spectrometry Search Tool do not scale to searching and clustering billions of mass spectral data in metabolomics repositories. To address this limitation, we designed MASST+ and Networking+, which can process datasets that are up to three orders of magnitude larger than those processed by state-of-the-art tools.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Unsupervised atomic data mining via multi-kernel graph autoencoders for machine learning force fields

Constructing a chemically diverse dataset while avoiding sampling bias is critical to training efficient and generalizable force fields. However, in computational chemistry and materials science, many common dataset generation techniques are prone to oversampling regions of the potential energy surface. Furthermore, these regions can be difficult to identify and isolate from each other or may not align well with human intuition, making it challenging to systematically remove bias in the dataset. While traditional clustering and pruning (down-sampling) approaches can be useful for this, they can often lead to information loss or a failure to properly identify distinct regions of the potential energy surface due to difficulties associated with the high dimensionality of atomic descriptors. In this work, we introduce the Multi-kernel Edge Attention-based Graph Autoencoder (MEAGraph) model, an unsupervised approach for analyzing atomic datasets. MEAGraph combines multiple linear kernel transformations with attention-based message passing to capture geometric sensitivity and enable effective dataset pruning without relying on labels or extensive training. Demonstrated applications on niobium, tantalum, and iron datasets show that MEAGraph efficiently groups similar atomic environments, allowing for the use of basic pruning techniques for removing sampling bias. This approach provides an effective method for representation learning and clustering that can be used for data analysis, outlier detection, and dataset optimization.

Materials science↗
DOE OSTI2021

DeepSZ: identification of Sunyaev–Zel’dovich galaxy clusters using deep learning

Galaxy clusters identified via the Sunyaev–Zel’dovich (SZ) effect are a key ingredient in multiwavelength cluster cosmology. In this paper, we present and compare three methods of cluster identification: the standard matched filter (MF) method in SZ cluster finding, a convolutional neural networks (CNN), and a ‘combined’ identifier. We apply the methods to simulated millimeter maps for several observing frequencies for a survey similar to SPT-3G, the third-generation camera for the South Pole Telescope. The MF requires image pre-processing to remove point sources and a model for the noise, while the CNN requires very little pre-processing of images. Additionally, the CNN requires tuning of hyperparameters in the model and takes cut-out images of the sky as input, identifying the cut-out as cluster-containing or not. We compare differences in purity and completeness. The MF signal-to-noise ratio depends on both mass and redshift. Our CNN, trained for a given mass threshold, captures a different set of clusters than the MF, some with signal-to-noise-ratio below the MF detection threshold. However, the CNN tends to mis-classify cut-out whose clusters are located near the edge of the cut-out, which can be mitigated with staggered cut-out. We leverage the complementarity of the two methods, combining the scores from each method for identification. The purity and completeness are both 0.61 for MF, and 0.59 and 0.61 for CNN. The combined method yields 0.60 and 0.77, a significant increase for completeness with a modest decrease in purity. We advocate for combined methods that increase the confidence of many low signal-to-noise clusters.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Towards quantifying the impact of triaxiality on optical signatures of galaxy clusters: weak lensing and galaxy distributions

ABSTRACT We present observational evidence of the impact of triaxiality on radial profiles that extend to 40 Mpc from galaxy cluster centres in optical measurements. We perform a stacked profile analysis from a sample of thousands of nearly relaxed galaxy clusters from public data releases of the Dark Energy Survey and the Dark Energy Camera Legacy Survey. Using the central galaxy elliptical orientation angle as a proxy for galaxy cluster orientation, we measure cluster weak lensing and excess galaxy density axis-aligned profiles, extracted along the central galaxy’s major or minor axes on the plane of the sky. Our measurements show a ≳ 2σ–3σ difference per radial bin between the normalized axis-aligned profiles. The profile difference between each axis-aligned profile and the azimuthally averaged profile ($\sim \pm 10\,\rm per\ cent-20~{{\ \rm per\ cent}}$ along major/minor axis) appears inside the clusters (∼0.4 Mpc) and extends to the large-scale structure regime (∼10–20 Mpc). The magnitude of the difference appears to be relatively insensitive to cluster richness and redshift, and extends further out in the weak lensing surface mass density than in the galaxy overdensity. Looking forward, this measurement can easily be applied to other observational or simulation data sets and can inform the systematics in cluster mass modelling related to triaxiality. We expect imminent upcoming wide-area deep surveys, such as the Vera C. Rubin Observatory’s Legacy Survey of Space and Time, to improve our quantification of optical signatures of cluster triaxiality.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Using leaf and stomatal traits to predict biomass production and water use efficiency in Populus

Climate change is reshaping ecosystems, driving plants to adapt through leaf-trait plasticity that reflects strategies for growth and water use. Predicting biomass production and intrinsic water use efficiency (iWUE) remains challenging because of genetic, taxonomic, and environmental variability. Here, we used eastern cottonwood and Populus hybrids as a model system to test whether easily measurable leaf traits can serve as reliable predictors of performance, and whether adding stomatal and biochemical traits improves predictive power. Across two field sites in Mississippi, leaf mass per area (LMA), biomass production, iWUE, leaf area, and foliar nitrogen ( N %) differed significantly among taxa and sites, while other traits were conserved. Factorial analysis of mixed data (FAMD) revealed distinct clustering of taxa and sites, indicating coordinated variation among leaf and stomatal traits. Pairwise correlations highlighted fundamental trade-offs, with biomass positively related to LMA and petiole length but negatively associated with iWUE, N %, and carbon isotopic ratios (δ 13 C). Leaf temperature and leaf angle varied among taxa and were significantly correlated with LMA and petiole length, suggesting mechanisms of heat dissipation and leaf movability that link simple traits to gas exchange and productivity. Weighted multiple linear regression models explained 80%–91% of variation in biomass production and iWUE. Models using only LMA, petiole length, and stomatal metrics performed nearly as well as those incorporating N %, and δ 13 C, with complex traits adding approximately 10% explanatory power. These results demonstrate that simple morphological traits capture integrated functional trade-offs, while complex traits refine predictions. This tiered approach provides an efficient framework for selecting high-yielding, water-efficient genotypes of Populus and other hardwood species, offering practical pathways to enhance carbon uptake and iWUE under climate change.

biomass production↗
DOE OSTI2021

Combined EDS and EBSD dataset from TiB2 ceramic material

This is supplemental information to a paper to be submitted, tentatively titled Cluster analysis of combined EDS and EBSD data to solve ambiguous phase identifications. Data was acquired from a TiB2 ceramic provided by Missouri University of Science and Technology. Simultaneous EDS and EBSD were acquired on a Tescan MIRA3 GMH field-emission SEM equipped with Oxford Instruments Symmetry CMOS-based EBSD detector and Oxford Instruments UltimMax 170 mm2 silicon-drift detector EDS. Data was acquired using Oxford Instruments AZtec 4.0 software. Data was acquired at 20 keV, 70° tilt, and ≈1 nA probe current. An 80×60 pixel, 40×30 μm map (500 nm pixel pitch) was acquired. EBSD indexing was performed using TiB2, space group 191 P6/mmm, and TiC, space group 225 Fm \bar{3}m, crystal cards.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Within and Among Fish Species Differences in Simulated Turbine Blade Strike Mortality: Limits on the Use of Surrogacy for Untested Species

Use of surrogacy remains a useful method for prioritizing research on representatives of at-risk groups of fishes, yet quantifiable evidence in support of its use is generally not available. Blade strike impact represents one of the most traumatic stressors experienced by fish during non-volitional movements through hydropower turbines. Here, we use data generated from laboratory trials on blade strike impact experiments to directly test use of surrogacy for salmonid and clupeid fishes. Results of logistic regression indicated that a -taxonomic (genus) variable was not a significant predictor of mortality among large rainbow trout and brook trout. Similar results were found for young-of-the-year shad species, but genus-level taxonomy was a significant predictor of mortality while species was not. Multivariate analysis of morphometric data showed that shad clustered together based on similarities in fish shape which was also closely associated with genus. Logistic regression including size as a major covariate suggested total fish length was not a significant predictor of mortality, yet dose–response data suggest differential susceptibility to lower strike velocities. We suggest that use of surrogacy among species is justifiable but should be avoided within a species since the effects of size remain unclear.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS2003

Gyrophase-bunched Electrons: Cluster Observations and Simulations

The interaction of the solar wind with the Earth's bow shock is responsible for a number of phenomena both upstream and downstream. One of the least understood and studied of these is the generation of gyrophase-bunched electrons. We will describe initial work searching for and analyzing such events in (Plasma Electron And Current Experiment (PEACE) data from CLUSTER. Plasma simulations will complement the data analysis. Recent analyses suggest that gyrophase-bunched electrons are present rather frequently in the upstream region, due either to energization in the reflection off the shock front or, more likely, to phase trapping in locally produced whistler wave fields.

Gurgiolo, C.↗
NASA NTRS2019

An Evolutionary System of Mineralogy: Proposal for A Classification of Planetary Materials Based on Natural Kind Clustering

Minerals reveal the nature of the co-evolving geosphere and biosphere through billions of years of Earth history. Mineral classification systems have the potential to elucidate this rich evolutionary story; however, the present mineral taxonomy, based as it is on idealized major element chemistry and crystal structure, lacks a temporal aspect, and thus cannot reflect planetary evolution. A complementary evolutionary system of mineralogy based on the quantitative recognition of “natural kind clustering” for a wide range of condensed planetary materials with different paragenetic origins has the potential to amplify, though not supersede, the present classification system.

Philosophy of mineralogy↗
DOE OSTI2024

Leveraging graph clustering techniques for cyber‐physical system analysis to enhance disturbance characterisation

Abstract Cyber‐physical systems have behaviour that crosses domain boundaries during events such as planned operational changes and malicious disturbances. Traditionally, the cyber and physical systems are monitored separately and use very different toolsets and analysis paradigms. The security and privacy of these cyber‐physical systems requires improved understanding of the combined cyber‐physical system behaviour and methods for holistic analysis. Therefore, the authors propose leveraging clustering techniques on cyber‐physical data from smart grid systems to analyse differences and similarities in behaviour during cyber‐, physical‐, and cyber‐physical disturbances. Since clustering methods are commonly used in data science to examine statistical similarities in order to sort large datasets, these algorithms can assist in identifying useful relationships in cyber‐physical systems. Through this analysis, deeper insights can be shared with decision‐makers on what cyber and physical components are strongly or weakly linked, what cyber‐physical pathways are most traversed, and the criticality of certain cyber‐physical nodes or edges. This paper presents several types of clustering methods for cyber‐physical graphs of smart grid systems and their application in assessing different types of disturbances for informing cyber‐physical situational awareness. The collection of these clustering techniques provide a foundational basis for cyber‐physical graph interdependency analysis.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Distributed non-negative matrix factorization with determination of the number of latent features

The holistic analysis and understanding of the latent (that is, not directly observable) variables and patterns buried in large datasets is crucial for data-driven science, decision making and emergency response. Such exploratory analyses require devising unsupervised learning methods for data mining and extraction of the latent features, and non-negative matrix factorization (NMF) is one of the prominent such methods. NMF is based on compute-intense non-convex constrained minimization, which, for large datasets requires fast and distributed algorithms. However, current parallel implementations of NMF fail to estimate the number of latent features. In practice, identifying these features is both difficult and significant for pattern recognition and latent feature analysis, especially for large dense matrices. Here, we introduce a distributed NMF algorithm coupled with distributed custom clustering followed by a stability analysis on dense data, which we call DnMFk, to determine the number of latent variables. The results on synthetic data and the classical Swimmer data set demonstrate the accuracy of model determination while scaling nearly linearly across multiple processors for large data. Further, we employ DnMFk to determine the number of hidden features from a terabyte matrix.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Cluster-Graph Fingerprinting: A Framework for Quantitative Analysis of Machine-Learned Interatomic Model Training and Simulation Data

Machine-learned interatomic models represent a significant advancement in simulation methods, extending the predictive ability of first-principles methods to previously inaccessible length and time scales. However, the data-driven nature of these models can lead to difficult-to-detect errors that can compromise prediction accuracy. To address this challenge, we introduce a novel fingerprinting approach based on the Chebyshev Interaction Model for Efficient Simulation (ChIMES) ML-IAM graph-based descriptor. Our strategy enables efficient and statistically rigorous analysis of system configurations used in ML-IAM training and those generated by their application, e.g., in molecular dynamics simulations. We demonstrate that these fingerprints can effectively assess novelty of a configuration relative to an existing data set and determine dissimilarity among individual configurations, which are two key tasks in workflows for active learning-based ML-IAM training, data set curation, and on-the-fly uncertainty quantification.

36 MATERIALS SCIENCE↗
DOE OSTI2023

A new step forward in realistic cluster lens mass modelling: analysis of Hubble Frontier Field Cluster Abell S1063 from joint lensing, X-ray, and galaxy kinematics data

We present a new method to simultaneously and self-consistently model the mass distribution of galaxy clusters that combines constraints from strong lensing features, X-ray emission, and galaxy kinematics measurements. We are able to successfully decompose clusters into their collisionless and collisional mass components thanks to the X-ray surface brightness, as well as use the dynamics of cluster members, to obtain more accurate masses exploiting the fundamental plane of elliptical galaxies. Knowledge from all observables is included through a consistent Bayesian approach in the likelihood or in physically motivated priors. We apply this method to the galaxy cluster Abell S1063 and produce a mass model that we publicly release with this paper. The resulting mass distribution presents different ellipticities for the intra-cluster gas and the other large-scale mass components as well as deviation from elliptical symmetry in the main halo. We assess the ability of our method to recover the masses of the different elements of the cluster using a mock cluster based on a simplified version of our Abell S1063 model. Thanks to the wealth of mutliwavelength information provided by the mass model and the detected X-ray emission, we also found evidence for an ongoing merger event with gas sloshing from a smaller infalling structure into the main cluster. In agreement with previous findings, the total mass, gas profile, and gas mass fraction are all consistent with small deviations from the hydrostatic equilibrium. This new mass model for Abell S1063 is publicly available, as the lenstool extension used to construct it.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

HFTS-2 Completions Design and State-of-the-Art Diagnostics Results

Various completion schemes were tested as part of the Hydraulic Fracture Test Site-2 (HFTS-2) project. The wells were instrumented with permanent fiber optic (FO) cable, and unique near-wellbore and far-field region surveys were acquired to evaluate spatial and temporal hydraulic fracture characteristics. The state-of-the-art diagnostics included substantial monitoring of both the well stimulation and longer-term production performance. The objective was to evaluate and improve stimulation distribution effectiveness (SDE) for different completion designs based on the diagnostics results. A hydraulic fracturing (HF) profile (i.e., proppant/fluid allocation among clusters) was obtained using near-wellbore Distributed Acoustic Sensing (DAS) data acquired during stimulation. Statistical analysis provided a quantitative assessment of SDE for the different completion designs. A novel workflow was developed to assess time-lapse fracture property changes at the cluster and stage levels based on Distributed Strain Sensing (DSS) data acquired during the production phase. These time-lapse fracture property changes were compared with the HF profile. Based on the statistical analysis, Rate Per Cluster (RPC) during proppant slurry placement appears to be a primary completion design variable, rather than the typical Rate Per Perf (RPP). If RPC was not maintained at a certain level, the likelihood of uneven distribution increased dramatically. The stage configurations that created low RPC while maintaining high RPP did not show improved SDE. The strain change results based on DSS data during the production phase indicated near-wellbore fracture property changes (e.g., aperture changes during well shut-in and flow periods) and aligned well with near-wellbore DAS signals acquired during stimulation. More importantly, fracture property changes based on DSS data acquired during two tests over a 7-month period show high consistency and good alignment with the near-wellbore HF profile. This workflow quantitatively evaluates SDE for different completion designs using diagnostic results and could help optimize completion strategy for future development projects. Here, the analysis and interpretation of results demonstrate the technical feasibility of using permanent fiber optic cable for stimulation and production monitoring and indic

58 GEOSCIENCES↗
NASA NTRS2005

Testing the Archivas Cluster (Arc) for Ozone Monitoring Instrument (OMI) Scientific Data Storage

The Ozone Monitoring Instrument (OMI) launched on NASA's Aura Spacecraft, the third of the major platforms of the EOS program on July 15,2004. In addition to the long term archive and distribution of the data from OM1 through the Goddard Earth Science Distributed Active Archive Center (GESDAAC), we are evaluating other archive mechanisms that can archive the data in a more immediately available method where it can be used for futher data production and analysis. In 2004, Archivas, Inc. was selected by NASA s Small Business Innovative Research (SBIR) program for the development of their Archivas Cluster (ArC) product. Arc is an online disk based system utilizing self-management and automation on a Linux cluster. Its goal is to produce a low cost solution coupled with the ease of management. The OM1 project is an application partner of the SBIR program, and has deployed a small cluster (5TB) based on the beta Archwas software. We performed extensive testing of the unit using production OM1 data since launch. In 2005, Archivas, Inc. was funded in SBIR Phase II for further development, which will include testing scalability with the deployment of a larger (35TB) cluster at Goddard. We plan to include Arc in the OM1 Team Leader Computing Facility (TLCF) hosting OM1 data for direct access and analysis by the OMI Science Team. This presentation will include a brief technical description of the Archivas Cluster, a summary of the SBIR Phase I beta testing results, and an overview of the OMI ground data processing architecture including its interaction with the Phase II Archivas Cluster and hosting of OMI data for the scientists.

Tilmes, Curt↗
NASA NTRS2003

Cluster Masses Derived from X-ray and Sunyaev-Zeldovich Effect Measurements

We infer the gas mass and total gravitational mass of 11 clusters using two different methods; analysis of X-ray data from the Chandra X-ray Observatory and analysis of centimeter-wave Sunyaev-Zel'dovich Effect (SZE) data from the BIMA and OVRO interferometers. This flux-limited sample of clusters from the BCS cluster catalogue was chosen so as to be well above the surface brightness limit of the ROSAT All Sky Survey; this is therefore an orientation unbiased sample. The gas mass fraction, f_g, is calculated for each cluster using both X-ray and SZE data, and the results are compared at a fiducial radius of r_500. Comparison of the X-ray and SZE results for this orientation unbiased sample allows us to constrain cluster systematics, such as clumping of the intracluster medium. We derive an upper limit on Omega_M assuming that the mass composition of clusters within r_500 reflects the universal mass composition Omega_M h_100 is greater than Omega _B / f-g. We also demonstrate how the mean f_g derived from the sample can be used to estimate the masses of clusters discovered by upcoming deep SZE surveys.

Laroque, S.↗