Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analysis cluster”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
NASA NTRS2012

Obtaining Accurate Change Detection Results from High-Resolution Satellite Sensors

Multi-date acquisitions of high-resolution imaging satellites (e.g. GeoEye and WorldView), can display local changes of current economic interest. However, their large data volume precludes effective manual analysis, requiring image co-registration followed by image-to-image change detection, preferably with minimal analyst attention. We have recently developed an automatic change detection procedure that minimizes false-positives. The processing steps include: (a) Conversion of both the pre- and post- images to reflectance values (this step is of critical importance when different sensors are involved); reflectance values can be either top-of-atmosphere units or have full aerosol optical depth calibration applied using bi-directional reflectance knowledge. (b) Panchromatic band image-to-image co-registration, using an orthorectified base reference image (e.g. Digital Orthophoto Quadrangle) and a digital elevation model; this step can be improved if a stereo-pair of images have been acquired on one of the image dates. (c) Pan-sharpening of the multispectral data to assure recognition of change objects at the highest resolution. (d) Characterization of multispectral data in the post-image ( i.e. the background) using unsupervised cluster analysis. (e) Band ratio selection in the post-image to separate surface materials of interest from the background. (f) Preparing a pre-to-post change image. (g) Identifying locations where change has occurred involving materials of interest.

multispectral↗
NASA NTRS1973

The applicability and effectiveness of cluster analysis

An insight into the characteristics which determine the performance of a clustering algorithm is presented. In order for the techniques which are examined to accurately cluster data, two conditions must be simultaneously satisfied. First the data must have a particular structure, and second the parameters chosen for the clustering algorithm must be correct. By examining the structure of the data from the Cl flight line, it is clear that no single set of parameters can be used to accurately cluster all the different crops. The effectiveness of either a noniterative or iterative clustering algorithm to accurately cluster data representative of the Cl flight line is questionable. Thus extensive a prior knowledge is required in order to use cluster analysis in its present form for applications like assisting in the definition of field boundaries and evaluating the homogeneity of a field. New or modified techniques are necessary for clustering to be a reliable tool.

Ingram, D. S.↗
DOE OSTI2022

Tracer-field cross-correlations with k -nearest neighbour distributions

ABSTRACT In astronomy and cosmology significant effort is devoted to characterizing and understanding spatial cross-correlations between points – e.g galaxy positions, high energy neutrino arrival directions, X-ray and AGN sources, and continuous fields – e.g. weak lensing meiand Cosmic Microwave Background maps. Recently, we introduced the k-nearest neighbour (kNN) formalism to better characterize the clustering of discrete (point) data sets. Here, we extend it to the point – field cross-correlations analysis. It combines kNN measurements of the point data set with measurements of the field smoothed at many scales. The resulting statistics are sensitive to all orders in the joint clustering of the points and the field. We demonstrate that this approach, unlike the 2-pt cross-correlation, can measure the statistical dependence of two data sets even when there are no linear (Gaussian) correlations between them. We further demonstrate that this framework is far more effective than the two point function in detecting cross-correlations when the continuous field is contaminated by high levels of noise. For a particularly high level of noise, the cross-correlation between haloes and the underlying matter field in a cosmological simulation, between 10 h−1 Mpc and 30 h−1 Mpc, is detected at >5σ significance using the technique presented here, when the two-point cross-correlation significance is ∼1σ. Finally, we show that kNN cross-correlations of haloes and the matter field can be well modelled on quasi-linear scales using the Hybrid Effective Field Theory (HEFT) framework, with the same set of bias parameters as are used for 2-pt cross-correlations. The substantial improvement in the statistical power of detecting cross-correlations using this method makes it a promising tool for various cosmological applications.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Exploring the stellar populations of backsplash galaxies

Backsplash galaxies are those that traverse and overshoot cluster cores as they fall into these structures. They are affected by environment, and should stand out in contrast to the infalling population. We target galaxies in the vicinity of clusters (R≳R 200 ) and select a sample in projected phase space (PPS), from the compilation of Sampaio et al. based on SDSS data. We present a statistical analysis, comparing two regions in PPS, with the same projected distance to the cluster but different velocity. The analysis relies on the presence of variations in the stellar population content of backsplash galaxies. We find a lower limit in the fractional contribution of ∼5 per cent with respect to the general sample of infalling galaxies at similar group-centric distance when using single line strength analysis, or ∼15-30 per cent when adopting bivariate distributions. The stellar populations show a subtle but significant difference towards older ages, and a higher fraction of quiescent galaxies. We also compare this set with a general field sample, where a substantially larger difference in galaxy properties is found, with the field sample being consistently younger, metal poorer and with a lower fraction of quiescent galaxies. Noting that our ‘cluster’ sample is located outside of the virial radius, we expect this difference to be caused by pre-processing of the infalling galaxies in the overall higher density regions.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

SCULPT (Supervised Clustering and Uncovering Latent Patterns with Training) v1

SCULPT (Supervised Clustering and Uncovering Latent Patterns with Training) is a comprehensive data visualization and analysis application focused on working with COLTRIMS (COLd Target Recoil Ion Momentum Spectroscopy) data, which is used in atomic and molecular physics experiments. The application offers several powerful features: - Data uploading and processing capabilities for COLTRIMS files - Multiple visualization methods using UMAP (Uniform Manifold Approximation and Projection) for dimensionality reduction - Interactive selection of data points across multiple views - Feature engineering through various methods: - Manual feature selection from calculated physics parameters - Deep autoencoder for dimension reduction - Genetic programming for discovering meaningful features - Mutual information-based feature selection - Multiple clustering approaches (DBSCAN, KMeans, Agglomerative) - Quality metrics for evaluating clustering results - Export capabilities for selections and generated features

Daoud, Hazem [Lawrence Berkeley National Laborator↗
NASA NTRS1986

Kinematic evidence of satellite galaxy populations in the potential wells of first-ranked cluster galaxies

The velocities of 38 centrally positioned galaxies (r much less than 100 kpc) were measured relative to the velocity of the first-ranked galaxy in 14 rich clusters. Analysis of the velocity distribution function of this sample and of previous data shows that the population cannot be fit by a single Gaussian. An adequate fit is obtained if 60 percent of the objects lie in a Gaussian with sigma = 250 km/s and the remainder in a population with sigma = 1400 km/s. All previous data sets are individually consistent with this conclusion. This suggests that there is a bound population of galaxies in the potential well of the central galaxy in addition to the normal population of the cluster core. This is taken as supporting evidence for the galactic cannibalism model of cD galaxy formation.

Cowie, L. L.↗
DOE OSTI2020

Phase identification using co‐association matrix ensemble clustering

Calibrating distribution system models to aid in the accuracy of simulations such as hosting capacity analysis is increasingly important in the pursuit of the goal of integrating more distributed energy resources. The recent availability of smart meter data is enabling the use of machine learning tools to automatically achieve model calibration tasks. This research focuses on applying machine learning to the phase identification task, using a co‐association matrix‐based, ensemble spectral clustering approach. The proposed method leverages voltage time series from smart meters and does not require existing or accurate phase labels. This work demonstrates the success of the proposed method on both synthetic and real data, surpassing the accuracy of other phase identification research.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Validation of the DESI-DR1 3x2-pt analysis: scale cut and shear ratio tests

Combined survey analyses of galaxy clustering and weak gravitational lensing (3x2-pt studies) will allow new and accurate tests of the standard cosmological model. However, careful validation is necessary to ensure that these cosmological constraints are not biased by uncertainties associated with the modelling of astrophysical or systematic effects. In this study we validate the combined 3x2-pt analysis of the Dark Energy Spectroscopic Instrument Data Release 1 (DESI-DR1) spectroscopic galaxy clustering and overlapping weak lensing datasets from the Kilo-Degree Survey (KiDS), the Dark Energy Survey (DES), and the Hyper-Suprime-Cam Survey (HSC). By propagating the modelling uncertainties associated with the non-linear matter power spectrum, non-linear galaxy bias and baryon feedback, we design scale cuts to ensure that measurements of the matter density and the amplitude of the matter power spectrum are biased by less than 30% of the statistical error. We also test the internal consistency of the data and weak lensing systematics by performing new measurements of the lensing shear ratio. We demonstrate that the DESI-DR1 shear ratios can be successfully fit by the same model used to describe cosmic shear correlations, and analyse the additional information that can be extracted about the source redshift distributions and intrinsic alignment parameters. This study serves as crucial preparation for the upcoming cosmological parameter analysis of these datasets.

Emas, N. [Swinburne U., Ctr. Astrophys. Supercompu↗
DOE OSTI2022

An overview of the operation architectures and energy management system for multiple microgrid clusters

The emerging novel energy infrastructures, such as energy communities, smart building-based microgrids, electric vehicles enabled mobile energy storage units raise the requirements for a more interconnective and interoperable energy system. It leads to a transition from simple and isolated microgrids to relatively large-scale and complex interconnected microgrid systems named multi-microgrid clusters. In order to efficiently, optimally, and flexibly control multi-microgrid clusters, cross-disciplinary technologies such as power electronics, control theory, optimization algorithms, information and communication technologies, cyber-physical, and big-data analysis are needed. This paper introduces an overview of the relevant aspects for multi-microgrids, including the outstanding features, architectures, typical applications, existing control mechanisms, as well as the challenges.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS1975

Computer-aided analysis of Skylab multispectral scanner data in mountainous terrain for land use, forestry, water resource, and geologic applications

The author has identified the following significant results. One of the most significant results of this Skylab research involved the geometric correction and overlay of the Skylab multispectral scanner data with the LANDSAT multispectral scanner data, and also with a set of topographic data, including elevation, slope, and aspect. The Skylab S192 multispectral scanner data had distinct differences in noise level of the data in the various wavelength bands. Results of the temporal evaluation of the SL-2 and SL-3 photography were found to be particularly important for proper interpretation of the computer-aided analysis of the SL-2 and SL-3 multispectral scanner data. There was a quality problem involving the ringing effect introduced by digital filtering. The modified clustering technique was found valuable when working with multispectral scanner data involving many wavelength bands and covering large geographic areas. Analysis of the SL-2 scanner data involved classification of major cover types and also forest cover types. Comparison of the results obtained wth Skylab MSS data and LANDSAT MSS data indicated that the improved spectral resolution of the Skylab scanner system enabled a higher classification accuracy to be obtained for forest cover types, although the classification performance for major cover types was not significantly different.

Hoffer, R. M.↗
NASA NTRS1994

An IRAS Hires study of low mass star formation in the Taurus molecular ring

The Taurus molecular cloud supposedly has no star clusters but only isolated star formation. However, the Infrared Astronomical Satellite (IRAS) shows us that a small star cluster is currently forming in Taurus. Most of the sources are deeply embedded and are probably low-mass protostars. We use High Resolution (HiRes) images of the IRAS data from the Infrared Processing and Analysis Center (IPAC) to look for additional infrared members of the cluster. We also investigate the question of whether the infrared emission matches predictions for protostellar sources by examining whether the dust emission is resolved on scales of one arcminute (approx. 10(exp 17) cm). With the exception of a luminous visible star, HD 29647, we find that the sources L1527, TMC1A, TMC1, TMC1C, tMR1, and IC2087 are unresolved in the HiRes images at 60 microns. Further analysis of IC2087 shows that it is unresolved at all four IRAS wavelengths.

Terebey, Susan↗
NASA NTRS2010

The Membership and Distance of the Open Cluster Collinder 419

The young open cluster Collinder 419 surrounds the massive O star, HD 193322, that is itself a remarkable multiple star system containing at least four components. Here we present a discussion of the cluster distance based upon new spectral classifications of the brighter members, UBV photometry, and an analysis of astrometric and photometric data from the third U. S. Naval Observatory CCD Astrograph Catalog and Two Micron All Sky Survey Catalog. We determine an average cluster reddening of E(B - V) = 0.37 +/-.05 mag and a cluster distance of 741 plus or minus 36 pc. The cluster probably contains some very young stars that may include a reddened M3 III star, IRAS 20161+4035.

COLLINDER↗
DOE OSTI2024

Topological Interpretability for Deep Learning

With the growing adoption of AI-based systems across everyday life, the need to understand their decision-making mechanisms is correspondingly increasing. The level at which we can trust the statistical inferences made from AI-based decision systems is an increasing concern, especially in high-risk systems such as criminal justice or medical diagnosis, where incorrect inferences may have tragic consequences. Despite their successes in providing solutions to problems involving real-world data, deep learning (DL) models cannot quantify the certainty of their predictions. These models are frequently quite confident, even when their solutions are incorrect. This work presents a method to infer prominent features in two DL classification models trained on clinical and non-clinical text by employing techniques from topological and geometric data analysis. We create a graph of a model's feature space and cluster the inputs into the graph's vertices by the similarity of features and prediction statistics. We then extract subgraphs demonstrating high-predictive accuracy for a given label. These subgraphs contain a wealth of information about features that the DL model has recognized as relevant to its decisions. We infer these features for a given label using a distance metric between probability measures, and demonstrate the stability of our method compared to the LIME and SHAP interpretability methods. This work establishes that we may gain insights into the decision mechanism of a DL model. This method allows us to ascertain if the model is making its decisions based on information germane to the problem or identifies extraneous patterns within the data.

Spannaus, Adam↗
NASA NTRS1975

Air pollution source identification

The techniques available for source identification are reviewed: remote sensing, injected tracers, and pollutants themselves as tracers. The use of the large number of trace elements in the ambient airborne particulate matter as a practical means of identifying sources is discussed. Trace constituents are determined by sensitive, inexpensive, nondestructive, multielement analytical methods such as instrumental neutron activation and charged particle X-ray fluorescence. The application to a large data set of pairwise correlation, the more advanced pattern recognition-cluster analysis approach with and without training sets, enrichment factors, and pollutant concentration rose displays for each element is described. It is shown that elemental constituents are related to specific source types: earth crustal, automotive, metallurgical, and more specific industries. A field-ready source identification system based on time and wind direction resolved sampling is described.

Fordyce, J. S.↗
NASA NTRS1983

Sea ice effective microwave emissivities from satellite passive microwave and infrared observations

Near-simultaneous images from the temperature-humidity IR radiometer and dual-polarization scanning multichannel microwave radiometer of the Nimbus 7 satellite are used to investigate microwave sea ice emissivities on a global scale. Emissivities in several Arctic region study areas are found to be approximately constant during a nine-month pereiod covering the fall, winter and spring months, in the cases of both first-year and multiyear ice. During the onset of summer, emissivity increases of about 30 percent are observed at 37 GHz in multiyear ice. A multichannel cluster analysis over very large study areas during winter indicates considerable variability in emissivities of consolidated ice clusters at 37 GHz, and only 1/3 as much variability at 18 GHz. If the variability within each cluster is quantified and taken into account by means of multispectral analysis, data on ice thickness and surface characteristics may also be obtained.

Comiso, J. C.↗
NASA NTRS1993

An information model for use in software management estimation and prediction

This paper describes the use of cluster analysis for determining the information model within collected software engineering development data at the NASA/GSFC Software Engineering Laboratory. We describe the Software Management Environment tool that allows managers to predict development attributes during early phases of a software project and the modifications we propose to allow it to develop dynamic models for better predictions of these attributes.

Li, Ningda R.↗
NASA NTRS2009

Use of UV Sources for Detection and Identification of Explosives

Measurement of Raman and native fluorescence emission using ultraviolet (UV) sources (<400 nm) on targeted materials is suitable for both sensitive detection and accurate identification of explosive materials. When the UV emission data are analyzed using a combination of Principal Component Analysis (PCA) and cluster analysis, chemicals and biological samples can be differentiated based on the geometric arrangement of molecules, the number of repeating aromatic rings, associated functional groups (nitrogen, sulfur, hydroxyl, and methyl), microbial life cycles (spores vs. vegetative cells), and the number of conjugated bonds. Explosive materials can be separated from one another as well as from a range of possible background materials, which includes microbes, car doors, motor oil, and fingerprints on car doors, etc. Many explosives are comprised of similar atomic constituents found in potential background samples such as fingerprint oils/skin, motor oil, and soil. This technique is sensitive to chemical bonds between the elements that lead to the discriminating separability between backgrounds and explosive materials.

Hug, William↗
DOE OSTI2025

Examining Clustered MCSs and Their Precipitation Significance Over Global Land MCS Hotspots

Multiple independent mesoscale convective systems (MCSs) can occur closely in space and time, subjecting common geographic regions to multiple precipitation events over short periods. Motivated by an earlier study highlighting significant hydrological impacts of clustered MCSs in the US, we extend the analysis to seven global continental MCS hotspots using a 20‐year global MCS data set. Our findings reveal that (a) 40%–80% of MCSs occur in clusters, depending on the region; (b) clustered MCSs exhibit larger rainfall areas and higher mean areal rainfall, with the highest values observed in Argentina and India; and (c) clustered MCSs contribute increasing fractions to more extreme 24‐ and 72‐hr precipitation events across all regions. Our results underscore the critical role of clustered MCSs in driving hydrological extremes over global land regions and highlight the need to better understand how their formation mechanisms differ from non‐clustered events across the globe.

Hu, Huancui [Pacific Northwest National Laboratory↗