SEARCH · Engineering Papers

Results for “Spectral clustering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

All sources NASA NTRS DOE OSTI

NASA NTRS1973

Unsupervised spatial clustering with spectral discrimination

The development of a computer program is reported for extracting features from remotely sensed data presented in digital image form. This computer program requires no human supervision or prejudgment and operates unassisted on the raw digital data. A condensed general background is included on remote sensing of earth features and a short synopsis on some of the most commonly used types of feature extraction techniques. Results obtained from the unsupervised feature extraction computer program along with a description and listing of the computer program are presented.

Jayroe, R. R., Jr.↗

NASA NTRS1985

Preliminary Comparisons of the Information Content and Utility of TM Versus MSS Data

Some preliminary indications were provided as to the relative merits of actual TM data versus MSS data for land cover mapping related applications. Three analyses were designed which had sensitivity to the differences in spectral, spatial and radiometric parameters between the TM and MSS. In the water body analysis, a primarily spatially related test, the detectability of small uniform targets was examined. The principal components analysis, an examination of the inherent dimensionality of the data, was more spectrally and radiometrically related. The spectral clustering analysis, also heavily spectrally and radiometrically influenced, provided information on the types of targets separable on TM versus MSS data. These analyses were to be conducted with simultaneously collected LANDSAT-4 complete TM (7 band) and MSS (4 band) data. In actuality, 4-band TM data, and archived LANDSAT-2 MSS data of the same area were used.

Markham, B. L.↗

DOE OSTI2023

An interlaboratory comparison of mid-infrared spectra acquisition: Instruments and procedures matter

Diffuse reflectance spectroscopy has been extensively employed to deliver timely and cost-effective predictions of a number of soil properties. However, although several soil spectral laboratories have been established worldwide, the distinct characteristics of instruments and operations still hamper further integration and interoperability across mid-infrared (MIR) soil spectral libraries. In this study, we conducted a large-scale ring trial experiment to understand the lab-to-lab variability of multiple MIR instruments. By developing a systematic evaluation of different mathematical treatments with modeling algorithms, including regular preprocessing and spectral standardization, we quantified and evaluated instruments' dissimilarity and how this impacts internal and shared model performance. We found that all instruments delivered good predictions when calibrated internally using the same instruments' characteristics and standard operating procedures by solely relying on regular spectral preprocessing that accounts for light scattering and multiplicative/additive effects, e.g., using standard normal variate (SNV). When performing model transfer from a large public library (the USDA NSSCKSSL MIR library) to secondary instruments, good performance was also achieved by regular preprocessing (e. g., SNV) if both instruments shared the same manufacturer. However, significant differences between the KSSL MIR library and contrasting ring trial instruments responses were evident and confirmed by a semi-unsupervised spectral clustering. For heavily contrasting setups, spectral standardization was necessary before transferring prediction models. Non-linear model types like Cubist and memory-based learning delivered more precise estimates because they seemed to be less sensitive to spectral variations than global partial least square regression. In summary, the results from this study can assist new laboratories in building spectroscopy capacity utilizing existing MIR spectral libraries and support the recent global efforts to make soil spectroscopy universally accessible with centralized or shared operating procedures.

58 GEOSCIENCES↗

NASA NTRS2019

ASCot, the NASA Analogy Software Cost Tool Suite: expanding our estimation horizons

The NASA Analogy Software Costing Tool Suite (ASCoT) consists of a cluster-based analogy estimator for estimating software development effort, a K-Nearest Neighbors (KNN) analogy estimator for estimating effort and delivered lines of code, a simple regression-based cost estimating relationship (CER) model that estimates cost in dollars, and a probabilistic version of COCOMO II. In this paper we document the analogy algorithms as well as summarize the results of the performance of the KNN and the principle components (PCA) cluster analogy models. KNN performance is assessed by varying the number of inputs and number of neighbors. Four different clustering methods: K-means, Spectral Clustering, Hierarchical Clustering, and Principle Components Analysis (PCA), and their respective evaluation criterion are described in detail. The comparative performance of all four estimation models is assessed using magnitude of relative error (MRE) measurements.

Menzies, Tim↗

NASA NTRS2003

Hierarchical Image Segmentation of Remotely Sensed Data using Massively Parallel GNU-LINUX Software

A hierarchical set of image segmentations is a set of several image segmentations of the same image at different levels of detail in which the segmentations at coarser levels of detail can be produced from simple merges of regions at finer levels of detail. In [1], Tilton, et a1 describes an approach for producing hierarchical segmentations (called HSEG) and gave a progress report on exploiting these hierarchical segmentations for image information mining. The HSEG algorithm is a hybrid of region growing and constrained spectral clustering that produces a hierarchical set of image segmentations based on detected convergence points. In the main, HSEG employs the hierarchical stepwise optimization (HSWO) approach to region growing, which was described as early as 1989 by Beaulieu and Goldberg. The HSWO approach seeks to produce segmentations that are more optimized than those produced by more classic approaches to region growing (e.g. Horowitz and T. Pavlidis, [3]). In addition, HSEG optionally interjects between HSWO region growing iterations, merges between spatially non-adjacent regions (i.e., spectrally based merging or clustering) constrained by a threshold derived from the previous HSWO region growing iteration. While the addition of constrained spectral clustering improves the utility of the segmentation results, especially for larger images, it also significantly increases HSEG s computational requirements. To counteract this, a computationally efficient recursive, divide-and-conquer, implementation of HSEG (RHSEG) was devised, which includes special code to avoid processing artifacts caused by RHSEG s recursive subdivision of the image data. The recursive nature of RHSEG makes for a straightforward parallel implementation. This paper describes the HSEG algorithm, its recursive formulation (referred to as RHSEG), and the implementation of RHSEG using massively parallel GNU-LINUX software. Results with Landsat TM data are included comparing RHSEG with classic region growing.

Tilton, James C.↗

DOE OSTI2022

Defensive Islanding to Enhance the Resilience of Distribution Systems Against Cyber-Induced Failures

The extensive integration of communication, computation, and control technologies into cyber-physical power systems (CPPSs) has increased the vulnerabilities of CPPSs to cyberattacks. This calls for developing solutions that assess and reduce the impacts of cyber-induced failures on CPPSs. This paper proposes a defensive islanding strategy to isolate impacted parts of the CPPS and form self-sufficient islanded grids with an objective of minimum load curtailment. The defensive islanding aims to split a power system into smaller grids to improve its resilience against a potential extreme event. A clustering approach that leverages the hierarchical spectral clustering method is utilized for the optimal defensive islanding. The proposed approach captures the fragility behavior and loading conditions of power system components due to cyber-induced failures. A graphical-based coupling framework is used to map the impacts of cyber failures into operation of power system components. The proposed method is demonstrated on a modified 33-node distribution feeder system integrated with distributed energy resources. The amount of load curtailment and radiality constraints have been used to evaluate the performance of the proposed clustering strategies. The results show the capability of the proposed algorithm to create islands considering the cyber-induced failures for enhanced resilience.

cyber-induced failures↗

DOE OSTI2020

Phase identification using co‐association matrix ensemble clustering

Calibrating distribution system models to aid in the accuracy of simulations such as hosting capacity analysis is increasingly important in the pursuit of the goal of integrating more distributed energy resources. The recent availability of smart meter data is enabling the use of machine learning tools to automatically achieve model calibration tasks. This research focuses on applying machine learning to the phase identification task, using a co‐association matrix‐based, ensemble spectral clustering approach. The proposed method leverages voltage time series from smart meters and does not require existing or accurate phase labels. This work demonstrates the success of the proposed method on both synthetic and real data, surpassing the accuracy of other phase identification research.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2025

Resolving local structural motifs across the phase evolution of zinc titanates with computational x-ray absorption spectroscopy

Resolving the local structure motifs that characterize phase evolution as a function of composition is a key challenge in structure characterization of complex materials. Here, in this study, we combine first-principles simulations and x-ray absorption near-edge structures (XANES) analysis to gain insights into the structure evolution revealed by measurements across a combinatorial zinc titanate thin film, which was grown with smoothly varying composition over a wide range of the Ti:Zn ratio. Specifically, we propose a cluster blind-signal-separation (cBSS) method for XANES spectral analysis based on a library of the structures and spectra of representative local motifs. In addition to motifs from zinc titanate crystals, two types of Ti-defect models constructed in this study are key to the understanding of the structure characteristics in the Zn-rich region. The cBSS method makes use of both spectral clustering of the simulated site-XANES spectra library and the BSS procedure to construct high-fidelity spectral basis functions from an experimental spectral sequence. The method provides a rigorous measure of the spectral sensitivity and basis completeness. The results of the XANES analysis are corroborated with other experimental modalities, including x-ray diffraction and spectroscopic ellipsometry, to validate the cBSS method. The calculated motif weights resulting from fitting the XANES spectra with the cBSS basis probe the atomic structure characteristics of both crystalline and amorphous phases as a function of the Ti/Zn composition. The insights of the local structure motif evolution are pivotal to the understanding of the nonmonotonic trend in the optical gap, which may lead to potential applications through tuning the optical properties of zinc titanate. The workflow of the XANES spectral analysis developed in this work can be generalized to construct the structure-property relationship in a broad material space.

36 MATERIALS SCIENCE↗

NASA NTRS1971

Redshifts and absolute spectral energy distributions of galaxies in distant clusters.

Absolute spectral energy distributions were measured in galaxies of three distant clusters. Redshifts and information on evolutionary effects are inferred by a comparison of the results with the integrated light energy distribution for nearby giant elliptical galaxies. Evidence for evolution over the last 3 to 6 billion years could not be established for these galaxies.

Oke, J. B.↗

DOE OSTI2022

Graph theory and nighttime imagery based microgrid design

Reducing the duration and frequency of blackouts in remote communities poses an engineering challenge for grid operators. Outage effects can also be mitigated locally through microgrids. This paper develops a systematic procedure to account for these challenges by creating microgrids prioritizing high value assets within vulnerable communities. Nighttime satellite imagery is used to identify vulnerable communities. Using an asset classification and rating system, multi-asset clusters within these communities are prioritized. Infrastructure data, geographic information systems, satellite imagery, and spectral clustering are used to form and rank microgrid candidates. A microgrid sizing algorithm is included to guide through the microgrid design process. Finally, an application of the methodology is presented using real event, location, and asset data.

24 POWER TRANSMISSION AND DISTRIBUTION↗

NASA NTRS2014

First Hard X-Ray Detection of the Non-Thermal Emission Around the Arches Cluster: Morphology and Spectral Studies With NuSTAR

The Arches cluster is a young, densely packed massive star cluster in our Galaxy that shows a high level of star formation activity. The nature of the extended non-thermal X-ray emission around the cluster remains unclear. The observed bright Fe K(alpha) line emission at 6.4 keV from material that is neutral or in a low ionization state can be produced either by X-ray photoionization or by cosmic-ray particle bombardment or both. In this paper, we report on the first detection of the extended emission around the Arches cluster above 10 keV with the NuSTAR mission, and present results on its morphology and spectrum. The spatial distribution of the hard X-ray emission is found to be consistent with the broad region around the cluster where the 6.4 keV line is observed. The interpretation of the hard X-ray emission within the context of the X-ray reflection model puts a strong constraint on the luminosity of the possible illuminating hard X-ray source. The properties of the observed emission are also in broad agreement with the low-energy cosmic-ray proton excitation scenario. Key words: cosmic rays - Galaxy: center - ISM: general - X-rays: individual (Arches cluster)

Arches cluster↗

DOE OSTI2022

Improved galactic foreground removal for B-mode detection with clustering methods

ABSTRACT Characterizing the sub-mm Galactic emission has become increasingly critical especially in identifying and removing its polarized contribution from the one emitted by the cosmic microwave background (CMB). In this work, we present a parametric foreground removal performed on to sub-patches identified in the celestial sphere by means of spectral clustering. Our approach takes into account efficiently both the geometrical affinity and the similarity induced by the measurements and the accompanying errors. The optimal partition is then used to parametrically separate the Galactic emission encoding thermal dust and synchrotron from the CMB one applied on two nominal observations of forthcoming experiments from the ground and from the space. Moreover, the clustering is performed on tracers that are different from the data used for component separation, e.g. the spectral index maps of dust and synchrotron. Performing the parametric fit singularly on each of the clustering derived regions results in an overall improvement: both controlling the bias and the uncertainties in the CMB B-mode recovered maps. We finally apply this technique using the map of the number of clouds along the line of sight, $\mathcal {N}_c$, as estimated from H i emission data and perform parametric fitting on to patches derived by clustering on this map. We show that adopting the $\mathcal {N}_c$ map as a tracer for the patches related to the thermal dust emission, results in reducing the B-mode residuals post-component separation. The code is made publicly available https://github.com/giuspugl/fgcluster.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS1973

A comparison of land-use determinations using data from ERTS-1 and high altitude aircraft

A manual interpretation of ERTS-1 MSS system corrected imagery has been performed on a study area within the Houston Area Test Site to classify land use using the Level 1 categories proposed by the Department of the Interior. The two types of imagery used included: (1) black and white transparencies of each band enlarged to a scale of approximately 1:250,000 and (2) color transparencies composited from the computer compatible tapes using the film recorder on a multispectral data analysis station. The results of this interpretation have been compared with the 1970 land use inventory of HATS which was compiled using color ektachrome imagery from high altitude aircraft (scale 1:120,000). Urban data from the same scene was also analyzed using a computer-aided (clustering) technique. The resulting clusters, representing areas of similar content, were compared with existing land use patterns in Houston. A technique was developed to correlate the spectral clusters to specific urban features on aircraft imagery by the location of specific, high contrast objects in particular resolution elements. It was concluded that ERTS-1 data could be used to develop Level 1 and many Level 2 land use categories for regional inventories and perhaps to some degree on a local level.

Lundelius, M. A.↗

NASA NTRS2016

Improving and Expanding NASA Software Cost Estimation Methods

Estimators and analysts are increasingly being tasked to develop better models and reliable cost estimates in support of program planning and execution. While there has been extensive work on improving parametric methods for cost estimation, there is very little focus on the use of cost models based on analogy and clustering algorithms. In this paper we summarize the results of our research in developing an analogy method for estimating NASA spacecraft flight software using spectral clustering on system characteristics (symbolic nonnumerical data) and evaluate its performance by comparing it to a number of the most commonly used estimation methods. The strengths and weaknesses of each method based on their performance are also discussed. The paper concludes with an overview of the analogy estimation tool (ASCoT) developed for use within NASA that implements the recommended analogy algorithm.

Hihn, Jairus↗

NASA NTRS1984

The Skylab lunar multispectral scanner data

Skylab S-192 multispectral scanner data, in 12 bands covering wavelengths from 0.41 to 2.3 microns, have been investigated to identify and classify geologic units of the lunar surface. Seventeen spectral cluster classes have been identified, seven in the highlands, seven in the maria, and three of which occur in both or in border regions. This finding may be roughly indicative of the relative heterogeneity of these regions. It implies that there is as much heterogeneity in the highlands as in the maria. This work extends the spectral and aerial coverage of similar studies of the lunar surface and provides useful data for comparison for most of the lunar near side.

Seeger, C. R.↗

NASA NTRS2011

Marker-Based Hierarchical Segmentation and Classification Approach for Hyperspectral Imagery

The Hierarchical SEGmentation (HSEG) algorithm, which is a combination of hierarchical step-wise optimization and spectral clustering, has given good performances for hyperspectral image analysis. This technique produces at its output a hierarchical set of image segmentations. The automated selection of a single segmentation level is often necessary. We propose and investigate the use of automatically selected markers for this purpose. In this paper, a novel Marker-based HSEG (M-HSEG) method for spectral-spatial classification of hyperspectral images is proposed. First, pixelwise classification is performed and the most reliably classified pixels are selected as markers, with the corresponding class labels. Then, a novel constrained marker-based HSEG algorithm is applied, resulting in a spectral-spatial classification map. The experimental results show that the proposed approach yields accurate segmentation and classification maps, and thus is attractive for hyperspectral image analysis.

Tarabalka, Yuliya↗

DOE OSTI2022

Long- and short-term temporal variability in cloud condensation nuclei spectra over a wide supersaturation range in the Southern Great Plains site

Abstract. When aerosol particles seed the formation of liquid water droplets in the atmosphere, they are called cloud condensation nuclei (CCN). Different aerosols will act as CCN under different degrees of water supersaturation (relative humidity above 100 %), depending on their size and composition. In this work, we build and analyze a best-estimate CCN spectrum product, tabulated at ∼ 45 min resolution, generated using high quality data from seven independent instruments at the U.S. Department of Energy Atmospheric Radiation Measurement (ARM) Southern Great Plains site. The data product spans a large supersaturation range, from 0.0001 % to ∼ 30 %, and time period of 5 years, from 2009–2013, and is available on the ARM data archive. We leverage this added statistical power to examine relationships that are unclear in smaller datasets. Our analysis is performed in three main areas. First, probability distributions of many aerosol and CCN metrics are found to exhibit skewed log-normal distribution shapes. Second, clustering analyses of CCN spectra reveal that the primary drivers of CCN differences are aerosol number size distributions, rather than hygroscopicity or composition, especially at supersaturations above 0.2 %, while also allowing for a simplified understanding of seasonal and diurnal variations in CCN behavior. The predictive ability of using limited hygroscopicity data with accurate number size distributions to estimate CCN spectra is investigated, and the uncertainties of this approach are estimated. Third, the dynamics of CCN spectral clusters and concentrations are examined with cross-correlation and autocorrelation analyses. We find that CCN concentrations change rapidly on the timescale of 1–3 h, with some conservation beyond that which is greatest for the lower supersaturation region of the spectrum.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

powersqueeze

powersqueeze (psqz) is a truncated power iteration library intended for high-performance computing platforms. psqz efficiently produces low-dimensional, linear measurements of graph matrix spectra by combining classical power iteration with sparse Johnson-Lindenstrauss transforms. psqz is intended to produce high-quality, fast, data-oblivious low-dimensional representations of high-dimensional sparse data such as graphs and term-document matrices. psqz is intended to replace similar workflows that depend on directly approximating a truncated eigendecomposition (e.g., the first step of spectral clustering), which is a much more expensive operation.

Priest, BenjaminW [Lawrence Livermore National Lab↗