Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Hierarchical clustering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Observations of the two components of the Abell 98 cluster of galaxies

X-ray and optical observations of A98 show that the cluster is composed of two subclusters. From an estimate of the mass and velocity differences, the two components may merge in about a billion years. These data support the hierarchical clustering model in which clusters occur on all size scales, with larger clusters being formed from mergers of smaller ones.

Henry, J. P.↗

Automated pipeline framework for processing of large-scale building energy time series data

Commercial buildings account for one third of the total electricity consumption in the United States and a significant amount of this energy is wasted. Therefore, there is a need for “virtual” energy audits, to identify energy inefficiencies and their associated savings opportunities using methods that can be non-intrusive and automated for application to large populations of buildings. Here we demonstrate virtual energy audits applied to large populations of buildings’ time-series smart-meter data using a systematic approach and a fully automated Building Energy Analytics (BEA) Pipeline that unifies, cleans, stores and analyzes building energy datasets in a non-relational data warehouse for efficient insights and results. This BEA pipeline is based on a custom compute job scheduler for a high performance computing cluster to enable parallel processing of Slurm jobs. Within the analytics pipeline, we introduced a data qualification tool that enhances data quality by fixing common errors, while also detecting abnormalities in a building’s daily operation using hierarchical clustering. We analyze the HVAC scheduling of a population of 816 buildings, using this analytics pipeline, as part of a cross-sectional study. With our approach, this sample of 816 buildings is improved in data quality and is efficiently analyzed in 34 minutes, which is 85 times faster than the time taken by a sequential processing. The analytical results for the HVAC operational hours of these buildings show that among 10 building use types, food sales buildings with 17.75 hours of daily HVAC cooling operation are decent targets for HVAC savings. Overall, this analytics pipeline enables the identification of statistically significant results from population based studies of large numbers of building energy time-series datasets with robust results. These types of BEA studies can explore numerous factors impacting building energy efficiency and virtual building energy audits. This approach enables a new generation of data-driven buildings energy analysis at scale.

36 MATERIALS SCIENCE↗

Application of unsupervised deep learning to image segmentation and in-situ contact angle measurements in a CO 2 -water-rock system

Rock surface wettability is a critical property that regulates multiphase flows in porous media, which can be quantified using the surface contact angle (CA). X-ray micro-computed tomography (μCT) provides an effective approach to in-situ measurements of surface CAs. However, the CA measurement accuracy depends significantly on the quality of CT image segmentation, which is the clustering of CT pixels into separate phases. Inspired by this, we developed a deep learning (DL)-based CA measurement workflow. Motivated by the recent tremendous progress in unsupervised learning techniques and aiming to avoid expensive manual data annotations, an unsupervised DL pipeline for CT image segmentation was proposed and implemented, which includes unsupervised model training and post-processing. The unsupervised model training was driven by a novel loss function constrained with feature similarity and spatial continuity and implemented by iterative forward and backward paths; the former clustered the pixel-wise feature vectors extracted by convolution neural networks, whereas the latter updated the parameters using gradient descent. An over-segmentation strategy was adopted for model training. The post-processing steps based on agglomerative hierarchical clustering (AHC) were implemented to further merge the over-segmented model output to the desired cluster number, which is intended to improve the efficiency of image segmentation. The developed unsupervised DL pipeline was compared with other commonly-used image segmentation methods using pixel-wise and physics-based evaluation metrics on a synthetic raw-image dataset, which had a known ground truth. The unsupervised DL pipeline showed the best performance. Next, the segmented images were input to an automatic CA measurement tool, and the results were validated by comparisons with manual measurements. The CA values from the manual and automatic measurements showed similar distributions and statistical properties. The automatic measurement demonstrated a wider spectrum because of the much larger number of measurement data points. The primary novelty of the unsupervised DL pipeline developed in this study lies in the novel loss function and the over-segmentation strategy associated with AHC post-processing. Finally, the workflow has been proven an efficient tool for pore-scale wettability characterization, which has a wide range of applications in fundamental studies of multiphase flows in natural porous media, which have critical implications to geological carbon sequestration, hydrocarbon energy recovery, and contaminant transport in groundwater.

42 ENGINEERING↗

Ion Clusters Reveal the Sources, Impacts, and Drivers of Freshwater Salinization

Population growth, land use change, climate change, and natural resource extraction are driving the salinization of freshwater resources worldwide. Reversing these trends will require data-centric approaches that identify salt sources, environmental drivers, and ecosystem responses. In this study, we applied principal component analysis and hierarchical clustering to identify ion covariance patterns, or “ion clusters,” in Broad Run, an urban stream in the Mid-Atlantic United States. These clusters correspond to distinct hydrologic regimes and reveal specific salinization risks: (1) phosphorus pollution mobilized during summer storms (Cluster 1); (2) elevated concentrations of sulfate and bicarbonate during baseflow (Cluster 2), likely reflecting groundwater discharge; and (3) elevated specific conductance and sodium, chloride, and potassium ion concentrations during snowmelt and rain-on-snow events (Cluster 3), driven by deicer and anti-icer wash-off. These ion fingerprints offer a transferable framework for diagnosing salt sources, assessing ecological risk, and identifying management targets. Our findings underscore the need for next-generation stormwater infrastructure and smart growth policies to protect aquatic life in rapidly urbanizing watersheds.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Void statistics of the CfA redshift survey

Clustering properties of two samples from the CfA redshift survey, each containing about 2500 galaxies, are studied. A comparison of the velocity distributions via a K-S test reveals structure on scales comparable with the extent of the survey. The void probability function (VPF) is employed for these samples to examine the structure and to test for scaling relations in the galaxy distribution. The galaxy correlation function is calculated via moments of galaxy counts. The shape and amplitude of the correlation function roughly agree with previous determinations. The VPFs for distance-limited samples of the CfA survey do not match the scaling relation predicted by the hierarchical clustering models. On scales not greater than 10/h Mpc, the VPFs for these samples roughly follow the hierarchical pattern. A variant of the VPF which uses nearly all the data in magnitude-limited samples is introduced; it accounts for the variation of the sampling density with velocity in a magnitude-limited survey.

Vogeley, Michael S.↗

Gravitational instability with high resolution

A series of very high resolution simulations have been performed for gravitational clustering in two dimensions. It is shown that mass resolution, achieved by having large numbers of particles, is as important as spatial resolution. New objects arising inside pancakes are found, which are coherent with structure on much larger scales. The evolution of structure in hierarchical clustering models with a sufficiently flat power spectrum includes pancake-like structures, confirming the presence of filaments in cold dark matter universes.

Melott, Adrian L.↗

Faint blue counts from formation of dwarf galaxies at z approximately equals 1

The nature of faint blue objects (FBO's) has been a source of much speculation since their detection in deep CCD images of the sky. Their high surface density argues against them being progenitors of present-day bright galaxies and since they are only weakly clustered on small scales, they cannot be entities that merged together to form present-day galaxies. Babul & Rees (1992) have suggested that the observed faint blue counts may be due to dwarf elliptical galaxies undergoing their initial starburst at z is approximately equal to 1. In generic hierarchical clustering scenarios, however, dwarf galaxy halos (M is approximately 10(exp 9) solar mass) are expected to form at an earlier epoch; for example, typical 10(exp 9) solar mass halos will virialize at z is approximately equal to 2.3 if the power-spectrum for the density fluctuations is that of the standard b = 2 cold dark matter (CDM) model. Under 'ordinary conditions' the gas would rapidly cool, collect in the cores, and undergo star-formation. Conditions at high redshifts are far from 'ordinary'. The intense UV background will prevent the gas in the dwarf halos from cooling, the halos being released from their suspended state only when the UV flux has diminished sufficiently.

Babul, Arif↗

Higher order correlations of IRAS galaxies

The higher order irreducible angular correlation functions are derived up to the eight-point function, for a sample of 4654 IRAS galaxies, flux-limited at 1.2 Jy in the 60 microns band. The correlations are generally found to be somewhat weaker than those for the optically selected galaxies, consistent with the visual impression of looser clusters in the IRAS sample. It is found that the N-point correlation functions can be expressed as the symmetric sum of products of N - 1 two-point functions, although the correlations above the four-point function are consistent with zero. The coefficients are consistent with the hierarchical clustering scenario as modeled by Hamilton and by Schaeffer.

Meiksin, Avery↗

Geospatial Cluster Analysis of the State, Duration and Severity of Drought Over Paraíba State, Northeastern Brazil

Droughts threaten water resources, agriculture, socio-economic activities and the population at the global and regional level, so identifying areas with homogeneous drought behaviors is an important consideration in improving the management of water resources. The objective of this study is to identify homogenous zones over Paraíba State in relation to the state, duration and severity of droughts that have occurred over the last 20 years (1998–2017) using hierarchical cluster analysis based on both gauge-measured and Tropical Rainfall Measuring Mission (TRMM) estimated rainfall data (TMPA 3B42). The drought series were calculated using the Standardized Precipitation Index (SPI) based on eight time scales and were grouped according to drought state, duration and severity time series. The integrated results of state, duration and severity of droughts indicate that there is a basis for dividing Paraíba State into two major regions (a) Zone I, formed by Mata Paraibana and Agreste Paraibano, and (b) Zone II, composed by Borborema and Sertão Paraibano. This division is evident when assessing short-term droughts, but in the case of long-term droughts, Paraíba State has a high similarity in terms of drought state, duration, and severity. Factors such as proximity to the ocean, active climatic systems, and the local relief configuration were identified as influencing the drought regime. Finally, it is concluded that TMPA rainfall estimates represent a valuable source of data to regionalize and identify drought patterns over this part of Brazil and that other studies of this type should be carried out to monitor these phenomena based on other satellite-based rainfall data, including the Global Precipitation Mission (GPM).

SPI↗

Network of networks: Time series clustering of AmeriFlux sites

Environmental observation networks, such as AmeriFlux, are foundational for monitoring ecosystem response to climate change, management practices, and natural disturbances; however, their effectiveness depends on their representativeness for the regions or continents. We proposed an empirical, time series approach to quantify the similarity of ecosystem fluxes across AmeriFlux sites. We extracted the diel and seasonal characteristics (i.e., amplitudes, phases) from carbon dioxide, water vapor, energy, and momentum fluxes, which reflect the effects of climate, plant phenology, and ecophysiology on the observations, and explored the potential aggregations of AmeriFlux sites through hierarchical clustering. While net radiation and temperature showed latitudinal clustering as expected, flux variables revealed a more uneven clustering with many small (number of sites < 5), unique groups and a few large (> 100) to intermediate (15–70) groups, highlighting the significant ecological regulations of ecosystem fluxes. Many identified unique groups were from under-sampled ecoregions and biome types of the International Geosphere-Biosphere Programme (IGBP), with distinct flux dynamics compared to the rest of the network. At the finer spatial scale, local topography, disturbance, management, edaphic, and hydrological regimes further enlarge the difference in flux dynamics within the groups. Nonetheless, our clustering approach is a data-driven method to interpret the AmeriFlux network, informing future cross-site syntheses, upscaling, and model-data benchmarking research. Finally, we highlighted the unique and underrepresented sites in the AmeriFlux network, which were found mainly in Hawaii and Latin America, mountains, and at under-sampled IGBP types (e.g., urban, open water), motivating the incorporation of new/unregistered sites from these groups.

54 ENVIRONMENTAL SCIENCES↗

The Physical Origin of Galaxy Morphologies and Scaling Laws

We propose a numerical study designed to interpret the origin and evolution of galaxy properties revealed by space- and ground-based imaging and spectroscopical surveys. Our aim is to unravel the physical processes responsible for the development of different galaxy morphologies and for the establishment of scaling laws such as the Tully-Fisher relation for spirals and the Fundamental Plane of ellipticals. In particular, we plan to address the following major topics: (1) The morphology and observability of protogalaxies, and in particular the relationship between primordial galaxies and the z approximately 3 'Ly-break' systems identified in the Hubble Deep Field and in ground-based searches; (2) The origin of the disk and spheroidal components in galaxies, the timing and mode of their assembly, the corresponding evolution in galaxy morphologies and its sensitivity to cosmological parameters; (3) The origin and redshift evolution of the scaling laws that link the mass, luminosity size, stellar content, and metal abundances of galaxies of different morphological types. This investigation will use state-of-the-art N-body/gasdynamical codes to provide a spatially resolved description of the galaxy formation process in hierarchically clustering universes. Coupled with population synthesis techniques. our models can be used to provide synthetic 'observations' that can be compared directly with observations of galaxies both nearby and at cosmologically significant distances. This study will thus provide insight into the nature of protogalaxies and into the formation process of galaxies like our own Milky Way. It will also help us to assess the cosmological significance of these observations within the context of hierarchical theories of galaxy formation and will supply a theoretical context within which current and future observations can be interpreted.

Steinmetz, Matthias↗

The Tropical Convective Spectrum: Archetypal Vertical Structures - Part 1

A taxonomy of tropical convective and stratiform vertical structures is constructed through cluster analysis of 3 yr of Tropical Rainfall Measuring Mission (TRMM) "warm-season" (surface temperature greater than 10 C) precipitation radar (PR) vertical profiles, their surface rainfall, and associated radar-based classifiers (convective/ stratiform and brightband existence). Twenty-five archetypal profile types are identified, including nine convective types, eight stratiform types, two mixed types, and six anvil/fragment types (nonprecipitating anvils and sheared deep convective profiles). These profile types are then hierarchically clustered into 10 similar families, which can be further combined, providing an objective and physical reduction of the highly multivariate PR data space that retains vertical structure information. The taxonomy allows for description of any storm or local convective spectrum by the profile types or families. The analysis provides a quasi-independent corroboration of the TRMM 2A23 convective/ stratiform classification. The global frequency of occurrence and contribution to rainfall for the profile types are presented, demonstrating primary rainfall contribution by midlevel glaciated convection (27%) and similar depth decaying/stratiform stages (28%-31%). Profiles of these types exhibit similar 37- and 85-GHz passive microwave brightness temperatures but differ greatly in their frequency of occurrence and mean rain rates, underscoring the importance to passive microwave rain retrieval of convective/stratiform discrimination by other means, such as polarization or texture techniques, or incorporation of lightning observations. Close correspondence is found between deep convective profile frequency and annualized lightning production, and pixel-level lightning occurrence likelihood directly tracks the estimated mean ice water path within profile types.

Precipitation radar↗

Structure-informed clustering for population stratification in association studies

Background: Identifying variants associated with complex traits is a challenging task in genetic association studies due to linkage disequilibrium (LD) between genetic variants and population stratification, unrelated to the disease risk. Existing methods of population structure correction use principal component analysis or linear mixed models with a random effect when modeling associations between a trait of interest and genetic markers. However, due to stringent significance thresholds and latent interactions between the markers, these methods often fail to detect genuinely associated variants. Results: To overcome this, we propose CluStrat, which corrects for complex arbitrarily structured populations while leveraging the linkage disequilibrium induced distances between genetic markers. It performs an agglomerative hierarchical clustering using the Mahalanobis distance covariance matrix of the markers. In simulation studies, we show that our method outperforms existing methods in detecting true causal variants. Applying CluStrat on WTCCC2 and UK Biobank cohorts, we found biologically relevant associations in Schizophrenia and Myocardial Infarction. CluStrat was also able to correct for population structure in polygenic adaptation of height in Europeans. Conclusions: CluStrat highlights the advantages of biologically relevant distance metrics, such as the Mahalanobis distance, which captures the cryptic interactions within populations in the presence of LD better than the Euclidean distance.

59 BASIC BIOLOGICAL SCIENCES↗

RHSEG and Subdue: Background and Preliminary Approach for Combining these Technologies for Enhanced Image Data Analysis, Mining and Knowledge Discovery

Under a project recently selected for funding by NASA's Science Mission Directorate under the Applied Information Systems Research (AISR) program, Tilton and Cook will design and implement the integration of the Subdue graph based knowledge discovery system, developed at the University of Texas Arlington and Washington State University, with image segmentation hierarchies produced by the RHSEG software, developed at NASA GSFC, and perform pilot demonstration studies of data analysis, mining and knowledge discovery on NASA data. Subdue represents a method for discovering substructures in structural databases. Subdue is devised for general-purpose automated discovery, concept learning, and hierarchical clustering, with or without domain knowledge. Subdue was developed by Cook and her colleague, Lawrence B. Holder. For Subdue to be effective in finding patterns in imagery data, the data must be abstracted up from the pixel domain. An appropriate abstraction of imagery data is a segmentation hierarchy: a set of several segmentations of the same image at different levels of detail in which the segmentations at coarser levels of detail can be produced from simple merges of regions at finer levels of detail. The RHSEG program, a recursive approximation to a Hierarchical Segmentation approach (HSEG), can produce segmentation hierarchies quickly and effectively for a wide variety of images. RHSEG and HSEG were developed at NASA GSFC by Tilton. In this presentation we provide background on the RHSEG and Subdue technologies and present a preliminary analysis on how RHSEG and Subdue may be combined to enhance image data analysis, mining and knowledge discovery.

Tilton, James C.↗

Watershed zonation through hillslope clustering for tractably quantifying above- and below-ground watershed heterogeneity and functions

Abstract. In this study, we develop a watershed zonation approach for characterizing watershed organization and functions in a tractable manner by integrating multiple spatial data layers. We hypothesize that (1) a hillslope is an appropriate unit for capturing the watershed-scale heterogeneity of key bedrock-through-canopy properties and for quantifying the co-variability of these properties representing coupled ecohydrological and biogeochemical interactions, (2) remote sensing data layers and clustering methods can be used to identify watershed hillslope zones having the unique distributions of these properties relative to neighboring parcels, and (3) property suites associated with the identified zones can be used to understand zone-based functions, such as response to early snowmelt or drought and solute exports to the river. We demonstrate this concept using unsupervised clustering methods that synthesize airborne remote sensing data (lidar, hyperspectral, and electromagnetic surveys) along with satellite and streamflow data collected in the East River Watershed, Crested Butte, Colorado, USA. Results show that (1) we can define the scale of hillslopes at which the hillslope-averaged metrics can capture the majority of the overall variability in key properties (such as elevation, net potential annual radiation, and peak snow-water equivalent – SWE), (2) elevation and aspect are independent controls on plant and snow signatures, (3) near-surface bedrock electrical resistivity (top 20 m) and geological structures are significantly correlated with surface topography and plan species distribution, and (4) K-means, hierarchical clustering, and Gaussian mixture clustering methods generate similar zonation patterns across the watershed. Using independently collected data, we show that the identified zones provide information about zone-based watershed functions, including foresummer drought sensitivity and river nitrogen exports. The approach is expected to be applicable to other sites and generally useful for guiding the selection of hillslope-experiment locations and informing model parameterization.

58 GEOSCIENCES↗

Functional Groups Based on Leaf Physiology: Are they Spatially and Temporally Robust?

The functional grouping hypothesis, which suggests that complexity in ecosystem function can be simplified by grouping species with similar responses, was tested in the Florida scrub habitat. Functional groups were identified based on how species in fire maintained Florida scrub regulate exchange of carbon and water with the atmosphere as indicated by both instantaneous gas exchange measurements and integrated measures of function (%N, delta C-13, delta N-15, C-N ratio). Using cluster analysis, five distinct physiologically-based functional groups were identified in the fire maintained scrub. These functional groups were tested to determine if they were robust spatially, temporally, and with management regime. Analysis of Similarities (ANOSIM), a non-parametric multivariate analysis, indicated that these five physiologically-based groupings were not altered by plot differences (R = -0.115, p = 0.893) or by the three different management regimes; prescribed burn, mechanically treated and burn, and fire-suppressed (R = 0.018, p = 0.349). The physiological groupings also remained robust between the two climatically different years 1999 and 2000 (R = -0.027, p = 0.725). Easy-to-measure morphological characteristics indicating functional groups would be more practical for scaling and modeling ecosystem processes than detailed gas-exchange measurements, therefore we tested a variety of morphological characteristics as functional indicators. A combination of non-parametric multivariate techniques (Hierarchical cluster analysis, non-metric Multi-Dimensional Scaling, and ANOSIM) were used to compare the ability of life form, leaf thickness, and specific leaf area classifications to identify the physiologically-based functional groups. Life form classifications (ANOSIM; R = 0.629, p 0.001) were able to depict the physiological groupings more adequately than either specific leaf area (ANOSIM; R = 0.426, p = 0.001) or leaf thickness (ANOSIM; R 0.344, p 0.001). The ability of life forms to depict the physiological groupings was improved by separating the parasitic Ximenia americana from the shrub category (ANOSIM; R = 0.794, p = 0.001). Therefore, a life form classification including parasites was determined to be a good indicator of the physiological processes of scrub species, and would be a useful method of grouping for scaling physiological processes to the ecosystem level.

Foster, Tammy E.↗

Ecohydrology of wetland plant communities along an estuarine to tidal river gradient

Abiotic filters that interact with wetland plant communities along tidal–fluvial gradients are highly dynamic, and understanding their quantitative thresholds and relationships to interspecific competition is important during an era of sea-level rise and watershed hydrologic change. Yet, landscape-scale studies of major coastal rivers from the river mouth to the head of tide, such as this study, remain rare. Here, we develop a new predictive framework for estuarine–tidal river research and management using a river-specific low-water datum and the wetland inundation indicator SEVg, the growing-season sum exceedance value of hourly surface-water depth. The distribution and variability of the wetland species pool (n = 203) on the 234 river kilometer (rkm) lower Columbia River and estuary floodplain are described for the first time. 4,940 quadrats at 50 marshes were surveyed (2005–2016). Throughout the estuarine–tidal river system, SEVg was well suited to describe the wetland inundation regime and its variability based on the combination of longitudinal river position and elevation. SEVg increased significantly landward. Two primary wetland inundation regimes were identified: the seaward-tidal, usually greatest during the winter months, and landward-fluvial, greatest during the growing season. Nearest the ocean, salinity is the abiotic factor limiting species richness and non-native species. Farther upriver, the daily, seasonal, and interannual variability of the wetting and drying cycle encourage disturbance-tolerant species and non-natives and limit the number of hydrophytes and total vegetative cover. Hence, the average between-year similarity of site-scale areal cover significantly decreased landward. Hierarchical cluster analysis indicated five vegetative groups and five ecohydrologic zones between rkm 0 and 234 were discriminated with 76 significant species–zone associations. All zones had unique indicator species. Species with high indicator values were Carex lyngbyei throughout the estuarine zones, and Eleocharis palustris, Sagittaria latifolia, and the invasive non-native Phalaris arundinacea in the upper estuarine and lower, middle, and upper tidal river zones (IV > 0.90). Competition from C. lyngbyei nearest the ocean and P. arundinacea in the tidal river was associated with reduced species richness when total cover was >65%. This framework of filters informs the design and prediction of future wetland plant communities on coastal river floodplains.

54 ENVIRONMENTAL SCIENCES↗

Maximizing machine learning interatomic potential transferability for the discovery of the novel stellated octadecagon Bi18-Pt24 cage structure

Achieving true transferability remains the central challenge for Machine Learning Interatomic Potentials (ML-IAPs) in modeling complex bimetallic nanoclusters across their vast potential energy surfaces. We systematically investigate data selection strategies to optimize the Chebyshev Interaction Model for Efficient Simulation (ChIMES) potential for the Bi-Pt nanoclusters by comparing three innovative sampling methods: Principal Component Analysis (PCA)/k-means (structural diversity), t-distributedStochasticNeighborEmbedding (t-SNE)/k-means (force-space diversity), and hierarchical clustering. Quantitatively, the PCA/k-means strategy proved most effective for global accuracy, yielding the lowest force errors and achieving energy root mean square errors (RMSE) values competitive with Density Functional Theory (DFT), demonstrating excellent accuracy (19.16meV/atom). Structural validation on 34 unique DFT-optimized isomers further confirmed the potential’s high fidelity, with the best model PCA/k-means reproducing structures with an average root mean square deviation (RMSD) of 0.10 Å. However, the t-SNE methods, by maximizing diversity in the force space, demonstrated superior extrapolative power, leading to the more precise prediction of a novel stellated octadecagon Bi18⁢Pt24 cage structure, demonstrating the potential for exploring previously unseen morphologies. Our results establish a clear methodology for strategic data sampling that successfully maximizes ML-IAP transferability, providing an accurate and computationally efficient tool that accelerates the theoretical discovery of complex bimetallic architectures.

Vangheluwe, Raphaël [Université Paris-Saclay, CNRS↗