Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “community clustering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
NASA NTRS1993

The methodology of multi-viewpoint clustering analysis

One of the greatest challenges facing the software engineering community is the ability to produce large and complex computer systems, such as ground support systems for unmanned scientific missions, that are reliable and cost effective. In order to build and maintain these systems, it is important that the knowledge in the system be suitably abstracted, structured, and otherwise clustered in a manner which facilitates its understanding, manipulation, testing, and utilization. Development of complex mission-critical systems will require the ability to abstract overall concepts in the system at various levels of detail and to consider the system from different points of view. Multi-ViewPoint - Clustering Analysis MVP-CA methodology has been developed to provide multiple views of large, complicated systems. MVP-CA provides an ability to discover significant structures by providing an automated mechanism to structure both hierarchically (from detail to abstract) and orthogonally (from different perspectives). We propose to integrate MVP/CA into an overall software engineering life cycle to support the development and evolution of complex mission critical systems.

Mehrotra, Mala↗
DOE OSTI2023

Subseasonal Representation and Predictability of North American Weather Regimes Using Cluster Analysis

Abstract This study focuses on assessing the representation and predictability of North American weather regimes, which are persistent large-scale atmospheric patterns, in a set of initialized subseasonal reforecasts created using the Community Earth System Model, version 2 (CESM2). The k -means clustering was used to extract four key North American (10°–70°N, 150°–40°W) weather regimes within ERA5 reanalysis, which were used to interpret CESM2 subseasonal forecast performance. Results show that CESM2 can recreate the climatology of the four main North American weather regimes with skill but exhibits biases during later lead times with overoccurrence of the West Coast high regime and underoccurrence of the Greenland high and Alaskan ridge regimes. Overall, the West Coast high and Pacific trough regimes exhibited higher predictability within CESM2, partly related to El Niño. Despite biases, several reforecasts were skillful and exhibited high predictability during later lead times, which could be partly attributed to skillful representation of the atmosphere from the tropics to extratropics upstream of North America. The high predictability at the subseasonal time scale of these case-study examples was manifested as an “ensemble realignment,” in which most ensemble members agreed on a prediction despite ensemble trajectory dispersion during earlier lead times. Weather regimes were also shown to project distinct temperature and precipitation anomalies across North America that largely agree with observational products. This study further demonstrates that unsupervised learning methods can be used to uncover sources and limits of subseasonal predictability, along with systematic biases present in numerical prediction systems. Significance Statement North American weather regimes are large-scale atmospheric patterns that can persist for several days. Their skillful subseasonal (2 weeks or greater) prediction can provide valuable lead time to prepare for temperature and precipitation anomalies that can stress energy and water resources. The purpose of this study was to assess the climatological representation and subseasonal predictability of four key North American weather regimes using a research subseasonal prediction system and clustering analysis. We found that the Pacific trough and West Coast high regimes exhibited higher predictability than other regimes and that skillful representation of conditions across the tropics and extratropics can increase predictability during later lead times. Future work will quantify causal pathways associated with high predictability.

58 GEOSCIENCES↗
DOE OSTI2021

Long-read metagenomics of soil communities reveals phylum-specific secondary metabolite dynamics

Abstract Microbial biosynthetic gene clusters (BGCs) encoding secondary metabolites are thought to impact a plethora of biologically mediated environmental processes, yet their discovery and functional characterization in natural microbiomes remains challenging. Here we describe deep long-read sequencing and assembly of metagenomes from biological soil crusts, a group of soil communities that are rich in BGCs. Taking advantage of the unusually long assemblies produced by this approach, we recovered nearly 3,000 BGCs for analysis, including 712 full-length BGCs. Functional exploration through metatranscriptome analysis of a 3-day wetting experiment uncovered phylum-specific BGC expression upon activation from dormancy, elucidating distinct roles and complex phylogenetic and temporal dynamics in wetting processes. For example, a pronounced increase in BGC transcription occurs at night primarily in cyanobacteria, implicating BGCs in nutrient scavenging roles and niche competition. Taken together, our results demonstrate that long-read metagenomic sequencing combined with metatranscriptomic analysis provides a direct view into the functional dynamics of BGCs in environmental processes and suggests a central role of secondary metabolites in maintaining phylogenetically conserved niches within biocrusts.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS2003

P2P Technology for High-Performance Computing: An Overview

The transition from cluster computing to peer-to-peer (P2P) high-performance computing has recently attracted the attention of the computer science community. It has been recognized that existing local networks and dedicated clusters of headless workstations can serve as inexpensive yet powerful virtual supercomputers. It has also been recognized that the vast number of lower-end computers connected to the Internet stay idle for as long as 90% of the time. The growing speed of Internet connections and the high availability of free CPU time encourage exploration of the possibility to use the whole Internet rather than local clusters as massively parallel yet almost freely available P2P supercomputer. As a part of a larger project on P2P high-performance computing, it has been my goal to compile an overview of the 2P2 paradigm. I have studied various P2P platforms and I have compiled systematic brief descriptions of their most important characteristics. I have also experimented and obtained hands-on experience with selected P2P platforms focusing on those that seem promising with respect to P2P high-performance computing. I have also compiled relevant literature and web references. I have prepared a draft technical report and I have summarized my findings in a poster paper.

Follen, Gregory J.↗
DOE OSTI2026

Simultaneous global and local clustering in multiplex networks with covariate information

Understanding both global and layer-specific group structures is useful for uncovering complex patterns in networks with multiple interaction types. In this work, we introduce a new model, the hierarchical multiplex stochastic blockmodel, which simultaneously detects communities within individual layers of a multiplex network while inferring a global node clustering across the layers. A stochastic blockmodel is assumed in each layer, with probabilities of layer-level group memberships determined by a node’s global group assignment. Our model uses a Bayesian framework, employing a probit stick-breaking process to construct node-specific mixing proportions over a set of shared Griffiths–Engen–McCloseky distributions. These proportions determine layer-level community assignment, allowing for an unknown and varying number of groups across layers, while incorporating nodal covariate information to inform the global clustering. We propose a scalable variational inference procedure with parallelisable updates for application to large networks. Extensive simulation studies demonstrate our model’s ability to accurately recover both global and layer-level clusters in complicated settings, and applications to real data showcase the model’s effectiveness in uncovering interesting latent network structure.

community detection↗
DOE OSTI2023

Triple Excitations in Green’s Function Coupled Cluster Solver for Studies of Strongly Correlated Systems in the Framework of Self-Energy Embedding Theory

Embedding theories became important approaches used for accurate calculations of both molecules and solids. In these theories, a small chosen subset of orbitals is treated with an accurate method, called an impurity solver, capable of describing higher correlation effects. Ideally, such a chosen fragment should contain multiple orbitals responsible for the chemical and physical behavior of the compound. Handling a large number of chosen orbitals presents a very significant challenge for the current generation of solvers used in the physics and chemistry community. Here, we develop a Green’s function coupled cluster singles doubles and triples (GFCCSDT) solver that can be used for a quantitative description in both molecules and solids. This solver allows us to treat orbital spaces that are inaccessible to other accurate solvers. At the same time, GFCCSDT maintains high accuracy of the resulting self-energy. Moreover, in conjunction with the GFCCSD solver, it allows us to test the systematic convergence of computational studies. Developing the CC family of solvers paves the road to fully systematic Green’s function embedding calculations in solids. In this paper, we focus on the investigation of GFCCSDT self-energies for a strongly correlated problem of SrMnO 3 solid. Subsequently, we apply this solver to solid MnO showing that an approximate variant of GFCCSDT is capable of yielding a high accuracy orbital resolved spectral function.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Developing energy flexibility in clusters of buildings: A critical analysis of barriers from planning to operation

This paper examines building energy flexibility at an aggregated level and addresses the main barriers and research gaps for the development of this resource across three design and development phases: market and policy, early planning and design, and operation. We review methodologies and tools and discuss barriers, challenges, and opportunities, incorporating policy, economic, technical, professional, and social perspectives. Although various legal and regulatory frameworks exist to foster the development of energy flexibility for small buildings, financing mechanisms are limited with a significant number of perceived risks undermining private investment. For the early planning and design phase, planners and designers lack appropriate tools and face interoperability challenges, which often results in insufficient consideration of demand response programs. The review of the operational phase highlighted the socio-technical challenges related to both the complexity of deployment and communication, as well as privacy and acceptability issues. Finally, the paper proposes a number of targeted research directions to address challenges and promote greater energy flexibility deployments, including capturing building demand side dynamics, improving baseline estimations and developing seamless connectivity between buildings and districts.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS1998

Open Clusters as Laboratories: The Angular Momentum Evolution of Young Stars

The core group concentrated on three primary research topics: (1) ROSAT observation of the coronal activity of low mass stars in young open clusters; (2) the determination of stellar ages and the determination of the timescale for dissipation of circumstellar disks around young stars; and (3) the determination of rotation velocities of low mass stars in young open cluster and the inferred angular momentum evolution of low mass stars. With accurate ages for the clusters, we can then derive an independent estimate of the timescale for debris disks to dissipate. As the second half of that project, we are using the Caltech/UC/NASA Keck telescopes to obtain spectra of brown dwarf candidates in a number of nearby, young open clusters, from which we can determine new and accurate cluster ages. The final primary program that we have addressed was the determination of rotational velocities for low mass stars in our target open clusters. Our group has obtained rotational velocities for a large number of stars in several open clusters during this LTSA program, and we have published the results in several papers. One particularly time-consuming aspect of our program was the development of a database of the photometry and rotational velocities for nearby open clusters, which we have made available to the community.

Stauffer, John R.↗
DOE OSTI2022

The ecological assembly of bacterial communities in Antarctic wetlands varies across levels of phylogenetic resolution

Summary As functional traits are conserved at different phylogenetic depths, the ability to detect community assembly processes can be conditional on the phylogenetic resolution; yet most previous work quantifying their influence has focused on a single level of phylogenetic resolution. Here, we have studied the ecological assembly of bacterial communities from an Antarctic wetland complex, applying null models across different levels of phylogenetic resolution (i.e. clustering ASVs into OTUs with decreasing sequence identity thresholds). We found that the relative influence of the community assembly processes varies with phylogenetic resolution. More specifically, selection processes seem to impose stronger influence at finer (100% sequence similarity ASV) than at coarser (99%–97% sequence similarity OTUs) resolution. We identified environmental features related with the ecological processes and propose a conceptual model for the bacterial community assembly in this Antarctic ecosystem. Briefly, eco‐evolutionary processes appear to be leading to different but very closely related ASVs in lotic, lentic and terrestrial environments. In all, this study shows that assessing community assembly processes at different phylogenetic resolutions is key to improve our understanding of microbial ecology. More importantly, a failure to detect selection processes at coarser phylogenetic resolution does not imply the absence of such processes at finer resolutions.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

A clustering-based approach to ocean model–data comparison around Antarctica

The Antarctic Continental Shelf seas (ACSS) are a critical, rapidly changing element of the Earth system. Analyses of global-scale general circulation model (GCM) simulations, including those available through the Coupled Model Intercomparison Project, Phase 6 (CMIP6), can help reveal the origins of observed changes and predict the future evolution of the ACSS. However, an evaluation of ACSS hydrography in GCMs is vital: previous CMIP ensembles exhibit substantial mean-state biases (reflecting, for example, misplaced water masses) with a wide inter-model spread. Because the ACSS are also a sparely sampled region, grid-point-based model assessments are of limited value. Our goal is to demonstrate the utility of clustering tools for identifying hydrographic regimes that are common to different source fields (model or data), while allowing for biases in other metrics (e.g., water mass core properties) and shifts in region boundaries. We apply K-means clustering to hydrographic metrics based on the stratification from one GCM (Community Earth System Model version 2; CESM2) and one observation-based product (World Ocean Atlas 2018; WOA), focusing on the Amundsen, Bellingshausen and Ross seas. When applied to WOA temperature and salinity profiles, clustering identifies “primary” and “mixed” regimes that have physically interpretable bases. For example, meltwater-freshened coastal currents in the Amundsen Sea and a region of high-salinity shelf water formation in the southwestern Ross Sea emerge naturally from the algorithm. Both regions also exhibit clearly differentiated inner- and outer-shelf regimes. The same analysis applied to CESM2 demonstrates that, although mean-state model biases in water mass T–S characteristics can be substantial, using a clustering approach highlights that the relative differences between regimes and the locations where each regime dominates are well represented in the model. CESM2 is generally fresher and warmer than WOA and has a limited fresh-water-enriched coastal regimes. Given the sparsity of observations of the ACSS, this technique is a promising tool for the evaluation of a larger model ensemble (e.g., CMIP6) on a circum-Antarctic basis.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Climate, food and humans predict communities of mammals in the United States

Abstract Aim The assembly of species into communities and ecoregions is the result of interacting factors that affect plant and animal distribution and abundance at biogeographic scales. Here, we empirically derive ecoregions for mammals to test whether human disturbance has become more important than climate and habitat resources in structuring communities. Location Conterminous United States. Time Period 2010–2021. Major Taxa Studied Twenty‐five species of mammals. Methods We analysed data from 25 mammal species recorded by camera traps at 6645 locations across the conterminous United States in a joint modelling framework to estimate relative abundance of each species. We then used a clustering analysis to describe 8 broad and 16 narrow mammal communities. Results Climate was the most important predictor of mammal abundance overall, while human population density and agriculture were less important, with mixed effects across species. Seed production by forests also predicted mammal abundance, especially hard‐mast tree species. The mammal community maps are similar to those of plants, with an east–west split driven by different dominant species of deer and squirrels. Communities vary along gradients of temperature in the east and precipitation in the west. Most fine‐scale mammal community boundaries aligned with established plant ecoregions and were distinguished by the presence of regional specialists or shifts in relative abundance of widespread species. Maps of potential ecosystem services provided by these communities suggest high herbivory in the Rocky Mountains and eastern forests, high invertebrate predation in the subtropical south and greater predation pressure on large vertebrates in the west. Main Conclusions Our results highlight the importance of climate to modern mammals and suggest that climate change will have strong impacts on these communities. Our new empirical approach to recognizing ecoregions has potential to be applied to expanded communities of mammals or other taxa.

Kays, Roland↗
DOE OSTI2024

The S-PLUS Fornax Project (S+FP): A first 12-band glimpse of the Fornax galaxy cluster

ABSTRACT The Fornax galaxy cluster is the richest nearby (D ∼ 20 Mpc) galaxy association in the southern sky. As such, it provides a wealth of opportunities to elucidate on the processes where environment holds a key role in transforming galaxies. Although it has been the focus of many studies, Fornax has never been explored with contiguous homogeneous wide-field imaging in 12 photometric narrow and broad bands like those provided by the Southern Photometric Local Universe Survey (S-PLUS). In this paper, we present the S-PLUS Fornax Project (S+FP) that aims to comprehensively analyse the galaxy content of the Fornax cluster using S-PLUS. Our data set consists of 106 S-PLUS wide-field frames (FoV∼1.4 × 1.4 deg2) observed in five Sloan Digital Sky Survey-like ugriz broad bands and seven narrow bands covering specific spectroscopic features like [O ii], Ca ii H+K, Hδ, G band, Mg b triplet, Hα, and the Ca ii triplet. Based on S-PLUS specific automated photometry, aimed at correctly detecting Fornax galaxies and globular clusters in S-PLUS images, our data set provides the community with catalogues containing homogeneous 12-band photometry for ∼3 × 106 resolved and unresolved objects within a region extending over ∼208 deg2 (∼5 Rvir in RA) around Fornax’ central galaxy, NGC 1399. We further explore the eagle and IllustrisTNG cosmological simulations to identify 45 Fornax-like clusters and generate mock images on all 12 S-PLUS bands of these structures down to galaxies with M⋆ ≥ 108 M⊙. The S+FP data set we put forward in this first paper of a series will enable a variety of studies some of which are briefly presented.

Astronomy & Astrophysics↗
DOE OSTI2023

Igor

SAND2023-05551O Igor, an open-source software, manages large clusters of users in a high-performance computing community. The systems allows users to choose an operating system and reserve and request hosts. The administrative side sets up and executes requests from users while simultaneously giving them tools to manage and enforce reservation policies and user access to the hosts. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Bagwell, Allen↗
NASA NTRS2012

NASA Center for Climate Simulation (NCCS) Presentation

The NASA Center for Climate Simulation (NCCS) offers integrated supercomputing, visualization, and data interaction technologies to enhance NASA's weather and climate prediction capabilities. It serves hundreds of users at NASA Goddard Space Flight Center, as well as other NASA centers, laboratories, and universities across the US. Over the past year, NCCS has continued expanding its data-centric computing environment to meet the increasingly data-intensive challenges of climate science. We doubled our Discover supercomputer's peak performance to more than 800 teraflops by adding 7,680 Intel Xeon Sandy Bridge processor-cores and most recently 240 Intel Xeon Phi Many Integrated Core (MIG) co-processors. A supercomputing-class analysis system named Dali gives users rapid access to their data on Discover and high-performance software including the Ultra-scale Visualization Climate Data Analysis Tools (UV-CDAT), with interfaces from user desktops and a 17- by 6-foot visualization wall. NCCS also is exploring highly efficient climate data services and management with a new MapReduce/Hadoop cluster while augmenting its data distribution to the science community. Using NCCS resources, NASA completed its modeling contributions to the Intergovernmental Panel on Climate Change (IPCG) Fifth Assessment Report this summer as part of the ongoing Coupled Modellntercomparison Project Phase 5 (CMIP5). Ensembles of simulations run on Discover reached back to the year 1000 to test model accuracy and projected climate change through the year 2300 based on four different scenarios of greenhouse gases, aerosols, and land use. The data resulting from several thousand IPCC/CMIP5 simulations, as well as a variety of other simulation, reanalysis, and observationdatasets, are available to scientists and decision makers through an enhanced NCCS Earth System Grid Federation Gateway. Worldwide downloads have totaled over 110 terabytes of data.

Webster, William P.↗
DOE OSTI2024

Bioactive exometabolites drive maintenance competition in simple bacterial communities

During prolonged resource limitation, bacterial cells can persist in metabolically active states of non-growth. These maintenance periods, such as those experienced in stationary phase, can include upregulation of secondary metabolism and release of exometabolites into the local environment. As resource limitation is common in many environmental microbial habitats, we hypothesized that neighboring bacterial populations employ exometabolites to compete or cooperate during maintenance and that these exometabolite-facilitated interactions can drive community outcomes. Here, we evaluated the consequences of exometabolite interactions over the stationary phase among three environmental strains: Burkholderia thailandensis E264, Chromobacterium subtsugae ATCC 31532, and Pseudomonas syringae pv. tomato DC3000. We assembled them into synthetic communities that only permitted chemical interactions. We compared the responses (transcripts) and outputs (exometabolites) of each member with and without neighbors. We found that transcriptional dynamics were changed with different neighbors and that some of these changes were coordinated between members. The dominant competitor B. thailandensis consistently upregulated biosynthetic gene clusters to produce bioactive exometabolites for both exploitative and interference competition. These results demonstrate that competition strategies during maintenance can contribute to community-level outcomes. It also suggests that the traditional concept of defining competitiveness by growth outcomes may be narrow and that maintenance competition could be an additional or alternative measure.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Climate warming enhances microbial network complexity and stability

Unravelling the relationships between network complexity and stability under changing climate is a challenging topic in theoretical ecology that remains understudied in the field of microbial ecology. Here, we examined the effects of long-term experimental warming on the complexity and stability of molecular ecological networks in grassland soil microbial communities. Warming significantly increased network complexity, including network size, connectivity, connectance, average clustering coefficient, relative modularity and number of keystone species, as compared with the ambient control. Molecular ecological networks under warming became significantly more robust, with network stability strongly correlated with network complexity, supporting the central ecological belief that complexity begets stability. Furthermore, warming significantly strengthened the relationships of network structure to community functional potentials and key ecosystem functioning. Furthermore, these results indicate that preserving microbial ‘interactions’ is critical for ecosystem management and for projecting ecological consequences of future climate warming.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Aemulus ν: precision halo mass functions in wνCDM cosmologies

Precise and accurate predictions of the halo mass function for cluster mass scales in wνCDM cosmologies are crucial for extracting robust and unbiased cosmological information from upcoming galaxy cluster surveys. Here, we present a halo mass function emulator for cluster mass scales (≳ 1013 M ⊙/h) up to redshift z = 2 with comprehensive support for the parameter space of wνCDM cosmologies allowed by current data. Based on the Aemulus ν suite of simulations, the emulator marks a significant improvement in the precision of halo mass function predictions by incorporating both massive neutrinos and non-standard dark energy equation of state models. This allows for accurate modeling of the cosmology dependence in large-scale structure and galaxy cluster studies. We show that the emulator, designed using Gaussian Process Regression, has negligible theoretical uncertainties compared to dominant sources of error in future cluster abundance studies. Our emulator is publicly available (https://github.com/DelonShen/aemulusnu_hmf), providing the community with a crucial tool for upcoming cosmological surveys such as LSST and Euclid.

cluster counts↗
DOE OSTI2020

Landfalling Droughts: Global Tracking of Moisture Deficits From the Oceans Onto Land

Abstract Droughts threaten food, energy, and water security, causing death and displacement of millions of people and billions of dollars in damages. However, there are still important gaps in the understanding of drought mechanisms and behaviors, inhibiting the accuracy of early‐warning systems designed to protect communities worldwide. We use an object‐tracking algorithm to track clusters of precipitation‐minus‐evaporation moisture deficits across land and ocean areas of the globe from 1981–2018. This analysis reveals a new type of “landfalling drought” that originates over the ocean and “migrates” onto land. We find that 16% of droughts that affected the continents worldwide from 1981–2018 were landfalling droughts. These droughts were significantly larger (220–425%) and more intense (4–30%)—and grew (253–285%) and intensified (9–28%) faster—than droughts that developed solely over the land or ocean. To identify potential underlying mechanisms, we analyze moisture transport associated with landfalling droughts over western North America. We find that landfalling droughts in this region are associated with anomalously anticyclonic atmospheric pressure patterns that reduce moisture fluxes over the Pacific Ocean toward the continent. By advancing understanding of the spatiotemporal evolution of droughts, our findings offer the potential to improve seasonal‐scale prediction and long‐term projection of global drought risks.

Herrera‐Estrada, Julio E.↗