SEARCH · Engineering Papers

Results for “pattern clustering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Power Profile Monitoring and Tracking Evolution of System-Wide HPC Workloads

The power & energy demands of HPC machines have grown significantly. Modern exascale HPC systems require tens of megawatts of combined power for computing resources and cooling facilities at full capacity. The current energy trend is not sustainable for future HPC systems, and there is a need to work toward the energy efficiency aspect of HPC performance. Energy awareness of the HPC applications at the job level is essential for running an efficient HPC system. This work aims to develop a pipeline to provide a production-level system-wide overview of the HPC workloads' power profile while handling evolving workloads exhibiting new power trends. We developed an open-set classification model for HPC jobs based on the properties of power profiles to continuously provide a system-wide holistic view of recently completed jobs. The pipeline helps continuously monitor the job-level power usage pattern of HPC and enables us to capture the new trends in applications' power behavior. We employed a comprehensive set of techniques to generate job-level data, custom-designed feature extraction methods to extract critical features from jobs' power profiles, clustering techniques powered by generative modeling, and open-set classification for identifying job profiles into known classes or an unknown set. With extensive evaluations, we demonstrate the effectiveness of each component in our pipeline. We provide an analysis of the resulting clusters that characterize the power profile landscape of the Summit supercomputer from more than 60K jobs executed in a year. The open-set classification classifies the known data sets into known classes with high accuracy and identifies unknown data noints with over 85% accuracy.

Karimi, Ahmad Maroof↗

DOE OSTI2020

ENSIGN

ENSIGN is a data analytics software package offering a modern unsupervised machine learning solution for scalable discovery in Big Data. The analytics in ENSIGN are based on an advanced mathematical tool called tensor decomposition and they are optimized to run efficiently on a range of computing platforms (from small multicore Desktop platforms to large Supercomputing clusters and novel high-end memory-driven computing platforms such as HPE Superdome Flex). ENSIGN enables the user to extract deep insights from the entirety of massive-scale (100s of Gigabytes or Terabytes scale) multidimensional data. ENSIGN uncovers latent patterns in data without the user having to specify or describe what the patterns are; the user, in the first place, may not even know such patterns existed and that they have to look for such patterns. The insights gained from ENSIGN could be trailheads that can be used as starting points for deeper forensic investigation.

Baskaran, Muthu↗

DOE OSTI2022

ENSIGN

Baskaran, Muthu↗

DOE OSTI2020

A Guide to Conquer the Biological Network Era Using Graph Theory

Networks are one of the most common ways to represent biological systems as complex sets of binary interactions or relations between different bioentities. In this article, we discuss the basic graph theory concepts and the various graph types, as well as the available data structures for storing and reading graphs. In addition, we describe several network properties and we highlight some of the widely used network topological features. We briefly mention the network patterns, motifs and models, and we further comment on the types of biological and biomedical networks along with their corresponding computer- and human-readable file formats. Finally, we discuss a variety of algorithms and metrics for network analyses regarding graph drawing, clustering, visualization, link prediction, perturbation, and network alignment as well as the current state-of-the-art tools. We expect this review to reach a very broad spectrum of readers varying from experts to beginners while encouraging them to enhance the field further.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2021

Single Cell RNA-Seq and Machine Learning Reveal Novel Subpopulations in Low-Grade Inflammatory Monocytes With Unique Regulatory Circuits

Subclinical doses of LPS (SD-LPS) are known to cause low-grade inflammatory activation of monocytes, which could lead to inflammatory diseases including atherosclerosis and metabolic syndrome. Sodium 4-phenylbutyrate is a potential therapeutic compound which can reduce the inflammation caused by SD-LPS. To understand the gene regulatory networks of these processes, we have generated scRNA-seq data from mouse monocytes treated with these compounds and identified 11 novel cell clusters. We have developed a machine learning method to integrate scRNA-seq, ATAC-seq, and binding motifs to characterize gene regulatory networks underlying these cell clusters. Using guided regularized random forest and feature selection, our method achieved high performance and outperformed a traditional enrichment-based method in selecting candidate regulatory genes. Our method is particularly efficient in selecting a few candidate genes to explain observed expression pattern. In particular, among 531 candidate TFs, our method achieves an auROC of 0.961 with only 10 motifs. Finally, we found two novel subpopulations of monocyte cells in response to SD-LPS and we confirmed our analysis using independent flow cytometry experiments. Our results suggest that our new machine learning method can select candidate regulatory genes as potential targets for developing new therapeutics against low grade inflammation.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2021

Unsupervised Power System Event Detection and Classification Using Unlabeled PMU Data

This paper proposes a novel data-driven power system event detection and classification method based on 5TB of actual PMU measurements collected from the US western interconnect. Firstly, a set of comprehensive power quality rules are proposed to pre-filter the raw data and extract the regions of interest (ROI). Six distinct event categories are defined and corresponding patterns are chosen as references. Meanwhile, detailed characteristics of patterns are summarized to enhance our understanding of the actual events. Then, the time-independent feature vectors are generated by extracting the statistical, temporal, and spectral features from the raw time-series data. Furthermore, an ensemble model is proposed to cluster the events by combining multiple K-means clustering models using a voting strategy. Besides, both system-level and PMU-level clustering models are developed. The accuracy and robustness of the event detection method are further improved through interactive evaluation of the two-level clustering results. This paper summarizes the actual characteristics of each event category and provides a reliable basis for accurate label generation. The experiments demonstrate the effectiveness of the proposed event detection and classification method.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2021

Unsupervised Power System Event Detection and Classification Using Unlabeled PMU Data

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2026

Constraining the Galactic bar using the M92 stellar stream

Stellar streams are excellent probes of the gravitational potential in which they evolve. In the Milky Way (MW), globular cluster (GC) streams are routinely used to infer properties about time-dependent perturbations of the underlying potential. This implies that streams with Galactocentric radii small enough to be perturbed by the MW bar should offer constraints on it, such as its pattern speed, which currently has a wide range of values reported in the literature and is important when studying stellar kinematics. The GC M92 has a small pericentre and should be affected by the bar. It has a diffuse stellar stream, but confirming stream members has previously been hindered by a lack of spectroscopic data. In this paper, we use Dark Energy Spectroscopic Instrument (DESI) observations together with photometric and astrometric data to obtain spectroscopic members of the M92 stream for the first time. We identify a clear spatial distribution and gradients in distance moduli, proper motions, and radial velocities that confirm the stream's existence. We compare the observed stream to mock streams generated in different barred potentials and estimate the MW bar's pattern speed $Î©= 29.1^{+0.7}_{-0.4}$ km s$^{-1}$ kpc$^{-1}$ and $\dot Î©= 0.7^{+3.5}_{-2.3}$ km s$^{-1}$ kpc$^{-1}$ Gyr$^{-1}$. This is the first time a stellar stream is used to probabilistically infer these bar properties, and it opens up an exciting realm of inner Galactic potential characterisation using stellar streams.

Byström, Amanda [Edinburgh U., Inst. Astron.] (ORC↗

DOE OSTI2021

Exploratory analysis and performance prediction of big data transfer in High-performance Networks

Big data transfer in large-scale scientific and business applications is increasingly carried out over connections with guaranteed bandwidth provisioned in High-performance Networks (HPNs) via advance bandwidth reservation. Provisioning agents need to carefully schedule data transfer requests, compute network paths, and allocate appropriate bandwidths. Such reserved bandwidths, if not fully utilized, could be simply wasted due to the exclusive access during the approved time window, and cause extra overhead and complexity for resource management. This calls for accurate performance prediction to reserve bandwidths that match actual needs and avoid over-provisioning. We employ machine learning algorithms to predict big data transfer performance based on extensive performance measurements collected in the past several years from data transfer tests using different protocols and toolkits between various end sites on several real-life physical or emulated testbeds. We first analyze the performance patterns in response to a comprehensive list of parameters in end-host systems, network connections, and data transfer applications, which motivate the use of machine learning and also help us identify the effects of latent factors. We then propose threshold- and clustering-based methods to eliminate negative effects of latent factors in data preprocessing and build a robust performance predictor based on customized domain-oriented loss functions. The performance of the proposed methods is verified by extensive experiments using SVR and RFR as well as theoretical analysis of the general performance bound.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Analysis of intraspecies diversity reveals a subset of highly variable plant immune receptors and predicts their binding sites

The evolution of recognition specificities by the immune system depends on the generation of receptor diversity and on connecting the binding of new antigens with the initiation of downstream signaling. In plant immunity, the innate Nucleotide-Binding Leucine-Rich Repeat (NLR) receptor family enables antigen binding and immune signaling. In this study, we surveyed the NLR complements of 62 ecotypes of Arabidopsis thaliana and 54 lines of Brachypodium distachyon and identified a limited number of NLR subfamilies that show high allelic diversity. We show that the predicted specificity-determining residues cluster on the surfaces of Leucine-Rich Repeat domains, but the locations of the clusters vary among NLR subfamilies. By comparing NLR phylogeny, allelic diversity, and known functions of the Arabidopsis NLRs, we formulate a hypothesis for the emergence of direct and indirect pathogen-sensing receptors and of the autoimmune NLRs. These findings reveal the recurring patterns of evolution of innate immunity and can inform NLR engineering efforts.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2024

Investigating the relationship between microbial network features of giant kelp “seedbank” cultures and subsequent farm performance

Microbial inoculants can increase the yield of cultivated crops and are successful in independent trials; however, efficacy drops in large-scale applications due to insufficient consideration of microbial community dynamics. The structure of microbiomes, in addition to the impact of individual taxa, is an important factor to consider when designing growth-promoting inoculants. Here, we investigate the microbial network and community assembly patterns of Macrocystis pyrifera gametophyte germplasm cultures (collectively referred to as a “seedbank”) used to cultivate an offshore farm in Santa Barbara, California, and identify network features associated with increased biomass of mature sporophytes. We found that [1] several network features, such as clustering coefficient and edge ratios, significantly vary with biomass outcomes; [2] gametophytes that become low- or high-biomass sporophytes have different hub taxa; and [3] microbial community assembly of gametophyte germplasm cultures is niche-driven. Overall, this study describes microbial community dynamics in M . pyrifera germplasm cultures and ultimately supports the development of early life stage inoculants that can be used on seaweed cultivars to increase biomass yield.

Osborne, Melisa G. (ORCID:0000000154980057)↗

DOE OSTI2025

Exploring urban typologies using comprehensive analysis of transportation dynamics

Abstract As urban areas continue to expand and develop, categorizing cities into typologies offers a valuable framework for understanding metropolitan dynamics and fostering inter-city collaboration. However, existing typologies related to urban mobility have limitations, failing to consider cities within a single large urban region and often overlooking crucial dimensions such as trip demand and traffic flow. In this paper, we introduce a transportation-focused characterization for cities within a large urban region, specifically the San Francisco Bay Area, California. We incorporate over 40 metrics across five transportation dimensions: trip demand, road network, multi-modal network, traffic flow, and land use. Specifically, for the trip demand dimension, we include metrics capturing residents’ trip characteristics, such as mode share, intra-city trips, and inter-city trips. Additionally, we analyze the purpose of trips entering the city to gain a deeper understanding of incoming trip patterns. In the traffic flow dimension, we examine metrics like vehicle miles traveled, delay, and congestion to assess the traffic conditions on the street network. These, combined with other dimensions, provide a comprehensive view of a city’s transportation dynamics. Using unsupervised machine learning clustering methods, we identified eight distinct typologies for the Bay Area: Live Work Cities; Job and Activity Magnet Cities; Anchor Cities; Multi-modal Cities; Hyper-connected Cities; Low-density Residential Cities; Medium-density Residential Cities; and Mixed-use Residential Cities. Our findings show that many clusters are strongly influenced by trip demand and traffic flow metrics. Finally, we examine the practicality of this typology and its potential to guide collaborative transportation management strategies. The typologies provide a foundation for dialogue among Bay Area cities, focusing on evaluating shared characteristics and leveraging successes or challenges to develop unified strategies for transportation management.

Kuncheria, Anu↗

DOE OSTI2025

Reuniting crystallography with real space: Ab initio structure elucidation with 4D-STEM

Structure elucidation via single-crystal methods has historically lacked experimental access to real-space information, instead relying exclusively on diffraction-space measurements of Bragg reflections. Here we exploit the dual-space imaging power of 4D scanning transmission electron microscopy to meaningfully integrate real-space information into the crystallographic workflow. We show that virtual apertures assembled by segmentation of high-angle annular dark-field images enable i) pixel-by-pixel separation of coherent Bragg signal from clusters of closely spaced nanocrystals and ii) selective extraction of integrated intensities from thinner subregions of individual specimens, facilitating retroactive tuning of multiple scattering artifacts. This strategy empowers us to simply pick and choose whichever nanoscale regions of interest generate the highest-quality diffraction patterns, allowing us to solve several independent structures of the metal-organic framework UiO-66 from specimens whose agglomerated morphology proved intractable for conventional microcrystal electron diffraction. Our method is compatible with both rotational and serial approaches to data processing, ultimately divulging the first scanning nanobeam electron diffraction structures determined by direct methods at subangstrom resolution.

Saha, Ambarneil↗

DOE OSTI2025

Poster Abstract: Leveraging Large Language Models to Reveal Interpretable Cooling Behaviors from Smart Thermostat Data

Frequent heatwaves and hot summers increasingly challenge occupant comfort, health, and energy grid stability. Addressing these challenges requires a detailed understanding of household cooling behaviors, such as thermostat adjustments and adaptive responses to extreme conditions. Traditional analyses often rely on aggregated numerical metrics that overlook subtle but important household-specific variations. In this study, we introduce a generalizable methodology that integrates large language models (LLMs) with vision capabilities to enable scalable and detailed analysis of residential thermostat data. Using Ecobee's Donate Your Data (DYD) dataset—which provides five-minute records of indoor temperatures, thermostat setpoints, and HVAC runtimes—we focus on two U.S. cities with contrasting summer climates : Austin (TX) and Phoenix (AZ). Because raw time-series data are not well suited for direct LLM analysis, we transform them into visual representations, such as daily indoor temperature trajectories and weekly runtime histograms, to better capture behavioral variations. Leveraging LLMs' visual interpretation, we extract descriptive behavioral features, including temperature preferences, time-of-day cooling orientation, anticipatory versus reactive heatwave responses, and behavioral consistency. These semantic features support unsupervised clustering to identify distinct occupant archetypes at scale, revealing differences—such as morning-centric anticipatory coolers versus households that shift toward warmer setpoints during heatwaves—that can inform demand response, resilience planning, and health-aware interventions. By converting raw numerical data into interpretable behavioral patterns, this methodology enables scalable and practical analysis of occupant behavior, supporting actionable insights for comfort, resilience, and energy management.

Nihar, Kopal↗

DOE OSTI2024

Comparison of Gas Phase Fragmentation Behaviors of Nuclear Fuel Cycle Ligands in Lanthanide and Americium Metal Ligand Nitrate Clusters

Introduction (120 words): Transport of metal ions across the aqueous-organic phase boundary is an essential step in a hydrometallurgical nuclear fuel reprocessing strategy. The study of transport agents for nuclear fuel elements is imperative to guide the design of ligands that boost the separation efficiency of the recovery process from fission products. However, limited studies have been made on the chemistry of these transport agents when complexing with transuranic elements in gas-phase where all surrounding factors are essentially excluded. This work investigates the reagent ligand complexations to transuranic and other metals and their dissociations in the gas phase. Comparisons are made between 4f and 5f elements and between ligands. Methods (120 words): (N,N-diisobutylcarbamoylmethyl)phenyloctylphosphine oxide (CMPO) and N,N,N',N'-tetraoctyldiglycolamide (TODGA) have been selected to complex with metal nitrates. The actinide americium and lanthanides neodymium, samarium, and europium were investigated as part of this work. The lanthanides were selected to act as size and electron configuration analogues of the minor actinides. Metal complexes with two ligands and two nitrates ([M(NO3)2(CMPO)2]+, for example) are studied in Bruker micrOTOF-Q II mass spectrometer equipped with collision-induced dissociation capability. The comparisons of the mass spectra are made in groups of homogenous ligands and mixed TODGA-CMPO ligands clusters. Comparisons are also made based on the complexed metals (Am and lanthanides). Preliminary data (300 words): Collision-induced dissociation mass spectrometry data are collected on two ligands complexed with metal nitrates where the two ligands are homogenous, with (CMPO)2 or (TODGA)2, or heterogeneous, with (TODGA)(CMPO). Several fragmentation patterns are observed among complexes with the CMPO ligand whereas the TODGA ligand commonly dissociates intact from the complex. Most of the metal complexes exhibit similar fragmentation patterns, but there are a few notable deviations in fragmentation patterns between the Am and Ln-bearing complexes. For the [M(CMPO)2(NO3)2]+ complexes, the initial loss of nitrate in the form of nitric acid is observed in all four complexes. However, [Am(CMPO)2(NO3)2]+ exhibits an additional fragmentation not found in the lanthanide complexes. Also, a significantly different ratio of the second nitric acid loss is found in the Am complex. These deviations may indicate the different interaction behaviors between actinides and lanthanides. The [M(TODGA)2(NO3)2]+ complexes exhibit the fragmentation as the loss of one TODGA ligand as an intact form and the loss of nitrate as nitric acid. The Am complex exhibits an additional fragmentation after losing the TOGDA ligand, which is not observed among the Ln complexes. The heterogeneous [M(TODGA)(CMPO)(NO3)2]+ complexes exhibit both similarities and differences between the Am and Ln complexes. For example, the heterogenous Am complex does not exhibit the loss of an intact TODGA ligand while all three Ln complexes do. This indicates that TODGA may bind more strongly to Am than Ln. Additionally, the intensity of the loss of CMPO ligand (as partially or whole) is found to be significantly larger than that of the loss of TODGA (as partially of whole) indicating that TODGA is bound to the metal significantly stronger than CMPO. Planned computational analysis will help understand the deviation in fragmentation behaviors between americium and lanthanide metal centers, or between TODGA and CMPO ligands. Novel aspect (20 words): Gas-phase actinide and lanthanide complex formation and fragmentation provide insight into the coordination environment differences of f-element metals.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2024

Comparison of Gas Phase Fragmentation Behaviors of Nuclear Fuel Cycle Ligands in Lanthanide and Americium Metal Ligand Nitrate Clusters

Title (20 word): Comparison of Gas Phase Fragmentation Behaviors of Nuclear Fuel Cycle Ligands in Lanthanide and Americium Metal Ligand Nitrate Clusters Introduction (120 words): Transport of metal ions across the aqueous-organic phase boundary is an essential step in a hydrometallurgical nuclear fuel reprocessing strategy. The study of transport agents for nuclear fuel elements is imperative to guide the design of ligands that boost the separation efficiency of the recovery process from fission products. However, limited studies have been made on the chemistry of these transport agents when complexing with transuranic elements in gas-phase where all surrounding factors are essentially excluded. This work investigates the reagent ligand complexations to transuranic and other metals and their dissociations in the gas phase. Comparisons are made between 4f and 5f elements and between ligands. Methods (120 words): (N,N-diisobutylcarbamoylmethyl)phenyloctylphosphine oxide (CMPO) and N,N,N',N'-tetraoctyldiglycolamide (TODGA) have been selected to complex with metal nitrates. The actinide americium and lanthanides neodymium, samarium, and europium were investigated as part of this work. The lanthanides were selected to act as size and electron configuration analogues of the minor actinides. Metal complexes with two ligands and two nitrates ([M(NO3)2(CMPO)2]+, for example) are studied in Bruker micrOTOF-Q II mass spectrometer equipped with collision-induced dissociation capability. The comparisons of the mass spectra are made in groups of homogenous ligands and mixed TODGA-CMPO ligands clusters. Comparisons are also made based on the complexed metals (Am and lanthanides). Preliminary data (300 words): Collision-induced dissociation mass spectrometry data are collected on two ligands complexed with metal nitrates where the two ligands are homogenous, with (CMPO)2 or (TODGA)2, or heterogeneous, with (TODGA)(CMPO). Several fragmentation patterns are observed among complexes with the CMPO ligand whereas the TODGA ligand commonly dissociates intact from the complex. Most of the metal complexes exhibit similar fragmentation patterns, but there are a few notable deviations in fragmentation patterns between the Am and Ln-bearing complexes. For the [M(CMPO)2(NO3)2]+ complexes, the initial loss of nitrate in the form of nitric acid is observed in all four complexes. However, [Am(CMPO)2(NO3)2]+ exhibits an additional fragmentation not found in the lanthanide complexes. Also, a significantly different ratio of the second nitric acid loss is found in the Am complex. These deviations may indicate the different interaction behaviors between actinides and lanthanides. The [M(TODGA)2(NO3)2]+ complexes exhibit the fragmentation as the loss of one TODGA ligand as an intact form and the loss of nitrate as nitric acid. The Am complex exhibits an additional fragmentation after losing the TOGDA ligand, which is not observed among the Ln complexes. The heterogeneous [M(TODGA)(CMPO)(NO3)2]+ complexes exhibit both similarities and differences between the Am and Ln complexes. For example, the heterogenous Am complex does not exhibit the loss of an intact TODGA ligand while all three Ln complexes do. This indicates that TODGA may bind more strongly to Am than Ln. Additionally, the intensity of the loss of CMPO ligand (as partially or whole) is found to be significantly larger than that of the loss of TODGA (as partially of whole) indicating that TODGA is bound to the metal significantly stronger than CMPO. Planned computational analysis will help understand the deviation in fragmentation behaviors between americium and lanthanide metal centers, or between TODGA and CMPO ligands. Novel aspect (20 words): Gas-phase actinide and lanthanide complex formation and fragmentation provide insight into the coordination environment differences of f-element metals.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2023

Pattern formation and transport for externally driven active matter on periodic substrates (a)

Abstract We investigate the transport of interacting active run-and-tumble particles moving under an external drift force through a periodic array of obstacles for increasing drive amplitudes. For high activity where the system forms a motility-induced phase-separated state, there are several distinct dynamic phases including a low drive pinned cluster phase, an intermediate uniform fluid, and a higher drive stripe crystal state. The transitions between the phases are correlated with signatures in the transport curves, differential mobility, and power spectra of the velocity fluctuations. In contrast, in the low activity regime the transport curves and power spectra undergo little change as a function of drive. We argue that in the high activity limit, the behavior is similar to that of driven solids on periodic substrates, while in the low activity limit the system behaves like a driven fluid.

36 MATERIALS SCIENCE↗

DOE OSTI2020

Rapid Generation of Hierarchically Porous Metal–Organic Frameworks through Laser Photolysis

Abstract Hierarchically porous metal–organic frameworks (HP‐MOFs) facilitate mass transfer due to mesoporosity while preserving the advantage of microporosity. This unique feature endows HP‐MOFs with remarkable application potential in multiple fields. Recently, new methods such as linker labilization for the construction of HP‐MOFs have emerged. To further enrich the synthetic toolkit of MOFs, we report a controlled photolytic removal of linkers to create mesopores within microporous MOFs at tens of milliseconds. Ultraviolet (UV) laser has been applied to eliminate “photolabile” linkers without affecting the overall crystallinity and integrity of the original framework. Presumably, the creation of mesopores can be attributed to the missing‐cluster defects, which can be tuned through varying the time of laser exposure and ratio of photolabile/robust linkers. Upon laser exposure, MOF crystals shrank while metal oxide nanoparticles formed giving rise to the HP‐MOFs. In addition, photolysis can also be utilized for the fabrication of complicated patterns with high precision, paving the way towards MOF lithography, which has enormous potential in sensing and catalysis.

Wang, Kun‐Yu↗