Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analysis cluster”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Validation of the DESI DR2 measurements of baryon acoustic oscillations from galaxies and quasars

The Dark Energy Spectroscopic Instrument (DESI) Data Release 2 (DR2) galaxy and quasar clustering data represents a significant expansion of data from Data Release 1 (DR1), providing improved statistical precision in baryon acoustic oscillation (BAO) constraints across multiple tracers, including bright galaxies, luminous red galaxies, emission line galaxies, and quasars. In this paper, we validate the BAO analysis of DR2. We present the results of robustness tests on the blinded DR2 data and, after unblinding, consistency checks on the unblinded DR2 data. All results are compared with those obtained from a suite of mock catalogs that replicate the selection and clustering properties of the DR2 sample. We confirm the consistency of DR2 BAO measurements with DR1 while achieving a reduction in statistical uncertainties due to the increased survey volume and completeness. The combined BAO precision, including both statistical and systematic errors, improves from ∼0.52% in DR1 to 0.30% in DR2—a factor of 1.7 gain. We assess the impact of analysis choices, including different data vectors (correlation function vs power spectrum), modeling approaches and systematics treatments, and an assumption of the Gaussian likelihood, finding that our BAO constraints are stable across these variations and assumptions with a few minor refinements to the baseline setup of the DR1 BAO analysis. We summarize a series of pre-unblinding tests that confirmed the readiness of our analysis pipeline, the final systematic errors, and the DR2 BAO analysis baseline. The successful completion of these tests led to the unblinding of the DR2 BAO measurements, ultimately leading to the DESI DR2 cosmological analysis, with their implications for the expansion history of the Universe and the nature of dark energy presented in the DESI key paper (companion paper).

79 ASTRONOMY AND ASTROPHYSICS↗

Convective and stratiform components of a Winter Monsoon Cloud Cluster determined from geosynchronous infrared satellite data

The horizontal precipitation structure of cloud clusters observed over the South China Sea during the Winter Monsoon Experiment (WMONEX) is analyzed using a convective-stratiform technique (CST) developed by Adler and Negri (1988). The technique was modified by altering the method for identifying convective cells in the satellite data, accounting for the extremely cold cloud tops characteristic of the WMONEX region, and modifying the threshold infrared temperature for the boundary of the stratiform rain area. The precipitation analysis was extended to the entire history of the cloud cluster by applying the modified CST to IR imagery from geosynchronous-satellite observations. The ship and aircraft data from the later period of the cluster's lifetime make it possible to check the locations of convective and stratiform precipitation identified by the CST using in situ observations. The extended CST is considered to be effective for determining the climatology of the convective-stratiform structure of tropical cloud clusters.

Goldenberg, Stanley B.↗

Reference Site Conditions for Floating Wind Arrays in the United States

Floating offshore wind farm design is highly site-specific, requiring detailed information about the specific conditions of a project area for realistic design studies. Unfortunately, publicly available site condition data for potential floating offshore wind project sites in the United States is scarce. To support U.S. offshore wind research, we developed reference site condition datasets, including metocean and seabed information, for four potential floating wind project areas in the U.S.: Humboldt Bay, Morro Bay, the Gulf of Maine, and the Gulf of Mexico. These datasets were compiled using publicly available data. Our metocean analysis, covering wind, waves, and surface currents, utilized measurement data from 2000 to 2020. Sources included the National Renewable Energy Laboratory’s National Offshore Wind Dataset for wind data, National Data Buoy Center buoys for wave data, and the High Frequency Radar Network for surface currents. These data were integrated into hourly time series used to compute extreme return periods up to 500 years, monthly statistics, and joint probability clusters for fatigue analysis. Soil conditions were evaluated using the usSEABED database and bathymetry grids were interpolated from the NCEI Digital Elevation Model Global Mosaic. In addition to providing curated reference site condition datasets for four U.S. areas, our assessment highlights the need for more publicly available metocean and soil condition data.

17 WIND ENERGY↗

Performance and Commissioning of the BigBite Timing Hodoscope for Nucleon Form Factor Measurements at Jefferson Lab

The BigBite Timing Hodoscope detector is the primary subject of this thesis. The Super BigBite Spectrometer is a Jefferson Lab Hall A Collaboration project that has and will continue to measure nucleon electromagnetic form factors. This spectrometer includes the Timing Hodoscope which provides high resolution particle timing data for scattered electrons in the electron arm of BigBite. The Timing Hodoscope utilizes 90, 25 × 25 × 600 mm3 scintillator bars stacked on top of each other to form a single detector plane, and these bars are connected to 180 photo-multiplier tubes via light guides. Particles collide with the scintillating material creating a shower of optical photons and these particle events in the bars are collected to generate signals that are readout by the data acquisition (DAQ) electronics. NINO ASIC amplifier-discriminator cards output signals from the photo-multiplier tubes into analogue and logic signals, which are sent to analogue-to-digital (ADC) and time-to-digital (TDC) converter data acquisition readout modules. This data is then used for analysis of the detector. The focus of this thesis is the construction, commissioning, calibration, and performance of the BigBite Timing Hodoscope before and during the first of five nucleon electromagnetic form factor experiments at Jefferson Lab Hall A. Before the neutron magnetic form factor, G n M, experiment, cosmic ray data was collected during commissioning to confirm proper operation of the Timing Hodoscope electronics by observing the ADC and TDC data. Commissioning studies for charge normalization, gain matching, and other ADC and TDC detector data variables were performed before moving the detector into Hall A. Following installation in Hall A, several calibration studies were implemented to fine-tune the detector in preparation for use in the experiment. The calibration studies included analysis of timing cuts, TDC alignment, the time-walk effect, time difference offsets, and scintillator velocity corrections. Once the Timing Hodoscope was well-calibrated, data-taking during the experiment commenced and the beam-on-target data was used to characterize the Timing Hodoscope performance during the G n M experiment run-time. The performance analysis included studies observing energy deposit, cluster size, rates, accidentals, pile-up, tracking efficiency, position resolution, and time resolution. After application of physics cuts to ensure a data set comprised of particle tracks corresponding to elastic electrons, which is the main data of interest for measurement of G n M, the Timing Hodoscope is shown on average across all kinematic settings to have a >98% tracking efficiency, a position resolution of 4-6 cm in the non-dispersive plane and 1.5-2 cm in the dispersive plane, and a time resolution of 500-750 ps. These performance results are compared to a GEANT4 based performance simulation of the BigBite Timing Hodoscope for reference, showing to what degree the measured performance values match those taken from the simulation.

Marinaro, Ralph↗

Asc-Seurat: analytical single-cell Seurat-based web application

Abstract Background Single-cell RNA sequencing (scRNA-seq) has revolutionized the study of transcriptomes, arising as a powerful tool for discovering and characterizing cell types and their developmental trajectories. However, scRNA-seq analysis is complex, requiring a continuous, iterative process to refine the data and uncover relevant biological information. A diversity of tools has been developed to address the multiple aspects of scRNA-seq data analysis. However, an easy-to-use web application capable of conducting all critical steps of scRNA-seq data analysis is still lacking. Summary We present Asc-Seurat, a feature-rich workbench, providing an user-friendly and easy-to-install web application encapsulating tools for an all-encompassing and fluid scRNA-seq data analysis. Asc-Seurat implements functions from the Seurat package for quality control, clustering, and genes differential expression. In addition, Asc-Seurat provides a pseudotime module containing dozens of models for the trajectory inference and a functional annotation module that allows recovering gene annotation and detecting gene ontology enriched terms. We showcase Asc-Seurat’s capabilities by analyzing a peripheral blood mononuclear cell dataset. Conclusions Asc-Seurat is a comprehensive workbench providing an accessible graphical interface for scRNA-seq analysis by biologists. Asc-Seurat significantly reduces the time and effort required to analyze and interpret the information in scRNA-seq datasets.

60 APPLIED LIFE SCIENCES↗

The Infrared Spectrum of H2S From 1 to 5 Microns

The absorption spectra of H2S from 2000 to 11,147 cm(exp -1) have been obtained with spectral resolutions of 0.006, 0.012, and 0.021 cm(exp -1) using the Fourier transform spectrometer at Kitt Peak National Observatory. The transitions of 21 bands have been assigned for the first time and 9 others reanalyzed so that accurate energy levels, band origins, and rotational parameters could be determined. The analysis of these data revealed some remarkable features in the energy spectrum, e.g., fourfold clustering of rotational levels belonging to the symmetric and asymmetric components of local mode manifolds at a high degree of stretching excitation. This paper reports fitted vibrational parameters and predicted band origins of H2S-32 up to 12,735 cm(exp -1). It also presents the degenerate rotational constants and upper state energies of (301)-(202) and (311)-(212) at 1 micron as illustrations of clustering in the local mode limit.

Alexander D. Bykov↗

Structure in the 3D Galaxy Distribution: III. Fourier Transforming the Universe: Phase and Power Spectra

We demonstrate the effectiveness of a relatively straightforward analysis of the complex 3D Fourier transform of galaxy coordinates derived from redshift surveys. Numerical demonstrations of this approach are carried out on a volume-limited sample of the Sloan Digital Sky Survey redshift survey. The direct unbinned transform yields a complex 3D data cube quite similar to that from the Fast Fourier Transform (FFT) of finely binned galaxy positions. In both cases deconvolution of the sampling window function yields estimates of the true transform. Simple power spectrum estimates from these transforms are roughly consistent with those using more elaborate methods. The complex Fourier transform characterizes spatial distributional properties beyond the power spectrum in a manner different from (and we argue is more easily interpreted than) the conventional multi-point hierarchy. We identify some threads of modern large scale inference methodology that will presumably yield detections in new wider and deeper surveys.

Galactic clusters↗

Structure in the 3D Galaxy Distribution. III. Fourier Transforming the Universe: Phase and Power Spectra

We demonstrate the effectiveness of a relatively straightforward analysis of the complex 3D Fourier transform of galaxy coordinates derived from redshift surveys. Numerical demonstrations of this approach are carried out on a volume-limited sample of the Sloan Digital Sky Survey redshift survey. The direct unbinned transform yields a complex 3D data cube quite similar to that from the Fast Fourier Transform of finely binned galaxy positions. In both cases, deconvolution of the sampling window function yields estimates of the true transform. Simple power spectrum estimates from these transforms are roughly consistent with those using more elaborate methods. The complex Fourier transform characterizes spatial distributional properties beyond the power spectrum in a manner different from (and we argue is more easily interpreted than) the conventional multipoint hierarchy. We identify some threads of modern large-scale inference methodology that will presumably yield detections in new wider and deeper surveys.

Galaxies↗

BOREAS AFM-12 1-km AVHRR Seasonal Land Cover Classification

The Boreal Ecosystem-Atmosphere Study (BOREAS) Airborne Fluxes and Meteorology (AFM)-12 team's efforts focused on regional scale Surface Vegetation and Atmosphere (SVAT) modeling to improve parameterization of the heterogeneous BOREAS landscape for use in larger scale Global Circulation Models (GCMs). This regional land cover data set was developed as part of a multitemporal one-kilometer Advanced Very High Resolution Radiometer (AVHRR) land cover analysis approach that was used as the basis for regional land cover mapping, fire disturbance-regeneration, and multiresolution land cover scaling studies in the boreal forest ecosystem of central Canada. This land cover classification was derived by using regional field observations from ground and low-level aircraft transits to analyze spectral-temporal clusters that were derived from an unsupervised cluster analysis of monthly Normalized Difference Vegetation Index (NDVI) image composites (April-September 1992). This regional data set was developed for use by BOREAS investigators, especially those involved in simulation modeling, remote sensing algorithm development, and aircraft flux studies. Based on regional field data verification, this multitemporal one-kilometer AVHRR land cover mapping approach was effective in characterizing the biome-level land cover structure, embedded spatially heterogeneous landscape patterns, and other types of key land cover information of interest to BOREAS modelers.The land cover mosaics in this classification include: (1) wet conifer mosaic (low, medium, and high tree stand density), (2) mixed coniferous-deciduous forest (80% coniferous, codominant, and 80% deciduous), (3) recent visible bum, vegetation regeneration, or rock outcrops-bare ground-sparsely vegetated slow regeneration bum (four classes), (4) open water and grassland marshes, and (5) general agricultural land use/ grasslands (three classes). This land cover mapping approach did not detect small subpixel-scale landscape features such as fens, bogs, and small water bodies. Field observations and comparisons with Landsat Thematic Mapper (TM) suggest a minimum effective resolution of these land cover classes in the range of three to four kilometers, in part, because of the daily to monthly compositing process. In general, potential accuracy limitations are mitigated by the use of conservative parameterization rules such as aggregation of predominant land cover classes within minimum horizontal grid cell sizes of ten kilometers. The AFM-12 one-kilometer AVHRR seasonal land cover classification data are available from the Earth Observing System Data and Information System (EOSDIS) Oak Ridge National Laboratory (ORNL) Distributed Active Archive Center (DAAC). The data files are available on a CD-ROM (see document number 20010000884).

Steyaert, Lou↗

The Heavy Element Abundance in Groups of Galaxies

Over the past few years we have analyzed a sample of clusters observed by the Advanced Spacecraft for Cosmology Astrophysics (ASCA) X-ray satellite. We performed spatially resolved X-ray spectroscopy of a sample of 18 relaxed clusters of galaxies with gas temperatures below 4 keV. The spectral analysis was done using ASCA/SIS (Solid state Imaging Spectrometer) data combined with imaging data from ROSAT/PSPC (German acronym for X-ray satellite/Position Sensitive Proportional Counter) and Einstein/IPC (Imaging Proportional Counter) observations. We derived temperature profiles using single-temperature fits for all of the clusters in the sample, and also corrected for the presence of cold gas in the center of so-called 'cooling flow' clusters. For all of the clusters in the sample we derived Si and Fe abundance profiles. For a few of the clusters we also were able to derive Ne and S abundance profiles. We compared the elemental abundances derived at similar overdensities in all of the clusters in the sample. We also compared element mass-to-light ratios for the entire sample. We concluded that the preferential accretion of low entropy, low abundance gas into the potentials of groups and cold clusters can explain most of the observed trends in metallicity. In addition, we discussed the importance of preheating of the intracluster medium by Type II supernovae on the cluster scaling relations.

David, Laurence↗

Landsat-4 data quality analysis

Landsat-4 satellite Thematic Mapper (TM) and multispectral scanner (MSS) data have been analyzed in order to ascertain data quality and information content. Geometric evaluations have tested band-to-band registration accuracy, and the TM's overall system resolution was evaluated for the case of image objects with high contrast, sharp edge responses. The information content evaluation employed clustering, principal components, and the transformed divergence separability measured on data from Iowa and Chicago, Illinois. The MSS classification analysis compared MSS and TM information contents for a large number of science classes.

Anuta, P.↗

In-Situ and Remote-Sensing Data Fusion Using Machine Learning Techniques to Infer Urban and Fire Related Pollution Plumes

Airmass type characterization is key in understanding the relative contribution of various emission sources to atmospheric composition and air quality and can be useful in bottom-up model validation and emission inventories. However, classification of pollution plumes from space is often not trivial. Sub-orbital campaigns, such as SEAC4RS (Studies of Emissions, Atmospheric Composition, Clouds and Climate Coupling by Regional Surveys) give us a unique opportunity to study atmospheric composition in detail, by using a vast suite of in-situ instruments for the detection of trace gases and aerosols. These measurements allow identification of spatial and temporal atmospheric composition changes due to various pollution plumes resulting from urban, biogenic and smoke emissions. Nevertheless, to transfer the knowledge gathered from such campaigns into a global spatial and temporal context, there is a need to develop workflow that can be applicable to measurements from space. In this work we rely on sub-orbital in-situ and total column remote sensing measurements of various pollution plumes taken aboard the NASA DC-8 during 2013 SEAC4RS campaign, linking them through a neural-network (NN) algorithm to allow inference of pollution plume types by input of columnar aerosol and trace-gas measurements. In particular, we use the 4STAR (Spectrometer for Sky-Scanning, Sun-Tracking Atmospheric Research) airborne measurements of wavelength dependent aerosol optical depth (AOD), particle size proxies, O3, NO2 and water vapor to classify different pollution plumes. Our method relies on assigning a-priori ground-truth labeling to the various plumes, which include urban pollution, different fire types (i.e. forest and agriculture) and fire stage (i.e. fresh and aged) using cluster analysis of aerosol and trace-gases in-situ and auxiliary (e.g. trajectory) data and the training of a NN scheme to fit the best prediction parameters using 4STAR measurements as input. We explore our misclassification rates as related to our ground-truth labels, and with multi-layered pollution plume cases. The next step in our analysis is to optimize parameter selection for a scheme that can be applied to space-borne aerosol and trace-gas observation platforms such as OMI, and future geostationary satellites such as TEMPO and GEO-CAPE.

Neural-network↗

The unique planetary nebula NGC 2818

The planetary nebula NGC 2818, or PK 261 + 8 deg 1, is of special interest due to its apparent association with a Population I open cluster (of the same designation). The results of new observations of the nebula are presented, including interference-filter imagery, photoelectric photometry, and ground-based and IUE spectroscopy. Analysis of its composition based on new IUE and ground-based spectroscopy and model calculations of the very similar planetary nebula NGC 2440 suggests that NGC 2818 is a prototype of the He-rich and N-rich Type I group. Compared to the composition of H II regions in the solar neighborhood, He is 60 percent overabundant, C is 0.3 dex lower, N is 1.0 dex higher, and O, Ne, Si, Cl, and Ar are essentially at comparable values. Analysis of kinematical and morphological data suggests that the nebula is probably associated with the star cluster (revised distance = 3.5 kpc). If so, then it is of exceptional size (radius approximately 1.1 pc), mass (greater than or equal to 0.6 solar mass), expansion velocity (52 + or - 3 km/s), and age (possibly as old as 22,000 yr). Some implications of the results regarding the masses of planetary-nebula progenitors, the nucleosynthesis processes in stars of intermediate mass, and the formation of planetary nebulae are also discussed.

Dufour, R. J.↗

Describing patterns of familial cancer risk in subfertile men using population pedigree data

STUDY QUESTION Can we simultaneously assess risk for multiple cancers to identify familial multicancer patterns in families of azoospermic and severely oligozoospermic men? SUMMARY ANSWER Here, distinct familial cancer patterns were observed in the azoospermia and severe oligozoospermia cohorts, suggesting heterogeneity in familial cancer risk by both type of subfertility and within subfertility type. WHAT IS KNOWN ALREADY Subfertile men and their relatives show increased risk for certain cancers including testicular, thyroid, and pediatric. STUDY DESIGN, SIZE, DURATION A retrospective cohort of subfertile men (N = 786) was identified and matched to fertile population controls (N = 5674). Family members out to third-degree relatives were identified for both subfertile men and fertile population controls (N = 337 754). The study period was 1966–2017. Individuals were censored at death or loss to follow-up, loss to follow-up occurred if they left Utah during the study period. PARTICIPANTS/MATERIALS, SETTING, METHODS Azoospermic (0 × 10 6 /mL) and severely oligozoospermic (<1.5 × 10 6 /mL) men were identified in the Subfertility Health and Assisted Reproduction and the Environment cohort (SHARE). Subfertile men were age- and sex-matched 5:1 to fertile population controls and family members out to third-degree relatives were identified using the Utah Population Database (UPDB). Cancer diagnoses were identified through the Utah Cancer Registry. Families containing ≥10 members with ≥1 year of follow-up 1966–2017 were included (azoospermic: N = 426 families, 21 361 individuals; oligozoospermic: N = 360 families, 18 818 individuals). Unsupervised clustering based on standardized incidence ratios for 34 cancer phenotypes in the families was used to identify familial multicancer patterns; azoospermia and severe oligospermia families were assessed separately. MAIN RESULTS AND THE ROLE OF CHANCE Compared to control families, significant increases in cancer risks were observed in the azoospermia cohort for five cancer types: bone and joint cancers hazard ratio (HR) = 2.56 (95% CI = 1.48–4.42), soft tissue cancers HR = 1.56 (95% CI = 1.01–2.39), uterine cancers HR = 1.27 (95% CI = 1.03–1.56), Hodgkin lymphomas HR = 1.60 (95% CI = 1.07–2.39), and thyroid cancer HR = 1.54 (95% CI = 1.21–1.97). Among severe oligozoospermia families, increased risk was seen for three cancer types: colon cancer HR = 1.16 (95% CI = 1.01–1.32), bone and joint cancers HR = 2.43 (95% CI = 1.30–4.54), and testis cancer HR = 2.34 (95% CI = 1.60–3.42) along with a significant decrease in esophageal cancer risk HR = 0.39 (95% CI = 0.16–0.97). Thirteen clusters of familial multicancer patterns were identified in families of azoospermic men, 66% of families in the azoospermia cohort showed population-level cancer risks, however, the remaining 12 clusters showed elevated risk for 2-7 cancer types. Several of the clusters with elevated cancer risks also showed increased odds of cancer diagnoses at young ages with six clusters showing increased odds of adolescent and young adult (AYA) diagnosis [odds ratio (OR) = 1.96–2.88] and two clusters showing increased odds of pediatric cancer diagnosis (OR = 3.64–12.63). Within the severe oligozoospermia cohort, 12 distinct familial multicancer clusters were identified. All 12 clusters showed elevated risk for 1–3 cancer types. An increase in odds of cancer diagnoses at young ages was also seen in five of the severe oligozoospermia familial multicancer clusters, three clusters showed increased odds of AYA diagnosis (OR = 2.19–2.78) with an additional two clusters showing increased odds of a pediatric diagnosis (OR = 3.84–9.32). LIMITATIONS, REASONS FOR CAUTION Although this study has many strengths, including population data for family structure, cancer diagnoses and subfertility, there are limitations. First, semen measures are not available for the sample of fertile men. Second, there is no information on medical comorbidities or lifestyle risk factors such as smoking status, BMI, or environmental exposures. Third, all of the subfertile men included in this study were seen at a fertility clinic for evaluation. These men were therefore a subset of the overall population experiencing fertility problems and likely represent those with the socioeconomic means for evaluation by a physician. WIDER IMPLICATIONS OF THE FINDINGS This analysis leveraged unique population-level data resources, SHARE and the UPDB, to describe novel multicancer clusters among the families of azoospermic and severely oligozoospermic men. Distinct overall multicancer risk and familial multicancer patterns were observed in the azoospermia and severe oligozoospermia cohorts, suggesting heterogeneity in cancer risk by type of subfertility and within subfertility type. Describing families with similar cancer risk patterns provides a new avenue to increase homogeneity for focused gene discovery and environmental risk factor studies. Such discoveries will lead to more accurate risk predictions and improved counseling for patients and their families. STUDY FUNDING/COMPETING INTEREST(S) This work was funded by GEMS: Genomic approach to connecting Elevated germline Mutation rates with male infertility and Somatic health (Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD): R01 HD106112). The authors have no conflicts of interest relevant to this work.

60 APPLIED LIFE SCIENCES↗

Precipitation Characteristics of ISCCP Cloud Regimes for Improving Model Hydrological Budgets

The key in unraveling relationships between precipitation and atmospheric circulations is their common linkage to clouds. Clouds can be described in a variety of ways and several approaches can be adopted to examine their connections to precipitation. We claim that when cloud regimes (aka weather states) from the International Satellite Cloud Climatology Project (ISCCP) are used to conditionally sample/sort and average precipitation data, useful insight and GCM-appropriate diagnostics on the origins and distribution of precipitation can be obtained. The ISCCP cloud regimes are mesoscale (2.5 ) cloud mixtures determined by cluster analysis on joint histograms of cloud optical thickness and cloud top pressure inferred from geostationary and polar orbiter satellite passive retrievals. The ISCCP cloud regime data are combined with GPCP IDD merged surface precipitation data and/or higher temporal and spatial resolution TRMM Multi-Satellite Precipitation Analysis (TMPA) data. The analysis is performed separately for three geographical zones, tropics, and northern/southern midlatitudes (for GPCP; only the tropics can be examined with TMPA data). Our presentation aspires to provide answers to the following questions: (l) What is the mean and variability of surface precipitation produced by each cloud regime at the time of regime occurrence? (2) What is the relative contribution of each cloud regime to the total precipitation within its geographical zone? (3) What is the geographical distribution of precipitation corresponding to particular cloud regime? (4) To what extent are the cloud regimes distinct in terms of their precipitation characteristics and is the regime ordering in terms of convective strength consistent with the observed precipitation intensity?

Lee, D.↗

Performance and usability enhancements for continuous subgraph matching queries on graph-structured data

A query graph, which includes vertices and edges, represents a query on graph-structured data. The query graph is decomposed into query subgraphs. A network analysis tool performs continuous subgraph matching queries to facilitate analysis of computer network traffic, social media events, or other streams of data represented as a dynamic data graph (graph-structured data). This can help identify emerging trends in the data. Some features of the network analysis tool enhance performance by effectively utilizing distributed computing resources (including processing cores and memory at different nodes of a cluster) to speed up the process of updating the dynamic data graph and detecting matches of query subgraphs. Features of a query graph building tool enhance usability by providing intuitive ways to specify query graphs and their subgraphs. Features of a results visualization tool enhance usability by providing an intuitive way to present the results of continuous subgraph matching queries.

Choudhury, Sutanay↗

Clustering, randomness and regularity in cloud fields. I - Theoretical considerations. II - Cumulus cloud fields

The current controversy existing in reference to the regularity vs. clustering in cloud fields is examined by means of analysis and simulation studies based upon nearest-neighbor cumulative distribution statistics. It is shown that the Poisson representation of random point processes is superior to pseudorandom-number-generated models and that pseudorandom-number-generated models bias the observed nearest-neighbor statistics towards regularity. Interpretation of this nearest-neighbor statistics is discussed for many cases of superpositions of clustering, randomness, and regularity. A detailed analysis is carried out of cumulus cloud field spatial distributions based upon Landsat, AVHRR, and Skylab data, showing that, when both large and small clouds are included in the cloud field distributions, the cloud field always has a strong clustering signal.

Weger, R. C.↗

G-Mapper: Learning a Cover in the Mapper Construction

The Mapper algorithm is a visualization technique in topological data analysis (TDA) that outputs a graph reflecting the structure of a given dataset. However, the Mapper algorithm requires tuning several parameters in order to generate a “nice” Mapper graph. This paper focuses on selecting the cover parameter. We present an algorithm that optimizes the cover of a Mapper graph by splitting a cover repeatedly according to a statistical test for normality. Our algorithm is based on G-means clustering, which searches for the optimal number of clusters in 𝑘-means by iteratively applying the Anderson–Darling test. Our splitting procedure employs a Gaussian mixture model to carefully choose the cover according to the distribution of the given data. In conclusion, experiments for synthetic and real-world datasets demonstrate that our algorithm generates covers so that the Mapper graphs retain the essence of the datasets, while also running significantly faster than a previous iterative method.

G-means clustering↗