Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data clustering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,459 records · Page 81

A High-Fidelity Molecular Model of the Cu(111) Repeating Unit

Dynamic processes at surfaces are central to heterogeneous catalysis, but their atomistic mechanism(s) can prove difficult to elucidate due to variations in material structure and the corresponding impact on reactivity. Moreover, disparities between reaction conditions and those employed for spectroscopic characterization at surfaces can inhibit detailed understanding of catalysis-relevant chemistries. Herein, we substantiate the so-called “cluster-surface” analogy by leveraging a low-valent tricopper architecture ( 1 ) as a model system for small molecule activation at Cu(111). Two reaction classes are explored: the adsorption of carbon monoxide (CO) and the dissociative adsorption of dihydrogen (H 2 ). These processes serve as an ideal testbed to compare the reactivity of a molecular cluster ( 1 ) to that of a heterogeneous surface, as both reactions have empirical data from measurements performed on crystalline Cu(111). Cluster 1 reversibly binds CO. Variable temperature NMR analysis with 13 CO reveals a favorable enthalpy but large negative entropy (−5.1 kcal × mol –1 and −22.9 cal × mol –1 × K –1 , respectively) for CO binding, affording a process that is marginally endergonic at room temperature (ΔG ads (298.15 K) = 1.7 ± 0.5 kcal × mol –1 ). Similarly, analogous to a Cu(111) surface, 1 is shown to oxidatively add (chemisorb) H 2 . Kinetic parameters were determined for this process and the activation enthalpy (8.4 ± 0.5 kcal × mol –1 ) closely mirrors that established for H 2 binding at the Cu(111) facet (6.0 to 12.4 kcal × mol –1 ). Together, these results showcase that a trinuclear cluster can reproduce the small molecule binding and activation energetics of a bulk crystalline surface, setting the stage for studying less-defined surface processes in an atomically precise molecular setting.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

The SRG/eROSITA All-Sky Survey: Optical identification and properties of galaxy clusters and groups in the western galactic hemisphere

The first SRG/eROSITA All-Sky Survey (eRASS1) provides the largest intracluster medium-selected galaxy cluster and group catalog covering the western Galactic hemisphere. Compared to samples selected purely on X-ray extent, the sample purity can be enhanced by identifying cluster candidates using optical and near-infrared data from the DESI Legacy Imaging Surveys. Using the red-sequence-based cluster findereROMaPPer, we measured individual photometric properties (redshiftz λ , richnessλ, optical center, and BCG position) for 12000 eRASS1 clusters over a sky area of 13 116 deg 2 , augmented by 247 cases identified by matching the candidates with known clusters from the literature. The median redshift of the identified eRASS1 sample isz= 0.31, with 10% of the clusters atz> 0.72. The photometric redshifts have an accuracy ofδz/(1 +z) ≲ 0.005 for 0.05 specand velocity dispersionσ) were measured a posteriori for a subsample of 3210 and 1499 eRASS1 clusters, respectively, using an extensive compilation of spectroscopic redshifts of galaxies from the literature. We infer that the primary eRASS1 sample has a purity of 86% and optical completeness >95% forz> 0.05. For these and further quality assessments of the eRASS1 identified catalog, we applied our identification method to a collection of galaxy cluster catalogs in the literature, as well as blindly on the full Legacy Surveys covering 24069 deg 2 . Using a combination of these cluster samples, we investigated the velocity dispersion-richness relation, finding that it scales with richness as log(λ norm ) = 2.401 × log(σ) − 5.074 with an intrinsic scatter ofδ in = 0.10 ± 0.01 dex. The primary product of our work is the identified eRASS1 cluster catalog with high purity and a well-defined X-ray selection process, opening the path for precise cosmological analyses presented in companion papers.

Astronomy & Astrophysics↗

Multiphoton ionization of large water clusters

Water clusters are multimers of water molecules held together by hydrogen bonds. In the present work, multiphoton ionization in the UV range coupled with time of flight mass spectrometry has been applied to water clusters with up to 160 molecules in order to obtain information on the electronic states of clusters of different sizes up to dimensions that can approximate the bulk phase. The dependence of ion intensities of water clusters and their metastable fragments produced by laser ionization at 355 nm on laser power density indicates a (3+1)-photon resonance-enhanced multiphoton ionization process. It also explains the large increase of ionization efficiency at 355 nm compared to that at 266 nm. Indeed, it was found, by applying both nanosecond and picosecond laser ionization with the two different UV wavelengths, that no water cluster sequences after n = 9 could be observed at 266 nm, whereas water clusters up to m/z 2000 Th in reflectron mode and m/z 3000 Th in linear mode were detected at 355 nm. The agreement between our findings on clusters of water, especially true in the range with n > 10, and reported data for liquid water supports the hypothesis that clusters above a critical dimension can approximate the liquid phase. It should thus be possible to study clusters just above 10 water molecules, for getting information on the bulk phase structure.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Linking stellar coronal activity and rotation at 500 MYR: A deep Chandra observation of M37

Empirical calibrations of the stellar age-rotation–activity relation (ARAR) rely on observations of the co-eval populations of stars in open clusters. We used the Chandra X-ray Observatory to study M37, a 500-Myr-old open cluster that has been extensively surveyed for rotation periods (P{sub rot}). M37 was observed almost continuously for five days, for a total of 440.5 ks, to measure stellar X-ray luminosities (L{sub X}), a proxy for coronal activity, across a wide range of masses. The cluster’s membership catalog was revisited to calculate updated membership probabilities from photometric data and each star’s distance to the cluster center. The result is a comprehensive sample of 1699 M37 members: 426 with P{sub rot}, 278 with X-ray detections, and 76 with both. We calculate Rossby numbers, R{sub o}= P{sub rot}/τ, where τ is the convective turnover time, and ratios of the X-ray-to-bolometric luminosity, L{sub X}/L{sub bol}, to minimize mass dependencies in our characterization of the rotation-coronal activity relation at 500 Myr. We find that fast rotators, for which R{sub o}<0.09±0.01, show saturated levels of activity, with log(L{sub X}/L{sub bol})= −3.06±0.04. For R{sub o}⩾0.09±0.01, activity is unsaturated and follows a power law of the form R{sub o}{sup β}, where β = −2.03{sub −0.14}{sup +0.17}. This is the largest sample available for analyzing the dependence of coronal emission on rotation for a single-aged population, covering stellar masses in the range 0.4–1.3 M{sub ⊙}, P{sub rot} in the range 0.4–12.8 days, and L{sub X} in the range 10{sup 28.4−30.5} erg s{sup −1}. Our results make M37 a new benchmark open cluster for calibrating the ARAR at ages of ≈500 Myr.

79 ASTRONOMY AND ASTROPHYSICS↗

Classification of Ascension Island and Natal Ozonesondes Using Self-Organizing Maps

Ozone profiles from balloon-borne ozonesondes are used for development of satellite algorithms and in chemistry-climate model initialization, assimilation and evaluation. An important issue in the application of these profiles is how best to treat variations where varying photochemical and dynamical influences can cause the ozone mixing ratio in the tropospheric segments of the profile to change by of a factor of 2-3 within a day. Clustering techniques are an ideal way to approach the statistical classification of profile data and we apply self-organizing maps to tropical tropospheric SHADOZ data, hypothesizing that the data will sort according to various influences on ozone, namely anthropogenic sources like biomass burning, meteorological conditions, and stratospheric or extra-tropical intrusions. Self-organizing maps, that use a learning algorithm to reveal the most prominent features of a data set according to a specified number of clusters, have been determined for the 1998-2009 SHADOZ profiles over Ascension Island (512 profiles, 7.98 deg. S, 14.42 deg. W) and Natal, Brazil (425 profiles, 5.42degS, 35.38degW). The 2 × 2 self-organizing map, which creates 4 clusters, reveals that deviations from the average ozone in the free troposphere include both increased ozone resulting from seasonal biomass burning in Africa and locally reduced ozone brought about by convective lifting of unpolluted boundary-layer air. Expanding to a 4 × 4 self-organizing map shows how biomass burning influences the yearly cycle of tropospheric ozone at Ascension Island and captures the seasonality of ozone at both Ascension Island and Natal. Comparing Ascension Island and Natal using a 4 × 4 self-organizing map at each site reveals similarities in mid-tropospheric ozone, but shows differences in lower-tropospheric ozone due to Ascension Island being closer to African biomass burning and more affected by descent from the mean Walker circulation, with less convective activity, than Natal.

algorithms↗

STELLAR LIFETIME AND ULTRAVIOLET PROPERTIES OF THE OLD METAL-RICH GALACTIC OPEN CLUSTER NGC 6791: A PATHWAY TO UNDERSTAND THE ULTRAVIOLET UPTURN OF ELLIPTICAL GALAXIES

The evolutionary properties of the old metal-rich Galactic open cluster NGC 6791 are assessed based on deep UB photometry and Two Micron All Sky Survey JK data. For the 4739 stars in the cluster, bolometric luminosity and effective temperature have been derived from theoretical (U - B) and (J - K) color fitting. The derived H-R diagram has been matched with the UVBLUE grid of synthetic stellar spectra to obtain the integrated spectral energy distribution (SED) of the system, together with a full set of UV (Fanelli) and optical (Lick) narrowband indices. The total bolometric magnitude of NGC 6791 is M{sup bol}{sub 6791} = -6.29, with a color (B - V){sub 6791} = 0.97. The cluster appears to be a fairly good proxy of standard elliptical galaxies, although with significantly bluer infrared colors, a shallower 4000 A Balmer break, and a lower Mg{sub 2} index. The confirmed presence of a dozen hot stars along their extreme horizontal-branch evolution leads the cluster SED to consistently match the properties of the most active UV-upturn galaxies, with 1.7% {+-} 0.4% of the total bolometric luminosity emitted shortward of 2500 Angstrom-Sign . The cluster helium abundance results in Y{sub 6791} = 0.30 {+-} 0.04, while the post-main-sequence (PMS) implied stellar lifetime from star number counts fairly agrees with the theoretical expectations from both the PADOVA and BASTI stellar tracks. A PMS fuel consumption of 0.43 {+-} 0.01 M{sub Sun} is found for NGC 6791 stars, in close agreement with the estimated mass of cluster He-rich white dwarfs. Such a tight figure may lead one to suspect that a fraction of the cluster stellar population does not actually reach the minimum mass required to effectively ignite He in the stellar core.

79 ASTRONOMY AND ASTROPHYSICS↗

X-ray properties of the X-CLASS-redMaPPer galaxy cluster sample: the luminosity–temperature relation

ABSTRACT This article presents the results of a spectroscopic analysis of the X-CLASS-redMaPPer (XC1-RM) galaxy cluster sample. X-CLASS is a serendipitous search for clusters in X-ray wavebands based on the XMM–Newton archive, whereas redMaPPer is an optical cluster catalogue derived from the Sloan Digital Sky Survey (SDSS). The present sample comprises 92 X-ray extended sources identified in optical images within 1 arcmin separation. The area covered by the cluster sample is ∼ 27 deg2. The clusters span a wide redshift range (0.05 < z < 0.6) and 88 clusters benefit from spectrosopically confirmed redshifts using data from SDSS Data Release 14. We present an automated pipeline to derive the X-ray properties of the clusters in three distinct apertures: R500 (at fixed mass overdensity), Rfit (at fixed signal-to-noise ratio) and ${R}_{300\, {\rm kpc}}$ (fixed physical radius). The sample extends over wide temperature and luminosity ranges: from 1–10 keV and from 6 × 1042 to 11 × 1044 erg s−1, respectively. We investigate the luminosity–temperature (L–T) relation of the XC1-RM sample and find a slope equal to 3.03 ± 0.26. It is steeper than predicted by self-similar assumptions, in agreement with independent studies. A simplified approach is developed to estimate the amount and impact of selection biases that might be affecting our recoveredL–Tparameters. The result of this simulation process suggests that the measuredL–Trelation is biased to a steeper slope and higher normalization.

Molham, Mona↗

Layout-aware I/O Scheduling for terabits data movement

Many science facilities, such as the Department of Energy's Leadership Computing Facilities and experimental facilities including the Spallation Neutron Source, Stanford Linear Accelerator Center, and Advanced Photon Source, produce massive amounts of experimental and simulation data. These data are often shared among the facilities and with collaborating institutions. Moving large datasets over the wide-area network (WAN) is a major problem inhibiting collaboration. Next-generation, terabit-networks will help alleviate the problem, however, the parallel storage systems on the endsystem hosts at these institutions can become a bottleneck for terabit data movement. The parallel storage system (PFS) is shared by simulation systems, experimental systems, analysis and visualization clusters, in addition to wide-area data movers. These competing uses often induce temporary, but significant, I/O load imbalances on the storage system, which impact the performance of all the users. The problem is a serious concern because some resources are more expensive (e.g. super computers) or have time-critical deadlines (e.g. experimental data from a light source), but parallel file systems handle all requests fairly even if some storage servers are under heavy load. This paper investigates the problem of competing workloads accessing the parallel file system and how the performance of wide-area data movement can be improved in these environments. First, we study the I/O load imbalance problems using actual I/O performance data collected from the Spider storage system at the Oak Ridge Leadership Computing Facility. Second, we present I/O optimization solutions with layout-awareness on end-system hosts for bulk data movement. With our evaluation, we show that our I/O optimization techniques can avoid the I/O congested disk groups, improving storage I/O times on parallel storage systems for terabit data movement.

Kim, Youngjae↗

Layout-Aware I/O Scheduling for Terabits Data Movement

Many science facilities, such as the Department of Energy s Leadership Computing Facilities and experimental facilities including the Spallation Neutron Source, Stanford Linear Accelerator Center, and Advanced Photon Source, produce massive amounts of experimental and simulation data. These data are often shared among the facilities and with collaborating institutions. Moving large datasets over the wide- area network (WAN) is a major problem inhibiting collaboration. Next- generation, terabit-networks will help alleviate the problem, however, the parallel storage systems on the end-system hosts at these institutions can become a bottleneck for terabit data movement. The parallel storage system (PFS) is shared by simulation systems, experimental systems, analysis and visualization clusters, in addition to wide-area data movers. These competing uses often induce temporary, but significant, I/O load imbalances on the storage system, which impact the performance of all the users. The problem is a serious concern because some resources are more expensive (e.g. super computers) or have time-critical deadlines (e.g. experimental data from a light source), but parallel file systems handle all requests fairly even if some storage servers are under heavy load. This paper investigates the problem of competing workloads accessing the parallel file system and how the performance of wide-area data movement can be improved in these environments. First, we study the I/O load imbalance problems using actual I/O performance data collected from the Spider storage system at the Oak Ridge Leadership Computing Facility. Second, we present I/O optimization solutions with layout-awareness on end-system hosts for bulk data movement. With our evaluation, we show that our I/O optimization techniques can avoid the I/O congested disk groups, improving storage I/O times on parallel storage systems for terabit data movement.

I/O and Storage↗

Network of networks: Time series clustering of AmeriFlux sites

Environmental observation networks, such as AmeriFlux, are foundational for monitoring ecosystem response to climate change, management practices, and natural disturbances; however, their effectiveness depends on their representativeness for the regions or continents. We proposed an empirical, time series approach to quantify the similarity of ecosystem fluxes across AmeriFlux sites. We extracted the diel and seasonal characteristics (i.e., amplitudes, phases) from carbon dioxide, water vapor, energy, and momentum fluxes, which reflect the effects of climate, plant phenology, and ecophysiology on the observations, and explored the potential aggregations of AmeriFlux sites through hierarchical clustering. While net radiation and temperature showed latitudinal clustering as expected, flux variables revealed a more uneven clustering with many small (number of sites < 5), unique groups and a few large (> 100) to intermediate (15–70) groups, highlighting the significant ecological regulations of ecosystem fluxes. Many identified unique groups were from under-sampled ecoregions and biome types of the International Geosphere-Biosphere Programme (IGBP), with distinct flux dynamics compared to the rest of the network. At the finer spatial scale, local topography, disturbance, management, edaphic, and hydrological regimes further enlarge the difference in flux dynamics within the groups. Nonetheless, our clustering approach is a data-driven method to interpret the AmeriFlux network, informing future cross-site syntheses, upscaling, and model-data benchmarking research. Finally, we highlighted the unique and underrepresented sites in the AmeriFlux network, which were found mainly in Hawaii and Latin America, mountains, and at under-sampled IGBP types (e.g., urban, open water), motivating the incorporation of new/unregistered sites from these groups.

54 ENVIRONMENTAL SCIENCES↗

CORS BAADE-WESSELINK DISTANCE TO THE LMC NGC 1866 BLUE POPULOUS CLUSTER

We used optical, near-infrared photometry, and radial velocity data for a sample of 11 Cepheids belonging to the young LMC blue populous cluster NGC 1866 to estimate their radii and distances on the basis of the CORS Baade-Wesselink method. This technique, based on an accurate calibration of surface brightness as a function of (U - B), (V - K) colors, allows us to estimate, simultaneously, the linear radius and the angular diameter of Cepheid variables, and consequently to derive their distance. A rigorous error estimate on radii and distances was derived by using Monte Carlo simulations. Our analysis gives a distance modulus for NGC 1866 of 18.51 {+-} 0.03 mag, which is in agreement with several independent results.

79 ASTRONOMY AND ASTROPHYSICS↗

Detecting Extreme Events in Gridded Climate Data

Detecting and tracking extreme events in gridded climatological data is a challenging problem on several fronts: algorithms, scalability, and I/O. Successful detection of these events will give climate scientists an alternate view of the behavior of different climatological variables, leading to enhanced scientific understanding of the impacts of events such as heat and cold waves, and on a larger scale, the El Nin o Southern Oscillation. Recent advances in computing power and research in data sciences enabled us to look at this problem with a different perspective from what was previously possible. In this paper we present our computationally efficient algorithms for anomalous cluster detection on climate change big data. We provide results on detection and tracking of surface temperature and geopotential height anomalies, a trend analysis, and a study of relationships between the variables. We also identify the limitations of our approaches, future directions for research and alternate approaches.

climate extremes temperature anomalies reanalysis↗

The Open Cluster Chemical Abundances and Mapping Survey. IV. Abundances for 128 Open Clusters Using SDSS/APOGEE DR16

The Open Cluster Chemical Abundances and Mapping (OCCAM) survey aims to constrain key Galactic dynamical and chemical evolution parameters by the construction of a large, comprehensive, uniform, infrared-based spectroscopic data set of hundreds of open clusters. This fourth contribution from the OCCAM survey presents analysis using Sloan Digital Sky Survey/APOGEE DR16 of a sample of 128 open clusters, 71 of which we designate to be “high quality” based on the appearance of their color–magnitude diagram. We find the APOGEE DR16 derived [Fe/H] abundances to be in good agreement with previous high-resolution spectroscopic open cluster abundance studies. Using the high-quality sample, we measure Galactic abundance gradients in 16 elements, and find evolution of some of the [X/Fe] gradients as a function of age. We find an overall Galactic [Fe/H] versus R {sub GC} gradient of −0.068 ± 0.001 dex kpc{sup −1} over the range of 6 < R {sub GC} < 13.9 kpc; however, we note that this result is sensitive to the distance catalog used, varying as much as 15%. We formally derive the location of a break in the [Fe/H] abundance gradient as a free parameter in the gradient fit for the first time. We also measure significant Galactic gradients in O, Mg, S, Ca, Mn, Cr, Cu, Na, Al, and K, some of which are measured for the first time. Our large sample allows us to examine four well-populated age bins in order to explore the time evolution of gradients for a large number of elements and comment on possible implications for Galactic chemical evolution and radial migration.

79 ASTRONOMY AND ASTROPHYSICS↗

A Novel Approach to Detect Accelerated Aged and Surface-Mediated Degradation in Explosives by UPLC-ESI-MS.

A new approach was created for studying energetic material degradation. This approach involved detecting and tentatively identifying non-volatile chemical species by liquid chromatography-mass spectrometry (LC-MS) with multivariate statistical data analysis that form as the CL-20 energetic material thermally degraded. Multivariate data analysis showed clear separation and clustering of samples based on sample group: either pristine or aged material. Further analysis showed counter-clockwise trends in the principal components analysis (PCA), a type of multivariate data analysis, Scores plots. These trends may indicate that there was a discrete shift in the chemical markers as the went from pristine to aged material, and then again when the aged CL-20 mixed with a potentially incompatible material was thermally aged for 4, 6, or 9 months. This new approach to studying energetic material degradation should provide greater knowledge of potential degradation markers in these materials.

36 MATERIALS SCIENCE↗

Profiling the BLAST bioinformatics application for load balancing on high-performance computing clusters

Abstract Background The Basic Local Alignment Search Tool (BLAST) is a suite of commonly used algorithms for identifying matches between biological sequences. The user supplies a database file and query file of sequences for BLAST to find identical sequences between the two. The typical millions of database and query sequences make BLAST computationally challenging but also well suited for parallelization on high-performance computing clusters. The efficacy of parallelization depends on the data partitioning, where the optimal data partitioning relies on an accurate performance model. In previous studies, a BLAST job was sped up by 27 times by partitioning the database and query among thousands of processor nodes. However, the optimality of the partitioning method was not studied. Unlike BLAST performance models proposed in the literature that usually have problem size and hardware configuration as the only variables, the execution time of a BLAST job is a function of database size, query size, and hardware capability. In this work, the nucleotide BLAST application BLASTN was profiled using three methods: shell-level profiling with the Unix “time” command, code-level profiling with the built-in “profiler” module, and system-level profiling with the Unix “gprof” program. The runtimes were measured for six node types, using six different database files and 15 query files, on a heterogeneous HPC cluster with 500+ nodes. The empirical measurement data were fitted with quadratic functions to develop performance models that were used to guide the data parallelization for BLASTN jobs. Results Profiling results showed that BLASTN contains more than 34,500 different functions, but a single function, RunMTBySplitDB, takes 99.12% of the total runtime. Among its 53 child functions, five core functions were identified to make up 92.12% of the overall BLASTN runtime. Based on the performance models, static load balancing algorithms can be applied to the BLASTN input data to minimize the runtime of the longest job on an HPC cluster. Four test cases being run on homogeneous and heterogeneous clusters were tested. Experiment results showed that the runtime can be reduced by 81% on a homogeneous cluster and by 20% on a heterogeneous cluster by re-distributing the workload. Discussion Optimal data partitioning can improve BLASTN’s overall runtime 5.4-fold in comparison with dividing the database and query into the same number of fragments. The proposed methodology can be used in the other applications in the BLAST+ suite or any other application as long as source code is available.

59 BASIC BIOLOGICAL SCIENCES↗

Optical–SZE scaling relations for DES optically selected clusters within the SPT-SZ Survey

We study the Sunyaev-Zel'dovich effect (SZE) signature in South Pole Telescope (SPT) data for an ensemble of 719 optically identified galaxy clusters selected from 124.6 deg$^2$ of the Dark Energy Survey (DES) science verification data, detecting a stacked SZE signal down to richness $\lambda\sim20$. The SZE signature is measured using matched-filtered maps of the 2500 deg$^2$ SPT-SZ survey at the positions of the DES clusters, and the degeneracy between SZE observable and matched-filter size is broken by adopting as priors SZE and optical mass-observable relations that are either calibrated using SPT selected clusters or through the Arnaud et al. (2010, A10) X-ray analysis. We measure the SPT signal to noise $\zeta$-$\lambda$, relation and two integrated Compton-$y$ $Y_\textrm{500}$-$\lambda$ relations for the DES-selected clusters and compare these to model expectations accounting for the SZE-optical center offset distribution. For clusters with $\lambda > 80$, the two SPT calibrated scaling relations are consistent with the measurements, while for the A10-calibrated relation the measured SZE signal is smaller by a factor of $0.61 \pm 0.12$ compared to the prediction. For clusters at $20 < \lambda < 80$, the measured SZE signal is smaller by a factor of $\sim$0.20-0.80 (between 2.3 and 10~$\sigma$ significance) compared to the prediction, with the SPT calibrated scaling relations and larger $\lambda$ clusters showing generally better agreement. We quantify the required corrections to achieve consistency, showing that there is a richness dependent bias that can be explained by some combination of contamination of the observables and biases in the estimated masses. We discuss possible physical effects, as contamination from line-of-sight projections or from point sources, larger offsets in the SZE-optical centering or larger scatter in the $\lambda$-mass relation at lower richnesses.

79 ASTRONOMY AND ASTROPHYSICS↗

A framework to measure the properties of intergalactic metal systems with two-point flux statistics

ABSTRACT The abundance, temperature, and clustering of metals in the intergalactic medium are important parameters for understanding their cosmic evolution and quantifying their impact on cosmological analysis with the Ly α forest. The properties of these systems are typically measured from individual quasar spectra redward of the quasar’s Ly α emission line, yet that approach may provide biased results due to selection effects. We present an alternative approach to measure these properties in an unbiased manner with the two-point statistics commonly employed to quantify large-scale structure. Our model treats the observed flux of a large sample of quasar spectra as a continuous field and describes the one-dimensional, two-point statistics of this field with three parameters per ion: the abundance (column density distribution), temperature (Doppler parameter), and clustering (cloud–cloud correlation function). We demonstrate this approach on multiple ions (e.g. ${\rm C\, \small {\rm IV}}$ , ${\rm Si\, \small {\rm IV}}$ , and ${\rm Mg\, \small {\rm II}}$ ) with early data from the Dark Energy Spectroscopic Instrument (DESI) and high-resolution spectra from the literature. Our initial results show some evidence that the ${\rm C\, \small {\rm IV}}$ abundance is higher than previous measurements and evidence for abundance evolution over time. The first full year of DESI observations will have over an order of magnitude more quasar spectra than this study. In a future paper, we will use those data to measure the growth of clustering and its impact on the Ly α forest, as well as test other DESI analysis infrastructure such as the pipeline noise estimates and the resolution matrix.

79 ASTRONOMY AND ASTROPHYSICS↗

A Spatiotemporal Indexing Approach for Efficient Processing of Big Array-Based Climate Data with MapReduce

Climate observations and model simulations are producing vast amounts of array-based spatiotemporal data. Efficient processing of these data is essential for assessing global challenges such as climate change, natural disasters, and diseases. This is challenging not only because of the large data volume, but also because of the intrinsic high-dimensional nature of geoscience data. To tackle this challenge, we propose a spatiotemporal indexing approach to efficiently manage and process big climate data with MapReduce in a highly scalable environment. Using this approach, big climate data are directly stored in a Hadoop Distributed File System in its original, native file format. A spatiotemporal index is built to bridge the logical array-based data model and the physical data layout, which enables fast data retrieval when performing spatiotemporal queries. Based on the index, a data-partitioning algorithm is applied to enable MapReduce to achieve high data locality, as well as balancing the workload. The proposed indexing approach is evaluated using the National Aeronautics and Space Administration (NASA) Modern-Era Retrospective Analysis for Research and Applications (MERRA) climate reanalysis dataset. The experimental results show that the index can significantly accelerate querying and processing (10 speedup compared to the baseline test using the same computing cluster), while keeping the index-to-data ratio small (0.0328). The applicability of the indexing approach is demonstrated by a climate anomaly detection deployed on a NASA Hadoop cluster. This approach is also able to support efficient processing of general array-based spatiotemporal data in various geoscience domains without special configuration on a Hadoop cluster.

big data↗