DP-HPC: Bringing Differential Privacy to HPC Systems Log Sharing and Analysis
Explore the source record for details and available documents.
Solorzano, Ana↗
SEARCH · Engineering Papers
Results for “logs”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Scalable GPS Data Logging To Support Advanced Fleet Analysis
This highlight details the key takeaways from a project that utilized NLR's Fleet Research, Energy Data, and Insights (FleetREDI) data analysis pipeline. National Laboratory of the Rockies researchers developed and demonstrated low-cost, open-source Arduino data loggers with 3D-printed cases that are compatible with global navigational systems and built with components available ubiquitously worldwide, enabling cost-effective collection and analysis of fleet operational data. Validated on an overseas transit bus fleet, NLR analysis showed that, with sufficient charging opportunities, 90% of observed duty cycles could be accomplished by electric buses with no modifications to operations.
33 ADVANCED PROPULSION SYSTEMS↗
Wood Decomposition: Understanding Processes Regulating Carbon Transfer to Soil Carbon Pools Using FACE Wood at Multiple Scales
Dead wood comprises approximately 20% of forest biomass. While it is widely recognized for its role in ecosystem functions relative to habitat and nutrient cycling, there are considerable uncertainties associated with its role in the forest carbon (C) cycle. The principal uncertainty is whether dead wood contributes to the soil C pool. With little supporting evidence, the presumption is that C in wood is respired back to the atmosphere through decomposition processes. The inability to attribute forest soil C to its source components has been a barrier to addressing this important forest carbon cycle question. The U.S. Dept. of Energy’s Free Air CO 2 Enrichment (FACE) experiment produced wood that has a distinct δ 13 C signature that can be used to trace its fate through organic matter decomposition processes. Using two hardwood species (aspen, birch) from the Rhinelander FACE site and pine from the Duke FACE site, the FACE Wood Decomposition Experiment (FWDE) was established in 2011 to provide the foundation for addressing wood decomposition and its associated processes at the continental scale. Plots were installed on nine experimental forests representing a range in bioclimatic forest conditions within the continental U.S. Each identical plot has logs of the three species incubating on the soil surface and pine logs suspended in the air, representing standing dead wood. Abiotic conditions are monitored continuously, and soil and forest conditions characterized. Logs on the sites have been measured every two years to assess decay. This project was initiated in 2016 with specific objectives to: (a) determine whether dead wood C contributes to the soil C pool, (b) assess the fungal community composition mediating the decay, (c) assess the interactions of termites with microbial decay, and (d) develop a mechanistic model to simulate wood decomposition. The principal field sampling was conducted in 2017; correspondingly, the results reported here represent six years of decomposition. Wood decomposition varied from 13 to 75 % loss across the bioclimatic gradient. Sites in the southeastern U.S. coastal plain and piedmont had fastest decomposition rates for each of the species. In contrast sites in the Rocky Mountains had the slowest decay rates, which were associated with cold temperatures. Standing deadwood decomposes at a much slower rate than logs on the soil surface; a response due to differences in wood moisture content. Wood carbon was measured in the mineral soil across each of the sites; accordingly, this is the first study to affirm that a portion of the wood C does become part of the soil C pool. Averaged across the FWDE sites, approximately 1.4% of the soil C in the upper 10 cm of the mineral soil directly beneath the log was derived from the deadwood; within 50 cm of the log, wood C accounted for an average of 2.1%. These results demonstrate that the contribution of deadwood to the soil C pool is a soil volume surrounding the log; and it’s likely a larger volume than what we sampled. We also hypothesized that there would be more wood C in the mineral soil when termites were present. However, that hypothesis wasn’t supported by measurements on the Santee Experimental Forest termite exclusion (SEF-TX) plots under FACE logs that incubated for 6 years. Across all the sites, the majority of the wood C was transferred to the atmosphere. Approximately 7,000 fungal species were sequenced. The fungal communities were different among each of the sites suggesting local colonization; interestingly, within sites the three species also exhibited differences in fungal community composition. White rot was the dominant fungal form in pine and hardwood, which yields less lignin in the wood residue. Brown rot occurred in approximately 20% of the pine and aspen logs, and it did not occur in birch logs. The occurrence of brown rot was only weakly correlated to site factors. We conducted two additional experiments to assess the effects of termites on wood decomposition and the associated interactions with the fungal community. Pine and birch logs were incubated on the Santee Experimental Forest termite exclusion plots in upland and riparian settings. There was no difference in decay between areas where termites were able colonize and plots where they had been excluded. Highly variable foraging by termites was a primary contributor the result. Correspondingly, fungal communities did not vary on logs incubated among the two treatments, but they did reflect site and species differences. The second experiment was conducted on each of the nine FWDE sites where pine and birch wood blocks were incubated for two years with and without a wrapping designed to exclude termites and other arthropods. The effects of termites on wood decomposition could be confirmed on two of the four sites known to have subterranean termites. On the two southeastern sites, termites contributed approximately 8% to mass loss in pine blocks over two years. A major factor clouding the role of termites in wood decomposition is the inability to assess the time, duration, and intensity of the foraging with the logs. Another uncertainty is related to whether a piece of wood will be foraged. A process-based wood decomposition model was developed representing biological processes mediated by fungi, bacteria, termites, beetles, as well as physical and chemical processes. The Coarse Wood Decomposition Model (CWDM) was parameterized based on a thorough review of the literature and it was validated using data from the FWDE. In the initial setup, the model considers softwoods and hardwoods groups, as opposed to individual species. Sensitivity analyses incorporating climate data from 89 locations in North America demonstrated that CWDM was stable from the tropics to the boreal zone. Model calibration and validation showed it to perform very well. The CWDM is poised for additional testing with subsequent FWDE data as well as other data sets, and it is available for incorporation into forest biogeochemical models or DOEs Earth System Modeling framework.
54 ENVIRONMENTAL SCIENCES↗
Two Ligands of Interest in Recovering Uranium from the Oceans: The Correct Formation Constants of the Uranyl(VI) Cation with 2,2'-Bipyridyl-6,6'-dicarboxylic Acid and 1,10-Phenanthroline-2,9-dicarboxylic Acid
The ligands BDA (2,2'-bipyridyl-6,6'-dicarboxylic acid) and PDA (1,10-phenanthroline-2,9-dicarboxylic acid) are of interest as functional group types for ion-exchange materials for extracting uranium from the oceans, reported in a previous paper for PDA Lashley, M. A. ( Inorg. Chem. 2016 55 10818 10829). Yang, Y. ( Inorg. Chem. 2019, 58, 6064 6074) have published what they claim to be a more accurate result for the formation of the UO 2 2+ /PDA complex of log K 1 = 22.84 compared with our reported value of log K 1 = 16.5, as well as log K 1 = 21.52 for the BDA complex. The determination of log K 1 for the PDA and BDA complexes with the UO 2 2+ cation was carried out by Yang et al. using a competition reaction between DTPA (diethylenetriamine pentaacetic acid) and BDA or PDA, monitoring the absorbance due to the BDA and PDA ligands. This competition method using absorbance versus pH titrations was developed for determining the formation constants of the complexes of several polypyridyl ligands plus PDA complexes of metal ions, which were too stable for log K determination by competition with protons. A key feature of such titrations is that in the competition reaction, the displacement of the pyridyl donor ligand (e.g., PDA) by the competing ligand (e.g., DTPA), the absorbance spectrum of the displaced pyridyl donor ligand should be observed. Competing ligands used to date have been EDTA (ethylenediamine tetraacetic acid), DTPA, or the hydroxide ion. In the study of Yang et al., no such displaced PDA or BDA was apparent in the absorbance spectra in their titrations so that their reported log K 1 values have no validity. Their log K 1 values are so much higher than log K 1 for the uranyl DTPA complex (~13.6) that DTPA could not possibly displace BDA or PDA from the uranyl cation, and a competition reaction could not possibly occur. Here, we report the correct value of log K 1 = 15.4 (ionic strength = zero) for the uranyl BDA complex, to illustrate the correct determination of such a constant by a competition reaction between BDA and hydroxide, showing how the characteristic absorbance spectrum for a BDA complex, here the UO 2 2+ complex, disappears, and the distinctive absorbance spectrum of the free nonprotonated BDA ligand appears as the pH is increased, and BDA is displaced by the hydroxide ion.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Constraining the Stellar-to-Halo Mass Relation with Galaxy Clustering and Weak Lensing from DES Year 3 Data
We develop a framework to study the relation between the stellar mass of a galaxy and the total mass of its host dark matter halo using galaxy clustering and galaxy-galaxy lensing measurements. We model a wide range of scales, roughly from $\sim 100 \; {\rm kpc}$ to $\sim 100 \; {\rm Mpc}$, using a theoretical framework based on the Halo Occupation Distribution and data from Year 3 of the Dark Energy Survey (DES) dataset. The new advances of this work include: 1) the generation and validation of a new stellar mass-selected galaxy sample in the range of $\log M_\star/M_\odot \sim 9.6$ to $\sim 11.5$; 2) the joint-modeling framework of galaxy clustering and galaxy-galaxy lensing that is able to describe our stellar mass-selected sample deep into the 1-halo regime; and 3) stellar-to-halo mass relation (SHMR) constraints from this dataset. In general, our SHMR constraints agree well with existing literature with various weak lensing measurements. We constrain the free parameters in the SHMR functional form $\log M_\star (M_h) = \log(εM_1) + f\left[ \log\left( M_h / M_1 \right) \right] - f(0)$, with $f(x) \equiv -\log(10^{αx}+1) + δ[\log(1+\exp(x))]^γ/ [1+\exp(10^{-x})]$, to be $\log M_1 = 11.506^{+0.325}_{-0.404}$, $\log ε= -1.632^{+0.306}_{-0.181}$, $α= -1.638^{+0.108}_{-0.099}$, $γ= 0.596^{+0.251}_{-0.210}$ and $δ= 3.810^{+2.045}_{-1.811}$. The inferred average satellite fraction is within $\sim 5-35\%$ for our fiducial results and we do not see any clear trends with redshift or stellar mass. Furthermore, we find that the inferred average galaxy bias values follow the generally expected trends with stellar mass and redshift. Our study is the first SHMR in DES in this mass range, and we expect the stellar mass sample to be of general interest for other science cases.
Zacharegkas, G. [Argonne; Chicago U., KICP] (ORCID↗
April 2020 Darshan counters from the Summit supercomputer
This dataset is the Darshan counters collected from the Summit supercomputer in a month of April 2020. 1. Description of methods used for collection/generation of data: Job submitted on Summit HPC system when completed successfully and has made I/O calls (captured by Darshan tool) writes a Darshan log file on alpine filesystem. One job can have multiple `jsrun` commands and Darshan will generate separate logs each log corresponding to an `jsrun` command, so a job can have one or more Darshan logs associated with it. 2. Methods for processing the data: To process the data, we first use `darshan-util` tool to parse the Darshan logs. Then we restructure the logs and merge data from multiple Darshan logs if they belong to the same Summit job.
97 MATHEMATICS AND COMPUTING↗
Compact galaxies and the size–mass galaxy distribution from a colour-selected sample at 0.04 < z < 0.15 supplemented by ugrizYJHK photometric redshifts
ABSTRACT The size–mass galaxy distribution is a key diagnostic for galaxy evolution. Massive compact galaxies are potential surviving relics of a high-redshift phase of star formation. Some of these could be nearly unresolved in Sloan Digital Sky Survey (SDSS) imaging and thus not included in galaxy samples. To overcome this, a sample was selected from the combination of SDSS and UKIRT Infrared Deep Sky Survey (UKIDSS) photometry to r < 17.8. This was done using colour–colour selection, and then by obtaining accurate photometric redshifts (photo-z) using scaled flux matching (SFM). Compared to spectroscopic redshifts (spec-z), SFM obtained a 1σ scatter of 0.0125 with only 0.3 per cent outliers (|Δln (1 + z)| > 0.06). A sample of 163 186 galaxies was obtained with 0.04 < z < 0.15 over $2300\, {\rm deg}^2$ using a combination of spec-z and photo-z. Following Barro et al. log Σ1.5 = log M* − 1.5log r50, maj was used to define compactness. The spectroscopic completeness was 76 per cent for compact galaxies (log Σ1.5 > 10.5) compared to 92 per cent for normal-sized galaxies. This difference is primarily attributed to SDSS ‘fibre collisions’ and not the completeness of the main galaxy sample selection. Using environmental overdensities, this confirms that compact quiescent galaxies are significantly more likely to be found in high-density environments compared to normal-sized galaxies. By comparison with a high-redshift sample from 3D-HST, log Σ1.5 distribution functions show significant evolution, with this being a compelling way to compare with simulations such as EAGLE. The number density of compact quiescent galaxies drops by a factor of about 30 from z ∼ 2 to log (n/Mpc−3) = − 5.3 ± 0.4 in the SDSS–UKIDSS sample. The uncertainty is dominated by the steep cut off in log Σ1.5, which is demonstrated conclusively using this complete sample.
Baldry, Ivan K.↗
Constraining quenching time-scales in galaxy clusters by forward-modelling stellar ages and quiescent fractions in projected phase space
We forward-model mass-weighted stellar ages (MWAs) and quiescent fractions (f Q ) in projected phase space (PPS), using data from the Sloan Digital Sky Survey, to jointly constrain an infall quenching model for galaxies in log (M vir /M ⊙ ) > 14 galaxy clusters at z ∼ 0. We find the average deviation in MWA from the MWA–M⋆ relation depends on position in PPS, with a maximum difference between the inner cluster and infalling interloper galaxies of ∼1 Gyr. Our model employs infall information from N-body simulations and stochastic star-formation histories from the universemachine model. We find total quenching times of t Q = 3.7 ± 0.4 Gyr and t Q = 4.0 ± 0.2 Gyr after first pericentre, for 9 < log (M ⋆ /M ⊙ ) < 10 and 10 < log (M ⋆ /M ⊙ ) < 10.5 galaxies, respectively. By using MWAs, we break the degeneracy in time of quenching onset and time-scale of star formation rate (SFR) decline. We find that time of quenching onset relative to pericentre is $t_{\mathrm{delay}}=3.5^{+0.6}_{-0.9}$ Gyr and $t_{\mathrm{delay}}=-0.3^{+0.8}_{-1.0}$ Gyr for 9 < log (M ⋆ /M ⊙ ) < 10 and 10 < log (M ⋆ /M ⊙ ) < 10.5 galaxies, respectively, and exponential SFR suppression time-scales are τenv ≤ 1.0 Gyr for 9 < log (M ⋆ /M ⊙ ) < 10 galaxies and τenv ∼ 2.3 Gyr for 10 < log (M ⋆ /M ⊙ ) < 10.5 galaxies. Stochastic star formation histories remove the need for rapid infall quenching to maintain the bimodality in the SFR of cluster galaxies; the depth of the green valley prefers quenching onsets close to first pericentre and a longer quenching envelope, in slight tension with the MWA-driven results. Taken together these results suggest that quenching begins close to, or just after pericentre, but the time-scale for quenching to be fully complete is much longer and therefore ram-pressure stripping is not complete on first pericentric passage.
79 ASTRONOMY AND ASTROPHYSICS↗
Characterization and identification of HPC applications at leadership computing facility
High Performance Computing (HPC) is an important method for scientific discovery via large-scale simulation, data analysis, or artificial intelligence. Leadership-class supercomputers are expensive, but essential to run large HPC applications. The Petascale era of supercomputers began in 2008, with the first machines achieving performance in excess of one petaflops, and with the advent of new supercomputers in 2021 (e.g., Aurora, Frontier), the Exascale era will soon begin. However, the high theoretical computing capability (i.e., peak FLOPS) of a machine is not the only meaningful target when designing a supercomputer, as the resources demand of applications varies. A deep understanding of the characterization of applications that run on a leadership supercomputer is one of the most important ways for planning its design, development and operation. In order to improve our understanding of HPC applications, user demands and resource usage characteristics, we perform correlative analysis of various logs for different subsystems of a leadership supercomputer. This analysis reveals surprising, sometimes counter-intuitive patterns, which, in some cases, conflicts with existing assumptions, and have important implications for future system designs as well as supercomputer operations. For example, our analysis shows that while the applications spend significant time on MPI, most applications spend very little time on file I/O. Combined analysis of hardware event logs and task failure logs show that the probability of a hardware FATAL event causing task failure is low. Combined analysis of control system logs and file I/O logs reveals that pure POSIX I/O is used more widely than higher level parallel I/O. Based on holistic insights of the application gained through combined and co-analysis of multiple logs from different perspectives and general intuition, we engineer features to "fingerprint" HPC applications. We use t-SNE (a machine learning technique for dimensionality reduction) to validate the explainability of our features and finally train machine learning models to identify HPC applications or group those with similar characteristic. To the best of our knowledge, this is the first work that combines logs on file I/O, computing, and inter-node communication for insightful analysis of HPC applications in production.
Liu, Zhengchun↗
Application of machine learning to characterize gas hydrate reservoirs in Mackenzie Delta (Canada) and on the Alaska north slope (USA)
Here, artificial neural network-trained models were used to predict gas hydrate saturation distributions in permafrost-associated deposits in the Eileen Gas Hydrate Trend on the Alaska North Slope (ANS), USA and at the Mallik research site in the Beaufort-Mackenzie Basin, Northwest Territories, Canada. The database of Logging-While-Drilling (LWD) and wireline logs collected at five wells (Mount Elbert, Ignik Sikumi, and Kuparuk 7–11–12 wells at ANS, plus 2L-38 and 5L-38 wells at the Mallik research site) includes more than 10,000 depth points, which were used for training, validation, and testing the machine learning (ML) models. Data used in training the ML models include the well logs of density, porosity, electrical resistivity, gamma radiation, and acoustic wave velocity measurements. Combinations of two or three out of these five well logs were found to reliably predict the gas hydrate saturation with accuracy varying between 80 and 90% when compared to the gas hydrate saturations derived from Nuclear Magnetic Resonance (NMR)-based technique. The ML models trained on data from three ANS wells achieved high fidelity predictions of gas hydrate saturation at the Mallik site. The results obtained in this study indicate that ML models trained on data from one geological basin can successfully predict key reservoir parameters for permafrost-associated gas hydrate accumulations within another basin. A generalized approach for selecting a well log combination that can improve model accuracy is discussed. Overall, the study outcome supports earlier work demonstrating that ML models trained on non-NMR well logs are a viable alternative to physics-driven methods for predicting gas hydrate saturations.
58 GEOSCIENCES↗
Sparse Cholesky factorization for solving nonlinear PDEs via Gaussian processes
In recent years, there has been widespread adoption of machine learning-based approaches to automate the solving of partial differential equations (PDEs). Among these approaches, Gaussian processes (GPs) and kernel methods have garnered considerable interest due to their flexibility, robust theoretical guarantees, and close ties to traditional methods. They can transform the solving of general nonlinear PDEs into solving quadratic optimization problems with nonlinear, PDE-induced constraints. However, the complexity bottleneck lies in computing with dense kernel matrices obtained from pointwise evaluations of the covariance kernel, and its partial derivatives, a result of the PDE constraint and for which fast algorithms are scarce. The primary goal of this paper is to provide a near-linear complexity algorithm for working with such kernel matrices. We present a sparse Cholesky factorization algorithm for these matrices based on the near-sparsity of the Cholesky factor under a novel ordering of pointwise and derivative measurements. The near-sparsity is rigorously justified by directly connecting the factor to GP regression and exponential decay of basis functions in numerical homogenization. We then employ the Vecchia approximation of GPs, which is optimal in the Kullback-Leibler divergence, to compute the approximate factor. This enables us to compute ϵ-approximate inverse Cholesky factors of the kernel matrices with complexity O(N log d (N/ϵ)) in space and O(N log 2d (N/ϵ)) in time. We integrate sparse Cholesky factorizations into optimization algorithms to obtain fast solvers of the nonlinear PDE. We numerically illustrate our algorithm’s near-linear space/time complexity for a broad class of nonlinear PDEs such as the nonlinear elliptic, Burgers, and Monge-Ampère equations. In summary, we provide a fast, scalable, and accurate method for solving general PDEs with GPs and kernel methods.
97 MATHEMATICS AND COMPUTING↗
SHαDE: survey description and mass–kinematics scaling relations for dwarf galaxies
ABSTRACT The Study of H α from Dwarf Emissions (SHαDE) is a high spectral resolution (R = 13 500) H α integral field survey of 69 dwarf galaxies with stellar masses 106 < M⋆ < 109 M⊙. The survey used FLAMES on the ESO Very Large Telescope. SHαDE is designed to study the kinematics and stellar populations of dwarf galaxies using consistent methods applied to massive galaxies and at matching level of detail, connecting these mass ranges in an unbiased way. In this paper, we set out the science goals of SHαDE, describe the sample properties, outline the data reduction, and analysis processes. We investigate the log M⋆–log S0.5 mass–kinematics scaling relation, which has previously shown potential for combining galaxies of all morphologies in a single scaling relation. We extend the scaling relation from massive galaxies to dwarf galaxies, demonstrating this relation is linear down to a stellar mass of M⋆ ∼ 108.6 M⊙. Below this limit, the kinematics of galaxies inside one effective radius appears to be dominated by the internal velocity dispersion limit of the H α-emitting gas, giving a bend in the log M⋆–log S0.5 relation. Replacing stellar mass with total baryonic mass using gas mass estimate reduces the severity but does not remove the linearity limit of the scaling relation. An extrapolation to estimate the galaxies’ dark matter halo masses, yields a log Mh–log S0.5 scaling relation that is free of any bend, has reduced curvature over the whole mass range, and brings galaxies of all masses and morphologies on to the virial relation.
Barat, Dilyar↗
Abundances of CNO elements in z ∼ 0.3–0.4 Lyman continuum leaking galaxies
We present observations with the Space Telescope Imaging Spectrograph onboard the Hubble Space Telescope (HST) of 11 Lyman continuum (LyC) leaking galaxies at redshifts, z , in the range 0.29–0.43, with oxygen abundances 12+log(O/H) = 7.64–8.16, stellar masses M ⋆ ∼ 10 7.8 –10 9.8 M ⊙ , and O 32 = [O III ] λ5007/[O II ] λ3727 of ∼ 5–20 aiming to detect the C III ] λ1908 emission line. We combine these observations with the optical Sloan Digital Sky Survey (SDSS) spectra for the determination of carbon, nitrogen, and oxygen abundances. Our sample was supplemented by 31 galaxies from the literature, for which carbon, nitrogen, and oxygen abundances can be derived from the HST and SDSS spectra. These additional galaxies, however, do not have LyC observations. We find that log(C/O) for the entire sample at 12+log(O/H) < 8.1 does not depend on metallicity, with a small dispersion of ∼0.13 dex around the average value of ∼−0.75 dex. On the other hand, the log(N/O) in galaxies at z > 0.1, including LyC leakers, is systematically higher compared to the rest of the sample with lower metallicity. We find that log(C/O) slightly decreases with increasing M ⋆ from ∼ −0.65 at M ⋆ = 10 6 M ⊙ to ∼ −0.80 at M ⋆ = 10 9 –10 10 M ⊙ , whereas log(N/O) is considerably enhanced at M ⋆ > 10 8 M ⊙ . The origin of these trends remains basically unknown. A possible solution would be to assume that the upper mass limit of the stellar initial mass function in more massive galaxies is higher. This would result in a higher production of oxygen and a larger fraction of massive stars with stellar wind polluting the interstellar medium with nitrogen.
79 ASTRONOMY AND ASTROPHYSICS↗
A comparison of the baryonic Tully–Fisher relation in MaNGA and IllustrisTNG
We compare an observed baryonic Tully–Fisher relation (BTFR) from the Mapping Nearby Galaxies at Apache Point Observatory (MaNGA) and HI-MaNGA surveys to a simulated BTFR from the cosmological magnetohydrodynamical simulation, IllustrisTNG. To do so, we calibrate the BTFR of the local universe using 377 galaxies from the MaNGA and HI-MaNGA surveys, and perform mock 21 cm observations of matching galaxies from IllustrisTNG. The mock observations are used to ensure that the comparison with the observed galaxies is fair since it has identical measurement algorithms, observational limitations, biases, and uncertainties. For comparison, we also calculate the BTFR for the simulation without mock observations and demonstrate how mock observations are necessary to fairly and consistently compare between observational and theoretical data. We report a MaNGA BTFR of log$_{10} (M_{ \rm Bary}/M_\odot)= (2.97 \pm 0.18)$ log$_{10} V_{ \rm Rot} + (4.04 \pm 0.41)\, \log _{10}{M_{\odot }}$ and an IllustrisTNG BTFR of log$_{10} (M_{ \rm Bary}/M_\odot) = (2.94 \pm 0.23$) log$_{10} V_{ \rm Rot} + (4.15 \pm 0.44)\, \log _{10}{M_{\odot }}$. Thus, MaNGA and IllustrisTNG produce BTFRs that agree within uncertainties, demonstrating that IllustrisTNG has created a galaxy population that obeys the observed relationship between mass and rotation velocity in the observed universe.
79 ASTRONOMY AND ASTROPHYSICS↗
Sentiment Analysis based Error Detection for Large-Scale Systems
Today's large-scale systems such as High Performance Computing (HPC) Systems are designed/utilized towards exascale computing, inevitably decreasing its reliability due to the increasing design complexity. HPC systems conduct extensive logging of their execution behaviour. In this paper, we leverage the inherent meaning behind the log messages and propose a novel sentiment analysis-based approach for the error detection in large-scale systems, by automatically mining the sentiments in the log messages. Our contributions are four-fold. (1) We develop a machine learning (ML) based approach to automatically build a sentiment lexicon, based on the system log message templates. (2) Using the sentiment lexicon, we develop an algorithm to detect system errors. (3) We develop an algorithm to identify the nodes and components with erroneous behaviors, based on sentiment polarity scores. (4) We evaluate our solution vs. other state-of-the-art machine/deep learning algorithms based on three representative supercomputers' system logs. Experiments show that our error detection algorithm can identify error messages with an average MCC score and f -score of 91% and 96% respectively, while state of the art ML/deep learning model (LSTM) obtains only 67% and 84%. To the best of our knowledge, this is the first work leveraging the sentiments embedded in log entries of large-scale systems for system health analysis.
error detection↗
Multi-Scale Lithofacies and Chemostratigraphic Analysis of Two Middle Devonian Marcellus Shale Wells in Northern West Virginia, USA
The Marcellus Shale Energy and Environmental Laboratory (MSEEL) consists of two project areas within the dry gas producing region of the Marcellus shale play in Monongalia County, West Virginia. MSEEL is a collaborative field project led by West Virginia University, with Northeast Natural Energy LLC, several industrial partners, and sponsored by the US Department of Energy National Energy Technology Laboratory. The study areas are drilled approximately 8.5 miles apart to better understand the vertical and lateral changes in stratigraphy over a short distance. Two vertical pilot wells, MIP-3H and Boggess 17H were drilled in the fall of 2015 and spring of 2019, respectively. Core was recovered from the MIP-3H (API: 47-061-01707-00-00) 112 feet (34m) between depths of 7445 to 7557 feet, and from the Boggess 17H (API: 47-061-01812-00-00) 139 feet (42m) between depths of 7908 and 8012 ft. A full suite of triple combo (gamma ray, neutron, density logs), image logs, and advanced logging tools were run in both wells and calibrated to core analysis. Core analysis includes medical computed tomography (CT) scans, mineralogy and chemostratigraphy determined from handheld X-Ray fluorescence (hhXRF) and X-Ray powder diffraction (XRD) measurements, and determination of total organic content (TOC). Lithofacies were determined at core-scale using traditional core description techniques and medical CT-scan images. Log-scale facies are based on mineralogy and TOC data and developed using petrophysical logging data calibrated to core data (XRD and pyrolysis data). Chemostratigraphic analysis utilized hhXRF data to determine the major and trace element trends in the cores. In the two wells six shale lithofacies were recognized at the core and log scale. Both wells show organic-rich facies (TOC > 6.5%) primarily in the middle and lower Marcellus, with a slight decrease in thickness of this interval in the Boggess 17H. This interval is interpreted as an increase in paleo-productivity (increased Ni, Zn, and V), decreased sedimentation (decreased detrital proxies), and anoxic to euxinic conditions (increased Mo and chalcophile elements). Paleo-redox conditions in both wells are dynamic throughout deposition transitioning between euxinic/anoxic to dysoxic/oxic. This trend is seen through elemental proxies and calcite/pyrite concretion distributions.
03 NATURAL GAS↗
A Mountaintop View Requires Minimal Sorting: A Faster Contour Tree Algorithm
Consider a scalar field f : M → R, where M is a triangulated simplicial mesh in R d . A level set, or contour, at value v is a connected component of f –1 (v). As v is changed, these contours change topology, merge into each other, or split. Contour trees are concise representations of f that track this contour behavior. The vertices of these trees are the critical points of f, where the gradient is zero. The edges represent changes in the topology of contours. It is a fundamental data structure in data analysis and visualization, and there is significant previous work (both theoretical and practical) on algorithms for constructing contour trees. Suppose M has n vertices, N facets, and t critical points. A classic result of Carr, Snoeyink, and Axen (2000) gives an algorithm that takes O(n log n+Nα(N)) time (where α(·) is the inverse Ackermann function). A further improvement to O(t log t + N) time was given by Chiang et al. All these algorithms involve a global sort of the critical points, a significant computational bottleneck. Unfortunately, lower bounds of Ω(t log t) also exist. We present the first algorithm that can avoid the global sort and has a refined time complexity that depends on the contour tree structure. Intuitively, if the tree is short and fat, we get significant improvements in running time. For a partition of the contour tree into a set of descending paths, P, our algorithm runs in O($\Sigma$ pϵP |p| log |p| + tα(t) + N). This is at most O(t log D + N), where D is the diameter of the contour tree. Moreover, it is O(tα(t) + N) for balanced trees, a significant improvement over the previous complexity. Our algorithm requires numerous ideas: partitioning the contour tree into join and split trees, a local growing procedure to iteratively build contour trees, and the use of heavy path decompositions for the time complexity analysis. There is a crucial use of a family of binomial heaps to maintain priorities, ensuring that any comparison made is between comparable nodes of the contour tree. We also prove lower bounds showing that the $\Sigma$ pϵP |p| log |p| complexity is inherent to computing contour trees.
97 MATHEMATICS AND COMPUTING↗
Analyzing Risks of Virtual Private Network Connections
The use of Splunk for analyzing VPN logs is an effective approach for identifying vulnerabilities in network endpoints. Splunk, a powerful platform for searching, monitoring, and analyzing machine-generated data, enables organizations to aggregate VPN logs in real-time, providing insights into network activity, user behavior, and potential security risks. By indexing VPN traffic and authentication logs, security teams can track abnormal patterns such as multiple failed login attempts, unusual IP addresses, or unexpected changes in bandwidth usage, all of which could indicate potential vulnerabilities or breaches. With Splunk’s advanced search and reporting capabilities, users can create custom dashboards and alerts to detect suspicious activities. Automated searches can flag endpoints exhibiting unusual behavior, while correlation analysis can identify links between compromised devices and broader network vulnerabilities. In particular, Splunk's machine learning capabilities can be leveraged to predict and prevent threats by identifying trends that might otherwise be missed in traditional log analysis. This proactive approach to monitoring VPN logs allows for the early detection of security weaknesses, enabling rapid response and minimizing potential damage to network integrity. By enhancing endpoint visibility, Splunk plays a crucial role in securing remote connections and safeguarding sensitive information. Additionally, Splunk’s automation and alerting features allow teams to create custom workflows that notify them of vulnerable or misconfigured endpoints identified through Shodan. This synergy between Splunk’s log analysis and Shodan’s device intelligence enhances an organization’s ability to proactively identify and mitigate security risks, improving the overall resilience of their VPN infrastructure.
97 MATHEMATICS AND COMPUTING↗