Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data clustering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,621 records · Page 90
All sourcesNASA NTRSDOE OSTI
DOE OSTI2014

The radial distribution of X-ray binaries and globular clusters in NGC 4649 and their relation with the local stellar mass density

We investigate the radial distribution of the low-mass X-ray binary (LMXB) population in the elliptical galaxy NGC 4649, using Chandra and Hubble data to separate the field and globular cluster (GC) populations. GCs with LMXBs have the same radial distribution as the parent red and blue GCs. The radial profile of field LMXBs follows the V-band profile within the D25 of NGC 4649. Using the spatial information provided by our data, we find that the global galaxy-wide relations among cumulative number and luminosity of LMXBs and the integrated stellar mass hold on local scales within D25. An excess of field LMXBs with respect to the V-band light is observed in the galaxy's outskirts, which may be partially due to unidentified GC sources or to a rejuvenated field LMXB population caused by past merging interactions.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2019

An Evolutionary System of Mineralogy: Proposal for A Classification of Planetary Materials Based on Natural Kind Clustering

Minerals reveal the nature of the co-evolving geosphere and biosphere through billions of years of Earth history. Mineral classification systems have the potential to elucidate this rich evolutionary story; however, the present mineral taxonomy, based as it is on idealized major element chemistry and crystal structure, lacks a temporal aspect, and thus cannot reflect planetary evolution. A complementary evolutionary system of mineralogy based on the quantitative recognition of “natural kind clustering” for a wide range of condensed planetary materials with different paragenetic origins has the potential to amplify, though not supersede, the present classification system.

Philosophy of mineralogy↗
DOE OSTI2018

Atomic data and spectral modeling constraints from high-resolution X-ray observations of the Perseus cluster with Hitomi

Here, the Hitomi Soft X-ray Spectrometer spectrum of the Perseus cluster, with ~5 eV resolution in the 2–9 keV band, offers an unprecedented benchmark of the atomic modeling and database for hot collisional plasmas. It reveals both successes and challenges of the current atomic data and models. The latest versions of AtomDB/APEC (3.0.8), SPEX (3.03.00), and CHIANTI (8.0) all provide reasonable fits to the broad-band spectrum, and are in close agreement on best-fit temperature, emission measure, and abundances of a few elements such as Ni. For the Fe abundance, the APEC and SPEX measurements differ by 16%, which is 17 times higher than the statistical uncertainty. This is mostly attributed to the differences in adopted collisional excitation and dielectronic recombination rates of the strongest emission lines. We further investigate and compare the sensitivity of the derived physical parameters to the astrophysical source modeling and instrumental effects. The Hitomi results show that accurate atomic data and models are as important as the astrophysical modeling and instrumental calibration aspects. Substantial updates of atomic databases and targeted laboratory measurements are needed to get the current data and models ready for the data from the next Hitomi-level mission.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Dark Energy Survey Year 3 Results: Constraints on cosmological parameters and galaxy bias models from galaxy clustering and galaxy-galaxy lensing using the redMaGiC sample

We constrain cosmological parameters and galaxy-bias parameters using the combination of galaxy clustering and galaxy-galaxy lensing measurements from the Dark Energy Survey Year-3 data. We describe our modeling framework and choice of scales analyzed, validating their robustness to theoretical uncertainties in small-scale clustering by analyzing simulated data. Using a linear galaxy bias model and redMaGiC galaxy sample, we obtain constraints on the matter content of the universe to be $\Omega_{\rm m} = 0.325^{+0.033}_{-0.034}$. We also implement a non-linear galaxy bias model to probe smaller scales that includes parameterizations based on hybrid perturbation theory, and find that it leads to a 17% gain in cosmological constraining power. Using the redMaGiC galaxy sample as foreground lens galaxies, we find the galaxy clustering and galaxy-galaxy lensing measurements to exhibit significant signals akin to decorrelation between galaxies and mass on large scales, which is not expected in any current models. This likely systematic measurement error biases our constraints on galaxy bias and the $S_8$ parameter. We find that a scale-, redshift- and sky-area-independent phenomenological decorrelation parameter can effectively capture this inconsistency between the galaxy clustering and galaxy-galaxy lensing. We perform robustness tests of our methodology pipeline and demonstrate stability of the constraints to changes in the theory model. After accounting for this decorrelation, we infer the constraints on the mean host halo mass of the redMaGiC galaxies from the large-scale bias constraints, finding the galaxies occupy halos of mass approximately $1.5 \times 10^{13} M_{\odot}/h$.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Interpreting internal consistency of DES measurements

ABSTRACT Bayesian evidence ratios are widely used to quantify the statistical consistency between different experiments. However, since the evidence ratio is prior dependent, the precise translation between its value and the degree of concordance/discordance requires additional information. The most commonly adopted metric, the Jeffreys scale, can falsely suggest agreement between data sets when priors are chosen to be sufficiently wide. This work examines evidence ratios in a DES-Y1 simulated analysis, focusing on the internal consistency between weak lensing and galaxy clustering. We study two scenarios using simulated data in controlled experiments. First, we calibrate the expected evidence ratio distribution given noise realizations around the best-fitting DES-Y1 ΛCDM cosmology. Secondly, we show the behaviour of evidence ratios for noiseless fiducial data vectors simulated using a modified gravity model, which generates internal tension in the LCDM analysis. We find that the evidence ratio of noise realizations generated at all confidence levels was biased towards agreement and show, with a modified gravity model, that the choice of prior could conceal the discrepancies between weak lensing and galaxy clustering induced by prior effects in unlike cosmological models, concluding that the evidence ratio in a DES-Y1 study is, indeed, biased towards agreement. Boundary effects can also influence conclusions about the inconsistency induced by modified gravity, even in a noiseless data vector simulation.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Iron-sulfur clusters are involved in post-translational arginylation

Eukaryotic arginylation is an essential post-translational modification that modulates protein stability and regulates protein half-life. Arginylation is catalyzed by a family of enzymes known as the arginyl-tRNA transferases (ATE1s), which are conserved across the eukaryotic domain. Despite their conservation and importance, little is known regarding the structure, mechanism, and regulation of ATE1s. In this work, we show that ATE1s bind a previously undiscovered [Fe-S] cluster that is conserved across evolution. We characterize the nature of this [Fe-S] cluster and find that the presence of the [Fe-S] cluster in ATE1 is linked to its arginylation activity, both in vitro and in vivo, and the initiation of the yeast stress response. Importantly, the ATE1 [Fe-S] cluster is oxygen-sensitive, which could be a molecular mechanism of the N-degron pathway to sense oxidative stress. Taken together, our data provide the framework of a cluster-based paradigm of ATE1 regulatory control.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2019

Machine Learning-Based Anomaly Detection for Load Forecasting Under Cyberattacks

Accurate load forecasting can create both economic and reliability benefits for power system operators. However, the cyberattack on load forecasting may mislead operators to make unsuitable operational decisions for the electricity delivery. To effectively and accurately detect these cyberattacks, this paper develops a machine learning-based anomaly detection (MLAD) methodology. First, load forecasts provided by neural networks are used to reconstruct the benchmark and scaling data by using the k-means clustering. Second, the cyberattack template is estimated by the naive Bayes classification based on the cumulative distribution function and statistical features of the scaling data. Finally, the dynamic programming is utilized to calculate both the occurrence and parameter of one cyberattack on load forecasting data. Here, a widely used symbolic aggregation approximation method is compared with the developed MLAD method. Numerical simulations on the publicly load data show that the MLAD method can effectively detect cyberattacks for load forecasting data with relatively high accuracy. Also, the robustness of MLAD is verified by thousands of attack scenarios based on Monte Carlo simulation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Cosmological analysis of three-dimensional BOSS galaxy clustering and Planck CMB lensing cross correlations via Lagrangian perturbation theory

In this work, we present a formalism for jointly fitting pre- and post-reconstruction redshift-space clustering (RSD) and baryon acoustic oscillations (BAO) plus gravitational lensing (of the CMB) that works directly with the observed 2-point statistics. The formalism is based upon (effective) Lagrangian perturbation theory and a Lagrangian bias expansion, which models RSD, BAO and galaxy-lensing cross correlations within a consistent dynamical framework. As an example we present an analysis of clustering measured by the Baryon Oscillation Spectroscopic Survey in combination with CMB lensing measured by Planck. The post-reconstruction BAO strongly constrains the distance-redshift relation, the full-shape redshift-space clustering constrains the matter density and growth rate, and CMB lensing constrains the clustering amplitude. Using only the redshift space data we obtain Ω m = 0.303 ± 0.008, $H_0$ = 69.21 ± 0.78 and $σ_8$ = 0.743 ± 0.043. The addition of lensing information, even when restricted to the Northern Galactic Cap, improves constraints to Ω m = 0.303 ± 0.008, $H_0$ = 69.21 ± 0.77 and $σ_8$ = 0.707 ± 0.035, in tension with CMB and cosmic shear constraints. The combination of Ω m and $H_0$ are consistent with Planck, though their constraints derive mostly from redshift-space clustering. The low $σ_8$ value are driven by cross correlations with CMB lensing in the low redshift bin ($\textit{z}$ ≃ 0.38) and at large angular scales, which show a 20% deficit compared to expectations from galaxy clustering alone. We conduct several systematics tests on the data and find none that could fully explain these tensions.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2010

The Kepler Science Operations Center Pipeline Framework Extensions

The Kepler Science Operations Center (SOC) is responsible for several aspects of the Kepler Mission, including managing targets, generating on-board data compression tables, monitoring photometer health and status, processing the science data, and exporting the pipeline products to the mission archive. We describe how the generic pipeline framework software developed for Kepler is extended to achieve these goals, including pipeline configurations for processing science data and other support roles, and custom unit of work generators that control how the Kepler data are partitioned and distributed across the computing cluster. We describe the interface between the Java software that manages the retrieval and storage of the data for a given unit of work and the MATLAB algorithms that process these data. The data for each unit of work are packaged into a single file that contains everything needed by the science algorithms, allowing these files to be used to debug and evolve the algorithms offline.

Klaus, Todd C.↗
DOE OSTI2024

Community detection in hypergraphs via mutual information maximization

Abstract The hypergraph community detection problem seeks to identify groups of related vertices in hypergraph data. We propose an information-theoretic hypergraph community detection algorithm which compresses the observed data in terms of community labels and community-edge intersections. This algorithm can also be viewed as maximum-likelihood inference in a degree-corrected microcanonical stochastic blockmodel. We perform the compression/inference step via simulated annealing. Unlike several recent algorithms based on canonical models, our microcanonical algorithm does not require inference of statistical parameters such as vertex degrees or pairwise group connection rates. Through synthetic experiments, we find that our algorithm succeeds down to recently-conjectured thresholds for sparse random hypergraphs. We also find competitive performance in cluster recovery tasks on several hypergraph data sets.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2013

RED GIANT BRANCH BUMP BRIGHTNESS AND NUMBER COUNTS IN 72 GALACTIC GLOBULAR CLUSTERS OBSERVED WITH THE HUBBLE SPACE TELESCOPE

We present the broadest and most precise empirical investigation of red giant branch bump (RGBB) brightness and number counts ever conducted. We implement a new method and use data from two Hubble Space Telescope globular cluster (GC) surveys to measure the brightness and star counts of the RGBB in 72 GCs. The median measurement precision is 0.018 mag in the brightness and 31% in the number counts, respectively, reaching peak precision values of 0.005 mag and 10%. The position of the main-sequence turnoff and the number of horizontal branch stars are used as comparisons where appropriate. Several independent scientific conclusions are newly possible with our parameterization of the RGBB. Both brightness and number counts are shown to have second parameters in addition to their strong dependence on metallicity. The RGBBs are found to be anomalous in the GCs NGC 2808, 5286, 6388, and 6441, likely due to the presence of multiple populations. Finally, we use our empirical calibration to predict the properties of the Galactic bulge RGBB. The updated RGBB properties for the bulge are shown to differ from the GC-calibrated prediction, with the former having lower number counts, a lower brightness dispersion, and a brighter peak luminosity than would be expected from the latter. This discrepancy is well explained by the Galactic bulge having a higher helium abundance than expected from GCs, {Delta}Y {approx} +0.06 at the median metallicity.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

The Dark Energy Survey Year 3 high-redshift sample: selection, characterization, and analysis of galaxy clustering

ABSTRACT The fiducial cosmological analyses of imaging surveys like DES typically probe the Universe at redshifts z < 1. We present the selection and characterization of high-redshift galaxy samples using DES Year 3 data, and the analysis of their galaxy clustering measurements. In particular, we use galaxies that are fainter than those used in the previous DES Year 3 analyses and a Bayesian redshift scheme to define three tomographic bins with mean redshifts around z ∼ 0.9, 1.2, and 1.5, which extend the redshift coverage of the fiducial DES Year 3 analysis. These samples contain a total of about 9 million galaxies, and their galaxy density is more than 2 times higher than those in the DES Year 3 fiducial case. We characterize the redshift uncertainties of the samples, including the usage of various spectroscopic and high-quality redshift samples, and we develop a machine-learning method to correct for correlations between galaxy density and survey observing conditions. The analysis of galaxy clustering measurements, with a total signal to noise S/N ∼ 70 after scale cuts, yields robust cosmological constraints on a combination of the fraction of matter in the Universe Ωm and the Hubble parameter h, $\Omega _m h = 0.195^{+0.023}_{-0.018}$, and 2–3 per cent measurements of the amplitude of the galaxy clustering signals, probing galaxy bias and the amplitude of matter fluctuations, bσ8. A companion paper (in preparation) will present the cross-correlations of these high-z samples with cosmic microwave background lensing from Planck and South Pole Telescope, and the cosmological analysis of those measurements in combination with the galaxy clustering presented in this work.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

A Comparison of Electronic Structure Methods for Predicting the Hydrogenation Energies of Candidate Molecules for Hydrogen Storage

The development of novel energy materials and fuels is required to expand current available energy sources. Aiming to reach this goal, there is growing interest in using molecular hydrogen as an energy carrier due to its abundance and high energy density. Liquid organic hydrogen carriers (LOHCs) are a promising route to the large-scale storage and transport of hydrogen for use in the energy economy. The search for thermodynamically viable LOHC molecules for real world use has led to a set of constraints on the dehydrogenation enthalpy and the minimum gravimetric hydrogen capacity. These constraints allow one to formulate the search for an ideal LOHC candidate molecule as an optimization problem well suited to the strengths of machine learning and artificial intelligence computational approaches. A critical barrier to a large-scale, high-throughput screening of LOHC candidate molecules is the lack of reliable training data. Computational electronic structure methods including density functional theory, coupled cluster approximations, and diffusion Monte Carlo can be used to provide training data where experimental data are either unreliable or do not exist. In this work, we use these methods to calculate the dehydrogenation energies and enthalpies of candidate LOHC molecules.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2013

STUDYING INTERCLUSTER GALAXY FILAMENTS THROUGH STACKING gmBCG GALAXY CLUSTER PAIRS

We present a method to study the photometric properties of galaxies in filaments by stacking the galaxy populations between pairs of galaxy clusters. Using Sloan Digital Sky Survey data, this method can detect the intercluster filament galaxy overdensity with a significance of {approx}5{sigma} out to z = 0.40. Using this approach, we study the g - r color and luminosity distribution of filament galaxies as a function of redshift. Consistent with expectation, filament galaxies are bimodal in their color distribution and contain a larger blue galaxy population than clusters. Filament galaxies are also generally fainter than cluster galaxies. More interestingly, the observed filament population seems to show redshift evolution at 0.12 < z < 0.40: the blue galaxy fraction has a trend to increase at higher redshift; such evolution is parallel to the ''Butcher-Oemler effect'' of galaxy clusters. We test the dependence of the observed filament density on the richness of the cluster pair: richer clusters are connected by higher density filaments. We also test the spatial dependence of filament galaxy overdensity: this quantity decreases when moving away from the intercluster axis between a cluster pair. This method provides an economical way to probe the photometric properties of filament galaxies and should prove useful for upcoming projects like the Dark Energy Survey.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Unsupervised atomic data mining via multi-kernel graph autoencoders for machine learning force fields

Constructing a chemically diverse dataset while avoiding sampling bias is critical to training efficient and generalizable force fields. However, in computational chemistry and materials science, many common dataset generation techniques are prone to oversampling regions of the potential energy surface. Furthermore, these regions can be difficult to identify and isolate from each other or may not align well with human intuition, making it challenging to systematically remove bias in the dataset. While traditional clustering and pruning (down-sampling) approaches can be useful for this, they can often lead to information loss or a failure to properly identify distinct regions of the potential energy surface due to difficulties associated with the high dimensionality of atomic descriptors. In this work, we introduce the Multi-kernel Edge Attention-based Graph Autoencoder (MEAGraph) model, an unsupervised approach for analyzing atomic datasets. MEAGraph combines multiple linear kernel transformations with attention-based message passing to capture geometric sensitivity and enable effective dataset pruning without relying on labels or extensive training. Demonstrated applications on niobium, tantalum, and iron datasets show that MEAGraph efficiently groups similar atomic environments, allowing for the use of basic pruning techniques for removing sampling bias. This approach provides an effective method for representation learning and clustering that can be used for data analysis, outlier detection, and dataset optimization.

Materials science↗
DOE OSTI2018

Wind energy variability and links to regional and synoptic scale weather

The accurate characterization of seasonal and inter-annual site-level wind energy variability is essential during wind project development. Understanding the features and probability of low-wind years is of particular interest to developers and financers. However, a dearth of long-term, hub-height wind observations makes these characterizations challenging, and thus techniques to improve these characterizations are of great value. To improve resource characterization, we explicitly link wind resource variability (at hub-height, and at specific sites) to regional and synoptic scale wind regimes. Our approach involves statistical clustering of high-resolution modeled wind data, and is applied to California for a period covering 1980–2015. With this approach, we investigate the unique meteorological patterns driving low and high wind years at five separate wind project sites. We also find wind regime changes over the 36-year period consistent with global warming: wind regimes associated with anomalously hot summer days increased at half a day per year and stagnant conditions increased at one-third days per year. Despite these changes, the average annual resource potential remained constant at all project sites. Additionally, we identify correlations between climate modes and wind regime frequency, a linkage valuable for resource characterization and forecasting. Our general approach can be applied in any location and may benefit many aspects of wind energy resource evaluation and forecasting.

17 WIND ENERGY↗
DOE OSTI2014

Two worlds collide: Image analysis methods for quantifying structural variation in cluster molecular dynamics

Inspired by methods of remote sensing image analysis, we analyze structural variation in cluster molecular dynamics (MD) simulations through a unique application of the principal component analysis (PCA) and Pearson Correlation Coefficient (PCC). The PCA analysis characterizes the geometric shape of the cluster structure at each time step, yielding a detailed and quantitative measure of structural stability and variation at finite temperature. Our PCC analysis captures bond structure variation in MD, which can be used to both supplement the PCA analysis as well as compare bond patterns between different cluster sizes. Relying only on atomic position data, without requirement for a priori structural input, PCA and PCC can be used to analyze both classical and ab initio MD simulations for any cluster composition or electronic configuration. Taken together, these statistical tools represent powerful new techniques for quantitative structural characterization and isomer identification in cluster MD.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1989

Data compression experiments with LANDSAT thematic mapper and Nimbus-7 coastal zone color scanner data

A case study is presented where an image segmentation based compression technique is applied to LANDSAT Thematic Mapper (TM) and Nimbus-7 Coastal Zone Color Scanner (CZCS) data. The compression technique, called Spatially Constrained Clustering (SCC), can be regarded as an adaptive vector quantization approach. The SCC can be applied to either single or multiple spectral bands of image data. The segmented image resulting from SCC is encoded in small rectangular blocks, with the codebook varying from block to block. Lossless compression potential (LDP) of sample TM and CZCS images are evaluated. For the TM test image, the LCP is 2.79. For the CZCS test image the LCP is 1.89, even though when only a cloud-free section of the image is considered the LCP increases to 3.48. Examples of compressed images are shown at several compression ratios ranging from 4 to 15. In the case of TM data, the compressed data are classified using the Bayes' classifier. The results show an improvement in the similarity between the classification results and ground truth when compressed data are used, thus showing that compression is, in fact, a useful first step in the analysis.

Tilton, James C.↗