Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analysis cluster”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Untangling the Galaxy. II. Structure within 3 kpc

We present the results of the hierarchical clustering analysis of the Gaia DR2 data to search for clusters, comoving groups, and other stellar structures. The current paper builds on the sample from the previous work, extending it in distance from 1 to 3 kpc and increasing the number of identified structures up to 8292. To aid in the analysis of the population properties, we developed a neural network called Auriga to robustly estimate the age, extinction, and distance of a stellar group based on the input photometry and parallaxes of the individual members. We apply Auriga to derive the properties of not only the structures found in this paper, but also previously identified open clusters. Through this work, we examine the temporal structure of the spiral arms. Specifically, we find that the Sagittarius Arm has moved by >500 pc in the last 100 Myr and the Perseus Arm has been experiencing a relative lull in star formation activity over the last 25 Myr. We confirm the findings of the previous paper on the transient nature of the spiral arms, with the timescale of transition of a few 100 Myr. Finally, we find a peculiar ~1 Gyr old stream of stars that appears to be heliocentric. Its origin is unclear.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Code Artifact for: Clustering Analysis of Commercial Vehicles Using Automatically Extracted Features from Time Series Data [SWR-21-96]

This repository contains data ingestion, feature extraction, and analysis code used in NREL Technical report "Clustering Analysis of Commercial Vehicles Using Automatically Extracted Features from Time Series Data." The code is written in Python. The ETL and feature extraction code must be run in a Spark context. The analysis code can be run without Spark, provided you have pre-computed features in a CSV file. Analysis code related to the NREL Technical Report NREL/TP-2C00-74212. Includes PySpark functions to perform trip segmentation and feature extraction over big time series data in Apache Spark. Includes "domain specific" features such as Aerodynamic Speed (ft/s), Characteristic Acceleration (ft/s2), Percent Below 55 (%), Percent Zero (%), Stops Per Mile, Average Speed (mph), Maximum Speed (mph), and Speed Standard Deviation (mph). Includes Pyspark UDF to compute "domain agnostic" features using the TSFresh library. This software record also includes the analysis notebooks and code to generate the results in the previously mentioned technical report.

Perr-Sauer, Jordan↗
DOE OSTI2022

High-throughput investigation of structural evolution upon solid-state in Cu–Cr–Co combinatorial multilayer thin-film

Cu-Cr-Co combinatorial multilayer thin-films were prepared by a high-throughput ion beam sputtering system. Based on the thickness ratio among the individual nanoscale monolayers (Cu, Cr, Co), the resulting stoichiometry covered the entire phase diagram. The chemical composition and structure of Cu-Cr-Co combinatorial chip upon solid-state reaction were studied by lab-based micro-X-ray fluorescence (mu-XRF) and high-throughput synchrotron X-ray diffraction (XRD), respectively. A composition-structure map for Cu-Cr-Co combinatorial chip was developed through automated data analysis employing hierarchical clustering techniques. The structural evolution of Cu-Cr-Co combinatorial chip as a function of heat-treatment temperature, time, and modulation period were studied systematically. Furthermore, the effect of the elemental distribution in-depth direction was investigated to gain more insights regarding phase transformation. This work provides an efficient method and new perspectives for the design and optimization of the composition and structure of high-performance thin-films.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Nitrogen starvation causes lipid remodeling in Rhodotorula toruloides

Abstract Background The oleaginous yeast Rhodotorula toruloides is a promising chassis organism for the biomanufacturing of value-added bioproducts. It can accumulate lipids at a high fraction of biomass. However, metabolic engineering efforts in this organism have progressed at a slower pace than those in more extensively studied yeasts. Few studies have investigated the lipid accumulation phenotype exhibited by R. toruloides under nitrogen limitation conditions. Consequently, there have been only a few studies exploiting the lipid metabolism for higher product titers. Results We performed a multi-omic investigation of the lipid accumulation phenotype under nitrogen limitation. Specifically, we performed comparative transcriptomic and lipidomic analysis of the oleaginous yeast under nitrogen-sufficient and nitrogen deficient conditions. Clustering analysis of transcriptomic data was used to identify the growth phase where nitrogen-deficient cultures diverged from the baseline conditions. Independently, lipidomic data was used to identify that lipid fractions shifted from mostly phospholipids to mostly storage lipids under the nitrogen-deficient phenotype. Through an integrative lens of transcriptomic and lipidomic analysis, we discovered that R. toruloides undergoes lipid remodeling during nitrogen limitation, wherein the pool of phospholipids gets remodeled to mostly storage lipids. We identify specific mRNAs and pathways that are strongly correlated with an increase in lipid levels, thus identifying putative targets for engineering greater lipid accumulation in R. toruloides . One surprising pathway identified was related to inositol phosphate metabolism, suggesting further inquiry into its role in lipid accumulation. Conclusions Integrative analysis identified the specific biosynthetic pathways that are differentially regulated during lipid remodeling. This insight into the mechanisms of lipid accumulation can lead to the success of future metabolic engineering strategies for overproduction of oleochemicals.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1993

Mass and spatial distribution of carbonaceous component in Comet Halley

Cometary grains containing large amounts of carbon and/or organic matter were discovered by in situ measurements of cometary dust composition during VEGA and GIOTTO fly-by missions. In accordance with the classification for the data of PUMA-1 and PUMA-2 mass-spectrometers on board the VEGA spacecraft, particles with a ratio of C to any rock-forming element (Mg, Si, Fe, Ca etc.) greater than 10, were categorized as CHON. There are 464 such particles in PUMA-1 data and 51 in PUMA-2 data. Application of cluster analysis to these grains revealed several distinct compositional classes, namely: (H,C,N,O), (H,C,N), (H,C), (H,C,O), (C,N), (C,O), (C,N,O), and (C). Similar classes were identified among particles analyzed by PIA. Also, about a third of all particles fell into groups (H) and (O) characterized by abundances of these elements beyond chemically reasonable limits.

Fomenkova, M.↗
NASA NTRS2011

NASA Instrument Cost/Schedule Model

NASA's Office of Independent Program and Cost Evaluation (IPCE) has established a number of initiatives to improve its cost and schedule estimating capabilities. 12One of these initiatives has resulted in the JPL developed NASA Instrument Cost Model. NICM is a cost and schedule estimator that contains: A system level cost estimation tool; a subsystem level cost estimation tool; a database of cost and technical parameters of over 140 previously flown remote sensing and in-situ instruments; a schedule estimator; a set of rules to estimate cost and schedule by life cycle phases (B/C/D); and a novel tool for developing joint probability distributions for cost and schedule risk (Joint Confidence Level (JCL)). This paper describes the development and use of NICM, including the data normalization processes, data mining methods (cluster analysis, principal components analysis, regression analysis and bootstrap cross validation), the estimating equations themselves and a demonstration of the NICM tool suite.

JCL↗
DOE OSTI2025

Scalable edge clustering of dynamic graphs via weighted line graphs

Timestamped relational datasets consisting of records (or connections) between pairs of entities are ubiquitous in network science. For applications like peer-to-peer communication, email, various social network interactions, and computer network security, it is useful to organize these records into groups based on how and when they are occurring. Weighted line graphs offer a natural way to model how records are related in such datasets but for large real-world graph topologies, building and utilizing the line graph is prohibitively expensive. Here, we present the framework to cluster the edges of a dynamic graph via the associated line graph that contains two major contributions. The first is a method to work with the line graph implicitly and the second is a distributed scale implementation of an agglomerative hierarchical graph clustering algorithm. We outline a novel hierarchical dynamic graph edge clustering approach that efficiently breaks massive relational datasets into small sets of edges containing events at various timescales. This is in stark contrast to traditional graph clustering algorithms that prioritize highly connected (clique-like) community structures. Our approach relies on constructing a sufficient subgraph of a weighted line graph and applying a hierarchical agglomerative clustering. This approach is related to scalable techniques from spatial clustering, nonlinear-dimension reduction, topological data analysis, and draws particular inspiration from HDBSCAN. As an edge clustering, this method yields an overlapping node clustering. Our algorithm is parallelizable and we demonstrate efficient clustering of a billion-scale, real-world dynamic graph into small edge sets that correlate in topology and time. The entire clustering process for a graph with tens of billions of edges takes just a few minutes of run time on 256 nodes of a distributed compute environment. We argue how the output of the edge clustering is useful for a multitude of data visualization and powerful machine learning tasks, both involving the original massive dynamic graph data and metadata associated with the nodes and edges. Finally, we describe how this approach can be extended to dynamic hypergraphs and dynamic graphs/hypergraphs with unstructured data living on vertices and edges.

Data Analysis↗
NASA NTRS2004

Cluster II Wideband (WBD) Plasma Wave Investigation Mission Operations and Data Analysis

This Summary of Research is being submitted to NASA Goddard Space Flight Center. A summary of the significant accomplishments of the Cluster Wideband (WBD) Plasma Wave Investigation team achieved during the period of the grant, October 1,2000 through January 14, 2004, and a listing of all of the publications that resulted from work carried out under the grant is presented. Also included is a listing of the numerous public outreach activities that took place during the period of the grant in which the Cluster mission and Cluster WBD science were discussed.

Gurnett, Donald A.↗
NASA NTRS1981

Mapping watermass boundaries using fluorosensing lidar

An initial application of multispectral LIDAR data from the NASA airborne oceanographic lidar (AOL) to the mapping of watermass boundaries is presented. The approach uses the multispectral lidar data from the fluorosensing mode in a cluster analysis to define water types. Individual data points are classified as to parent water type(s) and then plotted in plan view to show the watermass boundaries and mixing regions. The methodology was applied to the AOL data from the SUPERFLUX overflights. The results are compared to salinity-mapping radar results from the same region.

Sarabun, C. C., Jr.↗
NASA NTRS1987

Rain volume estimation over areas using satellite and radar data

The analysis of 18 convective clusters demonstrates that the extension of the Area-Time-Integral (ATI) technique to the use of satellite data is possible. The differences of the internal structures of the radar reflectivity features, and of the satellite features, give rise to differences in estimating rain volumes by delineating area; however, by focusing upon the area integrated over the lifetime of the storm, it is suggested that some of the errors produced by the differences in the cloud geometries as viewed by radar or satellite are minimized. The results are good and future developments should consider data from different climatic regions and should allow for implementation of the technique in a general circulation model.

Doneaud, Andre A.↗
DOE OSTI2023

Building an Efficient Cluster Cosmology Software Package for Modeling Cluster Counts and Lensing

We introduce a software suite developed for galaxy cluster cosmological analysis with the Dark Energy Survey Data. Cosmological analyses based on galaxy cluster number counts and weak-lensing measurements need efficient software infrastructure to explore an increasingly large parameter space, and account for various cosmological and astrophysical effects. Our software package is designed to model the cluster observables in a wide-field optical survey, including galaxy cluster counts, their averaged weak-lensing masses, or the cluster's averaged weak-lensing radial signals. To ensure maximum efficiency, this software package is developed in C++ in the CosmoSIS software framework, making use of the CUBA integration library. We also implement a testing and validation scheme to ensure the quality of the package. We demonstrate the effectiveness of this development by applying the software to the Dark Energy Survey Year 1 galaxy cluster cosmological data sets, and acquired cosmological constraints that are consistent with the fiducial Dark Energy Survey analysis.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2026

Dark Energy Survey Year 3 results: Simulation-based 𝑤CDM inference from weak lensing and galaxy clustering maps with deep learning: Analysis design

Data-driven approaches using deep learning are emerging as powerful techniques to extract non-Gaussian information from cosmological large-scale structure. Here, this work presents the first simulation-based inference (SBI) pipeline that combines weak lensing and galaxy clustering maps in a realistic Dark Energy Survey Year 3 (DES Y3) configuration and serves as preparation for a forthcoming analysis of the survey data. We develop a scalable forward model based on the CosmoGridV1 suite of N-body simulations to generate over one million self-consistent mock realizations of DES Y3 at the map level. Leveraging this large dataset, we train deep graph convolutional neural networks on the full survey footprint in spherical geometry to learn low-dimensional features that approximately maximize mutual information with target parameters. These learned compressions enable neural density estimation of the implicit likelihood via normalizing flows in a ten-dimensional parameter space spanning cosmological 𝑤CDM, intrinsic alignment, and linear galaxy bias parameters, while marginalizing over baryonic, photometric redshift, and shear bias nuisances. To ensure robustness, we extensively validate our inference pipeline using synthetic observations derived from both systematic contaminations in our forward model and independent Buzzard galaxy catalogs. Our forecasts yield significant improvements in cosmological parameter constraints, achieving 2−3× higher figures of merit in the 𝛺 𝑚 − 𝑆 8 plane relative to our implementation of baseline two-point statistics and effectively breaking parameter degeneracies through probe combination. These results demonstrate the potential of SBI analyses powered by deep learning for upcoming Stage-IV wide-field imaging surveys.

Thomsen, A. [Zurich, ETH] (ORCID:0000000203099021)↗
NASA NTRS1975

Use of LANDSAT imagery for wildlife habitat mapping in northeast and east central Alaska

The author has identified the following significant results. Two scenes were analyzed by applying an iterative cluster analysis to a 2% random data sample and then using the resulting clusters as a training set basis for maximum likelihood classification. Twenty-six and twenty-seven categorical classes, respectively resulted from this process. The majority of classes in each case were quite specific vegetation types; each of these types has specific value as moose habitat.

Lent, P. C.↗
NASA NTRS1991

The manifold of globular clusters

A multivariate statistical analysis of a large data set on the Galactic globular clusters indicates that at least 4 (possibly 5 or 6) parameters are needed in order to describe fully the global properties of these objects. Some nontrivial correlations are present in the data, and are described in the text. One of them is the scaling relation between the luminosity and the central velocity dispersion, whose possible physical origin is briefly discussed. Many of the systematic trends found in the data suggest that dynamical effects played an important or even a dominant role in determining the present-day global properties of globular clusters.

Djorgovski, S.↗
DOE OSTI2024

Masses of Sunyaev-Zel’dovich galaxy clusters detected by the Atacama Cosmology Telescope: Stacked lensing measurements with Subaru HSC year 3 data

We present a stacked lensing analysis of 96 galaxy clusters selected by the thermal Sunyaev-Zel’dovich (SZ) effect in maps of the cosmic microwave background (CMB). We select foreground galaxy clusters with a 5 σ -level SZ threshold in CMB observations from the Atacama Cosmology Telescope, while we define background source galaxies for the lensing analysis with secure photometric redshift cuts in Year 3 data of the Subaru Hyper Suprime Cam survey. We detect the stacked lensing signal in the range of 0.1 < R [ h - 1 Mpc ] < 100 in each of three cluster redshift bins, 0.092 < z ≤ 0.445 , 0.445 < z ≤ 0.695 , and 0.695 < z ≤ 1.180 , with 32 galaxy clusters in each bin. The cumulative signal-to-noise ratios of the lensing signal are 14.6, 12.0, and 6.6, respectively. Using a halo-based forward model, we then constrain statistical relationships between the mass inferred from the SZ observation (i.e. SZ mass) and the total mass derived from our stacked lensing measurements. At the average SZ mass in the cluster sample ( 2.1 - 2.4 × 10 14 h - 1 M ⊙ ), our likelihood analysis shows that the average total mass differs from the SZ counterpart by a factor of 1.3 ± 0.2 , 1.6 ± 0.2 , and 1.6 ± 0.3 (68%) in the aforementioned redshift ranges, respectively. Our limits are consistent with previous lensing measurements, and we find that the cluster modeling choices can introduce a 1 σ -level difference in our parameter inferences.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2024

Masses of Sunyaev-Zel’dovich Galaxy Clusters Detected by the Atacama Cosmology Telescope: Stacked Lensing Measurements with Subaru HSC Year 3 Data

We present a stacked lensing analysis of 96 galaxy clusters selected by the thermal Sunyaev-Zel’dovich (SZ) effect in maps of the cosmic microwave background (CMB). We select foreground galaxy clusters with a 5σ-level SZ threshold in CMB observations from the Atacama Cosmology Telescope, while we define background source galaxies for the lensing analysis with secure photometric redshift cuts in Year 3 data of the Subaru Hyper Suprime Cam survey. We detect the stacked lensing signal in the range of 0.1 < R[h −1 Mpc] < 100 in each of three cluster redshift bins, 0.092 < z ≤ 0.445, 0.445 < z ≤ 0.695, and 0.695 < z ≤ 1.180, with 32 galaxy clusters in each bin. The cumulative signal-to-noise ratios of the lensing signal are 14.6, 12.0, and 6.6, respectively. Using a halo-based forward model, we then constrain statistical relationships between the mass inferred from the SZ observation (i.e. SZ mass) and the total mass derived from our stacked lensing measurements. At the average SZ mass in the cluster sample (2.1 − 2.4 × 10 14 h −1 M⊙), our likelihood analysis shows that the average total mass differs from the SZ counterpart by a factor of 1.3 ± 0.2, 1.6 ± 0.2, and 1.6 ± 0.3 (68%) in the aforementioned redshift ranges, respectively. Our limits are consistent with previous lensing measurements, and we find that the cluster modeling choices can introduce a 1σ-level difference in our parameter inferences.

Masato Shirasaki↗
DOE OSTI2020

Improving galaxy clustering measurements with deep learning: analysis of the DECaLS DR7 data

ABSTRACT Robust measurements of cosmological parameters from galaxy surveys rely on our understanding of systematic effects that impact the observed galaxy density field. In this paper, we present, validate, and implement the idea of adopting the systematics mitigation method of artificial neural networks for modelling the relationship between the target galaxy density field and various observational realities including but not limited to Galactic extinction, seeing, and stellar density. Our method by construction allows a wide class of models and alleviates overtraining by performing k-fold cross-validation and dimensionality reduction via backward feature elimination. By permuting the choice of the training, validation, and test sets, we construct a selection mask for the entire footprint. We apply our method on the extended Baryon Oscillation Spectroscopic Survey (eBOSS) Emission Line Galaxies (ELGs) selection from the Dark Energy Camera Legacy Survey (DECaLS) Data Release 7 and show that the spurious large-scale contamination due to imaging systematics can be significantly reduced by up-weighting the observed galaxy density using the selection mask from the neural network and that our method is more effective than the conventional linear and quadratic polynomial functions. We perform extensive analyses on simulated mock data sets with and without systematic effects. Our analyses indicate that our methodology is more robust to overfitting compared to the conventional methods. This method can be utilized in the catalogue generation of future spectroscopic galaxy surveys such as eBOSS and Dark Energy Spectroscopic Instrument (DESI) to better mitigate observational systematics.

79 ASTRONOMY AND ASTROPHYSICS↗