Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analysis cluster”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

Data augmentation for disruption prediction via robust surrogate models

The goal of this work is to generate large statistically representative datasets to train machine learning models for disruption prediction provided by data from few existing discharges. Such a comprehensive training database is important to achieve satisfying and reliable prediction results in artificial neural network classifiers. Here, we aim for a robust augmentation of the training database for multivariate time series data using Student-t process regression. We apply Student-t process regression in a state space formulation via Bayesian filtering to tackle challenges imposed by outliers and noise in the training data set and to reduce the computational complexity. Thus, the method can also be used if the time resolution is high. We use an uncorrelated model for each dimension and impose correlations afterwards via coloring transformations. We demonstrate the efficacy of our approach on plasma diagnostics data of three different disruption classes from the DIII-D tokamak. To evaluate if the distribution of the generated data is similar to the training data, we additionally perform statistical analyses using methods from time series analysis, descriptive statistics, and classic machine learning clustering algorithms.

97 MATHEMATICS AND COMPUTING↗

An unsupervised classification technique for multispectral remote sensing data.

Description of a two-part clustering technique consisting of (a) a sequential statistical clustering, which is essentially a sequential variance analysis, and (b) a generalized K-means clustering. In this composite clustering technique, the output of (a) is a set of initial clusters which are input to (b) for further improvement by an iterative scheme. This unsupervised composite technique was employed for automatic classification of two sets of remote multispectral earth resource observations. The classification accuracy by the unsupervised technique is found to be comparable to that by traditional supervised maximum-likelihood classification techniques.

Su, M. Y.↗

Spectrophotometry of faint cluster galaxies and the Hubble diagram - An approach to cosmology

New spectrophotometric data are presented for large-redshift galaxies in clusters. A new approach to aperture corrections and the analysis of the Hubble diagram is outlined, including the explicit incorporation of evolutionary effects. The importance of selection effects on the usual methods of analysis are in principle overcome in the analysis, although the heterogeneity of the sample still makes conclusions about cosmology slightly suspect. Formal values of the deceleration parameter are derived under several sets of assumptions, yielding results between +0.33 and -1.27 with formal standard deviations of order 0.7.

Gunn, J. E.↗

A Survey of Variable Extragalactic Sources with XTE's All Sky Monitor (ASM)

The original goal of the project was the near real-time detection of AGN utilizing the SSC 3 of the ASM on XTE which does a deep integration on one 100 square degree region of the sky. While the SSC never performed sufficiently well to allow the success of this goal, the work on the project has led to the development of a new analysis method for coded aperture systems which has now been applied to ASM data for mapping regions near clusters of galaxies such as the Perseus Cluster and the Coma Cluster. Publications are in preparation that describe both the new method and the results from mapping clusters of galaxies.

Jernigan, Garrett↗

The Parallel System for Integrating Impact Models and Sectors (pSIMS)

We present a framework for massively parallel climate impact simulations: the parallel System for Integrating Impact Models and Sectors (pSIMS). This framework comprises a) tools for ingesting and converting large amounts of data to a versatile datatype based on a common geospatial grid; b) tools for translating this datatype into custom formats for site-based models; c) a scalable parallel framework for performing large ensemble simulations, using any one of a number of different impacts models, on clusters, supercomputers, distributed grids, or clouds; d) tools and data standards for reformatting outputs to common datatypes for analysis and visualization; and e) methodologies for aggregating these datatypes to arbitrary spatial scales such as administrative and environmental demarcations. By automating many time-consuming and error-prone aspects of large-scale climate impacts studies, pSIMS accelerates computational research, encourages model intercomparison, and enhances reproducibility of simulation results. We present the pSIMS design and use example assessments to demonstrate its multi-model, multi-scale, and multi-sector versatility.

crop modeling↗

Cosmological Constraints from Full-Scale Clustering and Galaxy-Galaxy Lensing with DESI DR1

We present constraints on cosmic structure growth from the analysis of galaxy clustering and galaxy-galaxy lensing with galaxies from the Dark Energy Spectroscopic Instrument (DESI) Data Release 1. We analyze four samples drawn from the Bright Galaxy Survey (BGS) and the Luminous Red Galaxy (LRG) target classes. Projected galaxy clustering measurements from DESI are supplemented with lensing measurements from the Dark Energy Survey (DES), the Kilo-Degree Survey (KiDS), and the Hyper Suprime-Cam (HSC) survey around the same targets. Our method relies on a simulation-based modeling framework using the AbacusSummit simulations and a complex halo occupation distribution model that incorporates assembly bias. We analyze scales down to $0.4 \, h^{-1} \, \mathrm{Mpc}$ for clustering and $2.5 \, h^{-1} \, \mathrm{Mpc}$ for lensing, leading to stringent constraints on $S_8 = σ_8 \sqrt{Ω_\mathrm{m} / 0.3}$ and $Ω_\mathrm{m}$ when fixing other cosmological parameters to those preferred by the CMB. We find $S_8 = 0.794 \pm 0.023$ and $Ω_\mathrm{m} = 0.295 \pm 0.012$ when using lensing measurements from DES and KiDS. Similarly, for HSC, we find $S_8 = 0.793 \pm 0.017$ and $Ω_\mathrm{m} = 0.303 \pm 0.010$ when assuming the best-fit photometric redshift offset suggested by the HSC collaboration. Overall, our results are in good agreement with other results in the literature while continuing to highlight the constraining power of non-linear scales.

Lange, Johannes U. [American U.] (ORCID:0000000224↗

Was There a 3.5 keV Line?

Abstract The 3.5 keV line is a purported emission line observed in galaxies, galaxy clusters, and the Milky Way whose origin is inconsistent with known atomic transitions and has previously been suggested to arise from dark matter decay. We systematically reexamine the bulk of the evidence for the 3.5 keV line, attempting to reproduce six previous analyses that found evidence for the line. We only reproduce one of the analyses; in the other five, we find no significant evidence for a 3.5 keV line when following the described analysis procedures on the original data sets. For example, previous results claimed 4 σ evidence for a 3.5 keV line from the Perseus cluster; we dispute this claim, finding no evidence for a 3.5 keV line. We find evidence for background mismodeling in multiple analyses. We show that analyzing these data in narrower energy windows diminishes the effects of mismodeling but returns no evidence for a 3.5 keV line. We conclude that there is little robust evidence for the existence of the 3.5 keV line. Some of the discrepancy of our results from those of the original works may be due to the earlier reliance on local optimizers, which we demonstrate can lead to incorrect results. For ease of reproducibility, all code and data are publicly available.

79 ASTRONOMY AND ASTROPHYSICS↗

The evaluation of alternate methodologies for land cover classification in an urbanizing area

The usefulness of LANDSAT in classifying land cover and in identifying and classifying land use change was investigated using an urbanizing area as the study area. The question of what was the best technique for classification was the primary focus of the study. The many computer-assisted techniques available to analyze LANDSAT data were evaluated. Techniques of statistical training (polygons from CRT, unsupervised clustering, polygons from digitizer and binary masks) were tested with minimum distance to the mean, maximum likelihood and canonical analysis with minimum distance to the mean classifiers. The twelve output images were compared to photointerpreted samples, ground verified samples and a current land use data base. Results indicate that for a reconnaissance inventory, the unsupervised training with canonical analysis-minimum distance classifier is the most efficient. If more detailed ground truth and ground verification is available, the polygons from the digitizer training with the canonical analysis minimum distance is more accurate.

Smekofski, R. M.↗

Joint cosmological fits to DESI-DR1 full-shape clustering and weak gravitational lensing in configuration space

We present a joint $3\times2$-pt cosmological analysis of auto- and cross-correlations between the Dark Energy Spectroscopic Instrument Data Release 1 (DESI-DR1) Bright Galaxy Survey (BGS) and Luminous Red Galaxy (LRG) samples and overlapping shear measurements from the KiDS-1000, DES-Y3 and HSC-Y3 weak lensing surveys. We perform our analysis in configuration space and, in addition to the cosmic shear correlation functions for each weak lensing dataset, we fit the tangential shear of the weak lensing source galaxies around DESI lens galaxies. Finally, we make use of the anisotropic BGS and LRG clustering information by fitting the full shape of the two-point correlation function multipoles measured over the full DESI-DR1 footprint, presenting the first full-shape analysis of DESI measurements in configuration space. We find that the addition of weak lensing information serves to improve, with respect to the clustering-only case, the measurements of the power spectrum amplitude parameters $\ln(10^{10}A_{\rm{s}})$ and $σ_{12}$ by $15\%$ and $36\%$, respectively. It also improves measurements of the linear bias of the lens galaxies by $15-20\%$, depending on the tracer. Our results show excellent consistency, regardless of the weak lensing survey considered, and are furthermore consistent with a companion analysis that fits $3\times2$-pt correlations including DESI projected clustering measurements, as well as the results published by the weak lensing collaborations themselves. Our measured values for weak lensing amplitude are $S_{8}^{\mathrm{DESI\times HSC}}=0.787\pm0.020$, $S_{8}^{\mathrm{DESI\times DES}}=0.791\pm0.016$, $S_{8}^{\mathrm{DESI\times KiDS}}=0.771\pm0.017$, which are $1.9σ-2.9σ$ below the $S_8$ value preferred by Planck. Finally, our clustering-only results are in good agreement with the Fourier space full-shape analysis of all DESI tracers.

Semenaite, A. [Swinburne U., Ctr. Astrophys. Super↗

Dark Energy Survey Year 6 Results: MagLim++ Lens Sample Selection and Measurements of Galaxy Clustering

Galaxy clustering is a sensitive probe of the expansion history and growth of structure of the universe, and key degeneracies can be broken by combining these data with measurements of cosmic shear and galaxy-galaxy lensing (a so-called 3$\times$2pt analysis). The largest and least biased statistical samples of galaxies for use in clustering analyses can be collected photometrically through large imaging surveys. However, selecting clean photometric subsamples for cosmology are crucial for avoiding contamination that can bias cosmological constraints. Here we present the MagLim++ galaxy sample, selected to optimize for cosmological constraining power and incorporating an array of novel quality cuts to identify and remove residual contamination. This sample comes from the full six years of observations from the Dark Energy Survey. We present measurements of the two-point angular clustering ($w(θ)$) of 9,186,205 galaxies distributed over 4031 sq. degrees and in six tomographic redshift bins centered at $\bar{z}\approx$ [0.31, 0.44, 0.62, 0.78, 0.90, 1.01]. These measurements are used as part of the 3$\times$2pt and other DES Y6 legacy cosmological analyses in companion works. We describe the battery of null tests and mitigation schemes implemented to address observational, astrophysical, and methodological systematics in the analysis. The resulting $w(θ)$ measurements have a S/N = 149 (90.2 for linear scales only), which we use to place galaxy-clustering-only constraints on the matter density of the Universe, $Ω_m=0.311^{+0.023}_{-0.035}$, and amplitude of galaxy clustering in each redshift bin, $b_iσ_8=[1.16^{+0.04}_{-0.06},\ 1.40^{+0.04}_{-0.06},\ 1.57^{+0.04}_{-0.06},\ 1.59^{+0.04}_{-0.05},\ 1.50^{+0.04}_{-0.05},\ 1.74^{+0.06}_{-0.08}]$.

Weaverdyck, N. [BCCP, Berkeley; UC, Berkeley; LBL,↗

Binning for IC Quality: Experimental Studies on the SEMATECH Data

The earlier smaller bipolar study did not provide a high enough bin 0 population to directly observe test escapes and thereby estimate defect levels for the best bin. Results presented here indicate that the best bin can be reasonably expected to show a 2 - 5 factor improvement in defect levels over the average for the lot for moderate to high yields (the overall yield for these experiments was approximately 65%). The experiments also confirm the dependence of the best bin quality on test transparency. The defect level improvement is poorer for the case Of IDDQ escapes where the tests applied had a much higher escape rate. Overall experimental results are consistent with analytical projections for typical values of the clustering parameter in [9]. The final version of this paper will include extensive analysis to validate the analytical models based on this data.

Singh, Adit D.↗

Satellite Data Sets in the Polar Regions

We have generated about two decades of consistently derived geophysical parameters in the polar regions. The key parameters are sea ice concentration, surface temperature, albedo, and cloud cover statistics. Sea ice concentrations were derived from the Scanning Multichannel Microwave Radiometer (SMMR) data and the Special Scanning Cl Microwave Imager (SSM/I) data from several platforms using the enhanced Bootstrap Algorithm for the period 1978 through 1999. The new algorithm reduces the errors associated with spatial and temporal variations in the emissivity and surface temperatures of sea ice. Also, bad data at ocean/land interfaces are identified and deleted in an unsupervised manner. Surface ice temperature, albedo and cloud cover statistics are derived simultaneously from the Advanced Very High Resolution Radiometer (AVHRR) data from 1981 through 1999 and mapped at a higher resolution but the same format as the ice concentration data. The technique makes use these co-registered ice concentration maps to enable cloud masking to be done separately for open ocean, sea ice and land areas. The effect of inversion is minimized by taking into consideration the expected changes in the effect of inversion with altitude, especially in the Antarctic. A technique for ice type regional classification has also been developed using multichannel cluster analysis and a neural network. This provide a means to identify large areas of thin ice, first year ice, and older ice types. The data sets have been shown to be coherent with each other and provide a powerful tool for in depth studies of the currently changing Arctic and Antarctic environment.

Comiso, Josefino C.↗

Bridging Control and Deployment: A Cross-Layer Analysis of Scalable Building Cluster Control

Building cluster control has emerged as a promising approach for enabling flexible and coordinated operation of distributed building systems, yet its transition from pilot demonstrations to routine grid-interactive operation remains limited. This paper argues that this gap cannot be explained by control algorithms alone. Instead, it arises from interacting barriers in communication infrastructure, data and semantic interoperability, uncertainty management, stakeholder participation, market design, and policy support. Accordingly, the paper reviews both technical and non-technical barriers to building cluster control. Technical challenges include heterogeneous devices and protocols, communication latency and reliability, distributed decision-making, and uncertainty propagation across aggregated loads. Non-technical barriers include user participation, stakeholder coordination, incentive allocation, and data governance. Existing solution approaches are synthesized, including semantic interoperability frameworks, edge and hierarchical communication architectures, distributed and transactive control strategies, uncertainty-aware optimization, policy mechanisms, and market reforms. Based on this analysis, two research directions are identified: testing infrastructures that can evaluate control performance under realistic multi-building conditions, and abstraction methods that allow building clusters to interact with other energy sectors through standardized flexibility representations. Overall, the paper provides a structured review of how building cluster control can move from isolated demonstrations toward reproducible, market-compatible, and grid-relevant implementation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

TopPICR: A Companion R Package for Top-Down Proteomics Data Analysis

Top-down proteomics is the analysis of proteins in their intact form without proteolysis, thus preserving valuable information about post-translational modifications, isoforms, and proteolytic processing. However, it is still a developing field due to limitations in the instrumentation, difficulties with interpretation of complex mass spectra, and a lack of well-established quantification approaches. TopPIC is one of the popular tools for proteoform identification. Here we extended its capabilities into label-free proteoform quantification by developing a companion R package (TopPICR). Key steps in the TopPICR pipeline include filtering identifications, inferring a minimal set of protein accessions explaining the observed sequences, aligning retention times, recalibrating measured masses, clustering features across datasets, and finally compiling feature intensities using the match-between-runs approach. The output of the pipeline is an MSnSet object which makes downstream data analysis seamlessly compatible with packages from the Bioconductor project. It also provides the capability for visualizing proteoforms within the context of the parent protein sequence. The functionality of TopPICR is demonstrated on top-down LC-MS/MS datasets of 10 human-in-mouse xenografts of luminal and basal breast tumor samples.

59 BASIC BIOLOGICAL SCIENCES↗

The importance of accounting for landscape position when investigating grasslands: A multidisciplinary characterisation of a Californian coastal grassland

Data from the characterisation of the Point Reyes Field Site, published in AGU Earth's Future under the title: The importance of accounting for landscape position when investigating grasslands: A multidisciplinary characterisation of a Californian coastal grassland. This paper explored the effect of landscape position on the response of a Californian grassland to seasonal changes. All files are csv files. The EMI data contains 8 csv files with a metadata csv explaining the columns. The dataset also includes soil variables including total concentrations calculated from fused samples, then dissolved and measured on ICP-AES for whole-rock elements and ICP-MS for trace elements. Mineral composition was attained using X-ray diffraction at BL 11-3 at SSRL . Data was then run through the High Score database to characterise different mineral phases. total It also includes a table with bulk soil characteristics such as soil pH, cation exchange capacity, and soil textural data. Data from Teros 12 Meter soil moisture, electrical conductivity and temperature sensors are presented in SMS Csv file. While the WL bottom and top files contain data from Piezometers measuring the ground water table. We have included a csv file that contains soil CO2 efflux data from Feb 2021-Oct 2021 in the Point Reyes Grassland Experiment We have included the spatially orientated (easting northing) remotely sensed datasets that were used in the K-means clustering analysis conducted on our site with electrical conductivity, normalised difference vegetation index, elevation, slope, solar radiation, topographic position and wetness index, and a clustering score. Finally there is a list of all the identified grassland species at the site.For more information on flux data, please contact the corresponding author.

54 ENVIRONMENTAL SCIENCES↗

Unsupervised classification of earth resources data.

A new clustering technique is presented. It consists of two parts: (a) a sequential statistical clustering which is essentially a sequential variance analysis and (b) a generalized K-means clustering. In this composite clustering technique, the output of (a) is a set of initial clusters which are input to (b) for further improvement by an iterative scheme. This unsupervised composite technique was employed for automatic classification of two sets of remote multispectral earth resource observations. The classification accuracy by the unsupervised technique is found to be comparable to that by existing supervised maximum liklihood classification technique.

Su, M. Y.↗

Studying the hadron structure with PANDA and CLAS using machine learning techniques

The hadron spectroscopy and structure are currently very active fields of research to study the non-perturbative regime of quantum chronodynamics. The first one studies the complex structure of excited hadrons by looking at their decay products, while the latter uses lepton scattering on nucleons. Both methods require reconstruction algorithms with great efficiency and good particle identification and background rejection rates. This work aims to provide these by either improving the existing methods or developing new ones. The first part of this document presents a feasibility study of a predicted hybrid charmonium state for the PANDA experiment. Lattice QCD calculations predict the ground state hybrid charmonium to be a spin exotic with quantum numbers of JP C = 1?+ at a mass of around 4.3 GeV with a width to be around 20 MeV. A machine learning based data analysis scheme is proposed to further improve the signal efficiency and the background reduction, alongside with improvements of the analysis software (PandaRoot), that are vital for this study. These improvements include a reworked clustering algorithm for the electromagnetic calorimeter (EMC) and an optimized monte carlo matching for neutral particles. The second part of this document is about studying the proton structure. A multidimensional study of the structure function ratio Fsin(?)LU /FUU has been performed for K±, based on the measurement of beam-spin asymmetries. It uses the high statistics data recorded with the CLAS12 spectrometer at Jefferson Laboratory. Fsin(?)LU is a twist-3 quantity that provides information about the quark gluon correlations in the proton. This document will present for the first time a simultaneous analysis of two kaon channels over a large kinematic range of z, xB , PT and Q2 with virtualities Q2 ranging from 1 GeV2 up to 8 GeV2 using machine learning techniques for improved particle identification.

Kripko, Aron↗

An Improved Boosting to Amplify Signal with Isobaric Labeling (iBASIL) Strategy for Precise Quantitative Single-cell Proteomics

Mass spectrometry (MS)-based proteomics has great potential for overcoming the limitations of antibody-based immunoassays for antibody-independent, comprehensive, and quantitative proteomic analysis of single cells. Indeed, recent advances in nanoscale sample preparation have enabled effective processing of single cells. In particular, the concept of using boosting/carrier channels in isobaric labeling to increase the sensitivity in MS detection has also been increasingly used for quantitative proteomic analysis of small-sized samples including single cells. However, the full potential of such boosting/carrier approaches has not been significantly explored, nor has the resulting quantitation quality been carefully evaluated. Herein, we have further evaluated and optimized our recent boosting to amplify signal with isobaric labeling (BASIL) approach, originally developed for quantifying phosphorylation in small number of cells, for highly effective analysis of proteins in single cells. This improved BASIL (iBASIL) approach enables reliable quantitative single-cell proteomics analysis with greater proteome coverage by carefully controlling the boosting-to-sample ratio (e.g. in general <100×) and optimizing MS automatic gain control (AGC) and ion injection time settings in MS/MS analysis (e.g. 5E5 and 300 ms, respectively, which is significantly higher than that used in typical bulk analysis). By coupling with a nanodroplet-based single cell preparation (nanoPOTS) platform, iBASIL enabled identification of ~2500 proteins and precise quantification of ~1500 proteins in the analysis of 104 FACS-isolated single cells, with the resulting protein profiles robustly clustering the cells from three different acute myeloid leukemia cell lines. This study highlights the importance of carefully evaluating and optimizing the boosting ratios and MS data acquisition conditions for achieving robust, comprehensive proteomic analysis of single cells.

59 BASIC BIOLOGICAL SCIENCES↗