Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data clustering”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47

dCache: The Storage System of Choice for Data-Intensive Applications

The ever-increasing volumes of data produced by modern scientific facilities like EuXFEL and LHC put significant stress on data management infrastructure operated by laboratories and research centers. The challenges to be addressed span the entire data life cycle, from ingest and efficient data analysis to long-term preservation, typically involving large tape libraries. dCache, a storage system developed in collaboration between the Deutsches Elektronen-Synchrotron (DESY), Fermi National Accelerator Laboratory, and Nordic e-Infrastructure Collaboration (NeIC), is designed to manage a large number of disk servers and to facilitate transparent data migration to and from archival storage. Its multifaceted approach offers a unified method to support a variety of scientific use cases with the same storage infrastructure, including high-throughput data ingest, data sharing over wide area networks, efficient access from HPC clusters, and long-term data preservation on tertiary storage. Initially developed for high energy physics (HEP) experiments, dCache is now used by various scientific communities, including astrophysics, biomedical research, and life sciences, each having specific requirements. This paper presents architecture, deployment strategies, performance and scalability enhancements, and recent advancements in dCache addressing the needs of scientific communities. Finally, we touch on the development and release process, ensuring the software’s high quality.

DCache↗

LoCuSS: THE STEADY DECLINE AND SLOW QUENCHING OF STAR FORMATION IN CLUSTER GALAXIES OVER THE LAST FOUR BILLION YEARS

We present an analysis of the levels and evolution of star formation activity in a representative sample of 30 massive galaxy clusters at 0.15 < z < 0.30 from the Local Cluster Substructure Survey, combining wide-field Spitzer/MIPS 24 μm data with extensive spectroscopy of cluster members. The specific SFRs of massive (M > or approx. 10{sup 10} M{sub ☉}) star-forming cluster galaxies within r{sub 200} are found to be systematically ∼28% lower than their counterparts in the field at fixed stellar mass and redshift, a difference significant at the 8.7σ level. This is the unambiguous signature of star formation in most (and possibly all) massive star-forming galaxies being slowly quenched upon accretion into massive clusters, their star formation rates (SFRs) declining exponentially on quenching timescales in the range 0.7-2.0 Gyr. We measure the mid-infrared Butcher-Oemler effect over the redshift range 0.0-0.4, finding rapid evolution in the fraction (f{sub SF}) of massive (M{sub K} < – 23.1) cluster galaxies within r{sub 200} with SFRs > 3 M{sub ☉} yr{sup –1}, of the form f{sub SF}∝(1 + z){sup 7.6±1.1}. We dissect the origins of the Butcher-Oemler effect, revealing it to be due to the combination of a ∼3 × decline in the mean specific SFRs of star-forming cluster galaxies since z ∼ 0.3 with a ∼1.5 × decrease in number density. Two-thirds of this reduction in the specific SFRs of star-forming cluster galaxies is due to the steady cosmic decline in the specific SFRs among those field galaxies accreted into the clusters. The remaining one-third reflects an accelerated decline in the star formation activity of galaxies within clusters. The slow quenching of star formation in cluster galaxies is consistent with a gradual shut down of star formation in infalling spiral galaxies as they interact with the intracluster medium via ram-pressure stripping or starvation mechanisms. The observed sharp decline in star formation activity among cluster galaxies since z ∼ 0.4 likely reflects the increased susceptibility of low-redshift spiral galaxies to gas removal mechanisms as their gas surface densities decrease with time. We find no evidence for the build-up of cluster S0 bulges via major nuclear starburst episodes.

79 ASTRONOMY AND ASTROPHYSICS↗

Machine learning analysis of perovskite oxides grown by molecular beam epitaxy

Reflection high-energy electron diffraction (RHEED) is a ubiquitous in situ molecular beam epitaxial (MBE) characterization tool. Although RHEED can be a powerful means for crystal surface structure determination, it is often used as a static qualitative surface characterization method at discrete intervals during a growth. A full analysis of RHEED data collected during the entirety of MBE growths is made possible using principle component analysis (PCA) and $\textit{k}$-means clustering to examine significant boundaries that occur in the temporal clusters grouped from RHEED data and identify statistically significant patterns. This process is applied to data from homoepitaxial SrTiO 3 growths, heteroepitaxial SrTiO 3 grown on scandate substrates, BaSnO 3 films grown on SrTiO 3 substrates, and LaNiO 3 films grown on SrTiO 3 substrates. We report this analysis may provide additional insights into the surface evolution and transitions in growth modes at precise times and depths during growth, and that video archival of an entire RHEED image sequence may be able to provide more insight and control overgrowth processes and film quality.

36 MATERIALS SCIENCE↗

MO-FG-204-01: Improved Noise Suppression for Dual-Energy CT Through Entropy Minimization

Purpose: In dual energy CT (DECT), noise amplification during signal decomposition significantly limits the utility of basis material images. Since clinically relevant objects contain a limited number of materials, we propose to suppress noise for DECT based on image entropy minimization. An adaptive weighting scheme is employed during noise suppression to improve decomposition accuracy with limited effect on spatial resolution and image texture preservation. Methods: From decomposed images, we first generate a 2D plot of scattered data points, using basis material densities as coordinates. Data points representing the same material generate a highly asymmetric cluster. We orient an axis by minimizing the entropy in a 1D histogram of these points projected onto the axis. To suppress noise, we replace pixel values of decomposed images with center-of-mass values in the direction perpendicular to the optimal axis. To limit errors due to cluster overlap, we weight each data point’s contribution based on its high and low energy CT values and location within the image. The proposed method’s performance is assessed on physical phantom studies. Electron density is used as the quality metric for decomposition accuracy. Our results are compared to those without noise suppression and with a recently developed iterative method. Results: The proposed method reduces noise standard deviations of the decomposed images by at least one order of magnitude. On the Catphan phantom, this method greatly preserves the spatial resolution and texture of the CT images and limits induced error in measured electron density to below 1.2%. In the head phantom study, the proposed method performs the best in retaining fine, intricate structures. Conclusion: The entropy minimization based algorithm with adaptive weighting substantially reduces DECT noise while preserving image spatial resolution and texture. Future investigations will include extensive investigations on material decomposition accuracy that go beyond the current electron density calculations. This work was supported in part by the National Institutes of Health (NIH) under Grant Number R21 EB012700.

60 APPLIED LIFE SCIENCES↗

X-ray observations of the Ophiuchus, PKS 0745-191 and Cygnus-A clusters of galaxies

Observations are reported of the X-ray emission from three bright clusters of galaxies at low Galactic latitudes: the Ophiuchus, PKS 0745-191, and Cygnus-A clusters. Temperatures and iron abundances are determined from Exosat spectral data. Images of the Ophiuchus cluster show it to have a high central density and a cooling flow. Measurements of a high gas density around PKS 0745-191 and are confirmed, and it is shown that the X-ray emission is centered on the radio galaxy. The PKS 0745-191 cluster is the most distant object for which an abundance has been measured from X-ray spectra. The spectrum of Cygnus-A contains a highly absorbed power-law component that is identified with the nucleus of the radio source.

Arnaud, K. A.↗

Parametric Testing of Launch Vehicle FDDR Models

For the safe operation of a complex system like a (manned) launch vehicle, real-time information about the state of the system and potential faults is extremely important. The on-board FDDR (Failure Detection, Diagnostics, and Response) system is a software system to detect and identify failures, provide real-time diagnostics, and to initiate fault recovery and mitigation. The ERIS (Evaluation of Rocket Integrated Subsystems) failure simulation is a unified Matlab/Simulink model of the Ares I Launch Vehicle with modular, hierarchical subsystems and components. With this model, the nominal flight performance characteristics can be studied. Additionally, failures can be injected to see their effects on vehicle state and on vehicle behavior. A comprehensive test and analysis of such a complicated model is virtually impossible. In this paper, we will describe, how parametric testing (PT) can be used to support testing and analysis of the ERIS failure simulation. PT uses a combination of Monte Carlo techniques with n-factor combinatorial exploration to generate a small, yet comprehensive set of parameters for the test runs. For the analysis of the high-dimensional simulation data, we are using multivariate clustering to automatically find structure in this high-dimensional data space. Our tools can generate detailed HTML reports that facilitate the analysis.

Schumann, Johann↗

An AERONET-Based Aerosol Classification Using the Mahalanobis Distance

We present an aerosol classification based on AERONET aerosol data from 1993 to 2012. We used the AERONET Level 2.0 almucantar aerosol retrieval products to define several reference aerosol clusters which are characteristic of the following general aerosol types: Urban-Industrial, Biomass Burning, Mixed Aerosol, Dust, and Maritime. The classification of a particular aerosol observation as one of these aerosol types is determined by its five-dimensional Mahalanobis distance to each reference cluster. We have calculated the fractional aerosol type distribution at 190 AERONET sites, as well as the monthly variation in aerosol type at those locations. The results are presented on a global map and individually in the supplementary material. Our aerosol typing is based on recognizing that different geographic regions exhibit characteristic aerosol types. To generate reference clusters we only keep data points that lie within a Mahalanobis distance of 2 from the centroid. Our aerosol characterization is based on the AERONET retrieved quantities, therefore it does not include low optical depth values. The analysis is based on point sources (the AERONET sites) rather than globally distributed values. The classifications obtained will be useful in interpreting aerosol retrievals from satellite borne instruments.

Hamill, Patrick↗

Improving Medication Regimen Recommendation for Parkinson’s Disease Using Sensor Technology

Parkinson’s disease medication treatment planning is generally based on subjective data obtained through clinical, physician-patient interactions. The Personal KinetiGraph™ (PKG) and similar wearable sensors have shown promise in enabling objective, continuous remote health monitoring for Parkinson’s patients. In this proof-of-concept study, we propose to use objective sensor data from the PKG and apply machine learning to cluster patients based on levodopa regimens and response. The resulting clusters are then used to enhance treatment planning by providing improved initial treatment estimates to supplement a physician’s initial assessment. We apply k-means clustering to a dataset of within-subject Parkinson’s medication changes—clinically assessed by the MDS-Unified Parkinson’s Disease Rating Scale-III (MDS-UPDRS-III) and the PKG sensor for movement staging. A random forest classification model was then used to predict patients’ cluster allocation based on their respective demographic information, MDS-UPDRS-III scores, and PKG time-series data. Clinically relevant clusters were partitioned by levodopa dose, medication administration frequency, and total levodopa equivalent daily dose—with the PKG providing similar symptomatic assessments to physician MDS-UPDRS-III scores. A random forest classifier trained on demographic information, MDS-UPDRS-III scores, and PKG time-series data was able to accurately classify subjects of the two most demographically similar clusters with an accuracy of 86.9%, an F1 score of 90.7%, and an AUC of 0.871. A model that relied solely on demographic information and PKG time-series data provided the next best performance with an accuracy of 83.8%, an F1 score of 88.5%, and an AUC of 0.831, hence further enabling fully remote assessments. These computational methods demonstrate the feasibility of using sensor-based data to cluster patients based on their medication responses with further potential to assist with medication recommendations.

59 BASIC BIOLOGICAL SCIENCES↗

Application of sulfur SAD to small crystals with a large asymmetric unit and anomalous substructure

The application of sulfur single-wavelength anomalous dispersion (S-SAD) to determine the crystal structures of macromolecules can be challenging if the asymmetric unit is large, the crystals are small, the size of the anomalously scattering sulfur structure is large and the resolution at which the anomalous signals can be accurately measured is modest. Here, as a study of such a case, approaches to the SAD phasing of orthorhombic Ric-8A crystals are described. The structure of Ric-8A was published with only a brief description of the phasing process [Zeng et al. (2019), Structure , 27 , 1137–1141]. Here, alternative approaches to determining the 40-atom sulfur substructure of the 103 kDa Ric-8A dimer that composes the asymmetric unit are explored. At the data-collection wavelength of 1.77 Å measured at the Frontier micro-focusing Macromolecular Crystallography (FMX) beamline at National Synchrotron Light Source II, the sulfur anomalous signal strength, |Δ ano |/σΔ ano ( d ′′/sig), approaches 1.4 at 3.4 Å resolution. The highly redundant, 11 000 000-reflection data set measured from 18 crystals was segmented into isomorphous clusters using BLEND in the CCP 4 program suite. Data sets within clusters or sets of clusters were scaled and merged using AIMLESS from CCP 4 or, alternatively, the phenix.scale_and_merge tool from the Phenix suite. The latter proved to be the more effective in extracting anomalous signals. The HySS tool in Phenix , SHELXC / D and PRASA as implemented in the CRANK 2 program suite were each employed to determine the sulfur substructure. All of these approaches were effective, although HySS , as a component of the phenix.autosol tool, required data from all crystals to find the positions of the sulfur atoms. Critical contributors in this case study to successful phase determination by SAD included (i) the high-flux FMX beamline, featuring helical-mode data collection and a helium-filled beam path, (ii) as recognized by many authors, a very highly redundant, multiple-crystal data set and (iii) the inclusion within that data set of data from crystals that were scanned over large ω ranges, yielding highly isomorphous and highly redundant intensity measurements.

59 BASIC BIOLOGICAL SCIENCES↗

The detection of extended X-ray emission surrounding cD galaxies in poor clusters

The paper presents some preliminary results of a survey, performed with an imaging proportional counter, to detect X-ray emission from poor clusters which nevertheless contain dominant D or cD galaxies and could, therefore, be classified as Bautz-Morgan Type I. The data suggest that poor clusters can collect enough gas to become detectable X-ray sources if they are relatively compact, which the presence of dominant galaxies indicates.

Kriss, G. A.↗

"A Richness Study of 14 Distant X-Ray Clusters from the 160 Square Degree Survey"

We have measured the surface density of galaxies toward 14 X-ray-selected cluster candidates at redshifts z(sub i) 0.46, and we show that they are associated with rich galaxy concentrations. These clusters, having X-ray luminosities of Lx(0.5-2 keV) approx. (0.5 - 2.6) x 10(exp 44) ergs/ sec are among the most distant and luminous in our 160 deg(exp 2) ROSAT Position Sensitive Proportional Counter cluster survey. We find that the clusters range between Abell richness classes 0 and 2 and have a most probable richness class of 1. We compare the richness distribution of our distant clusters to those for three samples of nearby clusters with similar X-ray luminosities. We find that the nearby and distant samples have similar richness distributions, which shows that clusters have apparently not evolved substantially in richness since redshift z=0.5. There is, however, a marginal tendency for the distant clusters to be slightly poorer than nearby clusters, although deeper multicolor data for a large sample would be required to confirm this trend. We compare the distribution of distant X-ray clusters in the L(sub X)-richness plane to the distribution of optically selected clusters from the Palomar Distant Cluster Survey. The optically selected clusters appear overly rich for their X-ray luminosities, when compared to X-ray-selected clusters. Apparently, X-ray and optical surveys do not necessarily sample identical mass concentrations at large redshifts. This may indicate the existence of a population of optically rich clusters with anomalously low X-ray emission, More likely, however, it reflects the tendency for optical surveys to select unvirialized mass concentrations, as might be expected when peering along large-scale filaments.

Jones, Christine↗

Leveraging graph clustering techniques for cyber‐physical system analysis to enhance disturbance characterisation

Abstract Cyber‐physical systems have behaviour that crosses domain boundaries during events such as planned operational changes and malicious disturbances. Traditionally, the cyber and physical systems are monitored separately and use very different toolsets and analysis paradigms. The security and privacy of these cyber‐physical systems requires improved understanding of the combined cyber‐physical system behaviour and methods for holistic analysis. Therefore, the authors propose leveraging clustering techniques on cyber‐physical data from smart grid systems to analyse differences and similarities in behaviour during cyber‐, physical‐, and cyber‐physical disturbances. Since clustering methods are commonly used in data science to examine statistical similarities in order to sort large datasets, these algorithms can assist in identifying useful relationships in cyber‐physical systems. Through this analysis, deeper insights can be shared with decision‐makers on what cyber and physical components are strongly or weakly linked, what cyber‐physical pathways are most traversed, and the criticality of certain cyber‐physical nodes or edges. This paper presents several types of clustering methods for cyber‐physical graphs of smart grid systems and their application in assessing different types of disturbances for informing cyber‐physical situational awareness. The collection of these clustering techniques provide a foundational basis for cyber‐physical graph interdependency analysis.

97 MATHEMATICS AND COMPUTING↗

Load Asymmetry Observed During Orion Main Parachute Inflation

The Crew Exploration Vehicle Parachute Assembly System (CPAS) has flight tested the first two generations of the Orion parachute program. Three of the second generation tests instrumented the dispersion bridles of the Main parachute with a Tension Measuring System. The goal of this load measurement was to better understand load asymmetry during the inflation process of a cluster of Main parachutes. The CPAS Main parachutes exhibit inflations that are much less symmetric than current parachute literature and design guides would indicate. This paper will examine loads data gathered on three cluster tests, quantify the degree of asymmetry observed, and contrast the results with published design guides. Additionally, the measured loads data will be correlated with videos of the parachute inflation to make inferences about the shape of the parachute and the relative load asymmetry. The goal of this inquiry and test program is to open a dialogue regarding asymmetrical parachute inflation load factors.

Morris, Aaron L.↗

Markov Chain Monte Carlo Joint Analysis of Chandra X-Ray Imaging Spectroscopy and Sunyaev-Zel'dovich Effect Data

X-ray and Sunyaev-Zel'dovich effect data can be combined to determine the distance to galaxy clusters. High-resolution X-ray data are now available from Chandra, which provides both spatial and spectral information, and Sunyaev-Zel'dovich effect data were obtained from the BIMA and Owens Valley Radio Observatory (OVRO) arrays. We introduce a Markov Chain Monte Carlo procedure for the joint analysis of X-ray and Sunyaev- Zel'dovich effect data. The advantages of this method are the high computational efficiency and the ability to measure simultaneously the probability distribution of all parameters of interest, such as the spatial and spectral properties of the cluster gas and also for derivative quantities such as the distance to the cluster. We demonstrate this technique by applying it to the Chandra X-ray data and the OVRO radio data for the galaxy cluster A611. Comparisons with traditional likelihood ratio methods reveal the robustness of the method. This method will be used in follow-up paper to determine the distances to a large sample of galaxy cluster.

Bonamente, Massimillano↗

Machine learning to discover mineral trapping signatures due to CO 2 injection

Mineral trapping is pursued as a geological CO 2 sequestration (GCS) mechanism because it permanently stores CO 2 in solid phases or minerals. However, CO 2 mineral-trapping mechanisms are poorly understood due to (1) lack of sufficient field and laboratory data characterizing these complex processes, and (2) challenges to develop site-specific reactive-transport models coupling fluid flow and geochemical reactions occurring at various temporal (from milliseconds to years) and spatial (from pore (millimeters) to field (kilometers)) scales. Reactive transport with additional complexities such as heterogeneity can make the simulation outputs even more difficult to interpret because of complex nonlinearity and multi-scale interdependencies. Furthermore, the values of model outputs such as concentrations can vary by several orders of magnitude, making it harder to correlate and characterize the impact of the variables via traditional data interpretation techniques such as exploratory data analyses. Recently, machine learning (ML) has shown promise in feature discovery and in highlighting hidden mechanisms that cannot be obtained by existing data-analytics and statistical methods. In this study, we applied an unsupervised ML approach, non-negative matrix factorization with custom -means clustering (NMF) to the data generated by reactive-transport simulations of GCS. The reactive-transport data consisted of 19 attributes, including four physio-chemical variables (pH, porosity, aqueous CO 2 , and sequestered CO 2 ), six chemical species (K + , Na + , HCO, Ca 2+ , Mg 2+ , Fe 2+ ), and four carbonate minerals (calcite, dolomite, siderite, and ankerite), a feldspar mineral (albite), and four clay minerals (illite, clinochlore, kaolinite, and smectite) over a period of 200 years of simulation time. Furthermore, the simulation data used was for Morrow B sandstone at the Farnsworth hydrocarbon unit in Texas. Data are sampled at two locations within the model domain: (1) at the injection well and (2) 200 m west of the injection well. The injection was performed for a period of 10 years. Using NMF, we estimated the temporal interdependencies among the 19 attributes over a span of 200 years. We found that NMF was able to identify four reaction stages and their dominant attributes; these cannot be directly discerned through traditional visualization (e.g., line plots, Pareto analysis, Glyph-based visualization methods) or exploratory data analysis tools of the simulation data. The four stages were: reactions in the injection phase followed by short-, mid-, and long-term reactions. The NMF analysis also revealed that 10 among the 19 attributes are dominant. These dominant attributes for mineral trapping include calcite, dolomite at injection well, siderite at 200 m away from the injection well, clinochlore, kaolinite, Na + , K + , Ca 2+ , Mg 2+ , pH, and aqeuous CO 2 . Finally, at late times (65–200 years), our results showed that calcite plays a major role in mineral trapping with insignificant contribution from siderite, ankerite, and clay minerals. These findings make the proposed unsupervised ML-model attractive for reactive-transport sensing towards real-time GCS monitoring.

54 ENVIRONMENTAL SCIENCES↗

Planck 2015 results: XXVII. The second Planck catalogue of Sunyaev-Zeldovich sources

Here, we present the all-sky Planck catalogue of Sunyaev-Zeldovich (SZ) sources detected from the 29 month full-mission data. The catalogue (PSZ2) is the largest SZ-selected sample of galaxy clusters yet produced and the deepest systematic all-sky surveyof galaxy clusters. It contains 1653 detections, of which 1203 are confirmed clusters with identified counterparts in external data sets, and is the first SZ-selected cluster survey containing >103 confirmed clusters. We present a detailed analysis of the survey selection function in terms of its completeness and statistical reliability, placing a lower limit of 83% on the purity. Using simulations, we find that the estimates of the SZ strength parameter Y5R500are robust to pressure-profile variation and beam systematics, but accurate conversion to Y500 requires the use of prior information on the cluster extent. We describe the multi-wavelength search for counterparts in ancillary data, which makes use of radio, microwave, infra-red, optical, and X-ray data sets, and which places emphasis on the robustness of the counterpart match. We discuss the physical properties of the new sample and identify a population of low-redshift X-ray under-luminous clusters revealed by SZ selection. These objects appear in optical and SZ surveys with consistent properties for their mass, but are almost absent from ROSAT X-ray selected samples.

79 ASTRONOMY AND ASTROPHYSICS↗

Rain volume estimation over areas using satellite and radar data

The analysis of 18 convective clusters demonstrates that the extension of the Area-Time-Integral (ATI) technique to the use of satellite data is possible. The differences of the internal structures of the radar reflectivity features, and of the satellite features, give rise to differences in estimating rain volumes by delineating area; however, by focusing upon the area integrated over the lifetime of the storm, it is suggested that some of the errors produced by the differences in the cloud geometries as viewed by radar or satellite are minimized. The results are good and future developments should consider data from different climatic regions and should allow for implementation of the technique in a general circulation model.

Doneaud, Andre A.↗

Imaging Electron Spectrometer (IES) Electron Preprocessor (EPP) Design

The Aerospace Corporation developed the Electron PreProcessor (EPP) to support the Imaging Electron Spectrometer (IES) that is part of the RAPID experiment on the ESA/NASA CLUSTER mission. The purpose of the EPP is to collect raw data from the IES and perform processing and data compression on it before transferring it to the RAPID microprocessor system for formatting and transmission to the CLUSTER satellite data system. The report provides a short history of the RAPID and CLUSTER programs and describes the EPP design. Four EPP units were fabricated, tested, and delivered for the original CLUSTER program. These were destroyed during a launch failure. Four more EPP units were delivered for the CLUSTER II program. These were successfully launched and are operating nominally on orbit.

Fennell, J. F.↗