Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analysis cluster”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

A Satellite-Based Estimate of Convective Vertical Velocity and Convective Mass Flux: Global Survey and Comparison with Radar Wind Profiler Observations

Convective vertical velocity (w c ) and convective mass flux (M c ) lie at the heart of GCM cumulus parameterizations, but few observations of these critical parameters are available. In this paper, we develop and evaluate a novel, satellite-based method for estimating profiles of w c and M c . Here, comparisons with collocated ground-based radar wind profiler (RWP) observations show that satellite estimated median w c is slightly greater than the RWP estimates, but they show solid agreement when compared at the 95th percentiles (intense updrafts). RWP-derived and satellite estimated M c are broadly comparable in the lower and middle troposphere, with some differences in the upper troposphere due to differences in convective core sampling. A k-means cluster analysis of multiple years of w c data shows that convective characteristics are distinctly different among extratropical convection, tropical land convection, and tropical oceanic convection. Tropical land convection is significantly more intense and more variable than the oceanic counterpart.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

ENSO Impact on Winter Precipitation in the Southeast United States through a Synoptic Climate Approach

The ENSO impact on winter precipitation in the Southeast United States was analyzed from the perspective of daily weather types (WTs). We calculated the dynamic contribution associated with the change in frequency of the WTs and the thermodynamic contribution due to changes in the spatial patterns of the environmental fields of the WTs. Six WTs were obtained using a k-means clustering analysis of 850 hPa winds in reanalysis data from November to February of 1948–2022. All the WTs can only persist for a few days. The most frequent winter weather type is WT1 (shallow trough in Eastern U.S.), which can persist or likely transfer to WT4 (Mississippi River Valley ridge). WT1 becomes less frequent in El Niño years, while the frequency of WT4 does not change much. WTs 2–6 correspond to a loop of eastward propagating waves with troughs and ridges in the mid-latitude westerlies. Three WTs with a deep trough in the Southeast U.S., which are WT2 (east coast trough), WT3 (off east coast trough) and WT6 (plains trough), become more frequent in El Niño years. The more frequent deep troughs (WTs 2, 3 and 6) and less frequent shallow trough (WT1) result in above-normal precipitation in the coastal Southeast U.S. in the winter of El Niño years. WT5 (off coast Carolina High), with maximum precipitation extending from Mississippi Valley to the Great Lakes, becomes less frequent in El Niño years, which corresponds to the below-normal precipitation from the Great Lakes to Upper Mississippi and Ohio River Valley in El Niño years, and vice versa in La Niña years. The relative contribution of the thermodynamic and dynamic contribution is location dependent. On the east coast, the two contributions are similar in magnitude.

Qian, Jian-Hua↗
NASA NTRS1974

Satellite detection of air pollutants

NASA's ERTS-1 satellite, with its high resolution and multispectral capabilities, has been found useful in the detection and analysis of smoke from large point sources (power plants, steel mills, etc.), and widespread atmospheric turbidity associated with atmospheric stagnations. Smoke plumes from the Chicago-Northern Indiana industrial complex have been tracked over Lake Michigan for over 100 km. Experience has shown that smoke plumes are relatively easy to detect over water (in the 0.6-0.7 micrometer band) but much more difficult over land surfaces. Pattern recognition techniques (cluster analysis) were applied to the digital ERTS data, and it was found that the smoke plumes indeed had a unique spectral signature. Studies are currently underway to use measured plume geometries to obtain quantitative estimates of diffusion over water surfaces.

Lyons, W. A.↗
NASA NTRS1976

Stratification of Landsat data by clustering

Full realization of the potential advantages of the synoptic coverage provided by Landsat will require the development and use of data analysis techniques which take into account the large variation and diversity of patterns found over many Landsat scenes. Stratification of the scene into units which are internally homogeneous is recommended as a first step in the analysis of data for whole or multiple frames of Landsat data. The use of clustering as an objective and efficient method of dividing scenes into areas which are spectrally similar (strata) is discussed and initial results, including classification performances and comparisons of spectral strata with major physical factors, are presented.

Bauer, M. E.↗
NASA NTRS1976

A computer analysis of ERTS data of the Lake Gregory area of South Australia with particular emphasis on its role in terrain classification for engineering

A digital computer and multivariate statistical techniques were used to analyze 4-band multispectral data. A representation of the original data for each of the four bands allows a certain degree of terrain interpretation; however, variations in appearance of sites within and between bands, without additional criteria for deciding which representation should be preferred, create difficulties for classification. Investigation of the video data groups produced by principal components analysis and cluster analysis techniques shows that effective correlations with classifications of terrain produced by conventional methods could be carried out. The analyses also highlighted underlying relationships between the various elements. The approach used allows large areas (185 cm by 185 cm) to be classified into fundamental units within a matter of hours and can be applied to those parts of the Earth where facilities for conventional studies are poor or lacking.

Lodwick, G. D.↗
DOE OSTI2020

Constraining the masses of high-redshift clusters with weak lensing: Revised shape calibration testing for the impact of stronger shears and increased blending

Weak lensing measurements suffer from well-known shear estimation biases, which can be partially corrected for with the use of image simulations. Here we present an analysis of simulated images that mimic Hubble Space Telescope/Advance Camera for Surveys observations of high-redshift galaxy clusters, including cluster specific issues such as non-weak shear and increased blending. Our synthetic galaxies have been generated to have similar observed properties as the background-selected source samples studied in the real images. First, we used simulations with galaxies placed on a grid to determine a revised signal-to-noise-dependent (S/N KSB ) correction for multiplicative shear measurement bias, and to quantify the sensitivity of our KSB+ bias calibration to mismatches of galaxy or PSF properties between the real data and the simulations. Next, we studied the impact of increased blending and light contamination from cluster and foreground galaxies, finding it to be negligible for high-redshift (z > 0.7) clusters, whereas shear measurements can be affected at the ~1% level for lower redshift clusters given their brighter member galaxies. Finally, we studied the impact of fainter neighbours and selection bias using a set of simulated images that mimic the positions and magnitudes of galaxies in Cosmic Assembly Near-IR Deep Extragalactic Legacy Survey (CANDELS) data, thereby including realistic clustering. While the initial SExtractor object detection causes a multiplicative shear selection bias of –0.028 ± 0.002, this is reduced to –0.016 ± 0.002 by further cuts applied in our pipeline. Given the limited depth of the CANDELS data, we compared our CANDELS-based estimate for the impact of faint neighbours on the multiplicative shear measurement bias to a grid-based analysis, to which we added clustered galaxies to even fainter magnitudes based on Hubble Ultra Deep Field data, yielding a refined estimate of ~ –0.013. Our sensitivity analysis suggests that our pipeline is calibrated to an accuracy of ~0.015 once all corrections are applied, which is fully sufficient for current and near-future weak lensing studies of high-redshift clusters. As an application, we used it for a refined analysis of three highly relaxed clusters from the South Pole Telescope Sunyaev-Zeldovich survey, where we now included measurements down to the cluster core (r > 200 kpc) as enabled by our work. Compared to previously employed scales (r > 500 kpc), this tightens the cluster mass constraints by a factor 1.38 on average.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1973

Thermal-bremsstrahlung interpretation of cluster X-ray sources.

Analysis of the X-ray data for the extended sources in Coma, Perseus, and Virgo in terms of an isothermal gas-sphere model emitting thermal-bremsstrahlung radiation. It is found that the gas distribution is somewhat less centrally condensed than the galaxies, and that the gas mass is generally a small fraction of the binding mass of each cluster. In the case of the Coma cluster, approximately one-eighth of the binding mass (with an uncertainty of about 50%) may be in the form of hot gas at 100,000,000 K if H sub zero = 50 km/sec/Mpc.

Lea, S. M.↗
DOE OSTI2024

Identifying Sample Provenance From SEM/EDS Automated Particle Analysis via Few-Shot Learning Coupled With Similarity Graph Clustering

Automated particle analysis (APA) provides a vast amount of compositional data via energy-dispersive X-ray spectroscopy along with size and shape data via scanning electron microscopy for individual particles in a sample. In many instances, APA data are leveraged to support identification of the source of a sample based on the detection of particles of a specific composition. Often, the particles that provide context make up a minuscule portion of the sample. Additionally, the interpretation of complex samples can be difficult due to the diversity of compositions both in the mixture and within a particle. In this work, we demonstrate a method to compute and cluster similarity graphs that describe inter-particle relationships within a sample using a multi-modal few-shot learning neural network. Here, as a proof-of-concept, we show that samples known to have been exposed to gunshot residue can be distinguished from samples occasionally mistaken for gunshot residue. Our workflow builds upon standard APA techniques and data processing methods to unveil additional information in a readily interpretable and quantitatively comparable format.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS2021

PIXLISE-C: Exploring The Data Analysis Needs of NASA Scientists for Mineral Identification

NASA JPL scientists working on the micro x-ray fluorescence (microXRF) spectroscopy data collected from Mars surface perform data analysis to look for signs of past microbial life on Mars. Their data analysis workflow mainly involves identifying mineral com- pounds through the element abundance in spatially distributed data points. Working with the NASA JPL team, we identified pain points and needs to further develop their existing data visualization and analysis tool. Specifically, the team desired improvements for the process of creating and interpreting mineral composition groups. To address this problem, we developed an interactive tool that enables scientists to (1) cluster the data using either manual lasso-tool selection or through various machine learning clustering algorithms, and (2) compare the clusters and individual data points to make informed decisions about mineral compositions. Our preliminary tool supports a hybrid data analysis workflow where the user can manually refine the machine-generated clusters.

Davidoff, Scott↗
DOE OSTI2020

Blinding multiprobe cosmological experiments

ABSTRACT The goal of blinding is to hide an experiment’s critical results – here the inferred cosmological parameters – until all decisions affecting its analysis have been finalized. This is especially important in the current era of precision cosmology, when the results of any new experiment are closely scrutinized for consistency or tension with previous results. In analyses that combine multiple observational probes, like the combination of galaxy clustering and weak lensing in the Dark Energy Survey (DES), it is challenging to blind the results while retaining the ability to check for (in)consistency between different parts of the data. We propose a simple new blinding transformation, which works by modifying the summary statistics that are input to parameter estimation, such as two-point correlation functions. The transformation shifts the measured statistics to new values that are consistent with (blindly) shifted cosmological parameters while preserving internal (in)consistency. We apply the blinding transformation to simulated data for the projected DES Year 3 galaxy clustering and weak lensing analysis, demonstrating that practical blinding is achieved without significant perturbation of internal-consistency checks, as measured here by degradation of the χ2 between the data and best-fitting model. Our blinding method’s performance is expected to improve as experiments evolve to higher precision and accuracy.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS2016

Search for Gamma-Ray Emission from the Coma Cluster with Six Years of Fermi-LAT Data

We present results from gamma-ray observations of the Coma cluster incorporating six years of Fermi-LAT data and the newly released 'Pass 8' event-level analysis. Our analysis of the region reveals low-significance residual structures within the virial radius of the cluster that are too faint for a detailed investigation with the current data. Using a likelihood approach that is free of assumptions on the spectral shape we derive upper limits on the gamma-ray flux that is expected from energetic particle interactions in the cluster. We also consider a benchmark spatial and spectral template motivated by models in which the observed radio halo is mostly emission by secondary electrons. In this case, the median expected and observed upper limits for the flux above 100 MeV are 1.7 x 10(exp -9) ph cm(exp -2) s(exp -1) and 5.2 x 10(exp -9) ph cm(exp -2) s(exp -1) respectively (the latter corresponds to residual emission at the level of 1.8sigma). These bounds are comparable to or higher than predicted levels of hadronic gamma-ray emission in cosmic-ray (CR) models with or without reacceleration of secondary electrons, although direct comparisons are sensitive to assumptions regarding the origin and propagation mode of CRs and magnetic field properties. The minimal expected gamma-ray flux from radio and star-forming galaxies within the Coma cluster is roughly an order of magnitude below the median sensitivity of our analysis.

galaxies: clusters: individual (Coma) – gamma ra↗
NASA NTRS1984

Preliminary Evaluation of Thematic Mapper Image Data Quality

Thematic Mapper (TM) data from Mississippi County, Arkansas, and Webster County, Iowa, were examined for the purpose of evaluating the image data quality of the TM which was launched on board the LANDSAT-4 spacecraft. Preliminary clustering and principal component analysis indicates that the middle infrared and thermal infrared data of TM appear to add significant information over that of the near IR and visible bands of the multispectral scanner data. Moreover, the higher spatial resolution of TM appears to provide better definition of the edges and the within variability of agricultural fields. The geometric performance of TM data, without ground control correction, was found to exceed expectations. The modulation transfer function for the 1.65 m band was found to agree with prelaunch specifications when the effects of the GSFC cubic convolution and the atmosphere were removed. The band to band registration for the bands within the noncooled focal plane was found to be better than specified. However, the middle infrared and thermal infrared, which are on a separate cooled focal plane were found to be misregistered and were significantly worse than prelaunch specifications.

Macdonald, R. B.↗
NASA NTRS2011

Parametric Testing of Launch Vehicle FDDR Models

For the safe operation of a complex system like a (manned) launch vehicle, real-time information about the state of the system and potential faults is extremely important. The on-board FDDR (Failure Detection, Diagnostics, and Response) system is a software system to detect and identify failures, provide real-time diagnostics, and to initiate fault recovery and mitigation. The ERIS (Evaluation of Rocket Integrated Subsystems) failure simulation is a unified Matlab/Simulink model of the Ares I Launch Vehicle with modular, hierarchical subsystems and components. With this model, the nominal flight performance characteristics can be studied. Additionally, failures can be injected to see their effects on vehicle state and on vehicle behavior. A comprehensive test and analysis of such a complicated model is virtually impossible. In this paper, we will describe, how parametric testing (PT) can be used to support testing and analysis of the ERIS failure simulation. PT uses a combination of Monte Carlo techniques with n-factor combinatorial exploration to generate a small, yet comprehensive set of parameters for the test runs. For the analysis of the high-dimensional simulation data, we are using multivariate clustering to automatically find structure in this high-dimensional data space. Our tools can generate detailed HTML reports that facilitate the analysis.

Schumann, Johann↗
DOE OSTI2025

Enabling Innovative Analysis on Heterogeneous Clusters through HTCdaskgateway

High energy particle (HEP) physics research is going through fundamental changes as we move to collect larger amounts of data from the Large Hadron Collider (LHC). Analysis facilities and distributed computing, through HTCs, have come together to create the next pythonic generation of analysis by utilizing HTCdaskgateway, a Dask gateway extension, allowing users to spawn workers compatible with both their analysis and heterogeneous clusters in line with authentication requirements. This is enabling physicists to engage with scientific python in ways they had not before because of domain specific C++ tools. An example of HTCdaskgateway’s use is Fermilab’s Elastic Analysis Facility.

Chavez, Elise [U. Wisconsin, Madison (main)]↗
DOE OSTI2026

Investigating the Determinants of Household Capabilities Burden During Power Outages: The Case of Winter Storm Uri

Existing research primarily uses census data to identify the vulnerability of communities to hazards. These vulnerability indices provide aggregated data and are not hazard-specific nor well-validated with post-event data. In contrast, our study uses household survey data (n=1065) to understand which Texan households suffered the greatest loss of their capabilities due to power outages and other utility service disruptions during Winter Storm Uri. Inspired by the Capabilities Approach, our measures of burden include the number of household capability types disrupted during the outages (e.g., cooking, heating, refrigeration), the severity of impact for each disrupted capability, and the additional time and financial costs of coping with these disruptions. We perform a clustering analysis, and find two distinct groups in our data, consisting of ‘lesser burden' and ‘heavier burden' households. Results indicate that the households experiencing the heaviest capabilities burden were most likely to experience longer power outages and the loss of water services. They were also more likely to have a Hispanic-Latino household member, lack access to a generator, live in a rented home, have larger households with more young children, fewer adults over 65, lower household incomes, been impacted by the COVID-19 pandemic, and more family characteristics that made life harder. We also fit a logistic regression model to assess the role of outage, household, and community characteristics in predicting differences in capabilities burden. Our results offer insights into enumerating the consequences of utility service disruptions on households, which can inform more targeted and equitable resilience strategies.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Poisson hurdle model-based method for clustering microbiome features

Abstract Motivation High-throughput sequencing technologies have greatly facilitated microbiome research and have generated a large volume of microbiome data with the potential to answer key questions regarding microbiome assembly, structure and function. Cluster analysis aims to group features that behave similarly across treatments, and such grouping helps to highlight the functional relationships among features and may provide biological insights into microbiome networks. However, clustering microbiome data are challenging due to the sparsity and high dimensionality. Results We propose a model-based clustering method based on Poisson hurdle models for sparse microbiome count data. We describe an expectation–maximization algorithm and a modified version using simulated annealing to conduct the cluster analysis. Moreover, we provide algorithms for initialization and choosing the number of clusters. Simulation results demonstrate that our proposed methods provide better clustering results than alternative methods under a variety of settings. We also apply the proposed method to a sorghum rhizosphere microbiome dataset that results in interesting biological findings. Availability and implementation R package is freely available for download at https://cran.r-project.org/package=PHclust. Supplementary information Supplementary data are available at Bioinformatics online.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1984

Venus: Global radar properties in a geological context

The radar altimetry, roughness (RMS slopes), and reflectivity data acquired for Venus represent the only global radar information available for any of the planets. In addition, the Pioneer Venus radar instrument was able to sound the surface at normal incidence so that it was possible to accurately measure the small-scale surface slopes and reflectivity (dielectric and porosity properties) at the same time as the surface elevation. Analyses of the topography of Venus demonstrate that it differs in its distribution from the Moon, Mars, or the Earth. While the range of topography extends from -2.5 km below the reference level to 11.5 km above, most of Venus falls within 1 km of the mean elevation, this is in sharp contrast to the Earth. The narrow, unimodal nature of the distribution of topography on Venus evidently exerts control on the other radar-derived properties of the surface. When clustering analysis techniques are applied to the Venus radar data sets, the result demonstrates that topographic zones serve as the best criteria for distinguishing regions on Venus which have related radar properties. The individual radar data sets are investigated separately and in conjunction with topography.

Garvin, J. B.↗