Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analysis cluster”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Characterizing the Effect of Capillary Heterogeneity on Multiphase Flow Pulsation in an Intermediate–Scale Beadpack Experiment using Time Series Clustering and Frequency Analysis

An intermediate-scale beadpack drainage experiment was conducted to investigate how simple layered lamination heterogeneity affects CO 2 flow. Two simple layers of capillary barriers are manually packed in the tank and slow drainage was carried out using analog fluids to mimic the capillary- and gravity-dominated CO 2 upward migration process in deep saline aquifers. Nonwetting phase saturation time series clustering analysis and frequency analysis have been conducted on the experimental data. Additionally, modified invasion percolation numerical simulations were done on a digital model of the beadpack to compare to experimental results. Results show that capillary barriers can lead to strong pulsation behavior, which in turn can cause unexpected early breaching through other barriers. The inlet pressure is found to be able to respond to saturation changes in far regions of the domain, indicating that the wetting phase can transmit pressure changes from the other phase. Although static simulations were not able to capture all the dynamic behavior observed in the experiment, Monte Carlo composite simulation results combining many different realizations can better illustrate how the nonwetting phase will behave in the heterogeneous domain. Furthermore, our results suggest the need for CO 2 storage site selection with preference given to aquifers with more capillary barriers with finer grain sizes to avoid flow pulsation and to retard plume upward migration.

58 GEOSCIENCES↗
DOE OSTI2021

Dark Energy Survey Year 3 Results: clustering redshifts – calibration of the weak lensing source redshift distributions with redMaGiC and BOSS/eBOSS

ABSTRACT We present the calibration of the Dark Energy Survey Year 3 (DES Y3) weak lensing (WL) source galaxy redshift distributions n(z) from clustering measurements. In particular, we cross-correlate the WL source galaxies sample with redMaGiC galaxies (luminous red galaxies with secure photometric redshifts) and a spectroscopic sample from BOSS/eBOSS to estimate the redshift distribution of the DES sources sample. Two distinct methods for using the clustering statistics are described. The first uses the clustering information independently to estimate the mean redshift of the source galaxies within a redshift window, as done in the DES Y1 analysis. The second method establishes a likelihood of the clustering data as a function of n(z), which can be incorporated into schemes for generating samples of n(z) subject to combined clustering and photometric constraints. Both methods incorporate marginalization over various astrophysical systematics, including magnification and redshift-dependent galaxy-matter bias. We characterize the uncertainties of the methods in simulations; the first method recovers the mean z of tomographic bins to RMS (precision) of ∼0.014. Use of the second method is shown to vastly improve the accuracy of the shape of n(z) derived from photometric data. The two methods are then applied to the DES Y3 data.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS1977

Reindeer range inventory in western Alaska from computer-aided digital classification of LANDSAT data

An inventory of reindeer-range resources was conducted for the USDA Soil Conservation Service of 1.6 million hectares of wildlands in western Alaska using clustering techniques with digital Landsat data. Computer-aided digital analysis produced a provisional map of rangeland types which was used to design the field collection of vegetation and soil types data. This field data facilitated refinement of the inventory map and was used to describe the map units. The informational classes important to range resources were wet, moist and alpine tundra, tidal marsh, brush and open spruce forest. A significant feature of the study was the extraction of acreage figures by administrative boundaries within the study area. In addition to soil and vegetation association map products (at scales of 1:250,000 and 1:63,360) acreage values were tallied from the digital data for each of the four grazing permit areas established by the Bureau of Land Management.

George, T. H.↗
NASA NTRS1981

Use of ordination and classification procedures to evaluate phytoplankton communities during Superflux II

Cluster analysis and an ordination procedure were performed on two data matrices to investigate real and environmental spatial relationships. Multiple regression analysis was used to relate the measured environmental variables to the phytoplankton community changes. Qualitative type phytoplankton data proved to be less structured in both of these spaces, relative to the biomass data. The salinity gradients of the northern transects covaried significantly with the phytoplankton association changes. In the southern transects the light variable was most important in explaining the variance in the ordination axes. These data suggest the close relationships between phytoplankton community changes and the physical hydrology of the area.

Rutledge, C. K.↗
DOE OSTI2024

Investigation of acoustic waves under subsurface conditions to improve the predictions of rock mechanical properties and natural fracture characteristics

Mechanical properties and natural fracture characteristics are critical to investigate for subsurface engineering applications, including carbon storage, well drilling, and stimulation, as they govern rock stability, fluid flow, and mechanical behavior under stress. This dissertation integrates experimental and machine learning approaches to enhance the prediction and understanding of these properties by analyzing acoustic wave behavior under varied subsurface conditions. First, the influence of temperature, pore pressure, and supercritical CO2 (scCO2) saturation on poroelastic properties is examined using Gray Berea sandstone samples. The results show that temperature and pore pressure significantly affect the bulk modulus and Biot’s coefficient, while scCO2 saturation impacts rock compressibility, informing strategies for effective geological carbon storage. The study extends this understanding by experimentally evaluating the impact of reservoir depletion on the dynamic mechanical properties of the emerging Caney shale in South Oklahoma with the employment of unsupervised machine learning to predict static mechanical properties across the Caney shale. Integrating petrophysical data and chemostratigraphy, the workflow—featuring K-means clustering, principal component analysis (PCA), and inverse distance weighting (IDW)—improves stratigraphic characterization and the estimation of static-to-dynamic modulus ratios, which is vital for optimizing drilling and stimulation strategies. Finally, the work explores how natural fracture characteristics in shale influence acoustic waveforms and shear wave splitting (SWS) analysis. Experimental data on fractured samples under different stress and temperature conditions, combined with machine learning models such as K-nearest neighbors (KNN) and extreme gradient boosting (XGBoost), reveal key fracture properties impacting SWS and wave propagation. Together, these studies provide a comprehensive framework for linking acoustic wave behavior with rock properties, advancing the methods for monitoring and predicting geomechanical changes. The insights offered valuable implications for safer, more efficient CO2 injection, hydrocarbon extraction, and subsurface management.

Elkholy, Sherif↗
NASA NTRS2019

An ALMA+ACA measurement of the shock in the Bullet Cluster

Context: The thermal Sunyaev-Zeldovich (SZ) effect presents a relatively new tool for characterizing galaxy cluster merger shocks, traditionally studied through X-ray observations. Widely regarded as the “textbook example” of a cluster merger bow shock, the western, most-prominent shock front in the Bullet Cluster (1E0657-56) represents the ideal test case for such an SZ study. Aims: We aim to characterize the shock properties using deep, high-resolution interferometric SZ effect observations in combination with priors from an independent X-ray analysis. Methods: Our analysis technique relies on the reconstruction of a parametric model for the SZ signal by directly and jointly fitting data from the Atacama Large Millimeter/submillimeter Array (ALMA) and Atacama Compact Array (ACA) in Fourier space. Results: The ALMA+ACA data are primarily sensitive to the electron pressure difference across the shock front. To estimate the shock Mach number M, this difference can be combined with the value for the upstream electron pressure derived from an independent Chandra X-ray analysis. In the case of instantaneous electron-ion temperature equilibration, we find M = 2.08 (+0.12,−0.12), in ≈ 2.4σ tension with the independent constraint from Chandra, M(X)= 2.74 ± 0.25. The assumption of purely adiabatic electron temperature change across the shock leads to M = 2.53 (+0.33,−0.25), in better agreement with the X-ray estimate M(X) = 2.57 ± 0.23 derived for the same heating scenario. Conclusion: We have demonstrated that interferometric observations of the thermal SZ effect provide constraints on the properties of the shock in the Bullet Cluster that are highly complementary to X-ray observations. The combination of X-ray and SZ data yields a powerful probe of the shock properties, capable of measuring M and addressing the question of electron-ion equilibration in cluster shocks. Our analysis is however limited by systematics related to the overall cluster geometry and the complexity of the post-shock gas distribution. To overcome these limitations, a simultaneous, joint-likelihood analysis of SZ and X-ray data is needed.

Luca Di Mascolo↗
DOE OSTI2025

Search for Neutrino Doublets and Triplets Using 11.4 yr of IceCube Data

We report a search for high-energy astrophysical neutrino multiplets, detections of multiple neutrino clusters in the same direction within 30 days, based on an analysis of 11.4 yr of IceCube data. A new search method optimized for transient neutrino emission with a monthly timescale is employed, providing a higher sensitivity to neutrino fluxes. This result is sensitive to neutrino transient emission, reaching per-flavor flux of approximately 10 -10 erg cm -2 s -1 from the Northern Sky in the energy range E ≳ 50 TeV. The number of doublets and triplets identified in this search is compatible with the atmospheric background hypothesis, which leads us to set limits on the nature of neutrino transient sources with emission timescales of one month.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Optical/X-ray/radio view of Abell 1213: A galaxy cluster with anomalous diffuse radio emission

Context. Abell 1213, a low-richness galaxy system, is known to host an anomalous radio halo detected in data of the Very Large Array (VLA). It is an outlier with regard to the relation between the radio halo power and the X-ray luminosity of the parent clusters. Aims. Our aim is to analyze the cluster in the optical, X-ray, and radio bands to characterize the environment of its diffuse radio emission and to shed new light on its nature. Methods. We used optical data from the Sloan Digital Sky Survey to study the internal dynamics of the cluster. We also analyzed archival XMM-Newton X-ray data to unveil the properties of its hot intracluster medium. Finally, we used recent data from the LOw Frequency ARray (LOFAR) at 144 MHz, together with VLA data at 1.4 GHz, to study the spectral behavior of the diffuse radio source. Results. Both our optical and X-ray analysis reveal that this low-mass cluster exhibits disturbed dynamics. In fact, it is composed of several galaxy groups in the peripheral regions and, in particular, in the core, where we find evidence of substructures oriented in the NE–SW direction, with hints of a merger nearly along the line of sight. The analysis of the X-ray emission adds further evidence that the cluster is in an unrelaxed dynamical state. At radio wavelengths, the LOFAR data show that the diffuse emission is ~510 kpc in size. Moreover, there are hints of low-surface-brightness emission permeating the cluster center. Conclusions. The environment of the diffuse radio emission is not what we would expect for a classical halo. The spectral index map of the radio source is compatible with a relic interpretation, possibly due to a merger in the N–S or NE–SW directions, in agreement with the substructures detected through the optical analysis. The fragmented, diffuse radio emissions at the cluster center could be attributed to the surface brightness peaks of a faint central radio halo.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2012

Hybrid Collaborative Learning for Classification and Clustering in Sensor Networks

Traditionally, nodes in a sensor network simply collect data and then pass it on to a centralized node that archives, distributes, and possibly analyzes the data. However, analysis at the individual nodes could enable faster detection of anomalies or other interesting events as well as faster responses, such as sending out alerts or increasing the data collection rate. There is an additional opportunity for increased performance if learners at individual nodes can communicate with their neighbors. In previous work, methods were developed by which classification algorithms deployed at sensor nodes can communicate information about event labels to each other, building on prior work with co-training, self-training, and active learning. The idea of collaborative learning was extended to function for clustering algorithms as well, similar to ideas from penta-training and consensus clustering. However, collaboration between these learner types had not been explored. A new protocol was developed by which classifiers and clusterers can share key information about their observations and conclusions as they learn. This is an active collaboration in which learners of either type can query their neighbors for information that they then use to re-train or re-learn the concept they are studying. The protocol also supports broadcasts from the classifiers and clusterers to the rest of the network to announce new discoveries. Classifiers observe an event and assign it a label (type). Clusterers instead group observations into clusters without assigning them a label, and they collaborate in terms of pairwise constraints between two events [same-cluster (mustlink) or different-cluster (cannot-link)]. Fundamentally, these two learner types speak different languages. To bridge this gap, the new communication protocol provides four types of exchanges: hybrid queries for information, hybrid "broadcasts" of learned information, each specified for classifiers-to-clusterers, and clusterers-to-classifiers. The new capability has the potential to greatly expand the in situ analysis abilities of sensor networks. Classifiers seeking to categorize incoming data into different types of events can operate in tandem with clusterers that are sensitive to the occurrence of new kinds of events not known to the classifiers. In contrast to current approaches that treat these operations as independent components, a hybrid collaborative learning system can enable them to learn from each other.

Wagstaff, Kiri L.↗
NASA NTRS2020

A Global End-Member Approach to Derive aCDOM(440) from Near-Surface Optical Measurements

This study establishes an optical inversion scheme for deriving the absorption coefficient of colored (or chromophoric, depending on the literature) dissolved organic material (CDOM) at the 440 nm wavelength, which can be applied to global water masses with near-equal efficacy. The approach uses a ratio of diffuse attenuation coefficient spectral end members, i.e., a short and long wavelength pair. The global perspective is established by sampling "extremely" clear water plus a generalized extent in turbidity and optical properties that each span three decades of dynamic range. A unique data set was collected in oceanic, coastal, and inland waters (as shallow as 0.6 m) from the North Pacific Ocean, the Arctic Ocean, Hawaii, Japan, Puerto Rico, and the east and west coasts of the United States. The data were partitioned using subjective categorizations to define a validation quality subset of conservative water masses, i.e., the inflow and outflow of properties constrain the range in the gradient of a constituent, plus 15 subcategories of water masses that were not evolving conservatively. The dependence on subcategories was confirmed with an objective methodology based on cluster analysis techniques. The latter defined five distinct classes with validation quality data present in all classes, but which also decreased in percent composition as a function of increasing class number and optical complexity. Four different algorithms based on different validation quality end members were validated with accuracies of 1.–6.2 %, wherein pairs with the largest spectral span were most accurate. Although algorithm accuracy decreased with the inclusion of more subcategories containing non-conservative water masses, changes to the algorithm fit were small when a preponderance of subcategories were included. The high accuracy for all end-member algorithms was the result of data acquisition and data processing improvements, e.g., increased vertical sampling resolution to less than 1mm and a boundary constraint to mitigate wave focusing effects, respectively. An independent evaluation with a historical database confirmed the consistency of the algorithmic approach and its application to quality assurance, e.g., to flag data outside expected ranges, identify suspect spectra, and objectively determine the in-water extrapolation interval by converging agreement for all applicable end-member algorithms. The legacy data exhibit degraded performance (as 44 % uncertainty) due to a lack of high-quality near-surface observations, especially for clear waters wherein wave-focusing effects are problematic. The novel optical approach allows the in situ estimation of an in-water constituent in keeping with the accuracy obtained in the laboratory.

Stanford B Hooker↗
DOE OSTI2024

Systematic study of projection biases in the weak lensing analysis of cosmic shear and the combination of galaxy clustering and galaxy-galaxy lensing

This paper presents the results of a systematic study of projection biases in the weak lensing analysis of cosmic shear and the combination of galaxy clustering and galaxy-galaxy lensing using data collected during the first year of running the Dark Energy Survey experiment. The study uses Lambda cold dark matter ( Λ CDM ) as the cosmological model and two-point correlation functions for the weak lensing (WL) analysis. The results in this paper show that, independent of the WL analysis, projection biases of more than 1 σ exist and are a function of the position of the true values of the parameters h , n s , Ω b , and Ω ν h 2 with respect to their prior probabilities. For cosmic shear, and the combination of galaxy clustering and galaxy-galaxy lensing, this study shows that the coverage probability of the 68.27% credible intervals ranges from as high as 93% to as low as 16% and that these credible intervals are inflated, on average, by 29% for cosmic shear and 20% for the combination of galaxy clustering and galaxy-galaxy lensing. The results of the study also show that, in six out of nine tested cases, the reduction in error bars obtained by transforming credible intervals into confidence intervals is equivalent to an increase in the amount of data by a factor of 3.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

PV Fleet Performance Data Initiative 2026 Update

We provide an update on the PV Fleet Performance Data Initiative at the 2026 PV Reliability Workshop. Our latest runs incorporate additional data sources and an integrated analysis pipeline run on our Kestrel HPC cluster. Initial degradation findings suggest that single-axis tracked PV systems exhibit higher performance loss rates than fixed-tilt systems, an increase of 0.5 %/yr, almost double. We discuss multiple methods for identifying stuck tracker rows, which are suspected to be a contributor to the enhanced degradation. Through satellite image detection and data-driven approaches we address the topic of identifying when stuck trackers are occuring and to what extent the problem exists. Preliminary results suggest that the increased performance loss detected for the tracked systems would be consistent with stuck tracker rows affecting on the order of 5% - 10% of the system.

14 SOLAR ENERGY↗
DOE OSTI2025

The Cocytos Stream: A Disrupted Globular Cluster from our Last Major Merger?

The census of stellar streams and dwarf galaxies in the Milky Way provides direct constraints on galaxy formation models and the nature of dark matter. The DESI Milky Way survey (with a footprint of 14,000$~deg{^2}$ and a depth of $r<19$ mag) delivers the largest sample of distant metal-poor stars compared to previous optical fiber-fed spectroscopic surveys. This makes DESI an ideal survey to search for previously undetected streams and dwarf galaxies. We present a detailed characterization of the Cocytos stream, which was re-discovered using a clustering analysis with a catalog of giants in the DESI year 3 data, supplemented with Magellan/MagE spectroscopy. Our analysis reveals a relatively metal-rich ([Fe/H]$=-1.3$) and thick stream (width$=1.5^\circ$) at a heliocentric distance of $\approx 25$ kpc, with an internal velocity dispersion of 6.5-9 km s$^{-1}$. The stream's metallicity, radial orbit, and proximity to the Virgo stellar overdensities suggest that it is most likely a disrupted globular cluster that came in with the Gaia-Enceladus merger. We also confirm its association with the Pyxis globular cluster. Our result showcases the ability of wide-field spectroscopic surveys to kinematically discover faint disrupted dwarfs and clusters, enabling constraints on the dark matter distribution in the Milky Way.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2002

Telescope Scientist on the Advanced X-Ray Astrophysics Observatory

This period included many scientific observations made with the Chandra Observatory. The results, as is well known, are spectacular. Fortunately, the HRMA performance continues to be essentially identical to that predicted from ground calibration data. The Telescope Scientist Team has improved the mirror model to provide a more accurate description to the Chandra observers and enable them to reduce the systematic errors and uncertainties in their data reduction. There also has been progress in the scientific program. At this time 47 distant clusters of galaxies have been observed. We are performing a systematic analysis of this rather large data set for the purpose of determining absolute distances utilizing the Sunyaev Zel'dovich effect.

VanSpeybroeck, L.↗
NASA NTRS1988

Autonomous image data reduction by analysis and interpretation

Image data is a critical component of the scientific information acquired by space missions. Compression of image data is required due to the limited bandwidth of the data transmission channel and limited memory space on the acquisition vehicle. This need becomes more pressing when dealing with multispectral data where each pixel may comprise 300 or more bytes. An autonomous, real time, on-board image analysis system for an exploratory vehicle such as a Mars Rover is developed. The completed system will be capable of interpreting image data to produce reduced representations of the image, and of making decisions regarding the importance of data based on current scientific goals. Data from multiple sources, including stereo images, color images, and multispectral data, are fused into single image representations. Analysis techniques emphasize artificial neural networks. Clusters are described by their outlines and class values. These analysis and compression techniques are coupled with decision making capacity for determining importance of each image region. Areas determined to be noise or uninteresting can be discarded in favor of more important areas. Thus limited resources for data storage and transmission are allocated to the most significant images.

Eberlein, Susan↗
NASA NTRS1988

Autonomous image data reduction by analysis and interpretation

Image data is a critical component of the scientific information acquired by space missions. Compression of image data is required due to the limited bandwidth of the data transmission channel and limited memory space on the acquisition vehicle. This need becomes more pressing when dealing with multispectral data where each pixel may comprise 300 or more bytes. An autonomous, real time, on-board image analysis system for an exploratory vehicle such as a Mars Rover is developed. The completed system will be capable of interpreting image data to produce reduced representations of the image, and of making decisions regarding the importance of data based on current scientific goals. Data from multiple sources, including stereo images, color images, and multispectral data, are fused into single image representations. Analysis techniques emphasize artificial neural networks. Clusters are described by their outlines and class values. These analysis and compression techniques are coupled with decision-making capacity for determining importance of each image region. Areas determined to be noise or uninteresting can be discarded in favor of more important areas. Thus limited resources for data storage and transmission are allocated to the most significant images.

Eberlein, Susan↗
DOE OSTI2025

Regime Characterization of Offshore Wind Resource Using Unsupervised Learning

Predictability of wind resource conditions is critical for offshore wind design and operations. While many studies of extreme wind conditions focus on specific events such as low-level jets or ramps, these rely on threshold definitions that limit generality. Here we present a data-driven framework that combines principal component analysis (PCA), self-organizing maps (SOM), and k-means clustering to classify wind resource conditions as typical and anomalous from climatological data. Anomalies are defined not by fixed thresholds but by flagging samples located far from SOM node centers inside the baseline SOM structure. This reframes extremes as rare ebents and hence, likely difficult to anticipate by numerical weather prediction models. We applied this approach to 23 years (2000–2022) of hourly profiles from the NOW-23 hindcast model at the Humboldt Wind Energy Area. Classification is conducted on a feature space consisting of 10 m wind speed and direction, bulk shear and veer across 30–270 m, and a low-level jet index. Dimensionality reduction is achieved through PC. A 2 × 3 OM lattice trained on the PCA vectors identified six baseline regimes spanning weak to strong flow states. High quantization-error profiles are identified and re-clustered into four anomalous regimes. The baseline regimes exhibited clear seasonal and diurnal cycles. Meanwhile, the anomalous regimes represented <10 % of all hours but showed distinct combinations of speed, shear, and veer, when compared to the baseline regimes. Anomalous regimes are typically short-lived (~few hours), yet their transitions can lead to hub-height wind changes of −18 to +9 m s -1 . For a representative 15 MW turbine, these shifts imply rapid swings in capacity factor from near-full output to negligible generation. Validation with lidar buoy data showed 51% agreement in SOM labels across ~6,000 overlapping hours, with most mismatches confined to adjacent speed classes. HRRR comparisons further revealed that anomalous regimes were disproportionately associated with forecast biases exceeding 5 m s -1 . Together, these results reframe extremes in offshore wind from absolute maxima or minima to weather states that are difficult to anticipate from models.

17 WIND ENERGY↗
DOE OSTI2020

Kepler Binary Stars in the NGC 6819 Open Cluster: KIC 5113146 and KIC 5111815

In this study, an investigation of two double-lined binary stars KIC 5113146 and KIC 5111815 in the NGC 6819 open cluster is presented based on both photometric and spectroscopic data. Simultaneous analysis of light and radial velocity curves was made and the absolute parameters of the systems’ components were determined for the first time. We find that both systems have F-type main-sequence components. The masses and radii were found to be M 1 = 1.29 ± 0.02M ⊙ , R 1 = 1.47 ± 0.03 R ⊙ and M 2 = 1.19 ± 0.02 M ⊙ , R 2 = 1.13 ± 0.02 R ⊙ for the primary and secondary components of KIC 5113146; and M 1 = 1.51 ± 0.08 M ⊙ , R 1 = 2.02 ± 0.05 R ⊙ and M 2 = 1.19 ± 0.07 M ⊙ , R 2 = 1.32 ± 0.04 R ⊙ for the components of KIC 5111815, respectively. The evolutionary status of the components was evaluated based on the MESA evolutionary tracks and isochrones. The ages of KIC 5111815 and KIC 5113146 were derived to be about 2.50 ± 0.35 Gyr and 1.95 ± 0.40 Gyr, respectively. Photometric distances were calculated to be 2850 ± 185 pc for KIC 5113146 and 3120 ± 260 pc for KIC 5111815. The results reveal that both KIC 5113146 and KIC 5111815 systems are the most likely members of NGC 6819.

79 ASTRONOMY AND ASTROPHYSICS↗