Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data analysis cluster”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35
All sourcesNASA NTRSDOE OSTI
NASA NTRS1999

Summary Report of Mission Acceleration Measurements for STS-89

Support of microgravity research on the 89th flight of the Space Transportation System (STS-89) and a continued effort to characterize the acceleration environment of the Space Shuttle Orbiter and the Mir Space Station form the basis for this report. For the STS-89 mission, the Space Shuttle Endeavour was equipped with a Space Acceleration Measurement System (SAMS) unit, which collected more than a week's worth of data. During docked operations with Mir, a second SAMS unit collected approximately a day's worth of data yielding the only set of acceleration measurements recorded simultaneously on the two spacecraft. Based on the data acquired by these SAMS units, this report serves to characterize a number of acceleration events and quantify their impact on the local nature of the accelerations experienced at the Mechanics of Granular Materials (MGM) experiment location. Crew activity was shown to nearly double the median root-mean-square (RMS) acceleration level calculated below 10 Hz, while the Enhanced Orbiter Refrigerator/Freezer operating at about 22 Hz was a strong acceleration source in the vicinity of the MGM location. The MGM science requirement that the acceleration not exceed plus or minus 1 mg was violated numerous times during their experiment runs; however, no correlation with sample instability has been found to this point. Synchronization between the SAMS data from Endeavour and from Mir was shown to be close much of the time, but caution with respect to exact timing should be exercised when comparing these data. When orbiting as a separate vehicle prior to docking, Endeavour had prominent structural modes above 3 Hz, while Mir exhibited a cluster of modes around 1 Hz. When mated, a transition to common modes was apparent in the two SAMS data sets. This report is not a comprehensive analysis of the acceleration data, so those interested in further details should contact the Principal Investigator Microgravity Services team at the National Aeronautics and Space Administration's John H. Glenn Research Center.

Hrovat, Kenneth↗
DOE OSTI2020

Similarity of Precursors in Solid-State Synthesis as Text-Mined from Scientific Literature

Collecting and analyzing the vast amount of information available in the solid-state chemistry literature may accelerate our understanding of materials synthesis. However, one major problem is the difficulty of identifying which materials from a synthesis paragraph are precursors or are target materials. In this study, we developed a two-step chemical named entity recognition model to identify precursors and targets, based on information from the context around material entities. Using the extracted data, we conducted a meta-analysis to study the similarities and differences between precursors in the context of solid-state synthesis. To quantify precursor similarity, we built a substitution model to calculate the viability of substituting one precursor with another while retaining the target. From a hierarchical clustering of the precursors, we demonstrate that the “chemical similarity” of precursors can be extracted from text data. Quantifying the similarity of precursors helps provide a foundation for suggesting candidate reactants in a predictive synthesis model.

36 MATERIALS SCIENCE↗
NASA NTRS2019

Cluster Analysis of Spectroscopic Line Profiles and EUV Emission in RMHD Simulations and Observations of the Solar Atmosphere

Spatially-resolved observations from the IRIS, SDO/AIA, and other space mission and ground-based telescopes, coupled with realistic 3D RMHD simulations, are a powerful tool for analysis of processes in the solar atmosphere. To better understand the dynamical and thermodynamic properties in the simulation data and their connection to observations, it is essential to determine similarities in the behaviors of the synthesized and observed emission. However, the complexity of observational data and physical processes makes comparison of observations and modeling results difficult. In this work, we show the initial results of application of K-Means clustering (unsupervised machine learning) algorithm to two different problems: 1) recognition of the typical spectroscopic line profiles observed by IRIS during solar flares and their typical dynamic behavior; 2) recognition of shocks and heating events in synthetic AIA emission data obtained from StellarBox quiet-Sun simulations. The average silhouette width technique for the KMeans algorithm is utilized in different ways to obtain optimal numbers of clusters. We discuss application of the emission clustering to visualizations of the computational volume, understanding its evolutionary trends and behavior patterns, and inversion (reconstruction) of physical properties of the solar atmosphere from synthesizes emission data.

Sadykov, Viacheslav↗
DOE OSTI2025

Oxygen Defect Configurations in Single-Phase UO 2.15

Hyperstoichiometric UO 2.15 was characterized by neutron total scattering at high temperature in the single-phase UO 2+x region of the U/O phase diagram. The diffraction data confirmed a single-phase fluorite structure at high temperature. Analysis of the short-range data showed that the same structural model does not fit the pair distribution functions well. Instead, structural models containing specific configurations of oxygen defect clusters best represent the local atomic arrangement. In conclusion, prevalent defect clusters previously proposed were fit to the experimental data, and moderately distorted oxygen cuboctahedra hypothesized by recent molecular dynamics simulations fit the data most accurately.

neutron pair-distribution function analysis↗
DOE OSTI2026

A Semi-Supervised Learning Method for the Identification of Bad Exposures in Large Imaging Surveys

As the data volume of astronomical imaging surveys rapidly increases, traditional methods for image anomaly detection, such as visual inspection by human experts, are becoming impractical. We introduce a machine-learning-based approach to detect poor-quality exposures in large imaging surveys, with a focus on the DECam Legacy Survey (DECaLS) in regions of low extinction (i.e., E ( B − V ) < 0.04 ). Our semi-supervised pipeline integrates a vision transformer (ViT), trained via self-supervised learning (SSL), with a k-Nearest Neighbor (kNN) classifier. We train and validate our pipeline using a small set of labeled exposures observed by surveys with the Dark Energy Camera (DECam). A clustering-space analysis of where our pipeline places images labeled in good and bad categories suggests that our approach can efficiently and accurately determine the quality of exposures. Applied to new imaging being reduced for DECaLS Data Release 11, our pipeline identifies 780 problematic exposures, which we subsequently verify through visual inspection. Being highly efficient and adaptable, our method offers a scalable solution for quality control in other large imaging surveys.

Luo, Yufeng (ORCID:0000000246230683)↗
DOE OSTI2026

Predicting U 3 O 8 powder processing conditions: An AI/ML approach analyzing deep learning embeddings of SEM micrographs

High-resolution SEM images of uranium-oxide powders encode micro- and nanoscale clues to their synthesis route and calcination temperature. We trained a ResNet-50 model on 11 commercial-scale U₃O₈ classes, ammonium diuranate (ADU) or uranyl peroxide (H₂O₂) precursors calcined at temperatures ranging from 400 to 750 °C and added a 256-D projection head before the classifier to analyze the learned representation. The best of eight seeds reached 92.4 % accuracy on reserved testing data, but our focus is the structure of the embedding space rather than the accuracy and labels. We quantify class relatedness in the original 256-D space using centroid similarity and distributional distances, and we use Uniform Manifold Approximation Projection (UMAP) for visualization. ‘Unknown’ images from different preparation methods, SEM operators, and from the literature localized near the expected classes under a nearest-centroid analysis without retraining, as well as clustered in similar UMAP space. In conclusion, this embedding-centered workflow complements black-box classification by providing quantitative, similarity-based comparisons of U₃O₈ morphologies and reduces storage space by up to 98 % for image data used in millisecond vector search comparisons.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Non-local contribution from small scales in galaxy–galaxy lensing: comparison of mitigation schemes

ABSTRACT Recent cosmological analyses with large-scale structure and weak lensing measurements, usually referred to as 3 × 2pt, had to discard a lot of signal to noise from small scales due to our inability to accurately model non-linearities and baryonic effects. Galaxy–galaxy lensing, or the position–shear correlation between lens and source galaxies, is one of the three two-point correlation functions that are included in such analyses, usually estimated with the mean tangential shear. However, tangential shear measurements at a given angular scale θ or physical scale R carry information from all scales below that, forcing the scale cuts applied in real data to be significantly larger than the scale at which theoretical uncertainties become problematic. Recently, there have been a few independent efforts that aim to mitigate the non-locality of the galaxy–galaxy lensing signal. Here, we perform a comparison of the different methods, including the Y-transformation, the point-mass marginalization methodology, and the annular differential surface density statistic. We do the comparison at the cosmological constraints level in a combined galaxy clustering and galaxy–galaxy lensing analysis. We find that all the estimators yield equivalent cosmological results assuming a simulated Rubin Observatory Legacy Survey of Space and Time (LSST) Year 1 like set-up and also when applied to DES Y3 data. With the LSST Y1 set-up, we find that the mitigation schemes yield ∼1.3 times more constraining S8 results than applying larger scale cuts without using any mitigation scheme.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Dark Energy Survey Year 3 results: Cosmology from combined galaxy clustering and lensing validation on cosmological simulations

In this work, we present a validation of the Dark Energy Survey Year 3 (DES Y3) 3×2-point analysis choices by testing them on Buzzard2.0, a new suite of cosmological simulations that is tailored for the testing and validation of combined galaxy clustering and weak-lensing analyses. We show that the buzzard2.0 simulations accurately reproduce many important aspects of the DES Y3 data, including photometric redshift and magnitude distributions, and the relevant set of two-point clustering and weak-lensing statistics. We then show that our model for the 3×2-point data vector is accurate enough to recover the true cosmology in simulated surveys assuming the true redshift distributions for our source and lens samples, demonstrating robustness to uncertainties in the modeling of the nonlinear matter power spectrum, nonlinear galaxy bias, and higher-order lensing corrections. Additionally, we demonstrate for the first time that our photometric redshift calibration methodology, including information from photometry, spectroscopy, clustering cross-correlations, and galaxy–galaxy lensing ratios, is accurate enough to recover the true cosmology in simulated surveys in the presence of realistic photometric redshift uncertainties.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Intelligent Experiments through Real-Time AI: Fast Data Processing and Autonomous Detector Control for High-Energy Nuclear Experiments

The aim of this project is to develop software and hardware for fast real-time data processing and autonomous detector control and calibration for the sPHENIX and the future EIC experiments. Below summarizes Georgia Tech team efforts in the past year: 1. We developed a real-time clustering algorithm and FPGA-based pipeline architecture for processing fired pixel data from ALPIDE sensors in sPHENIX experiments. Our Columnar Clustering Co-Design introduces a hardware-aware, stream-friendly approach that segments pixel data by column pairs using a Column Pair Clustering (CPC) strategy, followed by Cluster Stitching to merge adjacent subclusters. Implemented in Vitis HLS, the pipeline comprises five stages—read-in, subclustering, stitching, analysis, and write-out—connected by tagged HLS streams with custom end-of-event signaling for robust synchronization. We designed a pipelined dataflow model optimized for throughput, low latency, and minimal buffering, enabling scalable clustering across events of arbitrary size. Our system maintains spatial precision via center-of-mass and shape key extraction and efficiently handles edge cases such as fragmented or nested clusters. Compared against DBSCAN in both software and hardware, our approach demonstrates competitive performance under FPGA constraints. 2. We also conducted a comprehensive algorithm-to-hardware co-design of connected component analysis tailored for sPHENIX experiments, focusing on real-time, low-latency processing using FPGAs and High-Level Synthesis (HLS). Starting from a Python-based particle tracking pipeline, the team translated the core logic—graph traversal via DFS and Union-Find—into an HLS-compatible C++ model, replacing dynamic memory and recursion with static arrays and pipelined control flow. The final design includes a fully streamed and dataflow-compatible Union-Find kernel optimized across five iterations, incorporating loop pipelining, array partitioning, AXI/FIFO interface tuning, and function flattening. Experimental results show up to 14.8× speedup over the CPU baseline, reducing per-graph latency to 1.58 μs and demonstrating strong resource efficiency with only ~7k LUTs and zero BRAM usage. The design maintains functional correctness against the Python reference using a Python-based C-simulation framework and Mean Squared Error metrics. This work validates the potential of HLS-driven FPGA designs for edge-level HEP data acquisition, laying a scalable foundation for future integration with real-time detector pipelines and multi-graph processing systems.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS2005

The Tropical Convective Spectrum: Archetypal Vertical Structures - Part 1

A taxonomy of tropical convective and stratiform vertical structures is constructed through cluster analysis of 3 yr of Tropical Rainfall Measuring Mission (TRMM) "warm-season" (surface temperature greater than 10 C) precipitation radar (PR) vertical profiles, their surface rainfall, and associated radar-based classifiers (convective/ stratiform and brightband existence). Twenty-five archetypal profile types are identified, including nine convective types, eight stratiform types, two mixed types, and six anvil/fragment types (nonprecipitating anvils and sheared deep convective profiles). These profile types are then hierarchically clustered into 10 similar families, which can be further combined, providing an objective and physical reduction of the highly multivariate PR data space that retains vertical structure information. The taxonomy allows for description of any storm or local convective spectrum by the profile types or families. The analysis provides a quasi-independent corroboration of the TRMM 2A23 convective/ stratiform classification. The global frequency of occurrence and contribution to rainfall for the profile types are presented, demonstrating primary rainfall contribution by midlevel glaciated convection (27%) and similar depth decaying/stratiform stages (28%-31%). Profiles of these types exhibit similar 37- and 85-GHz passive microwave brightness temperatures but differ greatly in their frequency of occurrence and mean rain rates, underscoring the importance to passive microwave rain retrieval of convective/stratiform discrimination by other means, such as polarization or texture techniques, or incorporation of lightning observations. Close correspondence is found between deep convective profile frequency and annualized lightning production, and pixel-level lightning occurrence likelihood directly tracks the estimated mean ice water path within profile types.

Precipitation radar↗
DOE OSTI2021

Data–Driven Velocity Model Evaluation Using K–Means Clustering

In this work, we develop a data-driven clustering method to evaluate a velocity model using surface wave velocity dispersion. This is done by first computing theoretical dispersion curves for 1-D velocity profiles of all the grid locations and then splitting the resulting dispersion curves into a certain number of groups via the K-means clustering. The observed dispersion curves are also clustered following the same procedure and the velocity model is assessed by comparing the spatial patterns obtained for the observed and synthetic data sets. The method is applied to evaluate two community velocity models in southern California, CVM-S4.26 and CVM-H15.1, using phase velocity maps derived for 3–16 s Rayleigh waves. We found a good correlation in the spatial distribution of clusters between the result of CVM-S4.26 and that of the observed data, suggesting that the CVM-S4.26 fits the observed dispersion maps better than the CVM-H15.1 in terms of features extracted from the clustering analysis.

58 GEOSCIENCES↗
DOE OSTI2022

Optical emissivity dataset of multi-material heterogeneous designs generated with automated figure extraction

Optical device design is typically an iterative optimization process based on a good initial guess from prior reports. Optical properties databases are useful in this process but difficult to compile because their parsing requires finding relevant papers and manually converting graphical emissivity curves to data tables. Here, we present two contributions: one is a dataset of thermal emissivity records with design-related parameters, and the other is a software tool for automated colored curve data extraction from scientific plots. We manually collected 64 papers with 176 figures reporting thermal emissivity and automatically retrieved 153 colored curve data records. The automated figure analysis software pipeline uses Faster R-CNN for axes and legend object detection, EasyOCR for axes numbering recognition, and k-means clustering for colored curve retrieval. Additionally, we manually extracted geometry, materials, and method information from the text to add necessary metadata to each emissivity curve. Finally, we analyzed the dataset to determine the dominant classes of emissivity curves and determine the underlying design parameters leading to a type of emissivity profile.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

Structure determination of the HgcAB complex using metagenome sequence data: insights into microbial mercury methylation

Bacteria and archaea possessing the hgcAB gene pair methylate inorganic mercury (Hg) to form highly toxic methylmercury. HgcA consists of a corrinoid binding domain and a transmembrane domain, and HgcB is a dicluster ferredoxin. However, their detailed structure and function have not been thoroughly characterized. We modeled the HgcAB complex by combining metagenome sequence data mining, coevolution analysis, and Rosetta structure calculations. In addition, we overexpressed HgcA and HgcB in Escherichia coli, confirmed spectroscopically that they bind cobalamin and [4Fe-4S] clusters, respectively, and incorporated these cofactors into the structural model. Surprisingly, the two domains of HgcA do not interact with each other, but HgcB forms extensive contacts with both domains. The model suggests that conserved cysteines in HgcB are involved in shuttling HgII, methylmercury, or both. These findings refine our understanding of the mechanism of Hg methylation and expand the known repertoire of corrinoid methyltransferases in nature.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1977

Utility of correlation techniques in gravity and magnetic interpretation

Two methods of quantitative combined analysis, internal correspondence and clustering, are presented. Model studies are used to illustrate implementation and interpretation procedures of these methods, particularly internal correspondence. Analysis of the results of applying these methods to data from the midcontinent and a transcontinental profile show they can be useful in identifying crustal provinces, providing information on horizontal and vertical variations of physical properties over province size zones, validating long wave-length anomalies, and isolating geomagnetic field removal problems. Thus, these techniques are useful in considering regional data acquired by satellites.

Chandler, V. W.↗
NASA NTRS1986

Landsat Thematic Mapper digital information content for agricultural environments

Landsat Thematic Mapper (TM) data collected for Imperial Valley, California in December, 1982 were digitally examined to assess their utility to distinguish among agricultural and other land-covers. Statistics for thirty-seven training sites representing a variety of crops plus urban, water and desert land-covers were obtained and analyzed using transformed divergence (TD) calculations. TD values were employed to assess intraclass variability and the best bands for classification. Four subscenes were selected for clustering or unsupervised signature extraction. These areas were agriculture, urban, desert and water land-covers. The number of clusters for these subscenes were examined and the best TM bands for interclass separability were identified. The results of the clustering and training site analyses for interclass separability were compared. The TM data were useful for the digital delimitation of most crops and other cover types in this analysis. Four bands of data are adequate for classification with the best results obtained by the selection of one band from each of the available portions of the electromagnetic spectrum. Different band combinations are best for various land-cover intraclass separability.

Haack, Barry↗
NASA NTRS2006

Utilizing Hierarchical Segmentation to Generate Water and Snow Masks to Facilitate Monitoring Change with Remotely Sensed Image Data

The hierarchical segmentation (HSEG) algorithm is a hybrid of hierarchical step-wise optimization and constrained spectral clustering that produces a hierarchical set of image segmentations. This segmentation hierarchy organizes image data in a manner that makes the image's information content more accessible for analysis by enabling region-based analysis. This paper discusses data analysis with HSEG and describes several measures of region characteristics that may be useful analyzing segmentation hierarchies for various applications. Segmentation hierarchy analysis for generating landwater and snow/ice masks from MODIS (Moderate Resolution Imaging Spectroradiometer) data was demonstrated and compared with the corresponding MODIS standard products. The masks based on HSEG segmentation hierarchies compare very favorably to the MODIS standard products. Further, the HSEG based landwater mask was specifically tailored to the MODIS data and the HSEG snow/ice mask did not require the setting of a critical threshold as required in the production of the corresponding MODIS standard product.

Tilton, James C.↗
NASA NTRS2021

Potential impact of aerosols on convective clouds revealed by Himawari-8 observations over different terrain types in Eastern China

Convective clouds are common and play a major role in Earth’s water cycle and energy balance; they may even develop into storms and cause severe rainfall events. To understand the convective cloud development process, this study investigates the impact of aerosols on convective clouds by considering the influence of both topography and diurnal variation of radiation. By combining texture analysis, clustering and thresholding methods, we identify all convective clouds in two warm seasons (May-September, 2016-2017) in eastern China based on Himawari-8 Level 1 data. Having a large diurnally resolved cloud data together with surface meteorological and environmental measurements, we investigate convective cloud properties and their variation, stratified by elevation and diurnal change. We then analyze the potential impact of aerosol on convective clouds under different meteorological conditions and topographies. In general, convective clouds tend to occur preferentially under polluted conditions in the morning, which reverses in the afternoon. Convective cloud fraction first increases then decreases with aerosol loading, which may contribute to this phenomenon. Topography and diurnal meteorological variations may affect the strength of aerosol microphysical and radiative effects. Updraft is always stronger along the windward slopes of mountains and plateaus, especially in northern China. The prevailing southerly wind near the foothills of mountains and plateaus is likely to contribute to this windward strengthening of updraft and to bring more pollutant into the mountains, thereby strengthening the microphysical effect, invigorating convective clouds. By comparison, over plain, aerosols decrease surface heating and suppresses convection by blocking solar radiation reaching the surface.

Tianmeng Chen↗
NASA NTRS1991

Scientific requirements for space science data systems

In the 1990's space plasma physics studies will increasingly involve correlative analysis of observations from multiple instruments and multiple spacecraft. The solar terrestrial physics missions in the 1990's will be designed around simultaneous observations from spacecraft monitoring the solar wind, the polar magnetosphere and the near and distant magnetotail. Within these regions, clusters of spacecraft flying in formation will increasingly involve comparative magnetospheric studies. No single lab will have the expertise to process and analyze all of the different types of data so the data repositories will be distributed. Catalog and browse systems will be required to help select events for study. Data compression techniques may be useful in designing the data bases used for selecting events for study. Data compression onboard the spacecraft will be necessary, since instrument data rates will be much larger than available telemetry rates. However, considerable care will be necessary to avoid losing valuable data when applying data compression algorithms.

Walker, Raymond J.↗