SEARCH · Engineering Papers

Results for “clustering algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Coastal typologies and surface and subsurface characteristics of the Alaskan Beaufort Sea Coast

This dataset was generated to classify the Alaskan Beaufort Sea Coast (ABSC) into a set of distinct coastal typologies, to understand the surface and subsurface characteristics and variability of the ABSC, and to quantify relationships between these characteristics and historical rates of shoreline change. This geospatial dataset contains two csv files of points along the ABSC at a 50 m spacing, one for points sheltered by a barrier island and one for points exposed to the open ocean. Each point has a lat/lon location, and we have attributed to each point average values for elevation, historical long-term shoreline change rates, shoreline orientation, landcover, mean annual ground temperature, geomorphic unit, lithology, geology, ecological landscape unit, maximum thaw settlement potential, massive ice content, and segregated ice content. Each point is also assigned to one of 16 coastal typologies, determined by a hierarchical clustering algorithm on the elevation, shoreline change, orientation, and ground temperature data. There are 9 sheltered typologies and 7 exposed typologies, identified by an integer label in the last column of each csv file. The other two csv files contain the integer IDs and classes for the landcover and geomorphology datasets.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Global Characteristics of Observable Foreshocks for Large Earthquakes

Abstract Foreshocks are the only currently widely identified precursory seismic behavior, yet their utility and even identifiability are problematic, in part because of extreme variation in behavior. Here, we establish some global trends that help identify the expected frequency of foreshocks as well the type of earthquake most prone to foreshocks. We establish these tendencies using the global earthquake catalog of the U.S. Geological Survey National Earthquake Information Center with a completeness level of magnitude 5 and mainshocks with Mw≥7.0. Foreshocks are identified using three clustering algorithms to address the challenge of distinguishing foreshocks from background activity. The methods give a range of 15%–43% of large mainshocks having at least one foreshock but a narrower range of 13%–26% having at least one foreshock with magnitude within two units of the mainshock magnitude. These observed global foreshock rates are similar to regional values for a completeness level of magnitude 3 using the same detection conditions. The foreshock sequences have distinctive characteristics with the global composite population b-values being lower for foreshocks than for aftershocks, an attribute that is also manifested in synthetic catalogs computed by epidemic-type aftershock sequences, which intrinsically involves only cascading processes. Focal mechanism similarity of foreshocks relative to mainshocks is more pronounced than for aftershocks. Despite these distinguishing characteristics of foreshock sequences, the conditions that promote high foreshock productivity are similar to those that promote high aftershock productivity. For instance, a modestly higher percentage of interplate mainshocks have foreshocks than intraplate mainshocks, and reverse faulting events slightly more commonly have foreshocks than normal or strike-slip-faulting mainshocks. The western circum-Pacific is prone to having slightly more foreshock activity than the eastern circum-Pacific.

Geochemistry & Geophysics↗

DOE OSTI2022

Connecting the Radiative Influences of Aerosol upon the Mass Flux Profiles of Shallow Cumuli across the Southeast Atlantic Ocean Basin and its Boundaries (Final Report)

The Atlantic Ocean covers approximately 25% of Earth’s surface and the atmosphere above it is home to a complex array of clouds and aerosols that have important influences on regional and global weather and climate. These influences must be accurately depicted in short range, medium range, seasonal, and climate forecast models. Conditions over the tropical Atlantic are particularly complex due to continental scale plumes of dust from the Sahara Desert and smoke from agricultural burning in Africa that drift across the Atlantic Ocean basin toward the Americas. These plumes are often found meandering in the lower atmosphere above shallow tropical clouds that form above the ocean surface, presumably mingling with these clouds on occasion due to convective mixing processes. Elevated dust and smoke particles absorb incoming sunlight and substantially warm the marine atmosphere in the layer in which they are present. This warming may alter the thermal stability of the marine atmosphere and may throttle or enhance the development of clouds, change their internal structure and the rate at which they precipitate. Alternatively, it may isolate the lower atmosphere from drier layers above enabling water vapor to accumulate near the ocean surface potentially leading to the development of deeper convection. Our study was organized around the principal concept of determining the impact of African smoke and dust plumes upon cloud development at ASI and understanding how a popular shallow convection parameterization used in models responds to the presence of this aerosol. We analyzed observations collected during the US Department of Energy (DOE) Layered Atlantic Smoke Interactions with Clouds (LASIC) campaign using the Atmospheric Radiation Measurement Program’s Mobile Facility #1 (AMF-1), which was deployed to Ascension Island (ASI) in Southeastern Atlantic for a one-year period. Ascension Island is immediately downwind from an African source of these plumes, but far enough removed to enable the lower atmosphere to have reacted to their presence. A main goal of our study was to compute radiative heating rate profiles over Ascension Island and along the trajectory from the biomass burning regions along coastal Africa to Ascension Island. To compute the radiative heating rate due to aerosols and clouds, we employed observed profiles of temperature, humidity, and clouds from LASIC alongside aerosol optical properties from the Modern-era Retrospective analysis for Research and Applications Version 2 (MERRA-2), as input for the Rapid Radiation Transfer Model (RRTM). Radiative heating was also assessed across the southeast Atlantic Ocean using an ensemble of back trajectories from the Hybrid Single Particle Lagrangian Integrated Trajectory (HYSPLIT) model. We were successful in this effort and the resulting publication is already being cited despite its relatively short lifetime in the literature. The second part of our study involved the process-level representation of the clouds observed over the Southeastern Atlantic in models. Our initial task, upon which the balance of this portion of the study depended, was to evaluate the representativeness of the clouds observed by AMF-1. What orographic influence did Ascension Island have on the measured cloud structure? We set out to answer this question by trying to separate observations that were clearly indicative of orographic forcing from those that were representative of open ocean. The siting of AMF-1, which was 340-m above sea-level on the slope of a steep escarpment, proved demonstrably problematic for cloud process measurements. Despite considerable effort using multiple approaches including artificial intelligence (AI), we were unable to successfully compensate for the orographic forcing present at the AMF-1 site on ASI and, hence, produce process-level summaries of the convective mass flux representative of open ocean over the Southeastern Atlantic. Even though the project has officially ended, we are making a final attempt using two new types of clustering algorithm (i.e., AI) on the recommendation of a former student, who is an expert in this area. Since we have only recently begun to test these new AI schemes, the recommendations from the second part of our project outlined below are based on our experience at the time of this report.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Calibrating LArPix for TinyTPC

LArTPCs provide sensitivity to GeV signals, such as accelerator neutrinos and part of the supernova neutrino spectrum. TinyTPC is a LArTPC test stand for R&D of LAr doping to expand the reach of LArTPCs down to the 1-10 MeV range, which would substantially enhance the flagship analyses of experiments like DUNE, while enabling low energy analyses. We aim to dope LAr with Xe and pho- tosensitive dopants to expand the LArTPC range by converting hard-to-detect scintillation light to efficiently detected ionization charge. A critical element of the data analysis in TinyTPC is calibrating the readout. This poster will cover the calibration of TinyTPC, a pixelated liquid argon detector, where we find the distance a muon travels through each pixel. We then calculate the energy loss of muons traveling through the detector from cosmic data. We can reconstruct the path of the particles through the TPC using a density-based clustering algorithm designed to sort straight cosmic muon tracks from low energy radioactive decay curled paths and electronic noise

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2023

Clustering Acoustic Background Noise in the Stratosphere Using Machine Learning

Infrasound, characterized by low-frequency sound inaudible to humans (<20 Hz), emanates from natural and anthropogenic sources. Its efficacy for monitoring phenomena necessitates robust sensing networks. Traditional ground-based infrasound sensors have limitations due to atmospheric dynamics and noise interference. Balloon-bore sensors have emerged as an alternative, offering reduced noise and improved capabilities. This study bridges clustering algorithms with balloon borne infrasound data, a domain yet to be explored. Employing K-Means, DBSCAN, and GMM algorithms on normalized and reshaped data and only normalized data from a New Zealand-based NASA balloon flight, insights into background noise at stratospheric altitudes were revealed. Despite challenges arising from distinguishing signals amid unique background noise, this research provides vital reference material for noise analysis and calibration. Beyond infrasound event capture, the dataset enriches comprehension of background noise characteristics in the southern hemisphere.

47 OTHER INSTRUMENTATION↗

DOE OSTI2026

Prong Segmentation using Point Set Transformers in Multiple View Neutrino Detectors

NOvA is a long-baseline neutrino experiment studying neutrino oscillations by detecting neutrinos from the NuMI beam at Fermilab. Its physics analysis relies on accurate prong segmentation, which involves matching each hit to its source particle and identifying the particle type. This task has commonly been addressed using a combination of traditional clustering algorithms and convolutional neural networks (CNNs). However, NOvA’s detector design presents data as two sparse and decoupled 2D images (XZ and YZ views) rather than a native 3D representation, posing a significant challenge for traditional CNN-based models. In this talk, we propose a novel neural network based on the Point Set Transformer. By treating detector hits as sparse point clouds and implementing a cross-view attention mechanism, our model enables efficient information mixing between both views. Evaluated on NOvA simulated data, our model achieves superior accuracy while requiring significantly fewer computational resources compared to other models. Furthermore, the model demonstrates great performance when applied to Liquid Argon Time Projection Chamber (LArTPC) data, which shows its potential as a universal prong segmentation algorithm for multiple view neutrino detectors.

Liu, Jiaxi [UC, Irvine]↗

DOE OSTI2024

Uncertainty Quantification in CO2 Trapping Mechanisms: A Case Study of PUNQ-S3 Reservoir Model Using Representative Geological Realizations and Unsupervised Machine Learning

Evaluating uncertainty in CO2 injection projections often requires numerous high-resolution geological realizations (GRs) which, although effective, are computationally demanding. This study proposes the use of representative geological realizations (RGRs) as an efficient approach to capture the uncertainty range of the full set while reducing computational costs. A predetermined number of RGRs is selected using an integrated unsupervised machine learning (UML) framework, which includes Euclidean distance measurement, multidimensional scaling (MDS), and a deterministic K-means (DK-means) clustering algorithm. In the context of the intricate 3D aquifer CO2 storage model, PUNQ-S3, these algorithms are utilized. The UML methodology selects five RGRs from a pool of 25 possibilities (20% of the total), taking into account the reservoir quality index (RQI) as a static parameter of the reservoir. To determine the credibility of these RGRs, their simulation results are scrutinized through the application of the Kolmogorov–Smirnov (KS) test, which analyzes the distribution of the output. In this assessment, 40 CO2 injection wells cover the entire reservoir alongside the full set. The end-point simulation results indicate that the CO2 structural, residual, and solubility trapping within the RGRs and full set follow the same distribution. Simulating five RGRs alongside the full set of 25 GRs over 200 years, involving 10 years of CO2 injection, reveals consistently similar trapping distribution patterns, with an average value of Dmax of 0.21 remaining lower than Dcritical (0.66). Using this methodology, computational expenses related to scenario testing and development planning for CO2 storage reservoirs in the presence of geological uncertainties can be substantially reduced.

Mahjour, Seyed Kourosh↗

DOE OSTI2020

Chasing Accreted Structures within Gaia DR2 Using Deep Learning

In previous work, we developed a deep neural network classifier that only relies on phase-space information to obtain a catalog of accreted stars based on the second data release of Gaia (DR2). In this paper, we apply two clustering algorithms to identify velocity substructure within this catalog. We focus on the subset of stars with line-of-sight velocity measurements that fall in the range of Galactocentric radii $r\in [6.5,9.5]\,{\rm{kpc}}$ and vertical distances $| z| \lt 3\,{\rm{kpc}}$. Known structures such as Gaia Enceladus and the Helmi stream are identified. The largest previously unknown structure, Nyx, is a vast stream consisting of at least 200 stars in the region of interest. This study displays the power of the machine-learning approach by not only successfully identifying known features but also discovering new kinematic structures that may shed light on the merger history of the Milky Way.

Astronomy & Astrophysics↗

DOE OSTI2022

Unsupervised Machine Learning for Exploratory Data Analysis of Exoplanet Transmission Spectra

Abstract Transit spectroscopy is a powerful tool for decoding the chemical compositions of the atmospheres of extrasolar planets. In this paper, we focus on unsupervised techniques for analyzing spectral data from transiting exoplanets. After cleaning and validating the data, we demonstrate methods for: (i) initial exploratory data analysis, based on summary statistics (estimates of location and variability); (ii) exploring and quantifying the existing correlations in the data; (iii) preprocessing and linearly transforming the data to its principal components; (iv) dimensionality reduction and manifold learning; (v) clustering and anomaly detection; and (vi) visualization and interpretation of the data. To illustrate the proposed unsupervised methodology, we use a well-known public benchmark data set of synthetic transit spectra. We show that there is a high degree of correlation in the spectral data, which calls for appropriate low-dimensional representations. We explore a number of different techniques for such dimensionality reduction and identify several suitable options in terms of summary statistics, principal components, etc. We uncover interesting structures in the principal component basis, namely well-defined branches corresponding to different chemical regimes of the underlying atmospheres. We demonstrate that those branches can be successfully recovered with a K-means clustering algorithm in a fully unsupervised fashion. We advocate for lower-dimensional representations of the spectroscopic data in terms of the main principal components, in order to reveal the existing structure in the data and quickly characterize the chemical class of a planet.

Matchev, Konstantin T. (ORCID:0000000341829096)↗

DOE OSTI2026

rustpix

rustpix is a high-performance, open-source Rust library with first-class Python bindings (via PyO3) for processing pixel-detector data in neutron imaging. It targets time-stamping detectors such as Timepix3 (TPX3) at ORNL's Spallation Neutron Source (VENUS beamline), where each detected neutron deposits charge across a cluster of pixels within a very high-rate event stream (96M+ hits/sec). rustpix parses TPX3 event data in parallel using memory-mapped I/O, offers four interchangeable clustering algorithms (ABS adjacency-based search, DBSCAN, graph/union-find connected components, and a parallel grid method), and extracts weighted, super-resolved centroids to produce neutron-event lists. A streaming architecture lets it process files larger than available memory. rustpix is distributed as a pip-installable Python package (with NumPy integration), Rust crates, a command-line tool, and an interactive GUI; it writes HDF5, Apache Arrow, and CSV; and it is designed to extend to TPX4 and other detector types. Released as open-source under the MIT License.

Zhang, Chen [Oak Ridge National Laboratory (ORNL),↗

DOE OSTI2022

Data augmentation for disruption prediction via robust surrogate models

The goal of this work is to generate large statistically representative datasets to train machine learning models for disruption prediction provided by data from few existing discharges. Such a comprehensive training database is important to achieve satisfying and reliable prediction results in artificial neural network classifiers. Here, we aim for a robust augmentation of the training database for multivariate time series data using Student-t process regression. We apply Student-t process regression in a state space formulation via Bayesian filtering to tackle challenges imposed by outliers and noise in the training data set and to reduce the computational complexity. Thus, the method can also be used if the time resolution is high. We use an uncorrelated model for each dimension and impose correlations afterwards via coloring transformations. We demonstrate the efficacy of our approach on plasma diagnostics data of three different disruption classes from the DIII-D tokamak. To evaluate if the distribution of the generated data is similar to the training data, we additionally perform statistical analyses using methods from time series analysis, descriptive statistics, and classic machine learning clustering algorithms.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1973

An objective technique to estimate percentage of an ERTS-1 water boundary resolution element covered by water

The author has identified the following significant results. An objective technique was developed to measure the surface area of water bodies. Nineteen water bodies in the Houston and Galveston, Texas area were selected as a basis for the technique development. The actual surface area of each body was determined from rectified and enlarged NASA aircraft photography. A clustering algorithm was used to produce classification maps of the region from ERTS-1 data. Certain classes were identified as being 100% water. Other classes were identified as being mixtures of water with land or vegetation. The number of picture elements falling on each water body and its boundary were counted. A linear regression analysis was performed to relate the total number of picture elements and boundary elements counted to the actual surface area. The standard error of the estimate was 6.7 acres. The absolute error was not a function of the actual surface area of the water body.

Erb, R. B.↗

NASA NTRS1973

Unsupervised classification and areal measurement of land and water coastal features on the Texas coast

Multispectral scanner (MSS) digital data from ERTS-1 was used to delineate coastal land, vegetative, and water features in two portions of the Texas Coastal Zone. Data (Scene ID's 1037-16244 and 1037-16251) acquired on August 29, 1972, were analyzed on NASA Johnson Space Center systems through the use of two clustering algorithms. Seventeen to 30 spectrally homogeneous classes were so defined. Many classes were identified as being pure features such as water masses, salt marsh, beaches, pine, hardwoods, and exposed soil or construction materials. Most classes were identified to be mixtures of the pure class types. Using an objective technique for measuring the percentage of wetland along salt marsh boundaries, an analysis was made of the accuracy of areal measurement of salt marshes. Accuracies ranged from 89 to 99 percent. Aircraft photography was used as the basis for determining the true areal size of salt marshes in the study sites.

Flores, L. M.↗

NASA NTRS1974

Automated thematic mapping and change detection of ERTS-1 images

Results of an automated thematic mapping investigation using ERTS-1 MSS images are presented. A diffraction pattern analysis of MSS images led to the development of spatial signatures for farm land, urban areas, and mountains. Four spatial features are employed to describe the spatial characteristics of image cells in the digital data. Three spectral features are combined with the spatial features to form a seven dimensional vector describing each cell. Then, the classification of the feature vectors is accomplished by using the maximum likelihood criterion. Three ERTS-1 images from the Phoenix, Arizona area were processed, and recognition rates between 85% and 100% were obtained for the terrain classes of desert, farms, mountains and urban areas. To eliminate the need for training data, a new clustering algorithm has also been developed.

Gramenopoulos, N.↗

NASA NTRS1974

Boundary and object detection in real world images

A solution to the problem of automatic location of objects in digital pictures by computer is presented. A self-scaling local edge detector which can be applied in parallel on a picture is described. Clustering algorithms and boundary following algorithms which are sequential in nature process the edge data to locate images of objects.

Yakimovsky, Y.↗

NASA NTRS1974

International Symposium on Remote Sensing of Environment, 9th, University of Michigan, Ann Arbor, Mich., April 15-19, 1974, Proceedings. Volumes 1, 2 & 3

The present work gathers together numerous papers describing the use of remote sensing technology for mapping, monitoring, and management of earth resources and man's environment. Studies using various types of sensing equipment are described, including multispectral scanners, radar imagery, spectrometers, lidar, and aerial photography, and both manual and computer-aided data processing techniques are described. Some of the topics covered include: estimation of population density in Tokyo districts from ERTS-1 data, a clustering algorithm for unsupervised crop classification, passive microwave sensing of moist soils, interactive computer processing for land use planning, the use of remote sensing to delineate floodplains, moisture detection from Skylab, scanning thermal plumes, electrically scanning microwave radiometers, oil slick detection by X-band synthetic aperture radar, and the use of space photos for search of oil and gas fields. Individual items are announced in this issue.

Source record↗

NASA NTRS1975

Design data collection with Skylab microwave radiometer-scatterometer S-193, volume 2

The author has identified the following significant results. Skylab S-193 radiometer/scatterometer produced terrain responses with various polarizations and observation angles for cells of 100 to 400 sq km area. Classification of the observations into natural categories was achieved by K-means and spatial clustering algorithms. Microwave data acquired over the Great Salt Lake Desert area by sensors aboard Skylab and Nimbus 5 indicate that the microwave emission and backscatter were strongly influenced by contributions from subsurface layers of sediment saturated with brine. Correlations were noted between microwave backscatter response at approximately 33 deg from scatterometer (operating at 13.9 GHz) and the configuration of ground targets in Brazil as discerned from coarse scale maps. With limited, available ground truth, these correlations were sufficient to permit the production of image-like displays which bear a marked resemblance to known terrain features in several instances.

Moore, R. K.↗

NASA NTRS1979

Mathematical description and program documentation for CLASSY, an adaptive maximum likelihood clustering method

Discussed in this report is the clustering algorithm CLASSY, including detailed descriptions of its general structure and mathematical background and of the various major subroutines. The report provides a development of the logic and equations used with specific reference to program variables. Some comments on timing and proposed optimization techniques are included.

Lennington, R. K.↗