SEARCH · Engineering Papers

Results for “k-means”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

All sources NASA NTRS DOE OSTI

NASA NTRSDate not supplied

Springtime SEA Air Is Consistently Both Smoky and Humid, but This Relationship (and Its Radiative Effects) Varies Spatially and Seasonally

The atmosphere over the southeast Atlantic Ocean (SEA) sees a consistent springtime biomass burning (BB) smoke from widespread agricultural fires on the African continent. This smoke layer is initially lofted high in a continental mixed layer (~5-6km) and is then transported westward in the free troposphere, where it overlies and ultimately mixes into the SEA stratocumulus-topped oceanic boundary layer. Coincident with this smoke is an elevated humidity signal which is present from the time a given airmass is over the continental source region. ORACLES (ObseRvations of Aerosols above CLouds and their intEractionS) was a NASA Earth Venture Suborbital mission with the goal of measuring aerosol, cloud, and atmospheric properties over this region during three deployments in September 2016, August 2017, and October 2018. A previous study discussed the spatial characteristics of the water vapor-BB plume observations in the September 2016 flight data and their degree of agreement with several atmospheric reanalyses and models. In the present work, we first discuss atmospheric chemistry, structure, and aerosol results from all three ORACLES deployments to place these results in a broader seasonal context. Despite the differing locations and season of each deployment, we show that there continues to be good agreement between the airborne ORACLES dataset and large-scale reanalyses, specifically the ECMWF ERA5 and CAMS reanalyses. Other reanalyses (specifically NASA's MERRA-2) preserved the observed correlation between meteorology and biomass burning conditions, but, as was seen for 2016, was frequently displaced spatially relative to the observations. The CAMS reanalysis performs better with water vapor than with CO. Results comparing CAMS column AOD to the field measurements show slight overestimates, consistent with previous analysis, but the good relationship observed between AOD and inlet-based aerosol extinction demonstrates this metric's utility to broader studies. The good ERA5/CAMS/ORACLES agreement allows us to next examine the multi-year seasonal patterns and trends beyond the three ORACLES deployment periods. Looking at seven years of reanalysis data for the BB season, we find distinct variations between each month/deployment in terms of vertical smoke distribution and correlation to atmospheric specific humidity, due to changing conditions through the BB season. Using k-means clustering of these climatological reanalysis, we identify six canonical atmospheric profile types of varying total atmospheric humidity and vertical structure and describe their changing incidence spatially and throughout the season, and six analogous profile types for carbon monoxide, allowing us to characterize the atmospheric structure of both vapor and BB over time throughout the SEA region. This classification will allow for a more complete analysis of the broader radiative and dynamical effects of humid aerosols overlying stratocumulus clouds.

Kristina Marie Myers Pistone↗

NASA NTRSDate not supplied

arcjetCV: A New Machine Learning Application for Extracting Time-Resolved Recession Measurements From Arc Jet Test Videos

Arc jet Computer Vision (ArcjetCV) is a software application built to automate analysis of arc jet ground test video footage. This includes tracking material recession and the shock-material standoff distance. This provides a new capability to resolve and validate new physics associated with non-linear processes. This is an essential step to reduce testing, modeling, and validation uncertainties for heatshield material performance. ArcjetCV uses several types of machine learning (convolutional neural net: CNN, decision tree: DT, k-means unsupervised clustering: KM) to automate the video processing pipeline. These include inferring the start/stop of time segments of interest (1D CNN), measuring the time-dependent 2D recession of the material samples (2D CNN, DT), measuring the time-dependent shock standoff distance (2D CNN, DT), and post-processing cleaning of the recession data (KM). The software also provides a graphical user interface for ease of use. The results of using this tool on arc jet videos show non-linear time-dependent effects can be important for certain materials and characterizing certain failure modes.

machine learning↗

NASA NTRSDate not supplied

The Seasonal Evolution of Atmospheric Vertical Structure of Smoke and Humidity Over the Southeast Atlantic Biomass Burning Region

The atmosphere over the southeast Atlantic Ocean (SEA) sees a consistent springtime biomass burning (BB) smoke from widespread agricultural fires on the African continent. This smoke layer is initially lofted high in a continental mixed layer (~5-6km) and is then transported westward in the free troposphere, where it overlies and ultimately mixes into the SEA stratocumulus-topped oceanic boundary layer. Coincident with this smoke is an elevated humidity signal which is present from the time a given airmass is over the continental source region; this correlation is persistent through the biomass burning season, although varying through the course of the season. ORACLES (ObseRvations of Aerosols above CLouds and their intEractionS) was a NASA Earth Venture Suborbital mission with the goal of measuring aerosol, cloud, and atmospheric properties over this region during three deployments in September 2016, August 2017, and October 2018. We use the ORACLES observations to assess this smoke-vapor relationship. First, we discuss the good agreement between the airborne ORACLES dataset and the ECMWF ERA5 and CAMS reanalyses, as well as results from NASA’s MERRA-2, as seen over the three deployment years. We then use the reanalyses to develop a framework in which to understand more broadly the radiative and dynamical interactions between the elevated smoke and water vapor over the SEA through the biomass burning season, beyond the three ORACLES observation periods. Looking at seven years of reanalysis data for the BB season, we find distinct variations between each month/deployment in terms of vertical smoke distribution and correlation to atmospheric specific humidity, due to changing conditions through the BB season. Using k-means clustering of these climatological reanalyses, we identify six canonical atmospheric profile types of varying total atmospheric humidity and vertical structure and describe their changing incidence spatially and throughout the season, and six analogous profile types for carbon monoxide, allowing us to characterize the atmospheric structure of both vapor and BB over time throughout the SEA region. The radiative heating of both aerosol and water vapor has potential to influence the cloud-top entrainment and atmospheric turbulence, thus modifying the underlying stratocumulus cloud properties. We next discuss how these smoke-humidity variations influence both the low-cloud fraction (as observed by MODIS and VIIRS, and output by ERA5) and the boundary layer height in the region. This classification will ultimately allow for a more complete analysis of the broader radiative and dynamical effects of humid aerosols overlying stratocumulus clouds.

Kristina Marie Myers Pistone↗

NASA NTRS2023

Bandelier Ecological Conservation: Mapping Invasive Species Along the Rio Grande Corridor in Bandelier National Monument

The Southwest U.S. has experienced a growth of invasive riparian species, specifically Elaeagnus angustifolia (Russian olive), Tamarix ramosissima (saltcedar), and Ulmus pumila (Siberian elm), which alter local soil chemistry and outcompete native species. Locating these exotic species is critical for ecological conservation; however, field identification can be resource intensive. NASA DEVELOP partnered with the National Park Service (NPS) at Bandelier National Monument (BAND) to assess the feasibility of using Earth observation data to map invasive species along the Rio Grande corridor of the park. The team used Landsat 8 OLI, Sentinel-2 MSI, and ISS DESIS imagery to compute principal components based on spectral bands, vegetation indices, and terrain indices. Using the first five principal components, the team created classification maps using both a k-means classification algorithm and a random forest algorithm to differentiate between native and non-native species. The team derived maps for the three invasive riparian species in the region for the last five years. The team found that invasive species covered 33% of the park's river corridor in 2023, and the invasive species extent has increased by 5.7% from 2019 to 2023. The methods will serve as a guide for aiding historic and present invasive species identification in riparian regions, and the NPS staff at BAND will use the results to inform local mitigation practices and advocate for invasive species removal.

Evan Barrett↗

NASA NTRSDate not supplied

arcjetCV: automating recession extraction from video

Arc jet Computer Vision (arcjetCV)[1][2] is a software application built to automate time-resolved recession tracking of edges in test videos, specifically for tracking material recession and the shock-material standoff. This provides a new capability to resolve and validate new physics associated with non-linear processes and an essential step to reduce testing, modeling, and validation uncertainties for heatshield material performance. ArcticCV uses several types of machine learning (convolutional neural net: CNN, decision tree: DT, k-means unsupervised clustering: KM) to automate the video processing pipeline. These include inferring the start/stop of time segments of interest (1D CNN), measuring the time-dependent 2D recession of the material samples (2D CNN, DT), measuring the time-dependent shock standoff distance (2D CNN, DT), and post-processing cleaning of the recession data (KM). The software also provides a graphical user interface for ease of use. The results of using this tool on arc jet videos show non-linear time-dependent effects can be important for certain materials and characterizing certain failure modes.

Recession tracking↗

NASA NTRSDate not supplied

ArcjetCV: Automating Recession Tracking

Arc jet Computer Vision (arcjetCV) is a software application built to automate time-resolved recession tracking of edges in test videos, specifically for tracking material recession and the shock-material standoff. This provides a new capability to resolve and validate new physics associated with non-linear processes and an essential step to reduce testing, modeling, and validation uncertainties for heatshield material performance. ArcticCV uses several types of machine learning (convolutional neural net: CNN, decision tree: DT, k-means unsupervised clustering: KM) to automate the video processing pipeline. These include inferring the start/stop of time segments of interest (1D CNN), measuring the time-dependent 2D recession of the material samples (2D CNN, DT), measuring the time-dependent shock standoff distance (2D CNN, DT), and post-processing cleaning of the recession data (KM). The software also provides a graphical user interface for ease of use. The results of using this tool on arc jet videos show non-linear time-dependent effects can be important for certain materials and characterizing certain failure modes.

Recession tracking↗

NASA NTRSDate not supplied

ArcjetCV: Automating Arc Jet Analysis

Recession tracking↗

NASA NTRS2024

Synergistic Retrievals of Ice in High Clouds From Elastic Backscatter Lidar, Ku-band Radar and Submillimeter Wave Radiometer Observations

In this study, we investigate the synergy of elastic backscatter lidar, Ku-band radar, and sub-millimeter-wave radiometer measurements in the retrieval of ice from satellite observations. The synergy is analyzed through the generation of a large dataset of IceWater Content (IWC) profiles and simulated lidar, radar and radiometer observations. The characteristics of the instruments e.g. frequencies, sensitivities, etc. are set based on the expected characteristics of instruments of the Atmosphere Observing System (AOS) mission. A hold-out validation methodology is used to assess the accuracy of the IWC profiles retrieved from various combinations of observations from the three instruments. Specifically, the IWC and associated observations are randomly divided into two datasets, one for training and the other for evaluation. The training dataset is used to train the retrieval algorithm, while the evaluation dataset is used to assess the retrieval performance. The dataset of IWC profiles is derived from CloudSat reflectivity and CALIOP lidar observations. The retrieval of the ice water content IWC profiles from the computed observations is achieved in two steps. In the first step, a class, out of 18 potential classes characterized by different vertical distribution of IWC, is estimated from the observations. The 18 classes are predetermined based on the k-Means clustering algorithm. In the second step, the IWC profile is estimated using an Ensemble Kalman Smoother (EKS) algorithm that uses the estimated class as a priori information. The results of the study show that the synergy of lidar, radar, and radiometer observations is significant in the retrieval of the IWC profiles. Nevertheless, it should be mentioned that this synergy was found under idealized conditions, and additional work might be required to materialize it in practice. The inclusion of the lidar backscatter observations in the retrieval process has a larger impact on the retrieval performance than the inclusion of the radar observations. As ice clouds have a significant impact on atmospheric radiative processes, this work is relevant to ongoing efforts to reduce uncertainties in climate analyses and projections.

Mircea Grecu↗

NASA NTRS2024

Vertical Structure of a Springtime Smoky and Humid Troposphere Over the Southeast Atlantic From Aircraft and Reanalysis

The springtime atmosphere over the southeast Atlantic Ocean (SEA) is subjected to a consistent layer of biomass burning (BB) smoke from widespread fires on the African continent. An elevated humidity signal is coincident with this layer, consistently proportional to the amount of smoke present. The combined humidity and BB aerosol has potentially significant radiative and dynamic impacts. Here, we use aircraft-based observations from the NASA ORACLES (ObseRvations of Aerosols above CLouds and their intEractionS) deployments in conjunction with reanalyses to characterize covariations in humidity and BB smoke across the SEA. The observed plume–vapor relationship, and its agreement with the European Centre for Medium-Range Weather Forecasts (ECMWF) Reanalysis version 5 (ERA5) and Copernicus Atmosphere Monitoring Service (CAMS) reanalysis, persists across all observations, although the magnitude of the relationship varies as the season progresses. Water vapor is well represented by the reanalyses, while CAMS tends to underestimate carbon monoxide especially under high BB. While CAMS aerosol optical depth (AOD) is generally overestimated relative to ORACLES AOD, the observations show a consistent relationship between carbon monoxide (CO) and aerosol extinction, demonstrating the utility of the CO tracer to understanding vertical aerosol distribution. We next use k-means clustering of the reanalyses to examine multi-year seasonal patterns and distributions. We identify canonical profile types of humidity and of CO, allowing us to characterize changes in vapor and BB atmospheric structures, and their impacts as they covary. While the humidity profiles show a range in both total water vapor concentration and in vertical structure, the CO profiles primarily vary in terms of maximum concentration, with similar vertical structures in each. The distribution of profile types varies spatiotemporally across the SEA region and through the season, ranging from largely one type in the northeast and southwest to more evenly distributed between multiple types where air masses meet in the middle of the SEA. These distributions follow patterns of transport from the humid, smoky source region (greatest influence in the northeast of the SEA) and the seasonal changes in both humidity and smoke (increasing and decreasing through the season, respectively). With this work, we establish a framework for a more complete analysis of the broader radiative and dynamical effects of humid aerosols over the SEA.

Kristina Pistone↗

DOE OSTI2021

Unsupervised Power System Event Detection and Classification Using Unlabeled PMU Data

This paper proposes a novel data-driven power system event detection and classification method based on 5TB of actual PMU measurements collected from the US western interconnect. Firstly, a set of comprehensive power quality rules are proposed to pre-filter the raw data and extract the regions of interest (ROI). Six distinct event categories are defined and corresponding patterns are chosen as references. Meanwhile, detailed characteristics of patterns are summarized to enhance our understanding of the actual events. Then, the time-independent feature vectors are generated by extracting the statistical, temporal, and spectral features from the raw time-series data. Furthermore, an ensemble model is proposed to cluster the events by combining multiple K-means clustering models using a voting strategy. Besides, both system-level and PMU-level clustering models are developed. The accuracy and robustness of the event detection method are further improved through interactive evaluation of the two-level clustering results. This paper summarizes the actual characteristics of each event category and provides a reliable basis for accurate label generation. The experiments demonstrate the effectiveness of the proposed event detection and classification method.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2021

Unsupervised Power System Event Detection and Classification Using Unlabeled PMU Data

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2024

Exploring Geothermal Potential of Great Basin Sub-Regions: Preprint

The INnovative Geothermal Exploration through Novel Investigations Of Undiscovered Systems (INGENIOUS) project aims to discover new, economically viable hidden geothermal systems in the Great Basin region by building on previous work in play fairway analysis and machine learning. A key objective of this project is to develop an exploration workflow to reduce geothermal exploration risks for hidden geothermal systems. A single preliminary play fairway workflow was developed from the assessment of the regional INGENIOUS geological, geophysical, and geochemical datasets. This workflow provided new preliminary predictive geothermal fairway maps for the INGENIOUS study area, which encompasses most of Nevada, western Utah, southern Idaho, southeastern Oregon, and easternmost California. However, a recent study (incorporating machine learning techniques) of a portion of Nevada identified four geologic domains and determined that the relative importance of individual datasets or features as indicators of geothermal potential may differ across these domains. The INGENIOUS study area includes a much larger and more geologically diverse region; therefore, additional geologic domains or sub-regions are expected. To assess the sub-regions in the INGENIOUS study area, principal component analysis and k-means clustering were applied. Preliminary results indicate that the INGENIOUS regional data cluster into groups that relate to different geologic domains in the Great Basin region. These include domains such as the Walker Lane, extensional western Great Basin region, broad lower strain region in the eastern Great Basin of western Utah and eastern Nevada, Quaternary volcanic fields, and the area adjacent to the Snake River Plain. These clusters are assessed to determine the key geologic drivers of the identified clusters. Understanding this variability can provide key insights for the exploration and characterization of hidden geothermal systems in the Great Basin region and could indicate the need to develop multiple geothermal conceptual models and play fairway workflows for the INGENIOUS study area.

GEOTHERMAL ENERGY↗

DOE OSTI2024

Investigation of acoustic waves under subsurface conditions to improve the predictions of rock mechanical properties and natural fracture characteristics

Mechanical properties and natural fracture characteristics are critical to investigate for subsurface engineering applications, including carbon storage, well drilling, and stimulation, as they govern rock stability, fluid flow, and mechanical behavior under stress. This dissertation integrates experimental and machine learning approaches to enhance the prediction and understanding of these properties by analyzing acoustic wave behavior under varied subsurface conditions. First, the influence of temperature, pore pressure, and supercritical CO2 (scCO2) saturation on poroelastic properties is examined using Gray Berea sandstone samples. The results show that temperature and pore pressure significantly affect the bulk modulus and Biot’s coefficient, while scCO2 saturation impacts rock compressibility, informing strategies for effective geological carbon storage. The study extends this understanding by experimentally evaluating the impact of reservoir depletion on the dynamic mechanical properties of the emerging Caney shale in South Oklahoma with the employment of unsupervised machine learning to predict static mechanical properties across the Caney shale. Integrating petrophysical data and chemostratigraphy, the workflow—featuring K-means clustering, principal component analysis (PCA), and inverse distance weighting (IDW)—improves stratigraphic characterization and the estimation of static-to-dynamic modulus ratios, which is vital for optimizing drilling and stimulation strategies. Finally, the work explores how natural fracture characteristics in shale influence acoustic waveforms and shear wave splitting (SWS) analysis. Experimental data on fractured samples under different stress and temperature conditions, combined with machine learning models such as K-nearest neighbors (KNN) and extreme gradient boosting (XGBoost), reveal key fracture properties impacting SWS and wave propagation. Together, these studies provide a comprehensive framework for linking acoustic wave behavior with rock properties, advancing the methods for monitoring and predicting geomechanical changes. The insights offered valuable implications for safer, more efficient CO2 injection, hydrocarbon extraction, and subsurface management.

Elkholy, Sherif↗

DOE OSTI2025

Electron-Proton Scattering Event Generation using Structured Tokenization

Recent work such as Omnijet-$\alpha$ has demonstrated that effective tokenization combined with transformer-based architectures can produce effective foundation models for jet physics. While tokenization may help models capture generalizable event characteristics, it also introduces discretization errors that may compromise the precision required for downstream physics analyses. As the number and complexity of the particle features grow, these errors are likely to grow proportionally. In this study, we investigate new tokenization strategies to improve the application of generative transformer models to \textsc{Pythia8} simulations of electron-proton scattering at the Electron-Ion Collider. Specifically, we propose a feature-based structured tokenization approach that utilizes multiple tokens per particle, improving expressivity, while reducing the total number of unique tokens needed. We evaluate this method against grid-based binning, K-means clustering, and vector-quantized variational auto-encoders on the event simulations. Our results show that feature-based structured tokenization reduces discretization error, leading to more accurate generative modeling of particle-level events.

Goldenberg, Steven [Thomas Jefferson National Acce↗

DOE OSTI2025

Enhancing Cluster Identification in Atom Probe Tomography Data Using Transfer Learning

Atom Probe Tomography (APT) is a powerful technique for visualizing the atomic-scale distribution of solutes in materials, but quantitative cluster analysis of APT datasets remains a challenge due to the need for subjective parameter selection in clustering algorithms. While distance-based and density-based methods such as HDBSCAN are widely used, their performance is highly sensitive to user-defined parameters, which undermines reproducibility and accuracy. This study proposes an image-based, deep learning-aided workflow for automating parameter selection and cluster detection in APT data analysis. By projecting 3D APT point clouds onto 2D planes, we leverage pretrained convolutional neural networks (ConvNeXt-Tiny and ResNet-50) through transfer learning to predict the number of clusters present in synthetic datasets. The output is used to guide K-means clustering and estimate HDBSCAN parameters, specifically minimum cluster size and minimum sample points. This approach reduces reliance on manual parameter tuning, improving consistency and scalability. The methodology demonstrates the feasibility of using image-based deep learning for interpreting complex spatial patterns in APT data, enabling faster and more objective analysis. The complete workflow and code are made publicly available to support reproducibility and future research.

Density-based clustering↗

DOE OSTI2024

Using Knowledge-Guided Machine Learning To Assess Patterns of Areal Change in Waterbodies across the Contiguous United States

Lake and reservoir surface areas are an important proxy for freshwater availability. Advancements in machine learning (ML) techniques and increased accessibility of remote sensing data products have enabled the analysis of waterbody surface area dynamics on broad spatial scales. However, interpreting the ML results remains a challenge. While ML provides important tools for identifying patterns, the resultant models do not include mechanisms. Thus, the “black-box” nature of ML techniques often lacks ecological meaning. Using ML, we characterized temporal patterns in lake and reservoir surface area change from 1984 to 2016 for 103,930 waterbodies in the contiguous United States. We then employed knowledge-guided machine learning (KGML) to classify all waterbodies into seven ecologically interpretable groups representing distinct patterns of surface area change over time. Many waterbodies were classified as having “no change” (43%), whereas the remaining 57% of waterbodies fell into other groups representing both linear and nonlinear patterns. This analysis demonstrates the potential of KGML not only for identifying ecologically relevant patterns of change across time but also for unraveling complex processes that underpin those changes.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Correlative piezoresponse and micro-Raman imaging of CuInP 2 S 6 –In 4/3 P 2 S 6 flakes unravels phase-specific phononic fingerprint via unsupervised learning

Characterizing the novel properties of layered van der Waals materials is key for their application in functional devices. A better understanding of this type of material requires correlative imaging of diverse nanoscale material properties. Within this class of materials, CuInP 2 S 6 (CIPS) has received a significant degree of interest due to its ionically mediated room temperature ferroelectricity. Moreover, it is possible to form stable self-assembled heterostructures of ferroelectric CuInP 2 S 6 (CIPS) and non-ferroelectric (i.e., lacking Cu) In 4/3 P 2 S 6 (IPS) phases, by controlling the targeted composition and kinetics of synthesis. In this work, we present a correlative nanometric imaging study of the phononic modes and piezoelectricity of the phase-separated thin heteroepitaxial CIPS/IPS flakes. Here, we show that it is possible to isolate the different phononic modes of the two phases by spatially correlating them with their distinct ferroelectric behavior. The coupling of our experimental data with unsupervised learning statistical methods enables unraveling specific Raman peaks that are characteristic of each chemical phase (CIPS and IPS) present in the composite sample, discarding the less significant ones.

correlative microscopy↗

DOE OSTI2021

Genomic patterns of structural variation among diverse genotypes of Sorghum bicolor and a potential role for deletions in local adaptation

Genomic structural mutations, especially deletions, are an important source of variation in many species and can play key roles in phenotypic diversification and evolution. Previous work in many plant species has identified multiple instances of structural variations (SVs) occurring in or near genes related to stress response and disease resistance, suggesting a possible role for SVs in local adaptation. Sorghum [Sorghum bicolor (L.) Moench] is one of the most widely grown cereal crops in the world. It has been adapted to an array of different climates as well as bred for multiple purposes, resulting in a striking phenotypic diversity. In this study, we identified genome-wide SVs in the Biomass Association Panel, a collection of 347 diverse sorghum genotypes collected from multiple countries and continents. Using Illumina-based, short-read whole-genome resequencing data from every genotype, we found a total of 24,648 SVs, including 22,359 deletions. The global site frequency spectrum of deletions and other types of SVs fit a model of neutral evolution, suggesting that the majority of these mutations were not under any types of selection. Clustering results based on single nucleotide polymorphisms separated the genotypes into eight clusters which largely corresponded with geographic origins, with many of the large deletions we uncovered being unique to a single cluster. Even though most deletions appeared to be neutral, a handful of cluster-specific deletions were found in genes related to biotic and abiotic stress responses, supporting the possibility that at least some of these deletions contribute to local adaptation in sorghum.

59 BASIC BIOLOGICAL SCIENCES↗