SEARCH · Engineering Papers

Results for “data classification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,459 records · Page 81

All sources NASA NTRS DOE OSTI

NASA NTRS1985

Detection of lowland flooding using active microwave systems

The development of radar systems with longer wavelenths (greater than 3 cm) has provided new possibilities regarding the utilization of radar. Thus, it has been found that the interpretation of data from radar images can be a valuable classification aid for applications related to water resources. In the case of an interpreter accustomed to photographic or visible/infrared images, an evaluation of radar images presents some problems, because the radar is sensing a set of surface characteristics which have little influence on visible/infrared systems. Detectable features in radar images caused by differences in dielectric properties are usually associated with the water content of either soils or vegetation. The present paper is concerned with studies which were initiated in 1976. The studies had the objective to define the magnitude of the effects on radar data caused by flood waters under vegetation. The obtained results indicate the feasibility to detect flood conditions beneath a forest canopy, and to obtain an improved definition of the land-water boundary.

Ormsby, J. P.↗

NASA NTRS1996

SIR-C Measurements of Soil Moisture, Vegetation and Surface Roughness and their Hydrological Application

The objectives of the study are: (1) Analysis of SIR-C/X-SAR response to soil moisture, vegetation and surface roughness and development of an algorithm to retrieve these parameters; (2) Combination of the visible and near-infrared data and the SIR-C/X-SAR data to improve the range and accuracy of vegetation classification; (3) Testing of theoretical models for microwave propagation with SIR-C/X-SAR and microwave radiometric measurements over rough surfaces; and (4) Evaluation of a water balance model using SIR-C/X-SAR derived soil moisture values and other ancillary data. Progress, significant results and future plans are presented.

Wang, James R.↗

NASA NTRSDate not supplied

Multi-Class Anomaly Detection in Flight Data using Semi-Supervised Explainable Deep Learning Model

Identifying precursor for safety incidents in aviation data is a crucial task, yet extremely challenging. The main approach, in practice, leverages domain expertise to define expected tolerances in system’s behavior and alarm exceedance from such safety margins. However, this approach is incapable of identifying unknown risk and vulnerabilities. Machine learning has been long studied and deployed to identify precursors for such anomalies, with the great challenge of the need for sufficient labelled set of data to achieve a reliable and accurate performance. In this article, we develop an explainable deep semi-supervised model for anomaly detection in aviation, building upon recent advancements in the machine learning literature. The proposed model combines feature engineering and classification in the feature space, while leveraging all available data (labelled and unlabeled). Validating on two case studies of anomaly detection in take-off and landing phases of commercial aircraft, we show that our model is able to outperform state-of-the-art supervised anomaly detection model and reach significantly high accuracy and low false alarm with minimum amount of available labelled data.

Anomaly Detection↗

DOE OSTI2024

Machine Learning (ML) Classifier to Assist Metadata Creation

The Atmospheric Radiation Measurement (ARM) Data Center is responsible for the timely collection, archival, and curation of science data products. These products are freely available through an online data repository. Metadata creation is paramount for scientific users to find and access over seven petabytes of atmospheric science data. The hierarchical metadata structure allows users to search for information at both broad and narrow levels. This project aims to leverage 30 years’ worth of manually created metadata to enable machine predictions of broad-term classifications from narrow-term descriptions. These classification predictions would assist metadata coordinators with their term selections. This paper discusses the cleaning and preprocessing of the training data, the pipeline developed to determine the best model for this task, and the creation of an API metadata classifier for ARM measurement metadata. Our results show that the Linear Support Vector Classification (LinearSVC) algorithm, along with the Term Frequency – Inverse Document Frequency (TF-IDF) vectorizer, is well-suited for our multi-class classification task. Lengthier input training data led to better results, and artificial balancing was unnecessary for this particular use case. This predictive classifier enhances efficiency in metadata creation, as well as supports greater consistency and accuracy in metadata tagging.

Collier, Hannah [ORNL] (ORCID:0000000341284292)↗

NASA NTRS1995

Assessment of climate variability of the Greenland ice sheet: Integration of in situ and satellite data

The proposed research involves the application of multispectral satellite data in combination with ground truth measurements to monitor surface properties of the Greenland ice sheet which are essential for describing the energy and mass of the ice sheet. Several key components of the energy balance are parameterized using satellite data and in situ measurements. The analysis will be done for a ten year time period in order to get statistics on the seasonal and interannual variations of the surface processes and the climatology. Our goal is to investigate to what accuracy and over what geographic areas large scale snow properties and radiative fluxes can be derived based upon a combination of available remote sensing and meterological data sets. Data analysis showed the following results: (1)cloud classification based on longwave sky radiation revealed that overcast sky occurred for 25% of the time in winter, and for 15% in spring and summer respectively (winter and summer both show the same occurrence of clear sky of approximately 26%); (2) comparison of aerodynamic profile method with eddy correlation method to derive sensible and latent heat flux showed good agreement in the diurnal cycle and the turbulent fluxes were underestimated with the aerodynamic method by 10 - 30% as compared to the in situ eddy flux method; (3) the katabatic wind shows a distinct diurnal cycle with a maximum in the morning (7-9 h solar time) and a minimum in the later afternoon (18 h solar time); (4) snow grain size was modeled with a surface energy balance model (SNTHERM) and compared with in situ measurements. Sharp decreases in the modeled snow grain size, caused by accumulation events such as precipitation and deposition, could be verified with observational data; (4) radiative transfer modeling of firn supports our beliefs that the observed trends in 18 and 19 GHz passive microwave brightness temperatures are attributable to accumulation rate changes (modeling also indicates the above relationship is detectable because of the presence of depth hoar; (5) snow melt can be detected by a distinct signal in the passive microwave cross-polarized gradient ratio (19h-37v)/(19h+37v) and has been used for wet/dry snow classification; (6) top of the atmosphere (TOA) broadband albedos were derived from AVHRR visible and near infrared reflectances for the entire ice sheet from May 1990 - June 1991, and the highest albedo values are found along the southeast coast of the ice sheet which is consistent with the summer peak of precipitation due to onshore flow loaded with high water vapor content (TOA albedo values dropped to around 40% along the south-western coast during July and August due to bare ice surfaces); and (7) the net all-wave radiation balance at the top of the atmosphere is negative over the entire ice sheet except for the summer months - June-July-August (in June, the net radiation balance is slightly positive over the dry snow areas--15 W/m2).

Steffen, K.↗

DOE OSTI2023

Classification Analysis of Southwest Pacific Tropical Cyclone Intensity Changes Prior to Landfall

This study evaluates the ability of a random forest classifier to identify tropical cyclone (TC) intensification or weakening prior to landfall over the western region of the Southwest Pacific Ocean (SWPO) basin. For both Australia mainland and SWPO island cases, when a TC first crosses land after spending ≥24 h over the ocean, the closest hour prior to the intersection is considered as the landfall hour. If the maximum wind speed (V max ) at the landfall hour increased or remained the same from the 24-h mark prior to landfall, the TC is labeled as intensifying and if the V max at the landfall hour decreases, the TC is labeled as weakening. Geophysical and aerosol variables closest to the 24 h before landfall hour were collected for each sample. The random forest model with leave-one-out cross validation and the random oversampling example technique was identified as the best-performing classifier for both mainland and island cases. The model identified longitude, initial intensity, and sea skin temperature as the most important variables for the mainland and island landfall classification decisions. Incorrectly classified cases from the test data were analyzed by sorting the cases by their initial intensity hour, landfall hour, monthly distribution, and 24-h intensity changes. TC intensity changes near land strongly impact coastal preparations such as wind damage and flood damage mitigations; hence, this study will contribute to improve identifying and prioritizing prediction of important variables contributing to TC intensity change before landfall.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Expediting field-effect transistor chemical sensor design with neuromorphic spiking graph neural networks

Improving the sensitive and selective detection of analytes in a variety of applications requires accelerating the rational design of field-effect transistor (FET) chemical sensors. Achieving high-performance detection relies on identifying optimal probe materials that can effectively interact with target analytes, a process traditionally driven by chemical intuition and time-consuming trial-and-error methods. To address the difficulties in probe screening for FET sensor development, this work presents a methodology that combines neuromorphic machine learning (ML) architectures, specifically a hybrid spiking graph neural network (SGNN), with an enriched dataset of physicochemical properties through semi-automated data extraction using large language models. Achieving a classification accuracy of 0.89 in predicting sensor sensitivity categories, the SGNN model outperformed traditional ML techniques by leveraging its ability to capture both global physicochemical properties and sparse topological features through a hybrid modeling framework. Next-generation sensor design was informed by the actionable insights into the connections between material properties and sensing performance offered by the SGNN framework. Through virtual screening for the detection of per- and polyfluoroalkyl substances (PFAS) as a use case, the effectiveness of the SGNN model was further validated. Density functional theory simulations confirmed graphene as a promising active material for PFAS detection as suggested by the SGNN framework. By bridging gaps in predictive modeling and data availability, this integrated approach provides a strong foundation for accelerating advancements in FET sensor design and innovation.

Ferreira, Rodrigo Pires [Univ. of Chicago, IL (Uni↗

NASA NTRS1986

The physical basis for spectral variations in thermal infrared emittance of silicates and application to remote sensing

The use of infrared spectroscopy for the remote characterization of planetary surfaces has received attention due to efforts in the investigation of these bodies from space. In the 8 to 14 micron region, a depression in the emittance spectra of rocks (sometimes called reststrahlen) is related to the fundamental stretching vibrations of Si-O bonds and shifts in the locations of this feature are ascribed to variations in rock composition. Thus, it should be possible to investigate, quantify, and model the relationships of reststrahlen spectral band location through silicate mineralogical composition to rock classification. This concept will be tested first through the use of laboratory-acquired data on the infrared spectra and mineralogy of selected mineral and rock samples. As a suitable classification model is developed, it will be tested through overflights of appropriate rock outcrops using the Thermal Infrared Multispectral Scanner (TIMS).

Walter, Louis S.↗

DOE OSTI2024

OReole-FM: successes and challenges toward billion-parameter foundation models for high-resolution satellite imagery

While the pretraining of Foundation Models (FMs) for remote sensing (RS) imagery is on the rise, models remain restricted to a few hundred million parameters. Scaling models to billions of parameters has been shown to yield unprecedented benefits including emergent abilities, but requires data scaling and computing resources typically not available outside industry R&D labs. In this work, we pair high-performance computing resources including Frontier supercomputer, America's first exascale system, and high-resolution optical RS data to pretrain billion-scale FMs. Our study assesses performance of different pretrained variants of vision Transformers across image classification, semantic segmentation and object detection benchmarks, which highlight the importance of data scaling for effective model scaling. Moreover, we discuss construction of a novel TIU pretraining dataset, model initialization, with data and pretrained models intended for public release. By discussing technical challenges and details often lacking in the related literature, this work is intended to offer best practices to the geospatial community toward efficient training and benchmarking of larger FMs.

Ambrozio Dias, Philipe↗

NASA NTRS2015

Land Boundary Conditions for the Goddard Earth Observing System Model Version 5 (GEOS-5) Climate Modeling System: Recent Updates and Data File Descriptions

The Earths land surface boundary conditions in the Goddard Earth Observing System version 5 (GEOS-5) modeling system were updated using recent high spatial and temporal resolution global data products. The updates include: (i) construction of a global 10-arcsec land-ocean lakes-ice mask; (ii) incorporation of a 10-arcsec Globcover 2009 land cover dataset; (iii) implementation of Level 12 Pfafstetter hydrologic catchments; (iv) use of hybridized SRTM global topography data; (v) construction of the HWSDv1.21-STATSGO2 merged global 30 arc second soil mineral and carbon data in conjunction with a highly-refined soil classification system; (vi) production of diffuse visible and near-infrared 8-day MODIS albedo climatologies at 30-arcsec from the period 2001-2011; and (vii) production of the GEOLAND2 and MODIS merged 8-day LAI climatology at 30-arcsec for GEOS-5. The global data sets were preprocessed and used to construct global raster data files for the software (mkCatchParam) that computes parameters on catchment-tiles for various atmospheric grids. The updates also include a few bug fixes in mkCatchParam, as well as changes (improvements in algorithms, etc.) to mkCatchParam that allow it to produce tile-space parameters efficiently for high resolution AGCM grids. The update process also includes the construction of data files describing the vegetation type fractions, soil background albedo, nitrogen deposition and mean annual 2m air temperature to be used with the future Catchment CN model and the global stream channel network to be used with the future global runoff routing model. This report provides detailed descriptions of the data production process and data file format of each updated data set.

GEOS-5↗

DOE OSTI2026

HydraGNN_OPF_GFM_2026 - Ensemble of predictive graph foundation models for power grid applications

This dataset supports research on graph foundation models for optimal power flow (OPF) on electric grids using HydraGNN. It contains heterogeneous graph representations of PGLib-OPF cases spanning systems from 14 to 13,659 buses, together with packed HDF5 datasets for pretraining, feasibility classification, and N-1 contingency analysis. The release includes OPF solution data, downstream fine-tuning datasets, pretrained HeteroSAGE and HeteroHEAT model checkpoints, hyperparameter-optimization summaries across multiple heterogeneous GNN architectures, and aggregated fine-tuning results for sample-efficiency studies. The dataset is designed to enable scalable training, evaluation, and transfer-learning studies for OPF surrogate modeling, including node-level AC-OPF solution prediction, graph-level prediction, feasibility classification, operating-condition generalization, and contingency-response tasks.

24 POWER TRANSMISSION AND DISTRIBUTION↗

NASA NTRS2000

Hyperspectral Imaging Sensors and the Marine Coastal Zone

Hyperspectral imaging sensors greatly expand the potential of remote sensing to assess, map, and monitor marine coastal zones. Each pixel in a hyperspectral image contains an entire spectrum of information. As a result, hyperspectral image data can be processed in two very different ways: by image classification techniques, to produce mapped outputs of features in the image on a regional scale; and by use of spectral analysis of the spectral data embedded within each pixel of the image. The latter is particularly useful in marine coastal zones because of the spectral complexity of suspended as well as benthic features found in these environments. Spectral-based analysis of hyperspectral (AVIRIS) imagery was carried out to investigate a marine coastal zone of South Florida, USA. Florida Bay is a phytoplankton-rich estuary characterized by taxonomically distinct phytoplankton assemblages and extensive seagrass beds. End-member spectra were extracted from AVIRIS image data corresponding to ground-truth sample stations and well-known field sites. Spectral libraries were constructed from the AVIRIS end-member spectra and used to classify images using the Spectral Angle Mapper (SAM) algorithm, a spectral-based approach that compares the spectrum, in each pixel of an image with each spectrum in a spectral library. Using this approach different phytoplankton assemblages containing diatoms, cyanobacteria, and green microalgae, as well as benthic community (seagrasses), were mapped.

Richardson, Laurie L.↗

NASA NTRSDate not supplied

Developing Natural Language Processing and Supervised Learning Techniques to Classify Mars Tasks

As NASA's Human Research Program (HRP) prepares for long-duration Mars missions, understanding astronaut tasks is crucial. This study, conducted at NASA Glenn Research Center (GRC), employed Natural Language Processing (NLP) and machine learning techniques to analyze and classify Mars tasks. A list of 1,058 Mars tasks was provided by HRP experts including binary labeling of 18 Human System Task Categories (HSTCs). We developed an NLP model using Google's BERT language model to capture the semantic and syntactic nuances of these tasks. Supervised training was initially applied to a subset of the NLP-analyzed tasks to assess the model's effectiveness in classifying the remaining tasks. Incorporating HSTC descriptions significantly enhanced the classification accuracy for 9 out of the 18 HSTCs and reduced training time. To address the issue of severe class imbalance in the HSTC data, we introduced innovative weighting and sampling techniques for data augmentation. We then fine-tune BERT to implement a pairwise relatedness scoring method, allowing us to cluster tasks based on their relatedness and similarity, getting a step closer to labeling the tasks without supervision. In this presentation we guide you through data preprocessing, deciphering key syntax components using BERT, and performing supervised classification of the Mars tasks. This work showcases the potential use of advanced NLP techniques to analyze Mars missions to be incorporated into various crew health and performance analyses.

GenAI↗

DOE OSTI2021

Classification and regression models of audio and vibration signals for machine state monitoring in precision machining systems

Here we present a data-driven method for monitoring machine status in manufacturing processes. Audio and vibration data from precision machining are used for inference in two operating scenarios: (a) variable machine health states (anomaly detection); and (b) settings of machine operation (state estimation). Audio and vibration signals are first processed through Fast Fourier Transform and Principal Component Analysis to extract transformed and informative features. These features are then used in the training of classification and regression models for machine state monitoring. Specifically, three classifiers (K-nearest neighbors, convolutional neural networks and support vector machines) and two regressors (support vector regression and neural network regression) were explored, in terms of their accuracy in machine state prediction. It is shown that the audio and vibration signals are sufficiently rich in information about the machine that 100% state classification accuracy could be accomplished. Data fusion was also explored, showing overall superior accuracy of data-driven regression models.

42 ENGINEERING↗

NASA NTRS1997

The Gaseous Content of the Universe at Zeta less than 1.6

Together with graduate student Hsiao-Wen Chen, I have measured and analyzed structural and morphological parameters of 38 galaxies in eight fields for which sensitive measurements of corresponding Ly(alpha) absorption toward background QSOs are available. These measurements are based on Wide Field Planetary Camera 2 (WFPC2) observations obtained with the Hubble Space Telescope (HST) and provide a first look at how the incidence and extent of tenuous gas around galaxies depends on galaxy luminosity, size, and morphological type and on geometry of the impact. The primary result of the analysis is that the amount of gas encountered along the line of sight depends on the galaxy impact parameter and B-band luminosity but does not depend strongly on the galaxy average surface brightness, disk-to-bulge ratio, or redshift. This result confirms and improves upon an anti-correlation between Ly(alpha) absorption equivalent width and galaxy impact parameter found previously. More importantly, this result provides the first quantitative means of relating statistics of faint galaxies to statistics of Ly(alpha) absorption systems. which we plan to exploit to constrain the luminosity function of galaxies beyond the realm of current surveys. Results have been submitted for publication and will greatly improve our statistical conclusions . Together with graduate student Noriaki Yahata. I have measured and classified spectral properties of over 1000 faint galaxies and stars obtained in our low-resolution spectroscopic survey. The goal of this project is two-fold: (1) to exhaustively characterize the spectral properties of all faint galaxies that comprise our current survey, and (2) to gain experience with our measurement and classification code. which ultimately will be used on a data base of 20,000 galaxies to be obtained with the Two-Degree Field (2df) spectrograph at the Anglo-Australian Telescope (AAT). The results will ultimately be used for many goals, but so far we have concentrated on using the results to make a binary classification of the galaxies (i.e. early type versus late type) and to then exploit the density-morphology relationship to obtain a crude density indicator. The primary result of the analysis is that the incidence and extent of tenuous gas around galaxies shows no strong preference for local galaxy environment, at least over the range of densities spanned by the current observations. Along similar lines, two instances of Ly(alpha) absorption lines that arise in groups or clusters were examined. Analysis demonstrates that some can produce corresponding absorption lines and that LY(alpha) absorption lines do not avoid a high-density environment. A new measure of the galaxy-absorber cross-correlation function defines the statistical criterion by which galaxies and absorber pairs are to be matched. I have identified a damped Ly(alpha) absorption system at redshift z equals approximately 0.16, the lowest redshift confirmed to date. The most important results of the analysis are learning that the metal abundances of the absorption system are less than 10 percent of the solar metal abundance and that the absorbing gas is not rotating with the galaxy disk.

Source record↗

DOE OSTI2022

EdgeAI: Machine learning via direct attached accelerator for streaming data processing at high shot rate x-ray free-electron lasers

We present a case for low batch-size inference with the potential for adaptive training of a lean encoder model. We do so in the context of a paradigmatic example of machine learning as applied in data acquisition at high data velocity scientific user facilities such as the Linac Coherent Light Source-II x-ray Free-Electron Laser. We discuss how a low-latency inference model operating at the data acquisition edge can capitalize on the naturally stochastic nature of such sources. We simulate the method of attosecond angular streaking to produce representative results whereby simulated input data reproduce high-resolution ground truth probability distributions. By minimizing the mean-squared error between the decoded output of the latent representation and the ground truth distributions, we ensure that the encoding layers and resulting latent representation maintains full fidelity for any downstream task, be it classification or regression. We present throughput results for data-parallel inference of various batch sizes, some with throughput exceeding 100 k images per second. We also show in situ training below 10 s per epoch for the full encoder–decoder model as would be relevant for streaming and adaptive real-time data production at our nation’s scientific light sources.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS1977

Data-handling considerations for advanced high-resolution multispectral scanners

Several scanner design parameters that greatly affect data rates were varied to determine overall effect on data rates. Bit rates were calculated for scanners with 10-, 15-, 20-, and 30-meter instantaneous fields of view; with 5, 7, and 10 channels; and with swath widths of 46.3, 92.6, 138.9, and 185.2 kilometers (25, 50, 75, and 100 nautical miles). The data were analyzed to determine whether they could be (1) recorded onboard the spacecraft with currently available equipment, (2) recorded onboard with the equipment proposed for the 1980-90 period, (3) transmitted to earth with current or proposed equipment; and (4) compressed and decompressed without significant degradation of classification accuracy. The effect of classifying 10-meter scanner data on the existing and the development pattern-recognition systems was examined.

Whitley, S. L.↗

NASA NTRS1978

Multispectral scanner system parameter study and analysis software system description, volume 2

The author has identified the following significant results. The integration of the available methods provided the analyst with the unified scanner analysis package (USAP), the flexibility and versatility of which was superior to many previous integrated techniques. The USAP consisted of three main subsystems; (1) a spatial path, (2) a spectral path, and (3) a set of analytic classification accuracy estimators which evaluated the system performance. The spatial path consisted of satellite and/or aircraft data, data correlation analyzer, scanner IFOV, and random noise model. The output of the spatial path was fed into the analytic classification and accuracy predictor. The spectral path consisted of laboratory and/or field spectral data, EXOSYS data retrieval, optimum spectral function calculation, data transformation, and statistics calculation. The output of the spectral path was fended into the stratified posterior performance estimator.

Landgrebe, D. A.↗