Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image Classification”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,171 records · Page 65

Lower Omo Food Security & Agriculture: Mapping Land Cover Change in Unprotected and Protected Areas in the Lower Omo River Valley, Ethiopia

Ethiopia is home to unique wildlife, biodiversity, and ecosystem services and, like much of the world, is undergoing population growth, development, and land use change. As a result, some biodiverse regions may be at risk of being urbanized, cultivated as agricultural plots, or losing access to water bodies that are essential for maintaining both terrestrial and aquatic life. The DEVELOP team partnered with the Ethiopian Wildlife Conservation Authority to quantify the land cover change between the years 1994, 2010, and 2018. The team utilized Ethiopia’s dry season (January to May) for training point development which was crucial in differentiating the level of greenness between the four land cover classes: water, natural vegetation, cultivated land, and bare ground. The study area covered 62,000 km2 of the Lower Omo River Valley and includes eight protected areas. Data from Landsat 5 Thematic Mapper, Landsat 7 Enhanced Thematic Mapper Plus, Landsat 8 Operational Land Imager, and Shuttle Radar Topography Mission were used to employ a Random Forest classifier and identify the four classes within Google Earth Engine. For each of the supervised classifications, overall model accuracy was between 83% (2018) and 89% (1994). Between 1994 and 2018, the Lower Omo Valley experienced an overall increase of 258% (919 km2) in water and 291% (7,188 km2) in cultivated areas, while experiencing a 9% (2,761 km2) decrease in natural vegetation and 19% (5,346 km2) bare ground. There was an increase in water and cultivated land and a decrease in natural vegetation and bare ground in unprotected areas and all protected areas. However, protected areas maintained natural vegetation better than unprotected areas and only experienced a 1% (59 km2) loss compared to a 10% (2,701 km2) loss in unprotected areas.

Food Security & Agriculture↗

Lower Omo Food Security & Agriculture: Mapping Land Cover Change in Unprotected and Protected Areas in the Lower Omo River Valley, Ethiopia

Ethiopia is home to unique wildlife, biodiversity, and ecosystem services and, like much of the world, is undergoing population growth, development, and land use change. As a result, some biodiverse regions may be at risk of being urbanized, cultivated as agricultural plots, or losing access to water bodies that are essential for maintaining both terrestrial and aquatic life. The DEVELOP team partnered with the Ethiopian Wildlife Conservation Authority to quantify the land cover change between the years 1994, 2010, and 2018. The team utilized Ethiopia’s dry season (January to May) for training point development which was crucial in differentiating the level of greenness between the four land cover classes: water, natural vegetation, cultivated land, and bare ground. The study area covered 62,000 sq.km of the Lower Omo River Valley and includes eight protected areas. We used Landsat 5 Thematic Mapper, Landsat 7 Enhanced Thematic Mapper Plus, Landsat 8 Operational Land Imager, and Shuttle Radar Topography Mission imagery within Google Earth Engine to employ a Random Forest Classifier and identify these four distinct classes. For each of our supervised classifications, overall model accuracy was between 83% (2018) and 89% (1994). Between 1994 and 2018, the Lower Omo Valley experienced an overall increase of 258.57% in water bodies and 291.23% in cultivated areas, while experiencing an 8.91% decrease in natural vegetation and 18.76% bare ground. There was an increase in water bodies and cultivated land and a decrease in natural vegetation and bare ground in unprotected areas and all protected areas. However, protected areas disproportionately experienced an increase in land cover change, including Tama Community Conservation Area which saw a 17,272.33% increase between 1994 and 2018.

Food Security & Agriculture↗

Identifying common stored product insects using automated deep learning methods

Monitoring stored product insect pests is a common practice for post-harvest management of stored grain and grain-based commodities, which helps ensure product quality from harvest to final consumer. Current methods of sampling and monitoring can be time-consuming, labor-intensive, expensive and require expertise in insect identification. Therefore, this study aims to develop an image-based automated identification system for common stored product insect species using deep-learning methods. Top-down images of the common stored product adult insect species of Rhyzopertha dominica, Cryptolestes ferrugineus, Tribolium castaneum, Sitophilus oryzae, and Oryzaephilus surinamensis were acquired and analyzed. Deep learning-based, state-of-the-art Convolutional Neural Networks (CNN) models (ResNet-50, MobileNet-v2, DarkNet-53, and EfficientNet-b0) were fine-tuned with a transfer learning approach to classify the insect species. All models were able to correctly identify the insect species with at least 96% accuracy and with few misclassifications. One issue with trained CNNs is that they do not explain the reasoning for the classification and are often called a “black box”. Therefore, visualization methods called Gradient-weighted Class Activation Mapping (Grad-CAM) were implemented to explore the black box network. The Grad-CAM uses heat maps to highlight the major image features that the network focused on to make insect species predictions. The Grad-CAM verifies the network's prediction and also helps improve network performance. This study contributes to the overall goal of developing a camera-based system for monitoring stored grain insects. As a result, the developed system would empower warehouse, flour mills, and other food facilities with a tool to quickly and accurately identify insect species in stored product environments and could be implemented as part of a close to real-time monitoring system.

60 APPLIED LIFE SCIENCES↗

SkICAT: A cataloging and analysis tool for wide field imaging surveys

We describe an integrated system, SkICAT (Sky Image Cataloging and Analysis Tool), for the automated reduction and analysis of the Palomar Observatory-ST ScI Digitized Sky Survey. The Survey will consist of the complete digitization of the photographic Second Palomar Observatory Sky Survey (POSS-II) in three bands, comprising nearly three Terabytes of pixel data. SkICAT applies a combination of existing packages, including FOCAS for basic image detection and measurement and SAS for database management, as well as custom software, to the task of managing this wealth of data. One of the most novel aspects of the system is its method of object classification. Using state-of-theart machine learning classification techniques (GID3* and O-BTree), we have developed a powerful method for automatically distinguishing point sources from non-point sources and artifacts, achieving comparably accurate discrimination a full magnitude fainter than in previous Schmidt plate surveys. The learning algorithms produce decision trees for classification by examining instances of objects classified by eye on both plate and higher quality CCD data. The same techniques will be applied to perform higher-level object classification (e.g., of galaxy morphology) in the near future. Another key feature of the system is the facility to integrate the catalogs from multiple plates (and portions thereof) to construct a single catalog of uniform calibration and quality down to the faintest limits of the survey. SkICAT also provides a variety of data analysis and exploration tools for the scientific utilization of the resulting catalogs. We include initial results of applying this system to measure the counts and distribution of galaxies in two bands down to Bj is approximately 21 mag over an approximate 70 square degree multi-plate field from POSS-II. SkICAT is constructed in a modular and general fashion and should be readily adaptable to other large-scale imaging surveys.

Weir, N.↗

Coordination and establishment of centralized facilities and services for the University of Alaska ERTS survey of the Alaskan environment

The author has identified the following significant results. Specifications have been prepared for the engineering design and construction of a digital color display unit which will be used for automatic processing of ERTS data. The color display unit is a disk refresh memory with computer interfaced input and a color cathode ray tube output display. The system features both analog and digital post disk data manipulation and a versatile color coding device suitable for displaying not only images, but also computer generated graphics such as diagrams, maps, and overlays. Input is from IBM compatible 9 track, 800 BPI tapes, as generated by an IBM 360 computer. ERTS digital tapes are read into the 360, where various analyses such as maximum likelihood classification are performed and the results are written on a magnetic tape which is the input to the color display unit. The greatest versatility in the data manipulation area is provided by the minicomputer built into the color display unit, which is off-line from the main 360 computer. The minicomputer is able to read any line from the refresh disk and place it in its 4K-16 bit memory. Considerable flexibility is available for post-processing enhancement of images by the investigator.

Belon, A. E.↗

Comparison of Machine Learning and Deep Learning for View Identification from Cardiac Magnetic Resonance Images

Background: Artificial intelligence is increasingly utilized to aid in the interpretation of cardiac magnetic resonance (CMR) studies. One of the first steps is the identification of the imaging plane depicted, which can be achieved by both deep learning (DL) and classical machine learning (ML) techniques without user input. We aimed to compare the accuracy of ML and DL for CMR view classification and to identify potential pitfalls during training and testing of the algorithms. Methods: To train our DL and ML algorithms, we first established datasets by retrospectively selecting 200 CMR cases. The models were trained using two different cohorts (passively and actively curated) and applied data augmentation to enhance training. Once trained, the models were validated on an external dataset, consisting of 20 cases acquired at another center. We then compared accuracy metrics and applied class activation mapping (CAM) to visualize DL model performance. Results: The DL and ML models trained with the passively-curated CMR cohort were 99.1% and 99.3% accurate on the validation set, respectively. However, when tested on the CMR cases with complex anatomy, both models performed poorly. After training and testing our models again on all 200 cases (active cohort), validation on the external dataset resulted in 95% and 90% accuracy, respectively. The CAM analysis depicted heat maps that demonstrated the importance of carefully curating the datasets to be used for training. Conclusions: Both DL and ML models can accurately classify CMR images, but DL outperformed ML when classifying images with complex heart anatomy.

artificial intelligence↗

Earth feature identification for onboard multispectral data editing: Computational experiments

A computational model of the processes involved in multispectral remote sensing and data classification is developed as a tool for designing smart sensors which can process, edit, and classify the data that they acquire. An evaluation of sensor system performance and design tradeoffs involves classification rates and errors as a function of number and location of spectral channels, radiometric sensitivity and calibration accuracy, target discrimination assignments, and accuracy and frequency of compensation for imaging conditions. This model provides a link between the radiometric and statistical properties of the signals to be classified and the performance characteristics of electro-optical sensors and data processing devices. Preliminary computational results are presented which illustrate the editing performance of several remote sensing approaches.

Aherron, R. M.↗

Spatial estimation from remotely sensed data via empirical Bayes models

Multichannel satellite image data, available as LANDSAT imagery, are recorded as a multivariate time series (four channels, multiple passovers) in two spatial dimensions. The application of parametric empirical Bayes theory to classification of, and estimating the probability of, each crop type at each of a large number of pixels is considered. This theory involves both the probability distribution of imagery data, conditional on crop types, and the prior spatial distribution of crop types. For the latter Markov models indexed by estimable parameters are used. A broad outline of the general theory reveals several questions for further research. Some detailed results are given for the special case of two crop types when only a line transect is analyzed. Finally, the estimation of an underlying continuous process on the lattice is discussed which would be applicable to such quantities as crop yield.

Hill, J. R.↗

An ultraviolet-visible investigation of the globular cluster NGC 1851

Two-color ultraviolet images of the globular cluster NGC 1851 were obtained with the Ultraviolet Imaging Telescope (UIT) during the 1990 December Astro-1 Spacelab mission. A total of 133 stars are detected at 2490 A and 74 stars at 1520 A. An ultraviolet color-magnitude diagram based on the 46 well-photometered stars that appear in both images is presented. Thirty-nine of the 45 horizontal branch (HB) stars fall below the zero-age horizontal branch (ZAHB) of Z = 0.001 and Y = 0.23 predicted by Sweigart by as much as 0.6 mag if the interstellar reddening to the cluster is E(B - V) = 0.02. Supporting ground-based V and B observations, however, show excellent correlation with the same model ZAHB. A newly detected hot subdwarf star with T(sub eff) is approximately 26,000 K appears to be an extreme horizontal branch star. The measured flux for this star also falls approximately 0.6 mag below the position on the color-magnitude diagrams (CMD) predicted by parameters derived from ground-based spectroscopy by Landsman. The far-ultraviolet image is dominated by the ultraviolet-bright member star UV 5, which contributes 30% of the total flux at 1520 A. The UIT photometry is consistent with the classification of UV 5 as a post-asymptotic giant branch (PAGB) star. To a limit of 16.5 mag at 1520 A we find no ultraviolet counterpart within 6 minutes of the position of the X-ray source MX 0513-40.

Parise, Ronald A.↗

Direct Volume Rendering with Shading via Three-Dimensional Textures

A new and easy-to-implement method for direct volume rendering that uses 3D texture maps for acceleration, and incorporates directional lighting, is described. The implementation, called Voltx, produces high-quality images at nearly interactive speeds on workstations with hardware support for three-dimensional texture maps. Previously reported methods did not incorporate a light model, and did not address issues of multiple texture maps for large volumes. Our research shows that these extensions impact performance by about a factor of ten. Voltx supports orthographic, perspective, and stereo views. This paper describes the theory and implementation of this technique, and compares it to the shear-warp factorization approach. A rectilinear data set is converted into a three-dimensional texture map containing color and opacity information. Quantized normal vectors and a lookup table provide efficiency. A new tesselation of the sphere is described, which serves as the basis for normal-vector quantization. A new gradient-based shading criterion is described, in which the gradient magnitude is interpreted in the context of the field-data value and the material classification parameters, and not in isolation. In the rendering phase, the texture map is applied to a stack of parallel planes, which effectively cut the texture into many slabs. The slabs are composited to form an image.

Van Gelder, Allen↗

Direct Volume Rendering with Shading via Three-Dimensional Textures

A new and easy-to-implement method for direct volume rendering that uses 3D texture maps for acceleration, and incorporates directional lighting, is described. The implementation, called Voltx, produces high-quality images at nearly interactive speeds on workstations with hardware support for three-dimensional texture maps. Previously reported methods did not incorporate a light model, and did not address issues of multiple texture maps for large volumes. Our research shows that these extensions impact performance by about a factor of ten. Voltx supports orthographic, perspective, and stereo views. This paper describes the theory and implementation of this technique, and compares it to the shear-warp factorization approach. A rectilinear data set is converted into a three-dimensional texture map containing color and opacity information. Quantized normal vectors and a lookup table provide efficiency. A new tesselation of the sphere is described, which serves as the basis for normal-vector quantization. A new gradient-based shading criterion is described, in which the gradient magnitude is interpreted in the context of the field-data value and the material classification parameters, and not in isolation. In the rendering phase, the texture map is applied to a stack of parallel planes, which effectively cut the texture into many slabs. The slabs are composited to form an image.

VanGelder, Allen↗

Preliminary results from the ASF/GPS ice classification algorithm

The European Space Agency Remote Sensing Satellite (ERS-1) satellite carried a C-band synthetic aperture radar (SAR) to study the earth's polar regions. The radar returns from sea ice can be used to infer properties of ice, including ice type. An algorithm has been developed for the Alaska SAR facility (ASF)/Geophysical Processor System (GPS) to infer ice type from the SAR observations over sea ice and open water. The algorithm utilizes look-up tables containing expected backscatter values from various ice types. An analysis has been made of two overlapping strips with 14 SAR images. The backscatter values of specific ice regions were sampled to study the backscatter characteristics of the ice in time and space. Results show both stability of the backscatter values in time and a good separation of multiyear and first-year ice signals, verifying the approach used in the classification algorithm.

Cunningham, G.↗

2022 Prentice Award Lecture: Advancing Retinal Imaging and Visual Function in Patient Management and Disease Mechanisms

Patient-based research plays a key role in probing basic visual mechanisms. Less-well recognized is the role of patient-based retinal imaging and visual function studies in elucidating disease mechanisms, which are accelerated by advances in imaging and function techniques and are most powerful when combined with the results from histology and animal models. A patient's visual complaints can be one key to patient management, but human data are also key to understanding disease mechanisms. Unfortunately, pathological changes can be difficult to detect. Before advanced retinal imaging, the measurement of visual function indicated the presence of pathological changes that were undetectable with existing clinical examination. Over the past few decades, advances in retinal imaging have increasingly revealed the unseen. This has led to great strides in the management of many diseases, particularly diabetic retinopathy and macular edema, and age-related macular degeneration. It is likely widely accepted that patient-based research, as in clinical trials, led to such positive outcomes. Both visual function measures and advanced retinal imaging have clearly demonstrated differences among retinal diseases. Contrary to initial thinking, sight-threatening damage in diabetes occurs to the outer retina and not only to the inner retina. This has been clearly indicated in patient results but has only gradually entered the clinical classifications and understanding of disease etiology. There is strikingly different pathophysiology for age-related macular degeneration compared with photoreceptor and retinal pigment epithelial genetic defects, yet research models and even some treatments confuse these. It is important to recognize the role that patient-based research plays in probing basic visual mechanisms and elucidating disease mechanisms, combining these findings with the concepts from histology and animal models. Thus, this article combines sample instrumentation from my laboratory and progress in the fields of retinal imaging and visual function.

60 APPLIED LIFE SCIENCES↗

Detection, Location, and Classification of Space Shuttle Main Engine Nozzle Leaks by Transient Thermographic Inspection

Leak checking and evaluation of pressure vessels by observing the slight temperature changes resulting from structural anomalies has been made possible through developments in high resolution infrared cameras and advanced image processing. These developments have made thermal nondestructive analysis a very practical and efficient method to determine material consistency and structural quality as well as monitor processes. The Space Shuttle Main Engine Nozzle has regions which can not be inspected with standard leak check methods. The Thermographic methods being developed to nondestructively test the Nozzle for leaks in inaccessible regions are reported. Also, a flash heating Thermographic investigation of the braze line bonding the cooling tubes to the outer structural jacket of the nozzle is reported.

Russell, Samuel S.↗

Atmospheric effects on remote sensing of surface reflectance

This paper reviews the atmospheric effects on remote sensing of surface reflectance. The scattering and absorption of sunlight by atmospheric molecules and aerosols affects the quality of images of the surface remotely sensed from satellites and aircrafts. The concentration and characteristics of the atmospheric aerosols vary from place to place and vary with time. The effect of atmospheric aerosols on the upward radiance depends on their optical thickness, scattering phase function and absorption. These parameters result from the aerosol concentration, composition, and the relative humidity. For high resolution images the aerosol scale height is also of importance. The radiative transfer theory that predicts the atmospheric radiances for a given surface and atmosphere is a well established theory for the case of uniform surfaces (or low resolution data). Some radiative transfer models exist for nonuniform surfaces and others are being developed. Recent field experiment and laboratory simulation data confirm the need for these models and can be used for their testing. It is shown that the atmospheric effect reduces the apparent resolution of satellite imagery and causes errors in the classification of surface fields. Suggestions for correction procedures are given. Such corrections can be based on ground observations, on satellite radiances above dark areas, or on climatologic information, depending on the accuracy of the corrections needed. The chosen correction algorithm depends also on the image resolution and the specific remote sensing application.

Kaufman, Y. J.↗

Vegetation classification map and covariates associated with NEON AOP survey, East River, CO 2018

This package includes geospatial data layers developed to investigate how environmental gradients—specifically topography and near-surface soil properties—drive the spatial arrangement of dominant plant communities in mountainous watersheds. The geospatial products, which support the analysis of these ecological relationships, are derived from airborne hyperspectral and LiDAR datasets acquired by the National Ecological Observatory Network (NEON) Airborne Observation Platform (AOP), in conjunction with an extensive ground field campaign conducted in summer 2018. This work is part of the DOE Watershed Function Science Focus Area (SFA) and features geospatial datasets developed based on observations and ground data collected at East River, Colorado, in collaboration with the National Ecological Observatory Network (NEON) Airborne Observation Platform (AOP) survey in June 2018. Classification Map: - Classification Map (PNG, GeoTIFF): Derived from hyperspectral and LiDAR airborne data using a machine learning approach. - Class Code Mapper (CSV): Associates pixel values with corresponding vegetation/non-vegetation classes. - Classification Reference Data (CSV): Reference data used in the machine learning procedure. LiDAR-Derived Products: - Topographical Metrics (GeoTIFFs): Elevation, slope, curvature, TWI, TPI, solar insolation, and canopy height model (CHM), smoothed with a 5x5 pixel window. Vegetation Indices: - GeoTIFFs of NDVI, NDNI, NDWI: Vegetation indices derived from hyperspectral data. Urban Masks: - Urban Mask (GeoTIFF): Applied to the mapping to convert bare soil classes to urban classes. Software Compatibility: GeoTIFFs: Can be visualized with GIS software or libraries that support GeoTIFF images. CSV Files: Can be opened with any software that handles comma-separated values. The FLMD file provides details and links to the source datasets used to derive the products. The manuscript (in the Method session) provides details on how each product was derived. This work was supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231. Update on 2026-03-25: Since the original dataset publication date of 02/28/2020, this package has a new classification map derived by an improved methodology. This update also includes additional ground data that improved the representation of some of the communities. See the methods for further details on what has changed between versions.

2018 NEON and 2025 CHESS Campaigns↗

Automated Semantic Segmentation for Volumetric Cardiovascular Feature Quantification and Pathology Assessment

We present a pipeline method that curtails the expense and observer bias of manual cardiac evaluation by combining semantic segmentation and disease classification as a fully automatic processing pipeline. The initial element consists of a 2D U-Net convolutional neural network architecture for voxel-wise segmentation of the myocardium and ventricular cavities. The results of the segmentation were used to compute a comprehensive volumetric feature matrix that captured diagnostic clinical procedure data and that was used to model a cardiac pathology classifier.Our approach evaluated anonymized parasternal MRI cardiac images from a database of 100 patients (4 pathology groups, 1 healthy group, 20 patients per group) examined at the University Hospital of Dijon. We achieved top average Dice index scores of 0.939, 0.849, 0.886 for structure segmentation of the left ventricle (LV), right ventricle (RV) and myocardium respectively. A 5-ary pathology classification accuracy of 90% was recorded on an independent test set using our trained model.

Lindsey, Tony↗

Supernova host galaxies in the dark energy survey: I. Deep coadds, photometry, and stellar masses

ABSTRACT The 5-yr Dark Energy Survey Supernova Programme (DES-SN) is one of the largest and deepest transient surveys to date in terms of volume and number of supernovae. Identifying and characterizing the host galaxies of transients plays a key role in their classification, the study of their formation mechanisms, and the cosmological analyses. To derive accurate host galaxy properties, we create depth-optimized coadds using single-epoch DES-SN images that are selected based on sky and atmospheric conditions. For each of the five DES-SN seasons, a separate coadd is made from the other four seasons such that each SN has a corresponding deep coadd with no contaminating SN emission. The coadds reach limiting magnitudes of order ∼27 in g band, and have a much smaller magnitude uncertainty than the previous DES-SN host templates, particularly for faint objects. We present the resulting multiband photometry of host galaxies for samples of spectroscopically confirmed type Ia (SNe Ia), core-collapse (CCSNe), and superluminous (SLSNe) as well as rapidly evolving transients (RETs) discovered by DES-SN. We derive host galaxy stellar masses and probabilistically compare stellar-mass distributions to samples from other surveys. We find that the DES spectroscopically confirmed sample of SNe Ia selects preferentially fewer high-mass hosts at high-redshift compared to other surveys, while at low redshift the distributions are consistent. DES CCSNe and SLSNe hosts are similar to other samples, while RET hosts are unlike the hosts of any other transients, although these differences have not been disentangled from selection effects.

79 ASTRONOMY AND ASTROPHYSICS↗