Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Overhead Image”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Overhead Image Statistics

Statistical properties of high-resolution overhead images representing different land use categories are analyzed using various local and global statistical image properties based on the shape of the power spectrum, image gradient distributions, edge co-occurrence, and inter-scale wavelet coefficient distributions. The analysis was performed on a database of high-resolution (1 meter) overhead images representing a multitude of different downtown, suburban, commercial, agricultural and wooded exemplars. Various statistical properties relating to these image categories and their relationship are discussed. The categorical variations in power spectrum contour shapes, the unique gradient distribution characteristics of wooded categories, the similarity in edge co-occurrence statistics for overhead and natural images, and the unique edge co-occurrence statistics of downtown categories are presented in this work. Though previous work on natural image statistics has showed some of the unique characteristics for different categories, the relationships for overhead images are not well understood. The statistical properties of natural images were used in previous studies to develop prior image models, to predict and index objects in a scene and to improve computer vision models. The results from our research findings can be used to augment and adapt computer vision algorithms that rely on prior image statistics to process overhead images, calibrate the performance of overhead image analysis algorithms, and derive features for better discrimination of overhead image categories.

54 ENVIRONMENTAL SCIENCES↗

Hashed Binary Search Sampling for Convolutional Network Training with Large Overhead Image Patches

Very large overhead imagery associated with ground truth maps has the potential to generate billions of training image patches for machine learning algorithms. However, random sampling selection criteria often leads to redundant and noisy-image patches for model training. With minimal research efforts behind this challenge, the current status spells missed opportunities to develop supervised learning algorithms that generalize over wide geographical scenes. In addition, much of the computational cycles for large scale machine learning are poorly spent crunching through noisy and redundant image patches. We demonstrate a potential framework to address these challenges specifically, while evaluating a human settlement detection task. A novel binary search tree sampling scheme is fused with a kernel based hashing procedure that maps image patches into hash-buckets using binary codes generated from image content. The framework exploits inherent redundancy within billions of image patches to promote mostly high variance preserving samples for accelerating algorithmic training and increasing model generalization.

Lunga, Dalton↗

A combinatorial method for tracing objects using semantics of their shape.

We present a shape-first approach to finding automobiles and trucks in overhead images and include results from our analysis of an image from the Overhead Imaging Research Dataset [1]. For the OIRDS, our shape-first approach traces candidate vehicle outlines by exploiting knowledge about an overhead image of a vehicle: a vehicle's outline fits into a rectangle, this rectangle is sized to allow vehicles to use local roads, and rectangles from two different vehicles are disjoint. Our shape-first approach can efficiently process high-resolution overhead imaging over wide areas to provide tips and cues for human analysts, or for subsequent automatic processing using machine learning or other analysis based on color, tone, pattern, texture, size, and/or location (shape first). In fact, computationally-intensive complex structural, syntactic, and statistical analysis may be possible when a shape-first work flow sends a list of specific tips and cues down a processing pipeline rather than sending the whole of wide area imaging information. This data flow may fit well when bandwidth is limited between computers delivering ad hoc image exploitation and an imaging sensor. As expected, our early computational experiments find that the shape-first processing stage appears to reliably detect rectangular shapes from vehicles. More intriguing is that our computational experiments with six-inch GSD OIRDS benchmark images show that the shape-first stage can be efficient, and that candidate vehicle locations corresponding to features that do not include vehicles are unlikely to trigger tips and cues. We found that stopping with just the shape-first list of candidate vehicle locations, and then solving a weighted, maximal independent vertex set problem to resolve conflicts among candidate vehicle locations, often correctly traces the vehicles in an OIRDS scene.

99 GENERAL AND MISCELLANEOUS↗

Original images, ground truth annotations, and precited masks from U-NET for a fungal species x nitrogen experiment

This document describes the “MicroVision-MV003” dataset. This folder contains three subfolders: “originals”, “predicted_masks”, and “gt_masks”. The “originals” folder contains 720 original images acquired using two imaging modalities: 360 images from overhead imaging and 360 images from transmission (raw) imaging. Naming scheme:YYYY-MM-dd__plate_strain_nitrogen-level_replication_experiment_imaging-modalityYYYY-MM-dd: 2024-12-20, 2024-12-21, 2024-12-22,2024-12-23,2024-12-24,2024-12-25,2024-12-26,2024-12-27,2024-12-28,2024-12-29,2024-12-30,2024-12-31.plate: 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30.strain: FG, LE.nitrogen-level: N-1, N-10, N-100.replication: 1, 2, 3, 4, 5.experiment: MV.003.imaging-modality: overhead, transmission (raw). For example, the image2024-12-20__1_FG_N-10_3_MV.003_overheadwas taken on 2024-12-20. The plate number is 1, the fungal strain is FG, the nitrogen treatment is N-10, and the replication number is 3 for experiment MV.003, acquired using the overhead imaging modality. The “predicted_masks” folder contains masks generated by a trained U-Net model for the transmission imaging modality.The “gt_masks” folder contains 326 human hand-traced masks that serve as ground truth.

09 BIOMASS FUELS↗

Geospatial-Temporal Semantic Graphs for Automated Wide-Area Search

We address the problem of wide-area search of overhead imagery. Given a time sequence of overhead images, we construct a geospatial-temporal semantic graph, which expresses the complex continuous information in the overhead images in a discrete searchable form, including explicit modeling of changes seen from one image to the next. We can then express desired search goals as a template graph, and search for matches using simple and efficient graph search algorithms. This produces a set of potential matches which provide cues for where to examine the imagery in detail, applying human expertise to determine which matches are correct. We include a match quality metric that scores the matches according to how well they match the stated search goal. This enables matches to be presented in sorted order with the best matches first, similar to the results returned by a web search engine. We present an evaluation of the method applied to several examples and data sets, and show that it can be used successfully for some problems. We also remark on several limitations of the method and note additional work needed to improve its scope and robustness. Approved for public release; further dissemination unlimited.

97 MATHEMATICS AND COMPUTING↗

Benchmark Imagery Project: Report on Generation of Synthetic Images

The “Benchmark Imagery” project is a DOE NA-22-funded effort whose three-year goal is to create a suite of imagery that can be used to test geospatial algorithms used for extracting semantic content from overhead images of industrial facilities (e.g., auto-annotation). The project is a collaborative effort between Los Alamos National Laboratory (LANL) and the Lawrence Livermore National Laboratory (LLNL). Although a variety of image modalities are used to capture overhead photographs of terrestrial facilities, the current focus of the effort of this project is on collecting and annotating conventional visual-band (RGB or RGB/NIR) images. Presently, the set of images consists of 114 airborne images of various US industrial facilities. We have annotated all of the images in the imagery set, using a constrained vocabulary of about a dozen general terms such as “building,” ”tower,” or “electrical substation.” The project plans to include synthetic and composite images in addition to actual photographs. In preparation for using synthetic images, we have built a proof-of-principle synthetic image of a fictitious nuclear power plant. This report describes the key aspects of creating that image.

97 MATHEMATICS AND COMPUTING↗

Benchmark Imagery Project: Selection of Real World Images for Creating Composite Images of Facilities

The "Benchmark Imagery" project is a DOE NA-22-funded effort whose three-year goal is to create a suite of imagery (both real and composite) that can be used to test geospatial algorithms used for extracting semantic content from overhead images of industrial facilities. A composite image is an image that contains both real elements such as photographic imagery and synthetic elements such as 3D models. Composite images have the advantage of being customizable and distributable, and they can contain complete ground truth. It is our goal to generate composite images which appear realistic to both human and algorithm. When generating composite images of facilities we use real overhead imagery to increase realism and decrease effort. To construct all elements with purely synthetic textures would require too much effort and still may not look as realistic as a real image. We use real time 3D rendering software "SceneWorks" for rendering composite images. In SceneWorks, a scene is constructed by placing 3D models of facility components on top of a base terrain. A base terrain is a 3D model constructed from digital elevation mapping (DEM) data and then textured with overhead orthorectified imagery. The base terrain is constructed to be geospatially accurate using a real location’s source data (DEM and Imagery.) This document outlines the selection criteria in selecting appropriate location and source data for constructing the base terrain. Imagery should have resolution equal or better than desired composite image resolution. The imagery should have no seams. Seams can occur when two or more different imagery data sets exist in a single area with neither set covering the entire area. Elevation data (DEM) resolution generally should be 1/9 arc second or better depending on the variability of elevation. The imagery must contain a flat clearing of land large enough for multiple facility types. There should be no high-rise buildings anywhere in the base terrain.

42 ENGINEERING↗

A progressive data compression scheme based upon adaptive transform coding: Mixture block coding of natural images

A method for efficiently coding natural images using a vector-quantized variable-blocksized transform source coder is presented. The method, mixture block coding (MBC), incorporates variable-rate coding by using a mixture of discrete cosine transform (DCT) source coders. Which coders are selected to code any given image region is made through a threshold driven distortion criterion. In this paper, MBC is used in two different applications. The base method is concerned with single-pass low-rate image data compression. The second is a natural extension of the base method which allows for low-rate progressive transmission (PT). Since the base method adapts easily to progressive coding, it offers the aesthetic advantage of progressive coding without incorporating extensive channel overhead. Image compression rates of approximately 0.5 bit/pel are demonstrated for both monochrome and color images.

Rost, Martin C.↗

Remote Sensor Design for Visual Recognition with Convolutional Neural Networks

While deep learning technologies for computer vision have developed rapidly since 2012, modeling of remote sensing systems has remained focused around human vision. In particular, remote sensing systems are usually constructed to optimize sensing cost-quality trade-offs with respect to human image interpretability. While some recent studies have explored remote sensing system design as a function of simple computer vision algorithm performance, there has been little work relating this design to the state-of-the-art in computer vision: deep learning with convolutional neural networks. We develop experimental systems to conduct this analysis, showing results with modern deep learning algorithms and recent overhead image data. Our results are compared to standard image quality measurements based on human visual perception, and we conclude not only that machine and human interpretability differ significantly, but that computer vision performance is largely self-consistent across a range of disparate conditions. This repository contains all the code required to replicate the results of our research paper, and the corresponding docker environment in which that code can be executed. All code is written in Python3 and utilizes the PyTorch library (v1.0) for neural network model training and evaluation. Jupyter notebooks are used to visualize images transformed with our code, in addition to plotting experimental results. We also include the specific parameter files used to execute our experiments, with the intent that these experiments can be replicated.

Zelinski, michaelE.↗

Modeling and Simulation of the ARES UPPER STAGE Transportation, Lifting, Stacking and Mating Operations Within the Vehicle Assembly Building at KSC

This viewgraph presentation describes the modeling and simulation of the Ares Upper Stage Transportation, lifting, stacking, and mating operations within the Vehicle Assembly Building (VAB) at Kennedy Space Center (KSC). An aerial view of KSC Launch Shuttle Complex, two views of the Delmia process control layout, and an upper stage move subroutine and breakdown are shown. An overhead image of the VAB and the turning basin along with the Pegasus barge at the turning basin are also shown. This viewgraph presentation also shows the actual design and the removal of the mid-section spring tensioners, the removal of the AFT rear and forward tensioners tie downs, and removing the AFT hold down post and mount. US leaving the Pegasus Barge, the upper stage arriving at transfer aisle, upper stage receiving/inspection in transfer aisle, and an overhead view of upper stage receiving/inspection in transfer aisle are depicted. Five views of the actual connection of the cabling to the upper stage aft lifting hardware are shown. The upper stage transporter forward connector, two views of the rotation horizontal to vertical, the disconnection of the rear bolt ring cabling, the lowering of the upper stage to the inspection stand, disconnection of the rear bolt ring from the upper stage, the lifting of the upper stage and inspection of AFT fange, and the transfer of upper stage in an integrated stack are shown. Six views of the mating of the upper stage to the first stage are depicted. The preparation, inspection, and removal of the forward dome are shown. The upper stage mated on the integrated stack and crawler is also shown. This presentation concludes with A Rapid Upper Limb Assessment (RULA) utilizing male and female models for assessing risk factors to the upper extremities of human beings in an actual physical environment.

Kromis, Phillip A.↗

Quantifying the robustness of deep multispectral segmentation models against natural perturbations and data poisoning

In overhead image segmentation tasks, including additional spectral bands beyond the traditional RGB channels can improve model performance. However, it is still unclear how incorporating this additional data impacts model robustness to adversarial attacks and natural perturbations. For adversarial robustness, the additional in-formation could improve the model’s ability to distinguish malicious inputs, or simply provide new attack avenues and vulnerabilities. For natural perturbations, the additional information could better inform model decisions and weaken perturbation effects or have no significant influence at all. In this work, we seek to characterize the performance and robustness of a multispectral (RGB and near infrared) image segmentation model subjected to adversarial attacks and natural perturbations. While existing adversarial and natural robustness research has focused primarily on digital perturbations, we prioritize on creating realistic perturbations designed with physical world conditions in mind. For adversarial robustness, we focus on data poisoning attacks whereas for natural robustness, we focus on extending ImageNet-C common corruptions for fog and snow that coherently and self-consistently perturbs the input data. Overall, we find both RGB and multispectral models are vulnerable to data poisoning attacks regardless of input or fusion architectures and that while physically-realizable natural perturbations still degrade model performance, the impact differs based on fusion architecture and input data.

Deep learning, multispectral images, multimodal fu↗

Hyperspectral Geobotanical Remote Sensing for Monitoring and Verifying CO 2 Containment Final Report CRADA No. TC-2036-02

This collaborative effort was in support of the CO 2 Capture Project (CCP), to develop techniques that integrate overhead images of plant species, plant health, geological formations, soil types, aquatic, and human use spatial patterns for detection and discrimination of any CO 2 releases from underground storage formations. The goal of this work was to demonstrate advanced hyperspectral geobotanical remote sensing methods to assess potential leakage of CO 2 from underground storage. The timeframes and scales relevant to the long-term storage of CO 2 in the subsurface make remote sensing methods attractive. Moreover, it has been shown that individual field measurements of gas composition are subject to variability on extremely small temporal and spatial scales. The ability to verify ultimate reservoir integrity and to place individual surface measurements into context will be crucial to successful long-term monitoring and verification activities. The desired results were to produce a defined and tested procedure that could be easily used for long-term monitoring of possible CO 2 leakage from underground CO 2 sequestration sites. This testing standard will be utilized on behalf of the oil industry.

42 ENGINEERING↗

Path Planning with obstacle avoidance

The research report here summarizes a solution for two dimensional Path Planning with obstacle avoidance in a workspace with stationary obstacles. The solution finds the shortest path for the end effector of a manipulator arm. The program uses an overhead image of the robot work space and the starting and ending positions of the manipulator arm end effector to generate a search graph which is used to find the shortest path through the work area. The solution was originally implemented in VAX Pascal, but was later converted to VAX C.

Krause, Donald M.↗

Computer processing through distance-based quality score method in geospatial-temporal semantic graphs

A computer-implemented method of improving processing of overhead image data by a processor using a distance-based quality score in a geospatial-temporal semantic graph. An allowable range for each attribute in the subgraph search template is defined. For each match in a comparison, attribute values of each match element are compared against the preferred range and the allowable range to compute a corresponding distance of each match attribute from the subgraph search template. A corresponding overall match quality score is determined for each match from the subgraph search template, wherein determining the corresponding overall match qualities is performed using a corresponding required quality score and a corresponding optional quality score. All corresponding overall match quality scores are sorted into an ordered list and then displayed.

97 MATHEMATICS AND COMPUTING↗

A Fieldable-Prototype Large-Area Gamma-ray Imager for Orphan Source Search

We have constructed a unique instrument for use in the search for orphan sources. The system uses gamma-ray imaging to "see through" the natural background variations that effectively limit the search range of normal devices to ~10 m. The imager is mounted in a 4.9- m-long trailer and can be towed by a large personal vehicle. Source locations are determined both in range and along the direction of travel as the vehicle moves. A fully inertial platform coupled to a Global Positioning System receiver is used to map the gamma-ray images onto overhead geospatial imagery. The resulting images provide precise source locations, allowing rapid follow-up work. The instrument simultaneously searches both sides of the street to a distance of 50 m (100-m swath) for milliCurieclass sources with near-perfect performance.

Ziock, Klaus-Peter↗