Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Imagery”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Learning to Count Grave Sites for Cemetery Observation Models With Satellite Imagery

Understanding how people occupy open spaces is important for research in support of population modeling, policy, national security, emergency response, and sustainability. For the past decade, there has been an increase in research toward capturing and reporting population dynamics and patterns of life at the building level and in some open public spaces such as cemeteries and parks. This is done through observation models developed from local sociocultural information acquired at various spatiotemporal scales to inform night, day, and episodic population occupancy estimates (people/1000 sq ft). Sociocultural information for cemeteries and parks is scarcely available and often collected manually. The process is not only marred by inconsistencies but is laborious and time consuming. In this study, we leverage convolutional neural networks (CNNs) and satellite imagery to derive grave site counts as proxy variables to support scalable and accurate sociocultural data required in a population observation model. Through a hybrid workflow (weak localization plus regression model), we characterize a large scale automation process to counting of grave sites. We evaluate and demonstrate the efficacy of proposed workflow using out-of-data set large satellite imagery and establish its broader impact on cemetery observation models.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Aerial 3D Building Reconstruction from Drone Imagery (A3DBR) v1

This toolkit is composed of several modules for extracting buildings geometrical and thermal characteristics from RGB and thermal imagery captured using a drone. - Building 3D reconstruction module: leverage a photogrammetry software to construct a 3D point cloud from RGB drone imagery, which is then used in conjunction with image processing and geometric methods to extract building footprint and building height (i.e., 3D model of the building). - Windows to wall ratio estimation module: leverage deep learning semantic segmentation modeling to detect windows on 2D drone RGB images. The detected windows are then projected onto the extracted building 3D model (using building 3D reconstruction module) and their area is computed to obtain window to wall ratio estimation. - Thermal anomalies detection module: leverage image processing and machine learning algorithm to detect on 2D drone thermal images potential thermal anomalies within building's facades and roofs.

Granderson, Jessica↗
DOE OSTI2023

Conflation of Geospatial POI Data and Ground-level Imagery

The code solves the problem of conflating POI (Points of Interest) geospatial data and geo-tagged ground-level imagery data. The main challenges with fusion or conflation of these two types of data has been that these two data entities are represented not only in several ways in current state-of-the-art, but also there is mismatch of representation format of these two data types. This source code/software brings POI datapoints and ground-level imagery datapoints into same representation format, and then generates valuable Knowledge Graph combining POI and images data (so that it can be used for multitude of applications).

De, Debraj↗
DOE OSTI2022

Classification of Cloud Particle Imagery from Aircraft Platforms Using Convolutional Neural Networks

Abstract A vast amount of ice crystal imagery exists from a variety of field campaign initiatives that can be utilized for cloud microphysical research. Here, nine convolutional neural networks are used to classify particles into nine regimes on over 10 million images from the Cloud Particle Imager probe, including liquid and frozen states and particles with evidence of riming. A transfer learning approach proves that the Visual Geometry Group (VGG-16) network best classifies imagery with respect to multiple performance metrics. Classification accuracies on a validation dataset reach 97% and surpass traditional automated classification. Furthermore, after initial model training and preprocessing, 10 000 images can be classified in approximately 35 s using 20 central processing unit cores and two graphics processing units, which reaches real-time classification capabilities. Statistical analysis of the classified images indicates that a large portion (57%) of the dataset is unusable, meaning the images are too blurry or represent indistinguishable small fragments. In addition, 19% of the dataset is classified as liquid drops. After removal of fragments, blurry images, and cloud drops, 38% of the remaining ice particles are largely intersecting the image border (≥10% cutoff) and therefore are considered unusable because of the inability to properly classify and dimensionalize. After this filtering, an unprecedented database of 1 560 364 images across all campaigns is available for parameter extraction and bulk statistics on specific particle types in a wide variety of storm systems, which can act to improve the current state of microphysical parameterizations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

A holistic cyber-physical security protocol for authenticating the provenance and integrity of structural health monitoring imagery data

Modern infrastructure systems, such as bridges, dams, power generation stations, and buildings increasingly have an intrinsic cyber-physical nature to them. Infrastructure now commonly, includes actuators, network connections, sensors, control systems, and computational resources. It is of increasing concern that modern infrastructure is vulnerable to cyber-attacks that can damage both the cyber and physical nature of the infrastructure. To date, the physical and cyber health of infrastructure has been considered separately. However, the increasing concerns associated with the cyber-physical security of infrastructure coupled with the emergence of 5G networks made using components that are not universally considered trustworthy, and the emergence of techniques for creating deepfakes and adversarial examples suggests the time has come to begin considering cyber health and structural health with a more holistic approach. In this work, a protocol is developed for ensuring the imagery data captured by a structural health monitoring system can be unambiguously attributed to legitimate sensors associated with the structural health monitoring system. A computer vision approach based on the idea of mutual information is then presented to detect damage in an image. This work presents the protocol for authenticating the provenance of imager data and demonstrates that this protocol does not have overly adverse effects when used with the mutual information-based technique for detecting damage in the resulting imagery data.

Jung, HweeKwon↗
DOE OSTI2024

Dataset: Breaking the barrier of human-annotated training data for machine-learning-aided plant research using aerial imagery

This dataset supports the implementation described in the manuscript "Breaking the Barrier of Human-Annotated Training Data for Machine-Learning-Aided Biological Research Using Aerial Imagery." It comprises UAV aerial imagery used to execute the code available at https://github.com/pixelvar79/GAN-Flowering-Detection-paper. For detailed information on dataset usage and instructions for implementing the code to reproduce the study, please refer to the GitHub repository.

generative and adversarial learning↗
DOE OSTI2020

Integrating high resolution drone imagery and forest inventory to distinguish canopy and understory trees and quantify their contributions to forest structure and dynamics

Tree growth and survival differ strongly between canopy trees (those directly exposed to overhead light), and understory trees. However, the structural complexity of many tropical forests makes it difficult to determine canopy positions. The integration of remote sensing and ground-based data enables this determination and measurements of how canopy and understory trees differ in structure and dynamics. Here we analyzed 2 cm resolution RGB imagery collected by a Remotely Piloted Aircraft System (RPAS), also known as drone, together with two decades of bi-annual tree censuses for 2 ha of old growth forest in the Central Amazon. We delineated all crowns visible in the imagery and linked each crown to a tagged stem through field work. Canopy trees constituted 40% of the 1244 inventoried trees with diameter at breast height (DBH) > 10 cm, and accounted for ~70% of aboveground carbon stocks and wood productivity. The probability of being in the canopy increased logistically with tree diameter, passing through 50% at 23.5 cm DBH. Diameter growth was on average twice as large in canopy trees as in understory trees. Growth rates were unrelated to diameter in canopy trees and positively related to diameter in understory trees, consistent with the idea that light availability increases with diameter in the understory but not the canopy. The whole stand size distribution was best fit by a Weibull distribution, whereas the separate size distributions of understory trees or canopy trees > 25 cm DBH were equally well fit by exponential and Weibull distributions, consistent with mechanistic forest models. The identification and field mapping of crowns seen in a high resolution orthomosaic revealed new patterns in the structure and dynamics of trees of canopy vs. understory at this site, demonstrating the value of traditional tree censuses with drone remote sensing.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Predicting Switchgrass Biomass Yields Using a Spectral Vegetation Index Derived from Multispectral Satellite Imagery

Successful scaling of perennial bioenergy crop production requires a landscape design that optimizes the benefits of finite lands for people, communities, and environments. Utilizing marginal areas is the key to sustainable bioenergy crop production (Ssegane et al., 2015, 2016). Marginal areas are often small-sized lands and unevenly distributed across the agricultural landscape (Ssegane et al., 2016); thus, a systematic, semi-automated remote sensing method is needed as an effective means of estimating bioenergy crop yields across landscapes. Argonne National Laboratory (Argonne) is currently developing a tool, Scaling Up Perennial Bioenergy Economics and Ecosystem Services Tool (SUPERBEEST), to identify marginal agricultural lands and quantify environmental and economic effects of perennial bioenergy crop production systems. The tool aims to provide users a path to foster the sustainable and productive integration of bioenergy crops in the Midwestern agricultural landscape. Reliable, cost-effective, and timely estimation of bioenergy crop yields using remote sensing would help calculate and track the success of integrated bioenergy crops in the landscape for those communities. Argonne previously conducted feasibility studies for estimating biomass yields for bioenergy feedstock, corn and perennial grass using spectral vegetation indices (SVIs)1 derived from optical imagery (Hamada et al., 2015, 2021). In both studies, SVIs, more specifically those sensitive to plant chlorophyll or nitrogen contents, showed potential for estimating or predicting biomass yields with a correlation of determination (R2) ranging from 0.54 to 0.96, indicating a value for further investigation as a viable means of quantifying bioenergy feedstock production across large landscapes. Thus, the goal of this study is to evaluate the feasibility of use of SVIs as a means of estimating or predicting switchgrass biomass yields at harvest using publicly available multispectral satellite imagery. The feasibility analysis was performed using four study areas of mature switchgrass located in Virginia. Objectives are to (1) examine the SVIs and establish their relationships with switchgrass biomass yields at harvest, (2) develop a parsimonious image processing model for predicting at-harvest yields by applying the relationships with the most promising spectral index and (3) map switchgrass yields predicted by the image processing model across the study sites. The calibration to field data will rely on switchgrass biomass yields determined by the baling method, representing a potential challenge to the analysis but an important practical aspect for future applications. With this research design, the study aimed to gain insights into enabling remote sensing-based estimation of bioenergy crop yields in a reliable, cost- effective, and timely manner across large, heterogeneous landscapes.

09 BIOMASS FUELS↗
DOE OSTI2023

Automatic detection of ship-induced cloud features in satellite imagery

Ships crossing the ocean are known to produce long, curvilinear features called ship tracks visible in satellite imagery via the Twomey effect; however, there has been little exploitation of satellite imagery for broad atmospheric studies or global monitoring of ship emissions due to the difficulty of automated ship track detection. Prior studies are either proof-of-concept, qualitatively assessed, or restricted to a certain time of day. We propose a statistical method for the automated identification of ship tracks and demonstrate using GOES-West ABI data. We first present a human-assisted segmentation method, which we use to generate a ground truth data set of 529 annotated ship tracks in GOES-West ABI products. We then describe a two-stage automated approach comprising a detection stage to generate ship track proposals and a classification stage to reduce false positives. For detection, we present a novel pipeline based around a z-score filtering technique, and for classification, we demonstrate several classifiers from literature. In a final experiment, we quantitatively tune the detection parameters and train the classifier using the ground truth dataset, then test on a sequestered set of images; the detect-then-classify system had an overall Pd of 0.68 and 0.80 for daytime and nighttime data, respectively, and the classifier reduced false positive detections by 67% and 75%.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Understanding Growth Dynamics and Yield Prediction of Sorghum Using High Temporal Resolution UAV Imagery Time Series and Machine Learning

Unmanned aerial vehicles (UAV) carrying multispectral cameras are increasingly being used for high-throughput phenotyping (HTP) of above-ground traits of crops to study genetic diversity, resource use efficiency and responses to abiotic or biotic stresses. There is significant unexplored potential for repeated data collection through a field season to reveal information on the rates of growth and provide predictions of the final yield. Generating such information early in the season would create opportunities for more efficient in-depth phenotyping and germplasm selection. This study tested the use of high-resolution time-series imagery (5 or 10 sampling dates) to understand the relationships between growth dynamics, temporal resolution and end-of-season above-ground biomass (AGB) in 869 diverse accessions of highly productive (mean AGB = 23.4 Mg/Ha), photoperiod sensitive sorghum. Canopy surface height (CSM), ground cover (GC), and five common spectral indices were considered as features of the crop phenotype. Spline curve fitting was used to integrate data from single flights into continuous time courses. Random Forest was used to predict end-of-season AGB from aerial imagery, and to identify the most informative variables driving predictions. Improved prediction of end-of-season AGB (RMSE reduction of 0.24 Mg/Ha) was achieved earlier in the growing season (10 to 20 days) by leveraging early- and mid-season measurement of the rate of change of geometric and spectral features. Early in the season, dynamic traits describing the rates of change of CSM and GC predicted end-of-season AGB best. Late in the season, CSM on a given date was the most influential predictor of end-of-season AGB. The power to predict end-of-season AGB was greatest at 50 days after planting, accounting for 63% of variance across this very diverse germplasm collection with modest error (RMSE 1.8 Mg/ha). End-of-season AGB could be predicted equally well when spline fitting was performed on data collected from five flights versus 10 flights over the growing season. This demonstrates a more valuable and efficient approach to using UAVs for HTP, while also proposing strategies to add further value.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Identifying Critical Infrastructure in Imagery Data Using Explainable Convolutional Neural Networks

To date, no method utilizing satellite imagery exists for detailing the locations and functions of critical infrastructure across the United States, making response to natural disasters and other events challenging due to complex infrastructural interdependencies. This paper presents a repeatable, transferable, and explainable method for critical infrastructure analysis and implementation of a robust model for critical infrastructure detection in satellite imagery. This model consists of a DenseNet-161 convolutional neural network, pretrained with the ImageNet database. The model was provided additional training with a custom dataset, containing nine infrastructure classes. The resultant analysis achieved an overall accuracy of 90%, with the highest accuracy for airports (97%), hydroelectric dams (96%), solar farms (94%), substations (91%), potable water tanks (93%), and hospitals (93%). Critical infrastructure types with relatively low accuracy are likely influenced by data commonality between similar infrastructure components for petroleum terminals (86%), water treatment plants (78%), and natural gas generation (78%). Local interpretable model-agnostic explanations (LIME) was integrated into the overall modeling pipeline to establish trust for users in critical infrastructure applications. The results demonstrate the effectiveness of a convolutional neural network approach for critical infrastructure identification, with higher than 90% accuracy in identifying six of the critical infrastructure facility types.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Deep Convolutional Neural Networks Exploit High-Spatial- and -Temporal-Resolution Aerial Imagery to Phenotype Key Traits in Miscanthus

Miscanthus is one of the most promising perennial crops for bioenergy production, with high yield potential and a low environmental footprint. The increasing interest in this crop requires accelerated selection and the development of new screening techniques. New analytical methods that are more accurate and less labor-intensive are needed to better characterize the effects of genetics and the environment on key traits under field conditions. We used persistent multispectral and photogrammetric UAV time-series imagery collected 10 times over the season, together with ground-truth data for thousands of Miscanthus genotypes, to determine the flowering time, culm length, and biomass yield traits. We compared the performance of convolutional neural network (CNN) architectures that used image data from single dates (2D-spatial) versus the integration of multiple dates by 3D-spatiotemporal architectures. The ability of UAV-based remote sensing to rapidly and non-destructively assess large-scale genetic variation in flowering time, height, and biomass production was improved through the use of 3D-spatiotemporal CNN architectures versus 2D-spatial CNN architectures. The performance gains of the best 3D-spatiotemporal analyses compared to the best 2D-spatial architectures manifested in up to 23% improvements in R2, 17% reductions in RMSE, and 20% reductions in MAE. The integration of photogrammetric and spectral features with 3D architectures was crucial to the improved assessment of all traits. In conclusion, our findings demonstrate that the integration of high-spatiotemporal-resolution UAV imagery with 3D-CNNs enables more accurate monitoring of the dynamics of key phenological and yield-related crop traits. This is especially valuable in highly productive, perennial grass crops such as Miscanthus, where in-field phenotyping is especially challenging and traditionally limits the rate of crop improvement through breeding.

47 OTHER INSTRUMENTATION↗
NASA NTRS1972

Interpretation of geographic patterns in simulated orbital television imagery of earth resources

In order to better determine the effects of the television imagery characteristics upon the interpretation of geographic patterns obtainable from orbital television sensors, and in order to better evaluate the influences of alternative sensor system parameters such as changes in orbital altitudes or scan line rates, a team of three professional interpreters independently mapped thematically the selected geographic phenomena that they could detect in orbital television imagery produced on a fourteen inch monitor and recorded photographically for analysis. Three thematic maps were compiled by each interpreter. The maps were: (1) transportation patterns; (2) other land use; and (3) physical regions. The results from the three interpreters are compared, agreements noted, and differences analyzed for cause such as disagreement on identification of phenomenon, visual acuity, differences in interpretation techniques, and differing professional backgrounds.

Latham, J. P.↗
NASA NTRS1971

An assessment of remote sensor imagery in the determination of housing quality data

Selected census tracts in the metropolitan Washington area were examined using varying scales of aerial photography. Observable characteristics of housing and neighborhoods were assessed to determine feasibility of providing data on housing stock and quality and neighborhood condition from the imagery. Small scale imagery is shown to be of relatively marginal value in providing much of the data in the detail required, but can be useful for general survey purposes.

Mallon, H. J.↗
NASA NTRS1972

Application of ecological, geological and oceanographic ERTS-1 imagery to Delaware's coastal resources planning

The author has identified the following significant events. Coastal vegetation species appearing in the ERTS-1 image taken of the Southern Coast of Delaware, during orbit 333 on August 16, 1972, have been correlated with ground truth vegetation maps, and imagery obtained from high altitude RB-57 and U-2 overflights. The vegetation maps of the entire Delaware Coast were prepared using data collected on foot, in small boats, and from low altitude aircraft. Multispectral analysis of high altitude RB-57 and U-2 photographs indicated that five vegetation species could be clearly discriminated from 60,000 feet altitude, including: (1) salt marsh cord grass (Spartina alterniflora); (2) salt marsh hay and spike grass (Spartina patens and Distichlis spicata); (3) reed grass (Phragmites communis); (4) high tide bush and sea myrtle (Iva species and Baccharus halimifolia); and (5) a group of fresh water species found in impounded areas built to attract water fowl. Major Spartina alterniflora and Spartina patens communities within the tidal marshes can be identified in the ERTS-1 imagery. Phragmites, and other species however, occur in smaller, more dispersed groupings and are difficult to discriminate within the resolution capability of the ERTS-1 scanner. Similarly, major impounded areas, built to attract water fowl can be detected; however, mosquito drainage ditches, covering many of Delaware's marshes, are too narrow and not long enough to be resolved by ERTS-1 sensors. High-marsh and dune communities dominated by high tide bush (Iva frutescens) and sea myrtle (Baccharus halimifolia) can be distinguished from adjacent maritime forest and beach grass communities.

Klemas, V.↗
NASA NTRS1972

Mineral exploration from high altitude imagery

Types of remote sensing which can best be done from spacecraft and types which can best be done from aircraft are discussed. Five geologically distinctive areas in northwestern Saudi Arabia were selected for detailed study. The areas were mapped as thoroughly as possible on each of several different types of imagery. The final objective was to identify those classes of geologic problems that can best be resolved using satellite data and then to identify areas where orbital imagery might profitably be used to extend existing knowledge, with emphasis placed on mineral exploration.

Blodget, H. W.↗