Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Imagery”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Understanding Growth Dynamics and Yield Prediction of Sorghum Using High Temporal Resolution UAV Imagery Time Series and Machine Learning

Unmanned aerial vehicles (UAV) carrying multispectral cameras are increasingly being used for high-throughput phenotyping (HTP) of above-ground traits of crops to study genetic diversity, resource use efficiency and responses to abiotic or biotic stresses. There is significant unexplored potential for repeated data collection through a field season to reveal information on the rates of growth and provide predictions of the final yield. Generating such information early in the season would create opportunities for more efficient in-depth phenotyping and germplasm selection. This study tested the use of high-resolution time-series imagery (5 or 10 sampling dates) to understand the relationships between growth dynamics, temporal resolution and end-of-season above-ground biomass (AGB) in 869 diverse accessions of highly productive (mean AGB = 23.4 Mg/Ha), photoperiod sensitive sorghum. Canopy surface height (CSM), ground cover (GC), and five common spectral indices were considered as features of the crop phenotype. Spline curve fitting was used to integrate data from single flights into continuous time courses. Random Forest was used to predict end-of-season AGB from aerial imagery, and to identify the most informative variables driving predictions. Improved prediction of end-of-season AGB (RMSE reduction of 0.24 Mg/Ha) was achieved earlier in the growing season (10 to 20 days) by leveraging early- and mid-season measurement of the rate of change of geometric and spectral features. Early in the season, dynamic traits describing the rates of change of CSM and GC predicted end-of-season AGB best. Late in the season, CSM on a given date was the most influential predictor of end-of-season AGB. The power to predict end-of-season AGB was greatest at 50 days after planting, accounting for 63% of variance across this very diverse germplasm collection with modest error (RMSE 1.8 Mg/ha). End-of-season AGB could be predicted equally well when spline fitting was performed on data collected from five flights versus 10 flights over the growing season. This demonstrates a more valuable and efficient approach to using UAVs for HTP, while also proposing strategies to add further value.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Identifying Critical Infrastructure in Imagery Data Using Explainable Convolutional Neural Networks

To date, no method utilizing satellite imagery exists for detailing the locations and functions of critical infrastructure across the United States, making response to natural disasters and other events challenging due to complex infrastructural interdependencies. This paper presents a repeatable, transferable, and explainable method for critical infrastructure analysis and implementation of a robust model for critical infrastructure detection in satellite imagery. This model consists of a DenseNet-161 convolutional neural network, pretrained with the ImageNet database. The model was provided additional training with a custom dataset, containing nine infrastructure classes. The resultant analysis achieved an overall accuracy of 90%, with the highest accuracy for airports (97%), hydroelectric dams (96%), solar farms (94%), substations (91%), potable water tanks (93%), and hospitals (93%). Critical infrastructure types with relatively low accuracy are likely influenced by data commonality between similar infrastructure components for petroleum terminals (86%), water treatment plants (78%), and natural gas generation (78%). Local interpretable model-agnostic explanations (LIME) was integrated into the overall modeling pipeline to establish trust for users in critical infrastructure applications. The results demonstrate the effectiveness of a convolutional neural network approach for critical infrastructure identification, with higher than 90% accuracy in identifying six of the critical infrastructure facility types.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Deep Convolutional Neural Networks Exploit High-Spatial- and -Temporal-Resolution Aerial Imagery to Phenotype Key Traits in Miscanthus

Miscanthus is one of the most promising perennial crops for bioenergy production, with high yield potential and a low environmental footprint. The increasing interest in this crop requires accelerated selection and the development of new screening techniques. New analytical methods that are more accurate and less labor-intensive are needed to better characterize the effects of genetics and the environment on key traits under field conditions. We used persistent multispectral and photogrammetric UAV time-series imagery collected 10 times over the season, together with ground-truth data for thousands of Miscanthus genotypes, to determine the flowering time, culm length, and biomass yield traits. We compared the performance of convolutional neural network (CNN) architectures that used image data from single dates (2D-spatial) versus the integration of multiple dates by 3D-spatiotemporal architectures. The ability of UAV-based remote sensing to rapidly and non-destructively assess large-scale genetic variation in flowering time, height, and biomass production was improved through the use of 3D-spatiotemporal CNN architectures versus 2D-spatial CNN architectures. The performance gains of the best 3D-spatiotemporal analyses compared to the best 2D-spatial architectures manifested in up to 23% improvements in R2, 17% reductions in RMSE, and 20% reductions in MAE. The integration of photogrammetric and spectral features with 3D architectures was crucial to the improved assessment of all traits. In conclusion, our findings demonstrate that the integration of high-spatiotemporal-resolution UAV imagery with 3D-CNNs enables more accurate monitoring of the dynamics of key phenological and yield-related crop traits. This is especially valuable in highly productive, perennial grass crops such as Miscanthus, where in-field phenotyping is especially challenging and traditionally limits the rate of crop improvement through breeding.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Waffle Homes: Utilizing Aerial Imagery of Unfinished Buildings to Determine Average Room Size

A primary function of the Population Density Tables Project (PDT) at Oak Ridge National Laboratory is to produce residential population densities per 1000 sq. ft. for each country and their associated first-level administrative units. This is accomplished by utilizing the average size of different types of dwelling areas (urban, rural, single-family, multi-family, etc.) and the average household size provided by a country’s Census or statistical bureau records. This data is available for the majority of Europe, North America, and large swathes of Asia, but is less easily found in Africa and South America. In these regions, Censuses generally report dwelling area by number of rooms, which poses the challenging question of how we can translate number of rooms to dwelling size when no dwelling size areas are available with which to compare. Using sub-meter resolution satellite imagery of Accra, Ghana, this challenge can be tackled using imagery of roofless buildings currently under construction that show the interior floor plan of the dwelling. A sample of buildings from the different neighborhoods of Accra can be digitized to provide an estimate and range of average room sizes of dwellings. This average room size can then be translated to a total dwelling area using the "number of rooms occupied by a household" variable from the Ghanaian Census. This intermediate step between average dwelling size and number of rooms occupied, fills the missing link that prevents PDT from continually producing new population densities for countries where dwelling size is unavailable through any official means.

Woody, Carson↗
DOE OSTI2026

Dronebase Photovoltaic (PV) Fleet Imagery Quantitative Evaluation (CRADA CRD-22-22941 Final Report)

Combine the Dronebase aerial imagery with corresponding sites in the NLR Photovoltaic (PV) Fleets database. By combining these two data sources in an aggregated, anonymized fashion, we can perform the following analyses: quantifying power loss due to outages caused by stuck trackers, string outages, and shading/snow, validate site metadata, including tilt and azimuth, and correlate.

14 SOLAR ENERGY↗
DOE OSTI2025

Assessing the Impacts of Extreme Weather Events on Photovoltaic Installations Using Remote Sensing Imagery

In this study, we analyze poststorm satellite imagery to assess solar photovoltaic (PV) damage for over 11,300 systems following a catastrophic hailstorm in Austin, TX, in September 2023, which produced softball‐sized hail and for over 1500 systems across Puerto Rico and the US Virgin Islands after Hurricanes Irma and Maria in September 2017. Findings show that approximately 5.5% of identified PV sites were damaged in the hailstorm and approximately 17% of PV installations were damaged after the hurricanes. A weak correlation between hurricane wind gust speed and percent site damage was determined, with installation practices playing a heavy role in site resilience. Additionally, we show that newer module vintages are more susceptible to hail damage than older modules, possibly due to a convergence of larger size modules, decreased frame dimensions, and decreased front glass thickness but more research is needed. For hail sizes of 60 mm or greater, consistent hail damage is sustained by PV installations, regardless of system configuration.

14 SOLAR ENERGY↗
DOE OSTI2023

Using deep transfer learning and satellite imagery to estimate urban air quality in data-poor regions

Urban air pollution is a critical public health challenge in low-and-middle-income countries (LMICs). At the same time, LMICs tend to be data-poor, lacking adequate infrastructure to monitor air quality (AQ). As LMICs undergo rapid urbanization, the socio-economic burden of poor AQ will be immense. Here we present a globally scalable two-step deep learning (DL) based approach for AQ estimation in LMIC cities that mitigates the need for extensive AQ infrastructure on the ground. We train a DL model that can map satellite imagery to AQ in high-income countries (HICs) with sufficient ground data, and then adapt the model to learn meaningful AQ estimates in LMIC cities using transfer learning. The trained model can explain up to 54% of the variation in the AQ distribution of the target LMIC city without the need for target labels. The approach is demonstrated for Accra in Ghana, Africa, with AQ patterns learned and adapted from two HIC cities, specifically Los Angeles and New York.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Selecting Post-Processing Schemes for Accurate Detection of Small Objects in Low-Resolution Wide-Area Aerial Imagery

In low-resolution wide-area aerial imagery, object detection algorithms are categorized as feature extraction and machine learning approaches, where the former often requires a post-processing scheme to reduce false detections and the latter demands multi-stage learning followed by post-processing. In this paper, we present an approach on how to select post-processing schemes for aerial object detection. We evaluated combinations of each of ten vehicle detection algorithms with any of seven post-processing schemes, where the best three schemes for each algorithm were determined using average F-score metric. The performance improvement is quantified using basic information retrieval metrics as well as the classification of events, activities and relationships (CLEAR) metrics. We also implemented a two-stage learning algorithm using a hundred-layer densely connected convolutional neural network for small object detection and evaluated its degree of improvement when combined with the various post-processing schemes. The highest average F-scores after post-processing are 0.902, 0.704 and 0.891 for the Tucson, Phoenix and online VEDAI datasets, respectively. The combined results prove that our enhanced three-stage post-processing scheme achieves a mean average precision (mAP) of 63.9% for feature extraction methods and 82.8% for the machine learning approach.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

L0 Data from the 2018 NGEE Arctic LiDAR and Imagery Unoccupied Aerial System Campaign at the Teller 47 Field Site, Seward Peninsula, Alaska

Airborne remote sensing data collected from Los Alamos National Laboratory's (LANL) heavy-lift unoccupied aerial system (UAS) hexacopter platform operated by NGEE Arctic scientists from EES-14 (Earth System Observations group) at Los Alamos National Laboratory. These data were collected in July 2018 at a field site near mile marker 47 along the Teller road between Nome, Alaska and Teller, Alaska. A DJI Matrice 600 Pro Airframe and Routescene UAV LiDARSystem was used to collect LiDAR data, and DJI Phantom 4 Advanced was used to collect optical red/green/blue (RGB) imagery at regular intervals along 11 flight paths. This data package contains unprocessed data products (processing level 0) including flight paths, raw photos, and raw lidar data files (*.kml, *.jpg, and *.lpd formats). Ancillary aircraft data, flight mission parameters, and general flight conditions are also included (see Supplemental Files, *.rinex, and *.rtcm3 files). The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy’s Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy’s Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Influence of soil heterogeneity on soybean plant development and crop yield evaluated using time-series of UAV and ground-based geophysical imagery

Understanding the interactions among agricultural processes, soil, and plants is necessary for optimizing crop yield and productivity. This study focuses on developing effective monitoring and analysis methodologies that estimate key soil and plant properties. These methodologies include data acquisition and processing approaches that use unmanned aerial vehicles (UAVs) and surface geophysical techniques. In particular, we applied these approaches to a soybean farm in Arkansas to characterize the soil–plant coupled spatial and temporal heterogeneity, as well as to identify key environmental factors that influence plant growth and yield. UAV-based multitemporal acquisition of high-resolution RGB (red–green–blue) imagery and direct measurements were used to monitor plant height and photosynthetic activity. We present an algorithm that efficiently exploits the high-resolution UAV images to estimate plant spatial abundance and plant vigor throughout the growing season. Such plant characterization is extremely important for the identification of anomalous areas, providing easily interpretable information that can be used to guide near-real-time farming decisions. Additionally, high-resolution multitemporal surface geophysical measurements of apparent soil electrical conductivity were used to estimate the spatial heterogeneity of soil texture. By integrating the multiscale multitype soil and plant datasets, we identified the spatiotemporal co-variance between soil properties and plant development and yield. Our novel approach for early season monitoring of plant spatial abundance identified areas of low productivity controlled by soil clay content, while temporal analysis of geophysical data showed the impact of soil moisture and irrigation practice (controlled by topography) on plant dynamics. Our study demonstrates the effective coupling of UAV data products with geophysical data to extract critical information for farm management.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

SCOPE: Spectral cloud optical property estimation using real-time GOES-R longwave imagery

The output of ground-based, solar power generation systems is strongly dependent on cloud cover, which is the main contributor to solar power variability and uncertainty. Cloud optical properties are typically over-simplified in forecasting applications due to the lack of realtime, accurate estimates. In this work, we introduce a method, the Spectral Cloud Optical Property Estimation (SCOPE), for estimating cloud optical properties directly from high-resolution (5-min, 2 km) imagery from Geostationary Operational Environmental Satellite (GOES)-R, which is the newest generation of the GOES system. The SCOPE method couples a two-stream, spectrally resolved radiative model with the longwave GOES-R sensor output to simultaneously estimate the cloud optical depth, cloud top height, and cloud thickness during both day and night at 5-min intervals. The accuracy of SCOPE is evaluated using one year (2018) of downwelling longwave (DLW) radiation measurements from the Surface Radiation Budget Network, which consists of seven sites spread across climatically diverse regions of the contiguous United States. During daytime clear-sky periods, SCOPE predicts DLW within instrument uncertainty (10 W m -2 ) for four of the seven locations, with the remaining locations yielding errors of the order of 11.2, 17.7, and 20.2 W m -2 . For daytime cloudy-sky, daytime all-sky (clear or cloudy), and nighttime all-sky periods, SCOPE achieves root mean square error values of 23.0–34.5 W m -2 for all seven locations. These results, together with the low-latency of the method (1 s per sample), show that SCOPE provides a viable solution to real-time, accurate estimation of cloud optical properties for both day and night.

42 ENGINEERING↗
DOE OSTI2023

Automated remote sensing tools to counter illicit maritime activity: vessel detection, bathymetry and topography from WorldView imagery

Illicit maritime activity, such as piracy and smuggling, is a global issue that often occurs in areas where interdiction authorities are sparse, ground-based monitoring technologies like radar lack range and coverage, and dark vessels abound. Our objective was to assess vessel congregation patterns, identify likely beaching areas based on terrain maps, and use them to narrow the search for potential smuggling transfer and overland routes in a specific region along the Puntland coast of Somalia. To accomplish this goal, we developed automated protocols applied to WorldView satellite imagery for (1) vessel detection and size classification, (2) shallow-water bathymetric characterization, and (3) coastal topography mapping. Utilizing a single sensor for vessel detection and topographic and bathymetric extraction at high spatial resolution and at a high re-visit rate provides a simplification to near-shore characterization for monitoring purposes. The extracted topography and bathymetry are then presented as a single, comprehensive perspective of a coastal region. The vessel-detection algorithm identified all vessels larger than approximately 15 metres in length (35 of 35), but misidentified six artefacts (i.e. false positives), resulting in an overall accuracy of 85%. The combined vessel and terrain maps facilitated the identification of a potential beaching and overland transportation route location.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2025

Breaking the barrier of human-annotated training data for machine learning-aided plant research using aerial imagery

Machine learning (ML) can accelerate biological research. However, the adoption of such tools to facilitate phenotyping based on sensor data has been limited by (i) the need for a large amount of human-annotated training data for each context in which the tool is used and (ii) phenotypes varying across contexts defined in terms of genetics and environment. This is a major bottleneck because acquiring training data is generally costly and time-consuming. This study demonstrates how a ML approach can address these challenges by minimizing the amount of human supervision needed for tool building. A case study was performed to compare ML approaches that examine images collected by an uncrewed aerial vehicle to determine the presence/absence of panicles (i.e. “heading”) across thousands of field plots containing genetically diverse breeding populations of 2 Miscanthus species. Automated analysis of aerial imagery enabled the identification of heading approximately 9 times faster than in-field visual inspection by humans. Leveraging an Efficiently Supervised Generative Adversarial Network (ESGAN) learning strategy reduced the requirement for human-annotated data by 1 to 2 orders of magnitude compared to traditional, fully supervised learning approaches. The ESGAN model learned the salient features of the data set by using thousands of unlabeled images to inform the discriminative ability of a classifier so that it required minimal human-labeled training data. This method can accelerate the phenotyping of heading date as a measure of flowering time in Miscanthus across diverse contexts (e.g. in multistate trials) and opens avenues to promote the broad adoption of ML tools.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Haze Mitigation in High-Resolution Satellite Imagery using Enhanced Style-Transfer Neural Network and Normalization Across Multiple GPUs

Despite recent advances in deep learning approaches, haze mitigation in large satellite images is still a challenging problem. Due to amorphous nature of haze, object detection or image segmentation approaches are not applicable. Also it is practically infeasible to obtain ground truths for training. Bounded memory capacity of GPUs is another constraint that limits the size of image to be processed. In this paper, we propose a style transfer based neural network approach to mitigate haze in a large overhead imagery. The network is trained without paired ground truths; further, perception loss is added to restore vivid colors, enhance contrast and minimize artifacts. The paper also illustrates our use of multiple GPUs in a collective way to produce a single coherent clear image where each GPU dehazes different portions of a large hazy image.

Park, Byung↗
DOE OSTI2021

Automated Registration of Vector Data to Overhead Imagery

The availability of open source, remote sensing-derived vector data has increased exponentially in recent years. Unfortunately, these vector data are rarely made available with the corresponding source images from which objects were extracted. As such, these derived datasets are commonly used in combination with target images which differ from the source. Satellite viewing geometry can cause objects, extracted from a source image, to appear shifted when overlaid with a target image. Whether for purely cartographic purposes, reusability of preexisting training labels, or any spatial analysis where spatial correspondence between vector and image are required, the following paragraphs outline a method to address this challenge through the automated registration of vector data to overhead imagery, including existing literature regarding this challenge, followed by a case study of Sioux Falls, South Dakota.

McKee, Jacob↗
DOE OSTI2024

Introducing SpaceNet 9 - Cross-Modal Satellite Imagery Registration for Natural Disaster Responses

Computer vision algorithms are increasingly leveraged to accelerate geospatial analysis for disaster response and recovery. As the diversity of remote sensing imagery grows with optical, SAR, and other modalities, a perquisite for analytics is cross-modal image registration. There is a high potential to harness computer vision for this pre-processing requirement toward enabling downstream analytics such as heterogeneous change detection, automated feature extraction, and data fusion. Advancement in these areas has the potential to simplify data wrangling tasks and further accelerate disaster response timelines. The SpaceNet 9 challenge (launching in mid-2024) focuses on addressing the cross-modal image registration problem and demonstrating the utility of such modules on earthquake impacted scenarios. This paper describes the motivation for the SpaceNet 9 and provides a first overview of the dataset, the baseline algorithm, and implications for seeking cross-modal image registration in Earth observation. Code is available at https://github.com/SpaceNetChallenge/SpaceNet9.

Hansch, Ronny↗
DOE OSTI2024

Deep Learning Scene Classification Experiments in Automatic Detection of Slums on Planetscope Imagery

Population growth is increasingly happening in slum settlements of the large urban centers in the Global South. The term "slum" encompasses a wide range of communities, located mostly in underserved areas, and often exhibiting distinct structural and functional informalities with a relatively high concentration of marginalized populations. To address the issues confronting slums for effective planning and development, including the realistic estimation of the resident population, identifying them accurately is fundamental. Given the disagreements over a universal definition, diverse characteristic features, and socio-political limitations, global detection of slums is a veritable challenge. In this paper, we present experiments in slum detection using a scene classification algorithm and 3-meter spatial resolution satellite imagery. We train and evaluate the model for slum detection in Mumbai, India for the year 2023 and test the temporal generalization of the trained model on Mumbai in 2020 and 2018. In addition, we explore the pathways toward geographic generalization to Kolkata and Delhi (India). We discuss several limitations in the workflow and model, situate our findings in the existing literature, and suggest improvements and alternatives. With this, we establish baseline methods and experiments as a first step towards developing an image-based global slum detection framework and algorithm. This work adds to the community discussion on methods, data challenges, and open questions related to the detection of slums globally. With this research, we hope to improve our understanding of human settlements, especially in critical areas, improve population estimates, and help measure progress towards the sustainable development goals.

Arndt, Jacob↗
DOE OSTI2021

Large-Scale Classification of Urban Structural Units From Remote Sensing Imagery

Remote sensing in combination with deep learning has become instrumental for efficiently and accurately classifying land-use and land-cover across large geographic areas. These technologies have also been successful in characterizing urban environments in terms of their structural units, structure types, or morphological regions. In these approaches, an urban area is partitioned into regions that exhibit homogeneous physical characteristics. However, existing approaches are typically limited to a single city, use inconsistent typologies, and lack scalability and generalization capacity. In this article, we propose an urban structural units categorization scheme and demonstrate its utility by applying it to 13 cities. Inspired by the lack of scalability and generalization capacity in urban structural units mapping, we extend the reach of deep learning and conduct a set of classification experiments in all 13 cities. These experiments offer insights into the strengths and limitations of deep neural networks for classifying urban structural units over diverse geographic regions and on heterogeneous collections of satellite imagery. The efficacy of the proposed deep learning approach is compared to a baseline method of multiscale image features and support vector machines. Our validation on five cities shows that better performance is achieved with deep neural networks. Additionally, we evaluate the impact of input size, model depth, and spatial pyramid pooling to assess the generalization capacity of deep neural networks.

47 OTHER INSTRUMENTATION↗