Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “remote imagery”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Large-Scale Classification of Urban Structural Units From Remote Sensing Imagery

Remote sensing in combination with deep learning has become instrumental for efficiently and accurately classifying land-use and land-cover across large geographic areas. These technologies have also been successful in characterizing urban environments in terms of their structural units, structure types, or morphological regions. In these approaches, an urban area is partitioned into regions that exhibit homogeneous physical characteristics. However, existing approaches are typically limited to a single city, use inconsistent typologies, and lack scalability and generalization capacity. In this article, we propose an urban structural units categorization scheme and demonstrate its utility by applying it to 13 cities. Inspired by the lack of scalability and generalization capacity in urban structural units mapping, we extend the reach of deep learning and conduct a set of classification experiments in all 13 cities. These experiments offer insights into the strengths and limitations of deep neural networks for classifying urban structural units over diverse geographic regions and on heterogeneous collections of satellite imagery. The efficacy of the proposed deep learning approach is compared to a baseline method of multiscale image features and support vector machines. Our validation on five cities shows that better performance is achieved with deep neural networks. Additionally, we evaluate the impact of input size, model depth, and spatial pyramid pooling to assess the generalization capacity of deep neural networks.

47 OTHER INSTRUMENTATION↗

Systems and methods for verification and authentication of remote sensing imagery

A system for generating and authenticating remote sensing imagery includes a remote sensing platform. The remote sensing platform includes an imaging sensor and a hardware logic device that is directly coupled to the imaging sensor. The hardware logic device receives image data from the imaging sensor and generates a cryptographic signature based upon the image data. The hardware logic device outputs a signed image that includes the image data and the cryptographic signature. A computing device operated by a downstream user receives the signed image and can determine whether the image data has been modified from its original content based upon the cryptographic signature.

Crosby, Sean Michael↗

Multi-sensor anomalous change detection in remote sensing imagery

Combining multiple satellite remote sensing sources provides a far richer, more frequent view of the earth than that of any single source; the challenge is in distilling these petabytes of heterogeneous sensor imagery into meaningful characterizations of the imaged areas. Meeting this challenge requires effective algorithms for combining multi-modal imagery over time to identify subtle but real changes among the intrinsic data variation. Here, we implement a joint-distribution framework for multi-sensor anomalous change detection (MSACD) that can effectively account for these differences in modality, and does not require any signal resampling of the pixel measurements. This flexibility enables the use of satellite imagery from different sensor platforms and modalities. We use multi-year construction of the SoFi Stadium in California as our testbed, and exploit synthetic aperture radar imagery from Sentinel-1 and multispectral imagery from both Sentinel-2 and Landsat 8. We show results for MSACD using real imagery with implanted, measurable changes, as well as real imagery with real, observable changes, including scaling our analysis over multiple years.

47 OTHER INSTRUMENTATION↗

Quantification of Off-Channel Inundated Habitat for Pacific Chinook Salmon ( Oncorhynchus tshawytscha ) along the Sacramento River, California, Using Remote Sensing Imagery

Off-channel areas are one of the most impacted aquatic habitats by humans globally, as extensive agricultural and urban development has limited them to roughly 10% of historical extent. This is also true for California’s Sacramento River Valley, where historically frequent widespread inundation has been reduced to a few off-channel water bodies along the mid-Sacramento River. This remaining shallow-water habitat provides crucial ecological benefits to multiple avian and fish species, but especially to floodplain-adapted species such as Chinook salmon (Oncorhynchus tshawytscha). Characterizing spatiotemporal off-channel dynamics, including inundation extent and residence time, is fundamental to better understanding the intrinsic value of such habitats and their potential to support recovery actions. Remote sensing techniques have been increasingly used to map surface water at regional and local scales, with improved resolutions. As such, this study maps off-channel inundation areas and describes their temporal dynamics by analyzing pixel-based time- series of multiple water indices, modified Normalized Difference Water Index (mNDWI) and the Automated Water Extraction Index (AWEI), generated from LandSat-8 and Sentinel-2 data between 2013–2021. Quantified off-channel area was similar with each water index and method used, but improved performance was associated with Sentinel-2 products and AWEI index to identify wetted areas under lower mainstem discharges. Results indicate an uneven distribution of off-channel habitat in the study area, with limited inundated areas in upstream reaches (<16% of total off-channel area for greater flows). In addition, much less habitat exists for flows under 400 m 3 /s, an important migration cue for endangered winter-run Chinook salmon, limiting juvenile access to areas with enhanced rearing conditions. Off-channel habitat residence times averaged between 7 and 16 days, primarily defined by the rate of receding flows, with rapid flow recession providing marginal off-channel habitat. This study shows reasonable performance of moderate resolution LandSat-8 and Sentinel-2 remote sensing imagery to characterize shallow-water inundated habitat in higher-order rivers, and as a method to inform restoration and native fish recovery efforts.

54 ENVIRONMENTAL SCIENCES↗

DeepAndes: A Self-Supervised Vision Foundation Model for Multispectral Remote Sensing Imagery of the Andes

By mapping sites at large scales usingremotely sensed data, archaeologists can generate unique insights into long-term demographic trends, interregional social networks, and human adaptations in the past. Remote sensing surveys complement field-based approaches, and their reach can be especially great when combined with deep learning and computer vision techniques. However, conventional supervised deep learning methods face challenges in annotating fine-grained archaeological features at scale. In addition, while recent vision foundation models have shown remarkable success in learning large-scale remote sensing data with minimal annotations, most off-the-shelf solutions are designed for RGB images rather than multispectral satellite imagery, such as the eight-band data used in our study. In this article, we introduce DeepAndes, a transformer-based vision foundation model trained on three million multispectral satellite images, specifically tailored for Andean archaeology. DeepAndes incorporates a customized DINOv2 self-supervised learning algorithm optimized for eight-band multispectral imagery, marking the first foundation model designed explicitly for the Andes region. We evaluate its image understanding performance through imbalanced image classification, image instance retrieval, and pixel-level semantic segmentation tasks. Our experiments show that DeepAndes achieves superior F1 scores, mean average precision, and Dice scores in few-shot learning scenarios, significantly outperforming models trained from scratch or pretrained on smaller datasets. This underscores the effectiveness of large-scale self-supervised pretraining in archaeological remote sensing.

Guo, Junlin [Vanderbilt Univ., Nashville, TN (Unit↗

Assessing the Impacts of Extreme Weather Events on Photovoltaic Installations Using Remote Sensing Imagery

In this study, we analyze poststorm satellite imagery to assess solar photovoltaic (PV) damage for over 11,300 systems following a catastrophic hailstorm in Austin, TX, in September 2023, which produced softball‐sized hail and for over 1500 systems across Puerto Rico and the US Virgin Islands after Hurricanes Irma and Maria in September 2017. Findings show that approximately 5.5% of identified PV sites were damaged in the hailstorm and approximately 17% of PV installations were damaged after the hurricanes. A weak correlation between hurricane wind gust speed and percent site damage was determined, with installation practices playing a heavy role in site resilience. Additionally, we show that newer module vintages are more susceptible to hail damage than older modules, possibly due to a convergence of larger size modules, decreased frame dimensions, and decreased front glass thickness but more research is needed. For hail sizes of 60 mm or greater, consistent hail damage is sustained by PV installations, regardless of system configuration.

14 SOLAR ENERGY↗

Cycle-Consistent Adversarial Networks for Realistic Pervasive Change Generation in Remote Sensing Imagery

This paper introduces a new method of generating realistic pervasive changes in the context of evaluating the effectiveness of change detection algorithms in controlled settings. The method - a cycle-consistent adversarial network (CycleGAN) - requires low quantities of training data to generate realistic changes. Here we show an application of CycleGAN in creating realistic snow-covered scenes of multispectral Sentinel-2 imagery, and demonstrate how these images can be used as a test bed for anomalous change detection algorithms.

97 MATHEMATICS AND COMPUTING↗

UAV remote sensing imagery - Miscanthus trials 2020 - Energy Farm - UIUC

Aerial imagery utilized as input in the manuscript "Deep convolutional neural networks exploit high spatial and temporal resolution aerial imagery to predict key traits in miscanthus" . Data was collected over M. Sacchariflorus and Sinensis breeding trials at the Energy Farm, UIUC in 2020. Flights were performed using a DJI M600 mounted with a Micasense Rededge multispectral sensor at 20 m altitude around solar noon. Imagery is available as tif file by field trial and date (10). The post-processing of raw images into orthophoto was performed in Agisoft Metashape software. Each crop surface model and multispectral orthophoto was stacked into an unique raster stack by date and uploaded here. Each raster stack includes 6 layers in the following order: Layer 1 = crop surface model, Layer 2 = Blue, Layer 3 = Green, Layer 4 = Red, Layer 5 = Rededge, and Layer 6 = NIR multispectral bands. Msa raster stacks were resampled to 1.67 cm spatial resolution and Msi raster stacks were resampled to 1.41 cm spatial resolution to ease their integration into further analysis. 'MMDDYYYY' is the date of data collection, 'MSA' is M. Sacchariflorus trial, 'MSI' is Miscanthus Sinensis trial, 'CSM' is crop surface model layer, and 'MULTSP' are the five multispectral bands.

bioenergy↗

A Weakly-Supervised, Multitask Deep Learning Framework for Shadow Mitigation in Remote Sensing Imagery

We propose a weakly-supervised, multitask framework for training a convolutional neural network to solve the problem of cloud shadow mitigation given only cloud and shadow masks as labels. The network minimizes the Wasserstein distance between shadows and their proximal sunlit neighborhoods, generating a supervisory signal directly from within the input image. We extract further utility from the shadow mask through multitask learning by introducing an auxiliary task of shadow segmentation. Our approach is advantageous since it performs mitigation in an end-to-end framework which requires only a shadowed image for inference. We apply this process to the Landsat 8 OLI SPARCS validation data set and demonstrate plausible results.

Couwenhoven, Scott↗

Identification and Analysis of Backwater Nursery Habitats in the Middle Green River, Utah, during 2014, 2017, and 2018 Using High-Resolution Optical Remotely Sensed Imagery

Low-velocity channel-margin habitats, known as backwaters, serve as important nursery habitats for the endangered Colorado pikeminnow (Ptychocheilus lucius) in the middle Green River between Jensen and Ouray, Utah. The backwater synthesis report for the 1987–2013 period (Grippo et al. 2017) reported a decreased number of backwaters per river mile (RM) and an increased mean backwater size across the middle Green River. Information about backwaters is critical for understanding habitat characteristics that are important for Colorado pikeminnow recruitment. The goal of this study was to determine backwater number and size in the middle Green River using high-resolution imagery for 2018 to add to our understanding of long-term trends of backwater habitat availability across the reach. For comparative analysis of backwater habitats between 2004 and 2018, information for 2004, 2006, 2013, 2014 and 2017 from our previous studies was also utilized (Grippo et al. 2017; Hamada et al. 2017, 2021, and in review). Across the 2004, 2006, 2013, 2014, 2017, and 2018 study years, mean daily flow at the Jensen gage during image collection ranged from 1,220 cfs (2004) to 2,940 cfs (2014), which was approximately 140% greater in 2014 than in 2004. The number of delineated backwaters ranged from 88 (2013) to 245 (2017), and total backwater area ranged from 118,938 m 2 (2006) to 209,611 m 2 (2014). Mean backwater size ranged from 822 m 2 (2017) to 1,508 m 2 (2018), but there was considerable variability in backwater size for each of the study years. Backwater areas differed significantly among the study years based on a Kruskal-Wallis Rank Sum test ( P < 0.001). Pairwise Wilcoxon tests indicated that the median backwater areas in 2017 and 2014 were significantly lower than in the other sample years ( P ≤ 0.05), even though these years had the highest total backwater area. 2018 had the greatest median backwater area, although the distribution of backwater area values was not statistically different from backwater areas measured in 2013 ( P > 0.05). These two years also had the lowest maximum backwater area values among all sample years. The distribution of backwater area values was not significantly different ( P > 0.05) among the 2006, 2004, and 2013 sample years.

54 ENVIRONMENTAL SCIENCES↗

Interactive Rotated Object Detection for Novel Class Detection in Remotely Sensed Imagery

In this paper we propose IRTR-DETR an Interactive and Real-Time Rotated DEtection TRansformer that extends IRTDETR to predict rotated bounding boxes. IRTR-DETR maintains the Human-In-The-Loop (HIL) workflow of IRTDETR but introduces rotation-aware heads for improved detection of objects with arbitrary orientations. Similarly to IRTDETR IRTR-DETR can be trained with a small labeled sample set in an interactive setting but we show that it can also be pretrained on related but not identical data--such as a building damage dataset--before being applied to tasks like identifying buildings under construction. We demonstrate the efficacy of our approach on the publicly available Tiny-DOTA and xBD dataset as well as two study-cases on proprietary datasets of greenhouses and houses under construction ("waffle homes"). Detecting greenhouses is highly relevant in the context of damage assessment while "waffle homes" aid understanding typical floorplans and building codes in different areas both thereby supporting population modeling emergency response and policy planning. Our method outperforms the state of the art in interactive rotated object detection on the Tiny-DOTA dataset by 5.7 percent and improves upon the non interactive RTDETR by 7.85 to 19.39 percent (depending on the number of provided samples) while maintaining its real-time efficiency.

Burges, Marvin [ORNL] (ORCID:0000000312690769)↗

Assessing the Consistency of Estimated Ground Cover Fractions between the BLM AIM Method and Optical Remote Sensing Method

Since 2012, Argonne National Laboratory (Argonne) has supported the Bureau of Land Management (BLM) in developing remote sensing methodologies for long-term environmental monitoring of Palo Verde Mesa in eastern Riverside County, California, including methods for: detailed mapping of ephemeral streams, estimating fractional cover of desert-land surface components (e.g., trees, shrubs, litters, and bare ground), evaluating erosion risk or land stability, and characterizing vegetation alliances using spatial structure and geostatistical approaches. These studies showed the promise of remote sensing for monitoring changes in desert landscapes by providing information that would be difficult to obtain through field surveys. During this time the BLM has also worked to establish long-term monitoring protocols and compiled field-observation data collected using standardized protocols from the Assessment, Inventory, and Monitoring (AIM) strategy. The AIM data can be compared to data derived from remote sensing methods to evaluate their relative operational utility in monitoring landscape change. If ground cover estimated using remotely sensed imagery is comparable to AIM ground cover estimates, then remote sensing can be used to monitor whether any land cover change in desert landscapes may be related to solar energy development. Therefore, the goal of this study was to determine the consistency in ground cover estimates between AIM data and those derived from publicly- available remotely sensed imagery, such as that available through the U.S. Department of Agriculture, National Agricultural Imagery Program (NAIP), to examine feasibility of a remote sensing method for complementing AIM monitoring. Based on the image analysis in this study, we also provide recommendations for how small unmanned aerial system (sUAS) data may be used to complement BLM’s AIM data and NAIP imagery for future vegetation monitoring. The ground cover types we originally planned to investigate were trees, shrubs, and bare ground. However, the small sample size and a limited range of cover fraction of trees and shrubs in the AIM dataset (e.g., 33 samples with a maximum shrub cover of 18%, 14 samples with a maximum tree cover of 17%) did not allow for performing a meaningful evaluation for the remote sensing approach. Therefore, we conducted the study focusing on bare ground, foliar, and rock cover, all of which are indicators reported in the AIM remote sensing dataset.

47 OTHER INSTRUMENTATION↗

Post survey report for AOP Assignable Asset collection of Crested Butte, CO

This report contains details of the National Ecological Observatory Network Airborne Observation Platform (NEON AOP) assignable asset (AA) flight over Crested Butte, Colorado (CO). The report is being prepared for Lawrence Berkeley National Lab (LBNL), the primary clients for the flights who contracted the NEON AOP for flights during June 2018. The report includes a summary of the acquired flight lines over the planned area, results of calibration surveys, and quality assurance (QA) results of the acquired data. Detailed reports on the acquired data and processing results were also delivered with the data. LBNL contracted the AA NEON AOP flights to observe watersheds of interest at Crested Butte with remotely sensed data including high resolution LiDAR, imaging spectroscopy, and high-resolution camera imagery. The remote sensing imagery acquired by the AOP intendeds to support LBNL on an interdisciplinary project on hydrology, biogeochemistry, and ecosystem functioning in the area surrounding the Rocky Mountain Biological Laboratory (RMBL), one of the most prominent ecological study sites in the United States.

2018 NEON and 2025 CHESS Campaigns↗

Multiscale assessment of land surface phenology from harmonized Landsat 8 and Sentinel-2, PlanetScope, and PhenoCam imagery

As the spatial and temporal resolution of remotely sensed imagery has improved over the last four decades, algorithms for monitoring and mapping seasonal changes in surface properties have evolved rapidly. Most recently, the availability of daily PlanetScope imagery has created new opportunities for monitoring the land surface phenology (LSP) of terrestrial ecosystems at high spatial resolution. However, the quality and value of LSP information from PlanetScope imagery have not been systematically examined. In this paper, we evaluate the character and quality of LSP information derived from PlanetScope by comparing time series of vegetation indices and LSP metrics from PlanetScope to corresponding time series and LSP metrics derived from Harmonized Landsat 8 and Sentinel-2 (HLS) imagery and PhenoCams at six sites that span a diverse range of land cover types and climate. Results show that vegetation index time series from all three data sources show high temporal correlation, and LSP metrics derived from HLS, PlanetScope, and PhenoCam show high agreement with negligible bias. Semi-variograms for phenometrics estimated from PlanetScope imagery indicate that the majority of spatial variance captured in PlanetScope phenometrics occurs well below the spatial resolution HLS imagery. At the same time, LSP metrics from HLS are most strongly correlated with the 50–75% quantiles of 3 m LSP metrics from PlanetScope. This indicates that HLS captures the average phenology at sub-pixel scale captured in PlanetScope imagery. Here, our results represent the first comprehensive comparison of LSP metrics estimated from PlanetScope and publicly available moderate spatial resolution imagery, and provide insights regarding: (1) the quality and character of LSP metrics derived from HLS and PlanetScope; and (2) the relative merits and trade-offs associated with the use of each data source for LSP studies.

54 ENVIRONMENTAL SCIENCES↗

BlueHat

"Bluehat" is a collection of python routines to facilitate the analysis of spectral (multispectral and hyperspectral) remote sensing imagery, with an emphasis on various kind of target detection. The package provides collections of utilities that developers can use in producing algorithms for specific target detection scenarios. Although "bluehat" is mostly expected to be used for remote sensing imagery (which often comes from satellite sensors), and although early versions of "bluehat" were used to design algorithms that were then rewritten for onboard processing; "bluehat" itself is not not specially designed for space and/or satellite application.

Theiler, James↗