Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Imagery”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,261 records · Page 70

deadtrees.earth — An open-access and interactive database for centimeter-scale aerial imagery to uncover global tree mortality dynamics

Excessive tree mortality is a global concern and remains poorly understood as it is a complex phenomenon. We lack global and temporally continuous coverage on tree mortality data. Ground-based observations on tree mortality, e.g., derived from national inventories, are very sparse, and may not be standardized or spatially explicit. Earth observation data, combined with supervised machine learning, offer a promising approach to map overstory tree mortality in a consistent manner over space and time. However, global-scale machine learning requires broad training data covering a wide range of environmental settings and forest types. Low altitude observation platforms (e.g., drones or airplanes) provide a cost-effective source of training data by capturing high-resolution orthophotos of overstory tree mortality events at centimeter-scale resolution. Here, we introduce deadtrees.earth, an open-access platform hosting more than two thousand centimeter-resolution orthophotos, covering more than 1,000,000 ha, of which more than 58,000 ha are manually annotated with live/dead tree classifications. This community-sourced and rigorously curated dataset can serve as a comprehensive reference dataset to uncover tree mortality patterns from local to global scales using space-based Earth observation data and machine learning models. This will provide the basis to attribute tree mortality patterns to environmental changes or project tree mortality dynamics to the future. The open nature of deadtrees.earth, together with its curation of high-quality, spatially representative, and ecologically diverse data will continuously increase our capacity to uncover and understand tree mortality dynamics.

Citizen science↗

Automatic detection of methane emissions in multispectral satellite imagery using a vision transformer

Curbing methane emissions is among the most effective actions that can be taken to slow down global warming. However, monitoring emissions remains challenging, as detection methods have a limited quantification completeness due to trade-offs that have to be made between coverage, resolution and detection accuracy. Here we show that deep learning can overcome the trade-off in terms of spectral resolution that comes with multi-spectral satellite data, resulting in a methane detection tool with global coverage and high temporal and spatial resolution. We compare our detections with airborne methane measurement campaigns, which suggests that our method can detect methane point sources in Sentinel-2 data down to plumes of 0.01 km 2 , corresponding to 200 to 300 kg CH 4 /h -1 sources. Our model shows an order of magnitude improvement over the state-of-the-art, providing a significant step towards the automated, high resolution detection of methane emissions at a global scale, every few days.

54 ENVIRONMENTAL SCIENCES↗

A Weakly-Supervised, Multitask Deep Learning Framework for Shadow Mitigation in Remote Sensing Imagery

We propose a weakly-supervised, multitask framework for training a convolutional neural network to solve the problem of cloud shadow mitigation given only cloud and shadow masks as labels. The network minimizes the Wasserstein distance between shadows and their proximal sunlit neighborhoods, generating a supervisory signal directly from within the input image. We extract further utility from the shadow mask through multitask learning by introducing an auxiliary task of shadow segmentation. Our approach is advantageous since it performs mitigation in an end-to-end framework which requires only a shadowed image for inference. We apply this process to the Landsat 8 OLI SPARCS validation data set and demonstrate plausible results.

Couwenhoven, Scott↗

SPATIOTEMPORAL TRACKING OF WIDE AREA POWER OUTAGE FROM NIGHT-TIME LIGHT IMAGERY

Monitoring progress of power restoration following extreme events is essential for situational awareness about spatio-temporal distribution of populations without power and to help with response efforts. Because of the proprietary nature of restoration data, and the difficulty in obtaining power outage data from utility companies in near real-time (e.g., during hurricane Maria (2017)), this project used satellite derived nighttime lights data from Visible Infrared Imaging Radiometer Suite (VIIRS) Day/Night Band (DNB) to (i) monitor wide area power outage and (ii) estimate impacted customers over time to assist with restoration. A discussion of the methodology and its implementation during hurricanes Maria (2017) and Eta (2020) is presented in this paper. Future work will focus on calibrating estimated customers based on light intensity and density distribution, and generation of restoration profiles for emergency response.

Kar, Bandana↗

Correlations Between Panoramic Imagery and Gamma-Ray Background in an Urban Area

When searching for radiological sources in an urban area, a vehicle-borne detector system will often measure complex, varying backgrounds primarily from natural gamma-ray sources. Much work has been focused on developing spectral algorithms that retain sensitivity and minimize the false-positive rate even in the presence of such spectral and temporal variability. However, information about the environment surrounding the detector system might also provide useful clues about the expected background, which if incorporated into an algorithm, could improve performance. Recent work has focused on extensive measuring and modeling of urban areas with the goal of understanding how these complex backgrounds arise. This work presents an analysis of panoramic video images and gamma-ray background data collected in Oakland, California, by the radiological multisensor analysis platform (RadMAP) vehicle. Features were extracted from the panoramic images by semantically labeling the images and then convolving the labeled regions with the detector response. A linear model was used to relate the image-derived features to gamma-ray spectral features obtained using nonnegative matrix factorization (NMF) under different regularizations. Here we find some gamma-ray background features correlate strongly with image-derived features that measure the response-adjusted solid angle subtended by sky and buildings, and we discuss the implications for the development of future, contextually aware detection algorithms.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

One-shot gas detection with transformer paired neural networks in Mako collected longwave infrared hyperspectral imagery

To date, careful data treatment workflows and statistical detectors are used to perform hyperspectral image (HSI) detection of any gas contained in a spectral library, which is often expanded with physics models to incorporate different spectral characteristics. In general, surrounding evidence or known gas-release parameters are used to provide confidence in or confirm detection capability, respectively. This makes quantifying detection performance difficult as it is nearly impossible to develop an absolute ground truth for gas target pixel presence in collected HSI. Consequently, developing and comparing new detection methods, especially machine learning (ML)-based methods, is susceptible to subjectivity in derived detection map quality. Here, in this work, we demonstrate the first use of transformer-based paired neural networks (PNNs) for one-shot gas target detection for multiple gases while providing quantitative classification and detection metrics for their use on labeled data. Terabytes of training data are generated from a database of long-wave infrared HSI obtained from historical Mako sensor campaigns over Los Angeles. By incorporating labels, singular signature representations, and a model development pipeline, we can tune and select PNNs to detect multiple gas targets that are not seen in training on a quantitative basis. We additionally assess our test set detections using interpretability techniques widely employed with ML-based predictors, but less common with detection methods relying on learned latent spaces.

Hyperspectral imaging↗

Swirls and scoops: Ice base melt revealed by multibeam imagery of an Antarctic ice shelf

Knowledge gaps about how the ocean melts Antarctica’s ice shelves, borne from a lack of observations, lead to large uncertainties in sea level predictions. Using high-resolution maps of the underside of Dotson Ice Shelf, West Antarctica, we reveal the imprint that ice shelf basal melting leaves on the ice. Convection and intermittent warm water intrusions form widespread terraced features through slow melting in quiescent areas, while shear-driven turbulence rapidly melts smooth, eroded topographies in outflow areas, as well as enigmatic teardrop-shaped indentations that result from boundary-layer flow rotation. Full-thickness ice fractures, with bases modified by basal melting and convective processes, are observed throughout the area. This new wealth of processes, all active under a single ice shelf, must be considered to accurately predict future Antarctic ice shelf melt.

54 ENVIRONMENTAL SCIENCES↗

Conflation of Geospatial POI Data and Ground-level Imagery via Link Prediction on Joint Semantic Graph

With the proliferation of smartphone cameras and social networks, we have rich, multi-modal data about points of interest (POIs) - like cultural landmarks, institutions, businesses, etc. - within a given areas of interest (AOI) (e.g., a county, city or a neighborhood) available to us. Data conflation across multiple modalities of data sources is one of the key challenges in maintaining a geographical information system (GIS) which accumulate data about POIs. Given POI data from nine different sources, and ground-level geo-tagged and scene-captioned images from two different image hosting platforms, in this work we explore the application of graph neural networks (GNNs) to perform data conflation, while leveraging a natural graph structure evident in geospatial data. The preliminary results demonstrate the capacity of a GNN operation to learn distributions of entity (POIs and images) features, coupled with topological structure of entity's local neighborhood in a semantic nearest neighbor graph, in order to predict links between a pair of entities.

Gurav, Rutuja↗

Data for Aerial Imagery Can Detect Nitrogen Fertilizer Effects on Biomass and Stand Health of Miscanthus × giganteus

Miscanthus × giganteus ( Miscanthus ) is a warm-season perennial grass grown for bioenergy feedstock production. Nitrogen (N) fertilizer management is crucial for the sustainability of Miscanthus production. In our two-year study (2018 and 2019), we investigated the role of vegetation indices (VIs) in evaluating N fertilization (0 N, 56 N, 112 N, and 168 N kg ha−1) impacts on Miscanthus biomass yield and stand health. The flight campaigns were conducted early, middle, and late during the summer growing season. Among the VIs, mid-summer growing season NDRE provided the best prediction of fresh biomass (R2 = 0.87 and 0.97) and dry biomass (R2 = 0.89 and 0.97) in 2018 and 2019, respectively. The VIs generally showed that it was possible to distinguish between 0 N and 168 N treatments, but neither 0 N and 56 N kg ha−1 nor 112 N and 168 N kg ha−1 could be separated. The results from this study highlight the importance of moderate application of N (112 kg N ha−1) in improving and maintaining the stand health and biomass yield of Miscanthus over time and suggest that mid-summer growing season VIs, NDRE in particular, can be useful for assessment of Miscanthus stand health and biomass yield.

Biomass Analytics↗