Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Imagery”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

A Weakly-Supervised, Multitask Deep Learning Framework for Shadow Mitigation in Remote Sensing Imagery

We propose a weakly-supervised, multitask framework for training a convolutional neural network to solve the problem of cloud shadow mitigation given only cloud and shadow masks as labels. The network minimizes the Wasserstein distance between shadows and their proximal sunlit neighborhoods, generating a supervisory signal directly from within the input image. We extract further utility from the shadow mask through multitask learning by introducing an auxiliary task of shadow segmentation. Our approach is advantageous since it performs mitigation in an end-to-end framework which requires only a shadowed image for inference. We apply this process to the Landsat 8 OLI SPARCS validation data set and demonstrate plausible results.

Couwenhoven, Scott↗
DOE OSTI2021

SPATIOTEMPORAL TRACKING OF WIDE AREA POWER OUTAGE FROM NIGHT-TIME LIGHT IMAGERY

Monitoring progress of power restoration following extreme events is essential for situational awareness about spatio-temporal distribution of populations without power and to help with response efforts. Because of the proprietary nature of restoration data, and the difficulty in obtaining power outage data from utility companies in near real-time (e.g., during hurricane Maria (2017)), this project used satellite derived nighttime lights data from Visible Infrared Imaging Radiometer Suite (VIIRS) Day/Night Band (DNB) to (i) monitor wide area power outage and (ii) estimate impacted customers over time to assist with restoration. A discussion of the methodology and its implementation during hurricanes Maria (2017) and Eta (2020) is presented in this paper. Future work will focus on calibrating estimated customers based on light intensity and density distribution, and generation of restoration profiles for emergency response.

Kar, Bandana↗
DOE OSTI2021

Correlations Between Panoramic Imagery and Gamma-Ray Background in an Urban Area

When searching for radiological sources in an urban area, a vehicle-borne detector system will often measure complex, varying backgrounds primarily from natural gamma-ray sources. Much work has been focused on developing spectral algorithms that retain sensitivity and minimize the false-positive rate even in the presence of such spectral and temporal variability. However, information about the environment surrounding the detector system might also provide useful clues about the expected background, which if incorporated into an algorithm, could improve performance. Recent work has focused on extensive measuring and modeling of urban areas with the goal of understanding how these complex backgrounds arise. This work presents an analysis of panoramic video images and gamma-ray background data collected in Oakland, California, by the radiological multisensor analysis platform (RadMAP) vehicle. Features were extracted from the panoramic images by semantically labeling the images and then convolving the labeled regions with the detector response. A linear model was used to relate the image-derived features to gamma-ray spectral features obtained using nonnegative matrix factorization (NMF) under different regularizations. Here we find some gamma-ray background features correlate strongly with image-derived features that measure the response-adjusted solid angle subtended by sky and buildings, and we discuss the implications for the development of future, contextually aware detection algorithms.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

One-shot gas detection with transformer paired neural networks in Mako collected longwave infrared hyperspectral imagery

To date, careful data treatment workflows and statistical detectors are used to perform hyperspectral image (HSI) detection of any gas contained in a spectral library, which is often expanded with physics models to incorporate different spectral characteristics. In general, surrounding evidence or known gas-release parameters are used to provide confidence in or confirm detection capability, respectively. This makes quantifying detection performance difficult as it is nearly impossible to develop an absolute ground truth for gas target pixel presence in collected HSI. Consequently, developing and comparing new detection methods, especially machine learning (ML)-based methods, is susceptible to subjectivity in derived detection map quality. Here, in this work, we demonstrate the first use of transformer-based paired neural networks (PNNs) for one-shot gas target detection for multiple gases while providing quantitative classification and detection metrics for their use on labeled data. Terabytes of training data are generated from a database of long-wave infrared HSI obtained from historical Mako sensor campaigns over Los Angeles. By incorporating labels, singular signature representations, and a model development pipeline, we can tune and select PNNs to detect multiple gas targets that are not seen in training on a quantitative basis. We additionally assess our test set detections using interpretability techniques widely employed with ML-based predictors, but less common with detection methods relying on learned latent spaces.

Hyperspectral imaging↗
DOE OSTI2024

Swirls and scoops: Ice base melt revealed by multibeam imagery of an Antarctic ice shelf

Knowledge gaps about how the ocean melts Antarctica’s ice shelves, borne from a lack of observations, lead to large uncertainties in sea level predictions. Using high-resolution maps of the underside of Dotson Ice Shelf, West Antarctica, we reveal the imprint that ice shelf basal melting leaves on the ice. Convection and intermittent warm water intrusions form widespread terraced features through slow melting in quiescent areas, while shear-driven turbulence rapidly melts smooth, eroded topographies in outflow areas, as well as enigmatic teardrop-shaped indentations that result from boundary-layer flow rotation. Full-thickness ice fractures, with bases modified by basal melting and convective processes, are observed throughout the area. This new wealth of processes, all active under a single ice shelf, must be considered to accurately predict future Antarctic ice shelf melt.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Conflation of Geospatial POI Data and Ground-level Imagery via Link Prediction on Joint Semantic Graph

With the proliferation of smartphone cameras and social networks, we have rich, multi-modal data about points of interest (POIs) - like cultural landmarks, institutions, businesses, etc. - within a given areas of interest (AOI) (e.g., a county, city or a neighborhood) available to us. Data conflation across multiple modalities of data sources is one of the key challenges in maintaining a geographical information system (GIS) which accumulate data about POIs. Given POI data from nine different sources, and ground-level geo-tagged and scene-captioned images from two different image hosting platforms, in this work we explore the application of graph neural networks (GNNs) to perform data conflation, while leveraging a natural graph structure evident in geospatial data. The preliminary results demonstrate the capacity of a GNN operation to learn distributions of entity (POIs and images) features, coupled with topological structure of entity's local neighborhood in a semantic nearest neighbor graph, in order to predict links between a pair of entities.

Gurav, Rutuja↗
DOE OSTI2022

Data for Aerial Imagery Can Detect Nitrogen Fertilizer Effects on Biomass and Stand Health of Miscanthus × giganteus

Miscanthus × giganteus ( Miscanthus ) is a warm-season perennial grass grown for bioenergy feedstock production. Nitrogen (N) fertilizer management is crucial for the sustainability of Miscanthus production. In our two-year study (2018 and 2019), we investigated the role of vegetation indices (VIs) in evaluating N fertilization (0 N, 56 N, 112 N, and 168 N kg ha−1) impacts on Miscanthus biomass yield and stand health. The flight campaigns were conducted early, middle, and late during the summer growing season. Among the VIs, mid-summer growing season NDRE provided the best prediction of fresh biomass (R2 = 0.87 and 0.97) and dry biomass (R2 = 0.89 and 0.97) in 2018 and 2019, respectively. The VIs generally showed that it was possible to distinguish between 0 N and 168 N treatments, but neither 0 N and 56 N kg ha−1 nor 112 N and 168 N kg ha−1 could be separated. The results from this study highlight the importance of moderate application of N (112 kg N ha−1) in improving and maintaining the stand health and biomass yield of Miscanthus over time and suggest that mid-summer growing season VIs, NDRE in particular, can be useful for assessment of Miscanthus stand health and biomass yield.

Biomass Analytics↗
DOE OSTI2024

Surface elevation, snow depth, vegetation height, and color imagery from multiple UAV surveys from 2018 to 2023 across a watershed near Teller road mile marker 27, Seward Peninsula, Alaska

Multiple photogrammetric surveys using an unoccupied aerial system (UAS) were performed across a watershed along Teller road on the Seward Peninsula (Alaska) to investigate terrain, vegetation and snowpack properties. This work was led by the environmental geophysics team from Lawrence Berkeley National Laboratory as part of the Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic). The multiple photogrammetric surveys used mostly a DJI Matrice 210 UAS with a DJI X5S camera, Ground Control Points (GCPs) surveyed with a Real Time Kinematic (RTK)-GPS, and a structure from motion (SfM) technique for photogrammetric reconstruction. Digital Surface elevation Models (DSMs) were inferred at various times of year, including near peak in plant and leaf density (July 19 2017), close to peak in snow depth (April 1 2019 and April 11 2022), and at low plant and leaf density of tall after the first bare-ground date (June 9 2019). Snow and canopy height were obtained by subtracting DSMs from a Digital Terrain Model (DTM) proxy inferred from the June 9 2019 survey. The derived products include ortho-mosaiced RGB map, DSMs, a DTM proxy, snow depth (April 2019 and 2022) and canopy height (July 2017). Unprocessed and processed data products are included in this package (processing levels 0-2). Data and metadata are provided as text (*.csv), image (*.jpg), and GeoTiff (*.tif) formats. This metadata document contains a description of the survey and processing steps and the inferred products.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic) was a 15-year research effort (2012-2027) to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy’s Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy’s Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Reference Shapefiles and Pre-trained Random Forest Classification Models for Detecting Aufeis on the North Slope of Alaska in Landsat Imagery

This dataset provides shapefiles and trained machine learning models used for aufeis detection at four sites on the North Slope of Alaska. It includes reference data for evaluating Landsat-based detection methods, supporting research on remote sensing approaches for identifying aufeis. The ReferenceData folder contains ArcGIS shapefiles of semi-automated land cover classifications for 217 Landsat Collection 2 images, categorizing pixels into six classes: aufeis, snow, ground, none, water, and cloud. The SiteBuffers.zip file includes 10-kilometer buffer shapefiles defining regions of interest around four aufeis fields (Canning21, FH1, Firth, and Kuparuk), used to test three detection techniques. Additionally, the TrainedRFModels folder contains six pre-trained Scikit-Learn Random Forest classifiers (100 trees, max depth = 30) designed to predict aufeis presence in Landsat Collection 2 Surface Reflectance images using Red, Blue, SWIR2, NDVI, and NDWI bands. This dataset supports the development and validation of remote sensing methods for mapping aufeis in Arctic environments.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Panama tropical forest digital camera imagery for vegetation phenology, Dec2016-May2019, PA-SLZ, PA-PNM, PA-BCI

Tropical forest phenology monitoring undertaken by use of Wingscapes timelapse cameras (phenocams) at three tropical evergreen forests in Panama: San Lorenzo, Parque Natural Metropolitano, and Barro Colorado Island. Following installation in December 2016, images were acquired every 10 minutes from 10 am to 2 pm daily, ending in May 2019. A total of 37 cameras were mounted on towers and tree branches, and view sunlit canopy or understory forest as follows: PA-SLZ, 11 canopy, 14 understory; PA-PNM, 6 canopy, 2 understory, PA-BCI, 4 canopy (trees also monitored for sap flow). This data package contains a full data description, metadata, species identification guides and summary files showing example fields of view from each camera location as csv and pdf files. The data description provides instructions for download of the full resolution image files, and other summary data products stored on external servers.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

How Low Can You Go? Using Synthetic 3D Imagery to Drastically Reduce Real-World Training Data for Object Detection

Deep convolutional neural networks (DCNNs) currently provide state-of-the-art performance on image classification and object detection tasks, and there are many global security mission areas where such models could be extremely useful. Crucially, the success of these models is driven in large part by the widespread availability of high-quality open source data sets such as Image Net, Common Objects in Context (COCO), and KITTI, which contain millions of images with thousands of unique labels. However, global security relevant objects-of-interest can be difficult to obtain: relevant events are low frequency and high consequence; the content of relevant images is sensitive; and adversaries and proliferators seek to obscure their activities. For these cases where exemplar data is hard to come-by, even fine-tuning an existing model with available data can be effectively impossible. Recent work demonstrated that models can be trained using a combination of real-world and synthetic images generated from 3D representations; that such models can exceed the performance of models trained using real-world data alone; and that the generated images need not be perfectly realistic (Tremblay, et al., 2018). However, this approach still required hundreds to thousands of real-world images for training and fine tuning, which for sparse, global security-relevant datasets can be an unrealistic hurdle. In this research, we validate the performance and behavior of DCNN models as we drive the number of real-world images used for training object detection tasks down to a minimal set. We perform multiple experiments to identify the best approach to train DCNNs from an extremely small set of real-world images. In doing so, we: Develop state-of-the-art, parameterized 3D models based on real-world images and sample from their parameters to increase the variance in synthetic image training data; Use machine learning explainability techniques to highlight and correct through targeted training the biases that result from training using completely synthetic images; and Validate our results by comparing the performance of the models trained on synthetic data to one another, and to a control model created by fine-tuning an existing ImageNet-trained model with a limited number (hundreds) of real-world images.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

A new era of observationally-infused E3SM: GANs for unifying imagery archives

This paper presents an idea to develop a “Rosetta Stone” for unifying observations from various satellite or remote sensors into a common format that would vastly advance our ability to exploit existing datasets for improving predictability within Earth System Models (ESMs). While the applications of such a unified archive are broad, we believe it will be a critical step toward ushering in a new generation of ESMs that are richly informed, guided by, and validated by extensive observational data. With the vast quantity of both remotely-sensed and in-situ data streams available and coming online, new approaches are needed that can harmonize and thus fully exploit these expensive datasets. While we present the broader idea, we point to examples of applications that impact the water cycle and its representation in ESMs.

58 GEOSCIENCES↗
DOE OSTI2021

Data Fusion of Very High Resolution Hyperspectral and Polarimetric SAR Imagery for Terrain Classification

Performing terrain classification with data from heterogeneous imaging modalities is a very challenging problem. The challenge is further compounded by very high spatial resolution. (In this paper we consider very high spatial resolution to be much less than a meter.) At very high resolution many additional complications arise, such as geometric differences in imaging modalities and heightened pixel-by-pixel variability due to inhomogeneity within terrain classes. In this paper we consider the fusion of very high resolution hyperspectral imaging (HSI) and polarimetric synthetic aperture radar (PolSAR) data. We introduce a framework that utilizes the probabilistic feature fusion (PFF) one-class classifier for data fusion and demonstrate the effect of making pixelwise, superpixel, and pixelwise voting (within a superpixel) terrain classification decisions. We show that fusing imaging modality data sets, combined with pixelwise voting within the spatial extent of superpixels, gives a robust terrain classification framework that gives a good balance between quantitative and qualitative results.

47 OTHER INSTRUMENTATION↗