Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “multispectral imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Optimal band selection for target detection with a LWIR multispectral imager

Multispectral imaging can offer many benefits in cost, complexity, resolution, size, weight, and power, relative to hyperspectral imaging. When designing a multispectral system, spectral bandpasses can be selected using optimization algorithms configured to maximally separate target detection scores between target and background regions. A hyperspectral image (HSI) can serve as the source of data from which band groupings can be tested for optimality. The output of an adaptive cosine estimator target detection algorithm is used in an objective function. Three optimization algorithms are compared: particle swarm, dual annealing, and differential evolution. A global optimum is also found using a brute force approach on the Livermore Computing Syrah supercomputer. Three materials are investigated: calcite, gypsum, and limestone. This is done for 3-, 4-, and 5-band systems. The data originate from a longwave infrared HSI of a material display board. The optimization algorithms were run 30 times for every scenario. Performance statistics (maximum, minimum, mean, standard deviation, and median) based on the separation values are given. Additional characterization was performed using receiver operator characteristic (ROC) curves and the area under the ROC curve. While good performance was obtained for the three optimization algorithms, the dual annealing algorithm produced the highest and most consistent detection separation scores on average.

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

ResSR: A Computationally Efficient Residual Approach to Super-Resolving Multispectral Images

Multispectral imaging (MSI) plays a critical role in material classification, environmental monitoring, and remote sensing. However, MSI sensors typically have wavelength-dependent resolution, which limits downstream analysis. MSI super-resolution (MSI-SR) methods address this limitation by reconstructing all bands at a common high spatial resolution. Existing methods can achieve high reconstruction quality but often rely on spatially-coupled optimization or large learning-based models, leading to significant computational cost and limiting their use in large-scale or time-critical settings. In this paper, we introduce ResSR, a computationally efficient, model-based MSI-SR method that achieves high-quality reconstruction without supervised training or spatially-coupled optimization. Notably, ResSR decouples spectral and spatial processing into two sequential steps. ResSR first computes a spectrally-informed high-resolution estimate of the MSI using singular value decomposition together with a spatially-decoupled approximate forward model. It then applies a residual correction step to restore low-frequency spatial consistency while preserving high-frequency detail recovered by the spectral reconstruction. ResSR achieves comparable or improved reconstruction quality relative to existing MSI-SR methods while being

Sullivan, Haley [ORNL] (ORCID:0000000274069217)↗
DOE OSTI2023

Snapshot multispectral imaging using a diffractive optical network

Abstract Multispectral imaging has been used for numerous applications in e.g., environmental monitoring, aerospace, defense, and biomedicine. Here, we present a diffractive optical network-based multispectral imaging system trained using deep learning to create a virtual spectral filter array at the output image field-of-view. This diffractive multispectral imager performs spatially-coherent imaging over a large spectrum, and at the same time, routes a pre-determined set of spectral channels onto an array of pixels at the output plane, converting a monochrome focal-plane array or image sensor into a multispectral imaging device without any spectral filters or image recovery algorithms. Furthermore, the spectral responsivity of this diffractive multispectral imager is not sensitive to input polarization states. Through numerical simulations, we present different diffractive network designs that achieve snapshot multispectral imaging with 4, 9 and 16 unique spectral bands within the visible spectrum, based on passive spatially-structured diffractive surfaces, with a compact design that axially spans ~72 λ m , where λ m is the mean wavelength of the spectral band of interest. Moreover, we experimentally demonstrate a diffractive multispectral imager based on a 3D-printed diffractive network that creates at its output image plane a spatially repeating virtual spectral filter array with 2 × 2 = 4 unique bands at terahertz spectrum. Due to their compact form factor and computation-free, power-efficient and polarization-insensitive forward operation, diffractive multispectral imagers can be transformative for various imaging and sensing applications and be used at different parts of the electromagnetic spectrum where high-density and wide-area multispectral pixel arrays are not widely available.

36 MATERIALS SCIENCE↗
DOE OSTI2024

NDVI and Multispectral Images, UAS Flights, Council Road Site, Seward Peninsula, Alaska, June 2022

The dataset contains Normalized Difference Vegetation Index (NDVI) and multispectral images collected on June 18, 2022 using an UAS (Unmanned Aerial System) Yuneec H520, Mapir Survey 3, and Parrot Sequoia cameras. This data was created to accompany the following datasets:- NGEE Arctic CO2, CH4 and Energy Eddy-Covariance (EC) Flux Tower Auxiliary Measurements, Council Road Mile Marker 71, Seward Peninsula, Alaska (https://doi.org/10.5440/1526749)- Sun-induced chlorophyll fluorescence/eddy covariance measurements at NGEE Arctic Council site, Seward Peninsula, Alaska, 2022 (https://doi.org/10.15485/2466175)- NGEE Arctic Meteorological Data from Instrumented PCDC Stations, Council Site, Seward Peninsula, Alaska, 2018 - 2023 (https://doi.org/10.5440/1529604)Survey 3 is RGN (Red, Greeen, Near Infra Red) camera with 87° Horizontal Field of View (HFOV) (19mm) f/2.8 Aperture, 550nm/660nm/850nm (Red+Green+NIR) filter transmission and produced geo referenced jpg and raw format images. Parrot Sequoia is a camera with 16 megapixel RGB (Red, Green, Blue) sensor and 1.2 megapixel monochrome sensors in discrete spectral bands: Green (550nm - 40Nm Bandwidth), Red (660nm - 40nm Bandwidth), Red Edge (735nm - 10nm Bandwidth) and Near Infrared (790nm - 40nm Bandwidth).The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Recurrent and convolutional neural networks for sequential multispectral optoacoustic tomography ( MSOT ) imaging

Abstract Multispectral optoacoustic tomography (MSOT) is a beneficial technique for diagnosing and analyzing biological samples since it provides meticulous details in anatomy and physiology. However, acquiring high through‐plane resolution volumetric MSOT is time‐consuming. Here, we propose a deep learning model based on hybrid recurrent and convolutional neural networks to generate sequential cross‐sectional images for an MSOT system. This system provides three modalities (MSOT, ultrasound, and optoacoustic imaging of a specific exogenous contrast agent) in a single scan. This study used ICG‐conjugated nanoworms particles (NWs‐ICG) as the contrast agent. Instead of acquiring seven images with a step size of 0.1 mm, we can receive two images with a step size of 0.6 mm as input for the proposed deep learning model. The deep learning model can generate five other images with a step size of 0.1 mm between these two input images meaning we can reduce acquisition time by approximately 71%.

Juhong, Aniwat↗
DOE OSTI2025

Estimating Switchgrass Biomass Yield and Lignocellulose Composition from UAV-Based Indices

Innovative methods for estimating commercial-scale switchgrass yields and feedstock quality are essential to optimize harvest logistics and biorefinery efficiency for sustainable aviation fuel production. This study utilized vegetation indices (VIs) derived from multispectral images to predict biomass yield and lignocellulose concentrations of advanced bioenergy-type switchgrass cultivars (“Liberty” and “Independence”) under two N rates (28 and 56 kg N ha –1 ). Field-scale plots were arranged in a randomized complete block design (RCBD) and replicated three times at Urbana, IL. Multispectral images captured during the 2021–2023 growing seasons were used to extract VIs. The results show that linear and exponential models outperformed partial least square and random forest models, with mid-August imagery providing the best predictions for biomass, cellulose, and hemicellulose. The green normalized difference vegetation index (GNDVI) was the best univariate predictor for biomass yield (R 2 = 0.86), while a multivariate combination of the GNDVI and normalized difference red-edge index (NDRE) enhanced prediction accuracy (R 2 = 0.88). Cellulose was best predicted using the NDRE (R 2 = 0.53), whereas hemicellulose prediction was most effective with a multivariate model combining the GNDVI, NDRE, NDVI, and green ratio vegetation index (GRVI) (R 2 = 0.44). These findings demonstrate the potential of UAV-based VIs for the in-season estimation of biomass yield and cellulose concentration.

09 BIOMASS FUELS↗
DOE OSTI2023

Integrating LEO and GEO Observations: Toward Optimal Summertime Satellite Precipitation Retrieval

Abstract Reliable quantitative precipitation estimation with a rich spatiotemporal resolution is vital for understanding the Earth’s hydrological cycle. Precipitation estimation over land and coastal regions is necessary for addressing the high degree of spatial heterogeneity of water availability and demand, and for resolving the extremes that modulate and amplify hazards such as flooding and landslides. Advancements in computation power along with unique high spatiotemporal and spectral resolution data streams from passive meteorological sensors aboard geosynchronous Earth-orbiting (GEO) and low Earth-orbiting (LEO) satellites offer exciting opportunities to retrieve information about surface precipitation phenomena using data-driven machine learning techniques. In this study, the capabilities of U-Net–like architecture are investigated to map instantaneous, summertime surface precipitation intensity at the spatial resolution of 2 km. The calibrated brightness temperature products from the Global Precipitation Measurement (GPM) Microwave Imager (GMI) radiometer are combined with multispectral images (visible, near-infrared, and infrared bands) from the Advanced Baseline Imager (ABI) aboard the GOES-R satellites as main inputs to the U-Net–like precipitation algorithm. Total precipitable water and 2-m temperature from the Global Forecast System (GFS) model are also used as auxiliary inputs to the model. The results show that the U-Net–like algorithm can capture fine-scale patterns and intensity of surface precipitation at high spatial resolution over stratiform and convective precipitation regimes. The evaluations reveal the potential of extracting relevant, high spatial features over complex surface types such as mountainous regions and coastlines. The algorithm allows users to interpret the inputs’ importance and can serve as a starting point for further exploration of precipitation systems within the field of hydrometeorology.

Meteorology & Atmospheric Sciences↗
DOE OSTI2023

Multispectral Quantitative Phase Imaging Using a Diffractive Optical Network

As a label‐free imaging technique, quantitative phase imaging (QPI) provides optical path length information of transparent specimens for various applications in biology, materials science, and engineering. Multispectral QPI measures quantitative phase information across multiple spectral bands, permitting the examination of wavelength‐specific phase and dispersion characteristics of samples. Herein, the design of a diffractive processor is presented that can all‐optically perform multispectral quantitative phase imaging of transparent phase‐only objects within a snapshot. The design utilizes spatially engineered diffractive layers, optimized through deep learning, to encode the phase profile of the input object at a predetermined set of wavelengths into spatial intensity variations at the output plane, allowing multispectral QPI using a monochrome focal plane array. Through numerical simulations, diffractive multispectral processors are demonstrated to simultaneously perform quantitative phase imaging at 9 and 16 target spectral bands in the visible spectrum. The generalization of these diffractive processor designs is validated through numerical tests on unseen objects, including thin Pap smear images. Due to its all‐optical processing capability using passive dielectric diffractive materials, this diffractive multispectral QPI processor offers a compact and power‐efficient solution for high‐throughput quantitative phase microscopy and spectroscopy.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Relationships between summertime surface albedo and melt pond fraction in the central Arctic Ocean: The aggregate scale of albedo obtained on the MOSAiC floe

As part of the Multidisciplinary drifting Observatory for the Study of Arctic Climate (MOSAiC), the HELiX uncrewed aircraft system (UAS) was deployed over the sea ice in the central Arctic Ocean during summer 2020. Albedo measurements were obtained with stabilized pyranometers, and melt pond fraction was calculated from orthomosaic imagery from a surface-imaging multispectral camera. This study analyzed HELiX flight data to provide insights on the temporal and spatial evolution of albedo and melt pond fraction of the MOSAiC floe during the melt season as it drifted south through Fram Strait. The surface albedo distributions showed peak values changing from high albedo (0.55–0.6) to lower values (0.3) as the season advanced. Inspired by methods developed for satellite data, an algorithm was established to retrieve melt pond fraction from the orthomosaic images. We demonstrate that the near-surface observations of melt pond fraction were highly dependent on sample area, offering insight into the influence of subgrid scale features and spatial heterogeneity in satellite observations. Vertical observations conducted with the HELiX were used to quantify the influence of melt pond scales on observed surface albedo as a function of sensor footprint. These scaling results were used to link surface-based measurements collected during MOSAiC to broader-scale satellite data to investigate the influence of surface features on observed albedo. Albedo values blend underlying features within the sensor footprint, as determined by the melt pond size and concentration. This study framed the downscaling (upscaling) problem related to the airborne (surface) observations of surface albedo across a variety of spatial scales.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Electrochemical Structure of the Plasma–Liquid Interface

Nonthermal atmospheric pressure plasma in contact with a liquid yields a variety of energetic photons, ions, and electrons, which can be transported into the plasma–liquid interface (PLI). Similar to the electrochemical interface formed between a solid electrode and electrolyte in conventional electrochemical systems, the charge-transfer process across the PLI is able to promote reduction–oxidation (redox) reactions. However, in the case of free plasma jets in contact with liquids, the absence of solid electrodes obscures the spatial locations of the electrochemical half-reactions. Herein, we present a spatial electrochemical measurement technique used to characterize an aqueous solution in contact with an atmospheric pressure plasma jet. The technique is based on measuring the potential difference between two identical Ag/AgCl electrochemical electrodes positioned at different locations within the solution. More specifically, electrochemical maps were made by measuring the potential of one electrochemical electrode positioned at different locations near the PLI with respect to the other electrochemical electrode positioned far away from the PLI in the bulk solution. Regions in the map with negative and positive potential differences between these electrochemical electrodes were used to identify the electrodeless cathode and anode, respectively. Here, visualization of the spatial distribution of molecular colorimetric redox indicators by multispectral imaging revealed that reduction was occurring near the plasma jet centerline while oxidation was occurring further away in solution, which constitutes an independent confirmation of the electrochemical maps.

Absorption↗
DOE OSTI2025

hdsullivan/ResSR

This is the official implementation of ResSR [1]. ResSR is a computationally efficient MSI-SR method that achieves high-quality reconstructions by using a closed-form spectral decomposition along with a spatial residual correction. ResSR applies singular value decomposition to identify correlations across spectral bands, uses pixel-wise computation to upsample the MSI, and then applies a residual correction process to correct the high-spatial frequency components of the upsampled bands. While ResSR is formulated as the solution to a spatially-coupled optimization problem, we use pixel-wise regularization and derive an approximate closed-form solution, resulting in a pixel-wise algorithm with a dramatic reduction in computation that achieves state-of-the-art reconstructions. [1] Duba-Sullivan, H., Reid, E. J., Voisin, S., Bouman, C. A., & Buzzard, G. T. (2024). ResSR: A Computationally Efficient Residual Approach to Super-Resolving Multispectral Images. arXiv preprint arXiv:2408.13225.

Duba-Sullivan, Haley [Oak Ridge National Laborator↗
DOE OSTI2021

Sustainability Trait Modeling of Field-Grown Switchgrass ( Panicum virgatum ) Using UAV-Based Imagery

Unmanned aerial vehicles (UAVs) provide an intermediate scale of spatial and spectral data collection that yields increased accuracy and consistency in data collection for morphological and physiological traits than satellites and expanded flexibility and high-throughput compared to ground-based data collection. In this study, we used UAV-based remote sensing for automated phenotyping of field-grown switchgrass (Panicum virgatum), a leading bioenergy feedstock. Using vegetation indices calculated from a UAV-based multispectral camera, statistical models were developed for rust disease caused by Puccinia novopanici, leaf chlorophyll, nitrogen, and lignin contents. For the first time, UAV remote sensing technology was used to explore the potentials for multiple traits associated with sustainable production of switchgrass, and one statistical model was developed for each individual trait based on the statistical correlation between vegetation indices and the corresponding trait. Also, for the first time, lignin content was estimated in switchgrass shoots via UAV-based multispectral image analysis and statistical analysis. The UAV-based models were verified by ground-truthing via correlation analysis between the traits measured manually on the ground-based with UAV-based data. The normalized difference red edge (NDRE) vegetation index outperformed the normalized difference vegetation index (NDVI) for rust disease and nitrogen content, while NDVI performed better than NDRE for chlorophyll and lignin content. Overall, linear models were sufficient for rust disease and chlorophyll analysis, but for nitrogen and lignin contents, nonlinear models achieved better results. As the first comprehensive study to model switchgrass sustainability traits from UAV-based remote sensing, these results suggest that this methodology can be utilized for switchgrass high-throughput phenotyping in the field.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Multispectral and Thermal Imager Onboard Aerial Platforms Instrument Handbook

The MicaSense Altum imager is an off-the-shelf, synchronized multispectral and thermal camera, combined with a Global Positioning System (GPS) unit and downwelling light sensor (DLS). The Altum takes images of the land surface within its field of view (FOV) across five visible bands and one longwave infrared thermal band. The sensor records the radiance and converts it to digital numbers. Imagery is radiometrically corrected, taking into account the sensor calibration, lens distortions, vignette effects, sun angle, and atmospheric effects (scattering and absorption). The photogrammetry software Agisoft PhotoScan v 1.4 is used to align and stitch the images into a larger composite image using the technique of structure from motion image capture to construct a dense cloud and 3D model of the surface, which is used to produce a digital elevation model of the terrain surveyed and orthomosaic imagery. Land surface leaf area index, albedo, and surface skin temperature are provided for the user. The user can perform raster calculations on the imagery to produce various other vegetative indices, which are used to indicate plant health and land surface characteristics, including Normalized Difference Vegetation Index (NDVI), Green Normalized Difference Vegetation Index (GNDVI), Normalized Difference Water Index (NDWI), surface temperature, and Enhanced_vegetation_index (EVI). This code is provided with the readme file for each data set. The images have a resolution of 20-60 cm/pixel, which are subsampled to 100 cm/pixel.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Batch Active Learning for Multispectral and Hyperspectral Image Segmentation Using Similarity Graphs

Abstract Graph learning, when used as a semi-supervised learning (SSL) method, performs well for classification tasks with a low label rate. We provide a graph-based batch active learning pipeline for pixel/patch neighborhood multi- or hyperspectral image segmentation. Our batch active learning approach selects a collection of unlabeled pixels that satisfy a graph local maximum constraint for the active learning acquisition function that determines the relative importance of each pixel to the classification. This work builds on recent advances in the design of novel active learning acquisition functions (e.g., the Model Change approach in arXiv:2110.07739) while adding important further developments including patch-neighborhood image analysis and batch active learning methods to further increase the accuracy and greatly increase the computational efficiency of these methods. In addition to improvements in the accuracy, our approach can greatly reduce the number of labeled pixels needed to achieve the same level of the accuracy based on randomly selected labeled pixels.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

High-Resolution Image Products Acquired from Mid-Sized Uncrewed Aerial Systems for Land–Atmosphere Studies

We assess the viability of deploying commercially available multispectral and thermal imagers designed for integration on small uncrewed aerial systems (sUASs, <25 kg) on a mid-size Group-3-classification UAS (weight: 25–600 kg, maximum altitude: 5486 m MSL, maximum speed: 128 m/s) for the purpose of collecting a higher spatial resolution dataset that can be used for evaluating the surface energy budget and effects of surface heterogeneity on atmospheric processes than those datasets traditionally collected by instrumentation deployed on satellites and eddy covariance towers. A MicaSense Altum multispectral imager was deployed on two very similar mid-sized UASs operated by the Atmospheric Radiation Measurement (ARM) Aviation Facility. This paper evaluates the effects of flight on imaging systems mounted on UASs flying at higher altitudes and faster speeds for extended durations. We assess optimal calibration methods, acquisition rates, and flight plans for maximizing land surface area measurements. We developed, in-house, an automated workflow to correct the raw image frames and produce final data products, which we assess against known spectral ground targets and independent sources. We intend this manuscript to be used as a reference for collecting similar datasets in the future and for the datasets described within this manuscript to be used as launching points for future research.

47 OTHER INSTRUMENTATION↗