Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “multi-spectral”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Development of A Multi-Spectral Pyrometry Sensor for High-Speed Transient Surface-Temperature Measurements in Combustion-Relevant Harsh Environments

Accurate and high-speed transient surface-temperature measurements of combustion devices including internal combustion (IC) engines, gas turbines, etc., provide validation targets and boundary conditions for computational fluid dynamics models, and are broadly relevant to technology advancements such as performance improvement and emissions reduction. Development and demonstration of a multi-infrared-channel pyrometry-based optical instrument for high-speed surface-temperature measurement is described. The measurement principle is based on multi-spectral radiation thermometry (MRT) and uses surface thermal radiation at four discrete spectral regions and a corresponding emissivity model to obtain surface temperature via non-linear least squares (NLLS) optimization. Rules of thumb for specifying the spectral regions and considerations to avoid interference with common combustion products are developed; the impact of these along with linear and non-linear MRT analysis are assessed as a function of temperature and signal-to-noise ratio. A multi-start method to determine the MRT-solution global optimum is described and demonstrated. The resulting multi-channel transient pyrometry instrument is described along with practical considerations including optical-alignment drift, matching intra-channel transient response, and solution-confidence indicators. The instrument demonstrated excellent >97% accuracy and >99% 2-sigma precision over the 400–800 °C range, with ~20 µs (50 kHz, equivalent to 0.2 cad at 2000 RPM IC-engine operation) transient response in the bench validation.

47 OTHER INSTRUMENTATION↗

Temporal covariance structure of multi-spectral phenotypes and their predictive ability for end-of-season traits in maize

Vegetation indices (VIs) derived from multi-spectral imaging (MSI) platforms can be used to study properties of crop canopy, providing non-destructive phenotypes that could be used to better understand growth curves throughout the growing season. To investigate the amount of variation present in several VIs and their relationship with important end-of-season traits, genetic and residual (co)variances for VIs, grain yield and moisture were estimated using data collected from maize hybrid trials. The VIs considered were Normalized Difference Vegetation Index (NDVI), Green NDVI, Red Edge NDVI, Soil-Adjusted Vegetation Index, Enhanced Vegetation Index and simple Ratio of Near Infrared to Red (Red) reflectance. Genetic correlations of VIs with grain yield and moisture were used to fit multi-trait models for prediction of end-of-season traits and evaluated using within site/year cross-validation. To explore alternatives to fitting multiple phenotypes from MSI, random regression models with linear splines were fit using data collected in 2016 and 2017. Heritability estimates ranging from (0.10 to 0.82) were observed, indicating that there exists considerable amount of genetic variation in these VIs. Furthermore, strong genetic and residual correlations of the VIs, NDVI and NDRE, with grain yield and moisture were found. Considerable increases in prediction accuracy were observed from the multi-trait model when using NDVI and NDRE as a secondary trait. Finally, random regression with a linear spline function shows potential to be used as an alternative to mixed models to fit VIs from multiple time points.

59 BASIC BIOLOGICAL SCIENCES↗

Validation of 2D Te and ne measurements made with Helium imaging spectroscopy in the volume of the TCV divertor

Abstract Multi-spectral imaging of helium atomic emission (HeMSI) has been used to create 2D poloidal maps of T e and n e in TCV’s divertor. To achieve these measurements, TCV’s MANTIS multispectral cameras (Perek et al 2019 Rev. Sci. Instrum. 90 123514) simultaneously imaged four He I lines (two singlet and two triplet) and a He II line (468 nm) from passively present He and He + . The images, which were absolutely calibrated and covered the whole divertor region, were inverted through the assumption of toroidal symmetry to create emissivity profiles and, consequently, line-ratio profiles. A collisional-radiative model (CRM) was applied to the line-ratio profiles to produce 2D poloidal maps of T e and n e . The collisional-radiative modeling was accomplished with the Goto helium CRM code (Zholobenko et al 2018 Nucl. Fusion 58 126006, Zholobenko et al 2018 Technical Report , Goto 2003 J. Quant. Spectrosc. Radiat. Transfer 76 331–44) which accounts for electron-impact excitation (EIE) and deexcitation, and electron–ion recombination (EIR) with He + . The HeMSI T e and n e measurements were compared with co-local Thomson scattering measurements. The two sets of measurements exhibited good agreement for ionizing plasmas: ( 5 eV ⩽ T e ⩽ 60 eV , and 2 × 10 18 m − 3 ⩽ n e ⩽ 3 × 10 19 m − 3 ) in the case of majority helium plasmas, and ( 10 eV ⩽ T e ⩽ 40 eV , 2 × 10 18 m − 3 ⩽ n e ⩽ 3 × 10 19 m − 3 ) in the case of majority deuterium plasmas. However, there were instances where HeMSI measurements diverged from Thomson scattering. When T e ⩽ 10 eV in majority deuterium plasmas, HeMSI deduced inaccurately high values of T e . This disagreement cannot be rectified within the CRM’s EIE and EIR framework. Second, on sporadic occasions within the private flux region, HeMSI produced erroneously high measurements of n e . Multi-spectral imaging of Helium emission has been demonstrated to produce accurate 2D poloidal maps of T e and n e within the divertor of a tokamak for plasma conditions relevant to contemporary divertor studies.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Simultaneous on-chip generation of violet, blue, cyan, green, yellow, orange, and red light from an octave-spanning infrared frequency comb

An integrated, multi-spectral visible-light source could significantly benefit technologies such as displays, medical imaging, spectroscopy, visible-light communications, and astrophysics. However, despite recent advances in chip-scale visible lasers, simultaneously generating light of all colors in a single chip has been challenging. Existing solutions are either not suitable for full chip-scale integration, or are fundamentally difficult to scale. Here we demonstrate the simultaneous on-chip generation of infrared, red, orange, yellow, green, cyan, blue, and violet light. Leveraging the low loss, low dispersion, and high density of modes of an adiabatic multimode silicon nitride (SiN) microresonator, we use a single infrared pump of moderate power (~130 mW) to produce an octave-spanning infrared frequency comb that is then converted to different portions of the visible spectrum. We measure non-mode-locked combs and soliton steps corresponding to mode-locked states, making our comb generator suitable for applications that demand either low or high coherence. Since the required pump power is compatible with high-power lasers demonstrated in the same SiN platform, our multi-octave light generator can be fully integrated in a chip-scale form factor. We envision that such a light source will be a catalyst for the development and deployment of miniaturized multi-spectral technologies for quantum systems, medical imaging, displays, and spectroscopy.

47 OTHER INSTRUMENTATION↗

Integrated and dynamic multi-spectroscopic in situ imaging of plant metabolism at the level of subcellular compartments. Final Report

The goals of this project was to develop integrated multi-spectral molecular imaging technologies (Raman, fluorescence, and mass spectrometry), that can assess, and image metabolic processes at the cellular and subcellular levels of plant organs. These imaging technologies were developed in the context of computational capabilities that integrated multi-spectral images with genome scale models of metabolism. The integrated molecular imaging technologies were developed in the biological context of autophagy that remodels membrane lipid topologies, which control spatially defined subcellular regions within plant cells and optimizes plant biomass productivity during environmental stresses that can limit biomass productivity.

09 BIOMASS FUELS↗

An Unmanned Aerial System (UAS) for concurrent measurements of solar-induced chlorophyll fluorescence and hyperspectral reflectance toward improving crop monitoring

Unmanned aerial system (UAS)-based remote sensing can provide high spatial- and temporal-resolution crop monitoring for precision management. Existing crop monitoring UAS primarily use conventional techniques such as multi-spectral broadband vegetation indices (VIs) to track canopy structure/biomass. Recently developed lightweight hyperspectral sensors can track crop physiology and performance via complementary signals such as solar-induced chlorophyll fluorescence (SIF) and photochemical reflectance index (PRI) that can be derived from hyperspectral reflectance. However, few existing UAS can acquire high-quality SIF and hyperspectral reflectance. Here, we designed a novel UAS that simultaneously captures far-red SIF and hyperspectral reflectance, using a single bifurcated fiber and motorized arm to measure downwelling and upwelling irradiance. The UAS was tested over (1) a heterogeneous corn field with spatially varying crop yield potential and (2) a set of soybean and corn plots under differing nutrient treatments. Our UAS can maintain stability under low-to-moderate winds (2–3 m/s) with <0.4 m geolocation accuracy, <0.1 m altitude drift, and <1.5° error of the fiber optic from nadir position during scanning. Weekly seasonal campaigns reveal that SIF outperforms conventional VIs such as the normalized difference vegetation index (NDVI) for distinguishing plots with different crop yield potential, especially after canopy closure when NDVI tends to saturate. The UAS can capture the diurnal dynamics of SIF and PRI for both corn and soybean. At the seasonal scale, SIF acquired from the UAS correlates well with that from a fixed SIF tower system ( R 2 = 0.81), which measured the same target albeit with different footprints, demonstrating the capability of UAS in characterizing the seasonal progression of crop activity. In conclusion, our newly developed UAS provides high-quality SIF and hyperspectral reflectance, facilitating mechanistic understanding of the physiological control on photosynthesis dynamics. Our findings also imply that this UAS could enable extension of fixed tower-based systems to monitor multiple targets from diurnal to seasonal scales and improve monitoring of heterogeneous fields.

59 BASIC BIOLOGICAL SCIENCES↗

An end-to-end deep learning solution for automated LiDAR tree detection in the urban environment

Cataloging and classifying trees in the urban environment is a crucial step in urban and environmental planning; however, manual collection and maintenance of this data is expensive and time-consuming. Although algorithmic approaches that rely on remote sensing data have been developed for tree detection in forests, they generally struggle in the more varied urban environment. This work proposes a novel end-to-end deep learning method for the detection of trees in the urban environment from remote sensing data. Specifically, we develop and train a novel PointNet-based neural network architecture to predict tree locations directly from LiDAR data augmented with multi-spectral imagery. We compare this model to a number of high-performing baselines on a large and varied dataset in the Southern California region, and find that our method outperforms all baselines in terms of tree detection ability (75.5% F-score) and positional accuracy (2.28 meter root mean squared error), while being highly efficient. We then analyze and compare the sources of errors, and how these reveal the strengths and weaknesses of each approach. Our results highlight the importance of fusing spectral and structural information for remote sensing tasks in complex urban environments.

54 ENVIRONMENTAL SCIENCES↗

Automatic detection of methane emissions in multispectral satellite imagery using a vision transformer

Curbing methane emissions is among the most effective actions that can be taken to slow down global warming. However, monitoring emissions remains challenging, as detection methods have a limited quantification completeness due to trade-offs that have to be made between coverage, resolution and detection accuracy. Here we show that deep learning can overcome the trade-off in terms of spectral resolution that comes with multi-spectral satellite data, resulting in a methane detection tool with global coverage and high temporal and spatial resolution. We compare our detections with airborne methane measurement campaigns, which suggests that our method can detect methane point sources in Sentinel-2 data down to plumes of 0.01 km 2 , corresponding to 200 to 300 kg CH 4 /h -1 sources. Our model shows an order of magnitude improvement over the state-of-the-art, providing a significant step towards the automated, high resolution detection of methane emissions at a global scale, every few days.

54 ENVIRONMENTAL SCIENCES↗

Dynamic gain and frequency comb formation in exceptional-point lasers

Abstract Exceptional points (EPs)—singularities in the parameter space of non-Hermitian systems where two nearby eigenmodes coalesce—feature unique properties with applications such as sensitivity enhancement and chiral emission. Existing realizations of EP lasers operate with static populations in the gain medium. By analyzing the full-wave Maxwell–Bloch equations, here we show that in a laser operating sufficiently close to an EP, the nonlinear gain will spontaneously induce a multi-spectral multi-modal instability above a pump threshold, which initiates an oscillating population inversion and generates a frequency comb. The efficiency of comb generation is enhanced by both the spectral degeneracy and the spatial coalescence of modes near an EP. Such an “EP comb” has a widely tunable repetition rate, self-starts without external modulators or a continuous-wave pump, and can be realized with an ultra-compact footprint. We develop an exact solution of the Maxwell–Bloch equations with an oscillating inversion, describing all spatiotemporal properties of the EP comb as a limit cycle. We numerically illustrate this phenomenon in a 5-μm-long gain-loss coupled AlGaAs cavity and adjust the EP comb repetition rate from 20 to 27 GHz. This work provides a rigorous spatiotemporal description of the rich laser behaviors that arise from the interplay between the non-Hermiticity, nonlinearity, and dynamics of a gain medium.

36 MATERIALS SCIENCE↗

Iterative X-ray spectroscopic ptychography

Spectroscopic ptychography is a powerful technique to determine the chemical composition of a sample with high spatial resolution. In spectro-ptychography, a sample is rastered through a focused X-ray beam with varying photon energy so that a series of phaseless diffraction data are recorded. Each chemical component in the material under investigation has a characteristic absorption and phase contrast as a function of photon energy. Using a dictionary formed by the set of contrast functions of each energy for each chemical component, it is possible to obtain the chemical composition of the material from high-resolution multi-spectral images. This paper presents SPA (spectroscopic ptychography with alternating direction method of multipliers), a novel algorithm to iteratively solve the spectroscopic blind ptychography problem. First, a nonlinear spectro-ptychography model based on Poisson maximum likelihood is designed, and then the proposed method is constructed on the basis of fast iterative splitting operators. SPA can be used to retrieve spectral contrast when considering either a known or an incomplete (partially known) dictionary of reference spectra. By coupling the redundancy across different spectral measurements, the proposed algorithm can achieve higher reconstruction quality when compared with standard state-of-the-art two-step methods. It is demonstrated how SPA can recover accurate chemical maps from Poisson-noised measurements, and its enhanced robustness when reconstructing reduced-redundancy ptychography data using large scanning step sizes is shown.

47 OTHER INSTRUMENTATION↗

A Neural Differential Equation Formulation for Modeling Atmospheric Effects in Hyperspectral Images

Atmospheric correction is the process for removing atmospheric effects from spectral data; a necessary step for recovering salient spectral properties. The complex interactions between the atmosphere and light are dominated by absorbance and scattering physics. Existing methods for modeling atmospheric interactions typically rely on deep knowledge of relevant environmental conditions and high-fidelity numerical simulations of the governing physics in order to obtain accurate estimates of these effects. Additionally, existing approaches often require a subject matter expert for pre/post-processing of the data. Model-based approaches for removing atmospheric effects struggle in situations where such domain expertise is not available, and require significant human effort and computational power even when that expertise is available. In contrast, we propose a data-driven approach the uses Neural Differential Equations (NDEs) to accurately learn the interactions between electromagnetic radiation and the atmospheric without access to location specific environmental information. Once trained, the NDE can be applied bi-directionally; to apply or remove atmospheric effects. We demonstrate the effectiveness and utility of these techniques on an example multi-spectral scene.

Koch, James V.↗

Boundary, SOL, and Divertor Physics Studies on TCV (Final Report for Research Funded by DoE Award DE-SC0020327)

Research supported under this grant was organized around two diagnostic systems installed on the TCV tokamak located at EPFL in Lausanne, Switzerland: Multi-Spectral Imaging (MSI) and Gas-Puff Imaging (GPI). MSI monitors 2-d time-history images of up to 10 spectral lines, in the visible, using identical views for all wavelengths. The primary application of MSI is to infer 2-d time histories of electron temperature and density in the Scrape-Off-Layer (SOL) of diverted plasmas, utilizing ratios of emission from multiple neutral helium lines. The atomic models are validated against 1-d Thomson scattering measurements. SOL density and temperature maps are analyzed to infer divertor dynamics, including particle and power flows, for a variety of divertor configurations, and specifically as flux expansion along the long-legged outboard divertor is systematically varied. GPI is used to measure details of edge fluctuations in the SOL, particularly as a function of plasma triangularity (δ), including both positive and negative δ. A threshold is found, whereby for δ<-0.3, edge turbulence in the far SOL is completely suppressed. Dynamics of the filamentary turbulence was also analyzed using advance machine learning techniques. Research in support of four PhD theses was carried out within the scope of this Award, including 2 at MIT and 2 at EPFL.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Advanced monitoring of soil-vegetation co-dynamics reveals the successive controls of snowmelt on soil moisture and on plant seasonal dynamics in a mountainous watershed

Evaluating the interactions between above- and below-ground processes is important to understand and quantify how ecosystems respond differently to atmospheric forcings and/or perturbations and how this depends on their intrinsic characteristics and heterogeneity. Improving such understanding is particularly needed in snow-impacted mountainous systems where the complexity in water and carbon storage and release arises from strong heterogeneity in meteorological forcing and terrain, vegetation and soil characteristics. This study investigates spatial and temporal interactions between terrain, soil moisture, and plant seasonal dynamics at the intra- and inter-annual scale along a 160 m long mountainous, non-forested hillslope-to-floodplain system in the upper East River Watershed in the upper Colorado River Basin. To this end, repeated UAV-based multi-spectral aerial imaging, ground-based soil electrical resistivity imaging, and soil moisture sensors were used to quantify the interactions between above and below-ground compartments. Results reveal significant soil-plant co-dynamics. The spatial variation and dynamics of soil water content and electrical conductivity, driven by topographic and soil intrinsic characteristics, correspond to distinct plant types, with highest plant productivity in convergent areas. Plant productivity in heavy snow years benefited from more water infiltration as well as a shallow groundwater table depth. In comparison, low snowpack years with an early first bare-ground date, which are linked to an early increase in plant greenness, imply a short period of saturated conditions that leads to lower average and maximum greenness values during the growing season. Overall, these results emphasize the strong impact of snowpack dynamics, and terrain and subsurface characteristics on the heterogeneity in plant type and seasonal dynamics.

54 ENVIRONMENTAL SCIENCES↗

Classification of Wetland Vegetation Based on NDVI Time Series from the HLS Dataset

Natural wetlands are intrinsically heterogeneous and typically composed of a mosaic of ecosystem patches with different vegetation types. Hydrological and biogeochemical processes in wetlands vary strongly among these ecosystem patches. To date, most remote sensing classification approaches for wetland vegetation either rely on coarse images that cannot capture the spatial variability of wetland vegetation or rely on very-high-resolution multi-spectral images that are detailed but very sporadic in time (less than once per year). This study aimed to use NDVI time series, generated from NASA’s HLS dataset, to classify vegetation patches. We demonstrate our approach at a temperate, coastal lake, estuarine marsh. To classify vegetation patches, a standard time series library of the four land-cover patch types was built from referencing specific locations that were identified as “pure” pixels. These were identified using a single-time high-resolution image. We calculated the distance between the HLS-NDVI time series at each pixel and the “pure”-pixel standards for each land-cover type. The resulting true-positive classified rate was >73% for all patch types other than water lily. The classification accuracy was higher in pixels of a more uniform composition. A set of vegetation maps was created for the years 2016 to 2020 at our research site to identify the vegetation changes at the site as it is affected by rapid water elevation increases in Lake Erie. Our results reveal how changes in water elevation have changed the patch distribution in significant ways, leading to the local extinction of cattail by 2019 and a continuous increase in the area cover of water lily patches.

54 ENVIRONMENTAL SCIENCES↗

AICCA: AI-Driven Cloud Classification Atlas

Clouds play an important role in the Earth’s energy budget, and their behavior is one of the largest uncertainties in future climate projections. Satellite observations should help in understanding cloud responses, but decades and petabytes of multispectral cloud imagery have to date received only limited use. This study describes a new analysis approach that reduces the dimensionality of satellite cloud observations by grouping them via a novel automated, unsupervised cloud classification technique based on a convolutional autoencoder, an artificial intelligence (AI) method good at identifying patterns in spatial data. Our technique combines a rotation-invariant autoencoder and hierarchical agglomerative clustering to generate cloud clusters that capture meaningful distinctions among cloud textures, using only raw multispectral imagery as input. Cloud classes are therefore defined based on spectral properties and spatial textures without reliance on location, time/season, derived physical properties, or pre-designated class definitions. We use this approach to generate a unique new cloud dataset, the AI-driven cloud classification atlas (AICCA), which clusters 22 years of ocean images from the Moderate Resolution Imaging Spectroradiometer (MODIS) on NASA’s Aqua and Terra instruments—198 million patches, each roughly 100 km × 100 km (128 × 128 pixels)—into 42 AI-generated cloud classes, a number determined via a newly-developed stability protocol that we use to maximize richness of information while ensuring stable groupings of patches. AICCA thereby translates 801 TB of satellite images into 54.2 GB of class labels and cloud top and optical properties, a reduction by a factor of 15,000. The 42 AICCA classes produce meaningful spatio-temporal and physical distinctions and capture a greater variety of cloud types than do the nine International Satellite Cloud Climatology Project (ISCCP) categories—for example, multiple textures in the stratocumulus decks along the West coasts of North and South America. We conclude that our methodology has explanatory power, capturing regionally unique cloud classes and providing rich but tractable information for global analysis. AICCA delivers the information from multi-spectral images in a compact form, enables data-driven diagnosis of patterns of cloud organization, provides insight into cloud evolution on timescales of hours to decades, and helps democratize climate research by facilitating access to core data.

97 MATHEMATICS AND COMPUTING↗

Hyper Spectral Anomaly Detection

Anomaly detection is a common machine learning (ML) task with growing importance in the fields of imaging, quality assurance, and multiple security related disciplines. Anomaly detection is more difficult than traditional machine learning methods due to the inherent unlabeled nature of the datasets. Existing anomaly detection architectures commonly face challenges with explainability, retaining information related to the relational structure of the data, and false positive rates. Hyperspectral Imaging Anomaly Detection (HSI) is a statistical model that employs vertex and edge weighted graphs to preserve the data’s relationships on different topographical scales. The model is able to generalize from anomaly detection in 2D images to novel datasets related to cyber-security. Furthermore, the use of multi-spectral and other filtering methods results in fewer false positives and increases the explainability of model predictions. When applying HSI to cyber-security datasets, we are able to successfully detect malicious activity with a relatively high degree of accuracy.

97 - MATHEMATICS AND COMPUTING↗

Integrating AI and Multi-sensor Technology for better Bioenergy Preprocessing

Integrating multi-sensor identification with machine learning significantly enhances bioenergy preprocessing by using non-destructive, multi-spectral sensors to improve feedstock purity and quality. This approach not only reduces preprocessing costs but also ensures a more efficient and sustainable bioenergy production process.

09 - BIOMASS FUELS↗