Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Sub-pixel resolution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Light-powered end-to-end neutron detection and imaging with an edge-deployed optical AI chip

Neutron detection is widely used in many applications including nuclear physics, nuclear energy, nuclear technologies and nuclear safeguards. Developing an end-to-end neutron detection and imaging workflow paves way towards fully automated processes for many applications. We implemented an automated workflow for neutron detection experiments which use a solid state image sensor to capture neutron hits as a digital image. We deploy the workflow to an edge-based optical neural network (ONN) to increase the radiation-hardness and lifetime of neutron detection instruments. We present a two-stage neural network framework for detection of neutrons at sub-pixel resolution. The first stage uses a region proposal network to efficiently detect and extract neutron hits from the input camera image. The second stage feeds the extracted hits into a fully connected neural network to predict the sub-pixel hit position. The performance of the two-stage framework is evaluated using the edge-based ONN. The results show that we can achieve above 96% neutron detection accuracy as well as sub-pixel and sub-micron position resolution, while enjoying the advantages of the ONN hardware including radiation-hardness, low energy consumption and high computing speed for integrated edge camera and hardware deployment, when compared with electronic counterparts.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

An extended-source spatial acquisition process based on maximum likelihood criterion for planetary optical communications

This paper describes an extended-source spatial acquisition process based on the maximum likelihood criterion for interplanetary optical communications. The objective is to use the sun-lit Earth image as a receiver beacon and point the transmitter laser to the Earth-based receiver to establish a communication path. The process assumes the existence of a reference image. The uncertainties between the reference image and the received image are modeled as additive white Gaussian disturbances. It has been shown that the optimal spatial acquisition requires solving two nonlinear equations to estimate the coordinates of the transceiver from the received camera image in the transformed domain. The optimal solution can be obtained iteratively by solving two linear equations. Numerical results using a sample sun-lit Earth as a reference image demonstrate that sub-pixel resolutions can be achieved in a high disturbance environment. Spatial resolution is quantified by Cramer-Rao lower bounds.

Yan, Tsun-Yee↗

Detection of edges using local geometry

Researchers described a new representation, the local geometry, for early visual processing which is motivated by results from biological vision. This representation is richer than is often used in image processing. It extracts more of the local structure available at each pixel in the image by using receptive fields that can be continuously rotated and that go to third order spatial variation. Early visual processing algorithms such as edge detectors and ridge detectors can be written in terms of various local geometries and are computationally tractable. For example, Canny's edge detector has been implemented in terms of a local geometry of order two, and a ridge detector in terms of a local geometry of order three. The edge detector in local geometry was applied to synthetic and real images and it was shown using simple interpolation schemes that sufficient information is available to locate edges with sub-pixel accuracy (to a resolution increase of at least a factor of five). This is reasonable even for noisy images because the local geometry fits a smooth surface - the Taylor series - to the discrete image data. Only local processing was used in the implementation so it can readily be implemented on parallel mesh machines such as the MPP. Researchers expect that other early visual algorithms, such as region growing, inflection point detection, and segmentation can also be implemented in terms of the local geometry and will provide sufficiently rich and robust representations for subsequent visual processing.

Gualtieri, J. A.↗

Location and Geologic Setting for the Three U.S. Mars Landers

Super resolution of the horizon at both Viking landing sites has revealed "new" features we use for triangulation, similar to the approach used during the Mars Pathfinder Mission. We propose alternative landing site locations for both landers for which we believe the confidence is very high. Super resolution of VL-1 images also reveals some of the drift material at the site to consist of gravel-size deposits. Since our proposed location for VL-2 is NOT on the Mie ejecta blanket, the blocky surface around the lander may represent the meter-scale texture of "smooth palins" in the region. The Viking Lander panchromatic images typically offer more repeat coverage than does the IMP on Mars Pathfinder, due to the longer duration of these landed missions. Sub-pixel offsets, necessary for super resolution to work, appear to be attributable to thermal effects on the lander and settling of the lander over time. Due to the greater repeat coverage (particularly in the near and mid-fields) and all-panchromatic images, the gain in resolution by super resolution processing is better for Viking than it is with most IMP image sequences. This enhances the study of textural details near the lander and enables the identification rock and surface textures at greater distances from the lander. Discernment of stereo in super resolution im-ages is possible to great distances from the lander, but is limited by the non-rotating baseline between the two cameras and the shorter height of the cameras above the ground compared to IMP. With super resolution, details of horizon features, such as blockiness and crater rim shapes, may be better correlated with Orbiter images. A number of horizon features - craters and ridges - were identified at VL-1 during the misison, and a few hils and subtle ridges were identified at VL-2. We have added a few "new" horizon features for triangulation at the VL-2 landing site in Utopia Planitia. These features were used for independent triangulation with features visible in Viking Orbiter and MGS MOC images, though the actual location of VL-1 lies in a data dropout in the MOC image of the area. Additional information is contained in the original extended abstract.

Parker, T. J.↗

Earth Observing System (EOS) Moderate Resolution Imaging Spectroradiometer (MODIS) Global Snow-Cover Maps

Following the 1999 launch of the Earth Observing System (EOS) Moderate Resolution Imaging Spectroradiometer (MODIS), the capability exists to produce global snow-cover maps on a daily basis at 500-m resolution. Eight-day composite snow-cover maps will also be available. MODIS snow-cover products are produced at Goddard Space Flight Center and archived and distributed by the National Snow and Ice Data Center (NSIDC) in Boulder, Colorado. The products are available in both orbital and gridded formats. An online search and order tool and user-services staff will be available at NSIDC to assist users with the snow products. The snow maps are available at a spatial resolution of 500 m, and 1/4 degree x 1/4 degree spatial resolution, and provide information on sub-pixel (fractional) snow cover. Pre-launch validation work has shown that the MODIS snow-mapping algorithms perform best under conditions of continuous snow cover in low vegetation areas, but can also map snow cover in dense forests. Post-launch validation activities will be performed using field and aircraft measurements from a February 2000 validation mission, as well as from existing satellite-derived snow-cover maps from NOAA and Landsat-7 Enhanced Thematic Mapper Plus (ETM+).

Hall, Dorothy K.↗

Unrolled Video Super-Resolution Network with Autoregressive Prior for the Case of Known Motion

Real-time detection and classification of distant objects is necessary for many national security applications. However, when objects are far from the sensor, they occupy only a small number of pixels in the captured video, limiting the amount of visual detail available for recognition. State-of-the-art classification methods typically rely on high-resolution (HR) video streams to capture characteristic object features, but obtaining such detail is challenging for distant objects that occupy only a few pixels. This motivates the development of video super-resolution (VSR) methods that enhance object classification by recovering fine details from low-pixel representations. Current VSR methods rely either on model-based optimization, which is interpretable but computationally expensive, or on learning-based approaches, which are efficient and high-performing but often lack flexibility and interpretability. In this report, we propose an end-to-end trainable unrolled VSR network, UVSRNet, which super-resolves each frame in a video by exploiting sub-pixel motion between neighboring low-resolution (LR) frames as well as incorporating high-frequency detail from previously super-resolved frames. In particular, by unrolling a plug-and-play (PnP) half-quadratic splitting (HQS) algorithm, we leverage a model-based data-fitting module alongside a learning-based autoregressive prior module. This combination yields a method that maintains the flexibility and interpretability of model-based methods while achieving the performance advantages of learning-based methods.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Recovery of motion parameters from distortions in scanned images

Scanned images, such as those produced by the scanning-laser ophthalmoscope (SLO), show distortions when there is target motion. This is because pixels corresponding to different image regions are acquired sequentially, and so, in essence, are slices of different snapshots. While these distortions create problems for image registration algorithms, they are potentially useful for recovering target motion parameters at temporal frequencies above the frame rate. Stetter, Sendtner and Timberlake measured large distortions in SLO images to recover the time course of rapid horizontal saccadic eye movements. Here, this work is extended with the goal of automatically recovering small eye movements in two dimensions. Eye position during the frame interval is modeled using a low dimensional parametric description, which in turn is used to generate predicted distortions of a reference template. The input image is then registered to the distorted template using normalized cross correlation. The motion parameters are then varied, and the correlation recomputed, to find the motion which maximizes the peak value of the correlation. The location and value of the correlation maximum are determined with sub-pixel precision using biquadratic interpolation, yielding eye position resolution better than 1 arc minute. This method of motion parameter estimation is tested using actual SLO images as well as simulated images. Motion parameter estimation might also be applied to individual video lines in order to reduce pipeline delays for a near real-time system.

Mulligan, Jeffrey B.↗

Effect of sub-pixel sized cloud on vegetation assessment from satellite data

The visible and reflected infrared channels of the NOAA-7 Advanced Very High Resolution Radiometer (AVHRR) are used for environmental monitoring, including agricultural crop assessment. An index consisting of a combination of digital data from these channels is used to screen the AVHRR data for cloud. The effects on spectral signature of sub-pixel sized cloud, which does not fill the entire IFOV of the instrument, are considered. It is shown that, for two different targets, for clear and turbid atmospheric conditions and for various scan angles, cloud which would not be detected during the screening process will cause substantial effects (up to a five-fold decrease) in the data.

Duggin, M. J.↗

Discorpy : algorithms and software for camera calibration and correction

Camera or lens-based detector calibration is essential for spatial accuracy in applications like dimensional tomography, optical metrology, and computer vision. Many methods and software exist yet there is still a lack of approaches that achieve both high accuracy and robustness while being easy to use and capable of handling a wide range of distortions. Radial lens distortion is common in high-resolution X-ray detector optics used in parallel-beam tomography at synchrotrons. Achieving sub-pixel accuracy requires calibrating with an optical target image. Although methods for characterizing radial distortion are well established, acquired images often also include perspective distortion and optical center offset. Here, we present our approaches to individually characterize and correct both types of distortion using a single calibration image, implemented in the Discorpy software.

36 MATERIALS SCIENCE↗

On-Orbit Calibration of ADEOS OCTS with an AVIRIS Underflight

The Ocean Color Temperature Scanner (OCTS) onboard the Advanced Earth Observation Satellite (ADEOS) was launched on August 17, 1996. Calibration of OCTS is required for use of the on-orbit measured data for retrieval of physical properties of the ocean. In the solar reflected portion of the electromagnetic spectrum, OCTS measures images with nominally 700-m spatial resolution through eight multispectral bands. The objective of this research was to establish the absolute radiometric calibration of OCTS on orbit through an underflight by the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS). AVIRIS is a NASA earth-observing imaging spectrometer designed, built and operated by the Jet Propulsion Laboratory (JPL). AVIRIS acquires data from 20-km altitude on a NASA ER-2 aircraft, above most of the Earth's atmosphere. AVIRIS measures the solar reflected spectrum from 370 nm to 2500 nm through 224 contiguous spectral channels. The full width at half maximum (FWHM) of the spectral channels is nominally 10-nm. AVIRIS spectra are acquired as images of 11 km by up to 800 km extent with 20-m spatial resolution. The high spectral resolution of AVIRIS data allows direct convolution to the spectral response functions of the eight multispectral bands of OCTS. The high spatial resolution of AVIRIS data allows for spatial re-sampling of the data to match the ADEOS sensors spatial resolution. In addition, the AVIRIS high spatial resolution allows assessment of the scaling effects due to environmental factors of thin cirrus clouds, sub-pixel cloud cover, white caps, ocean foam, sun-glint, and bright-target adjacency. The platform navigation information recorded by AVIRIS allows calculation of the position and observation geometry of each spectrum for matching to the OCTS measurement. AVIRIS is rigorously characterized and calibrated in the laboratory prior to and following the flight season. The stability and repeatability of AVIRIS calibration have been validated through an extensive series of inflight calibration experiments. In the OCTS portion of the spectrum, using pre-and post-flight runway calibrations of AVIRIS coupled with the on-board calibrator an absolute calibration accuracy of better than 3% spectral, 2% radiometric and 5% spatial has been achieved. An analogous satellite underflight calibration experiment was performed with AVIRIS and the Optical Sensor (OPS) onboard the Japanese Earth Resources Satellite (JERS).

Green, Robert O.↗

On-Orbit Calibration of ADEOS OCTS with an AVIRIS Underflight

The Ocean Color Temperature Scanner (OCTS) onboard the Advanced Earth Observation Satellite (ADEOS) was launched on August 17, 1996. Calibration of OCTS is required for use of the on-orbit measured data for retrieval of physical properties of the ocean. In the solar reflected portion of the electromagnetic spectrum, OCTS measures images with nominally 700-m spatial resolution through eight multispectral bands. The objective of this research was to establish the absolute radiometric calibration of OCTS on orbit through an underflight by the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS). AVIRIS is a NASA Earth-observing imaging spectrometer designed, built and operated by the Jet Propulsion Laboratory (JPL). AVIRIS acquires data from 20-km altitude on a NASA ER-2 aircraft, above most of the Earth's atmosphere. AVIRIS measures the solar reflected spectrum from 370 nm to 2500 nm through 224 contiguous spectral channels. The full width at half maximum (FWHM) of the spectral channels is nominally 10-nm. AVIRIS spectra are acquired as images of 11 km by up to 800 km extent with 20-m spatial resolution. The high spectral resolution of AVIRIS data allows direct convolution to the spectral response functions of the eight multispectral bands of OCTS. The high spatial resolution of AVIRIS data allows for spatial re-sampling of the data to match the ADEOS sensors spatial resolution. In addition, the AVIRIS high spatial resolution allows assessment of the scaling effects due to environmental factors of thin cirrus clouds, sub-pixel cloud cover, white caps, ocean foam, sun-glint, and bright-target adjacency. The platform navigation information recorded by AVIRIS allows calculation of the position and observation geometry of each spectrum for matching to the OCTS measurement. AVIRIS is rigorously characterized and calibrated in the laboratory prior to and following the flight season. The stability and repeatability of AVIRIS calibration have been validated through an extensive series of inflight calibration experiments. In the OCTS portion of the spectrum, using pre- and post-flight runway calibrations of AVIRIS coupled with the on-board calibrator an absolute calibration accuracy of better than 3% spectral, 2% radiometric, and 5% spatial, has been achieved. An analogous satellite underflight calibration experiment was performed with AVIRIS and the Optical Sensor (OPS) onboard the Japanese Earth Resources Satellite (JERS).

Green, Robert O.↗

The Surface Displacement Field of the November 8, 1997, Mw7.6 Manyi (Tibet) Earthquake Observed with ERS InSAR Data

ERS2 radar data acquired before and after the Mw7.6, Manyi (Tibet) earthquake of November 8, 1997, provide geodetic information about the surface displacement produced by the earthquake in two ways. (1) The sub-pixel geometric adjustment of the before and after images provides a two dimensional offset field with a resolution of approx, 1m in both the range (radar line of sight) and azimuth (satellite track) directions. Comparison of offsets in azimuth and range indicates that the displacement along the fault is essentially strike-slip and in a left-lateral sense. The offset map reveals a relatively smooth and straight, N78E surface rupture that exceeds 150 km in length, consistent with the EW plane of the Harvard CMT solution. The rupture follows the trace of a quaternary fault visible on satellite imagery (Tapponnier and Molnar, 1978; Wan Der Woerd, pers. comm.). (2) Interferometric processing of the SAR data provides a range displacement map with a precision of a few millimeters. The slip distribution along the rupture reconstructed from the range change map is a bell-shaped curve in the 100-km long central section of the fault with smaller, local maxima near both ends. The curve shows that the fault slip exceeds 2.2 m in range, or 6.2 in strike-slip, along a 30-km long section of the fault and remains above 1 m in range, approx. 3 m strike-slip, along most of its length. Preliminary forward modeling of the central section of the rupture, assuming a uniform slip distribution with depth, indicates that the slip occur-red essentially between 0 and the depth of 10 km, consistent with a relatively shallow event (Velasco et al., 1998).

Peltzer, G.↗

Super-resolution model for overlapping peak detection and improved spatial resolution in high-energy diffraction microscopy

Reconstruction quality in Far-field High-Energy Diffraction Microscopy (FF-HEDM) is limited by the spatial resolution of area detectors and the frequent occurrence of overlapping diffraction spots. To address these challenges, we developed a super-resolution (SR) framework using convolutional neural networks (CNNs) to recreate 2D diffraction peaks at up to ×8 resolution from raw detector data. A specialized simulation tool was created to generate synthetic training datasets with varying degrees of peak overlap. Integrated into the Microstructural Imaging using Diffraction Analysis Software (MIDAS), the SR model improves the spatial accuracy and precision of 3D grain reconstruction by an order of magnitude. This approach provides a robust solution for investigation of complex micromechanical states and material classes where the analysis is limited by the presence of overlapping peaks. Furthermore, the methodology developed here can potentially be extended to other techniques that require sub-pixel accuracy for high-fidelity data analysis.

High-energy diffraction microscopy↗

Current Status of Aerosol Retrievals from TOMS

Properties of atmospheric aerosols over all land and water surfaces are retrieved from TOMS measurements of backscattered radiances. The TOMS technique, uses observations at two wavelengths. In the near ultraviolet (330-380 nm) range, where the effects of gaseous absorption are negligible. The retrieved properties are optical depth and a measure of aerosol absorptivity, generally expressed as single scattering albedo. The main sources of error of the TOMS aerosol products are sub-pixel cloud contamination and uncertainty on the height above the surface of UV-absorbing aerosol layers. The first error source is related to the large footprint (50 x 50 km at nadir) of the sensor, and the lack of detection capability of sub-pixel size clouds. The uncertainty associated with the height of the absorbing aerosol layers, on the other hand, is related to the pressure dependence of the molecular scattering process, which is the basis of the near-UV method of absorbing aerosol detection. The detection of non-absorbing aerosols is not sensitive to aerosol layer height. We will report on the ongoing work to overcome both of these difficulties. Coincident measurements of high spatial resolution thermal infrared radiances are used to address the cloud contamination issue. Mostly clear scenes for aerosol retrieval are selected by examining the spatial homogeneity of the IR radiance measurements within a TOMS pixel. The approach to reduce the uncertainty associated with the height of the aerosol layer by making use of a chemical transport model will also be discussed.

Torres, O.↗

A Comparison of Seasonal and Interannual Variability of Soil Dust Aerosols Over the Atlantic Ocean as Inferred by the Toms AI and AVHRR AOT Retrievals

The seasonal cycle and interannual variability of two estimates of soil (or 'mineral') dust aerosols are compared: Advanced Very High Resolution Radiometer (AVHRR) aerosol optical thickness (AOT) and Total Ozone Mapping Spectrometer (TOMS) aerosol index (AI), Both data sets, comprising more than a decade of global, daily images, are commonly used to evaluate aerosol transport models. The present comparison is based upon monthly averages, constructed from daily images of each data set for the period between 1984 and 1990, a period that excludes contamination from volcanic eruptions. The comparison focuses upon the Northern Hemisphere subtropical Atlantic Ocean, where soil dust aerosols make the largest contribution to the aerosol load, and are assumed to dominate the variability of each data set. While each retrieval is sensitive to a different aerosol radiative property - absorption for the TOMS AI versus reflectance for the AVHRR AOT - the seasonal cycles of dust loading implied by each retrieval are consistent, if seasonal variations in the height of the aerosol layer are taken into account when interpreting the TOMS AI. On interannual time scales, the correlation is low at most locations. It is suggested that the poor interannual correlation is at least partly a consequence of data availability. When the monthly averages are constructed using only days common to both data sets, the correlation is substantially increased: this consistency suggests that both TOMS and AVHRR accurately measure the aerosol load in any given scene. However, the two retrievals have only a few days in common per month so that these restricted monthly averages have a large uncertainty. Calculations suggest that at least 7 to 10 daily images are needed to estimate reliably the average dust load during any particular month, a threshold that is rarely satisfied by the AVHRR AOT due to the presence of clouds in the domain. By rebinning each data set onto a coarser grid, the availability of the AVHRR AOT is increased during any particular month, along with its interannual correlation with the TOMS AI The latter easily exceeds the sampling threshold due to its greater ability to infer the aerosol load in the presence of clouds. Whether the TOMS AI should be regarded as a more reliable indicator of interannual variability depends upon the extent of contamination by sub-pixel clouds.

Cakmur, R. V.↗

Study of atmospheric and bidirectional effects on surface reflectance and vegetation index time series: Application to NOAA AVHRR and preparation for future space missions

The objectives of the investigation, namely 'to characterize the atmospheric and directional effects on surface reflectance and vegetation index using the First International Satellite Cloud Climatology Project (ISLCSP) Field Experiment (FIFE) data set, develop new algorithms to obtain better Advanced Very High Resolution Radiometer (AVHRR) indices, and define possible improvements for future satellite missions', were addressed in three separate, yet complementary studies. First, it was shown, from theoretical calculations, that visible and near infrared reflectances combined linearly at optimum (one or two) viewing angles relate linearly to the fraction of photosynthetically available radiation absorbed by plants, f(sub par), can be used independently of the type of foliage and substrate, eliminate the effects of sub-pixel spatial heterogeneity, and improve the accuracy of the f(sub par) estimates when compared to the Normalized Difference Vegetation Index, NDVI. Second, it was demonstrated that NDVI, even though it is not a linear combination of radiances or reflectances, can be spatially integrated without significant loss of information from scales of 300 to 1000 m. Third, AVHRR visible and near-infrared reflectances over the FIFE site, separating temporal and bidirectional components and determining the model parameters through an original iterative scheme was successfully modeled. It appears that NDVI generated from the top-of-atmosphere reflectances normalized by the bidirectional effects (as determined in the scheme) is a better vegetation index than maximum NDVI. Details about the three studies are presented.

Frouin, Robert↗

Full complex spatial filtering with a phase mostly DMD

A new technique for implementing fully complex spatial filters with a phase mostly deformable mirror device (DMD) light modulator is described. The technique combines two or more phase-modulating flexure-beam mirror elements into a single macro-pixel. By manipulating the relative phases of the individual sub-pixels within the macro-pixel, the amplitude and the phase can be independently set for this filtering element. The combination of DMD sub-pixels into a macro-pixel is accomplished by adjusting the optical system resolution, thereby trading off system space bandwidth product for increased filtering flexibility. Volume in the larger dimensioned space, space bandwidth-complex axes count, is conserved. Experimental results are presented mapping out the coupled amplitude and phase characteristics of the individual flexure-beam DMD elements and demonstrating the independent control of amplitude and phase in a combined macro-pixel. This technique is generally applicable for implementation with any type of phase modulating light modulator.

Florence, James M.↗