Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image sensor”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,351 records · Page 75

Virtual Sensing with Unsupervised Image-to-Image Translation

Earth observing satellites carrying multi-spectral sensors are widely used to monitor the physical and biological states of the atmosphere, land, and oceans. These satellites have different vantage points above the earth and different spectral imaging bands resulting in inconsistent imagery from one to another. This presents challenges in building downstream applications. What if we could generate synthetic bands for existing satellites from the union of all domains? We tackle the problem of generating synthetic spectral imagery for multispectral sensors as an unsupervised image-to-image translation problem with partial labels and introduce a novel shared spectral reconstruction loss. Simulated experiments performed by dropping one or more spectral bands show that cross-domain reconstruction outperforms measurements obtained from a second vantage point. On a downstream cloud detection task, we show that generating synthetic bands with our model improves segmentation performance beyond our baseline. Our proposed approach enables synchronization of multispectral data and provides a basis for more homogeneous remote sensing datasets.

Geostationary satellites↗

Multi-Sensor Registration of Earth Remotely Sensed Imagery

Assuming that approximate registration is given within a few pixels by a systematic correction system, we develop automatic image registration methods for multi-sensor data with the goal of achieving sub-pixel accuracy. Automatic image registration is usually defined by three steps; feature extraction, feature matching, and data resampling or fusion. Our previous work focused on image correlation methods based on the use of different features. In this paper, we study different feature matching techniques and present five algorithms where the features are either original gray levels or wavelet-like features, and the feature matching is based on gradient descent optimization, statistical robust matching, and mutual information. These algorithms are tested and compared on several multi-sensor datasets covering one of the EOS Core Sites, the Konza Prairie in Kansas, from four different sensors: IKONOS (4m), Landsat-7/ETM+ (30m), MODIS (500m), and SeaWIFS (1000m).

LeMoigne, Jacqueline↗

Wind dynamic range video camera

A television camera apparatus is disclosed in which bright objects are attenuated to fit within the dynamic range of the system, while dim objects are not. The apparatus receives linearly polarized light from an object scene, the light being passed by a beam splitter and focused on the output plane of a liquid crystal light valve. The light valve is oriented such that, with no excitation from the cathode ray tube, all light is rotated 90 deg and focused on the input plane of the video sensor. The light is then converted to an electrical signal, which is amplified and used to excite the CRT. The resulting image is collected and focused by a lens onto the light valve which rotates the polarization vector of the light to an extent proportional to the light intensity from the CRT. The overall effect is to selectively attenuate the image pattern focused on the sensor.

Craig, G. D.↗

Assessment of High Resolution Commercial Satellite Geolocation Accuracy

Commercial companies such as Maxar, PlanetScope, and BlackSky have launched many satellites with revisit times ranging from two hours to one day and have built large archives of high resolution (1-3 m) Earth observing data. The high temporal resolution and global coverage of these satellites makes commercial satellite images ideal for scientists studying rapidly changing processes such as flooding and fires. A key step in assessing changes in these images is co-registration of various images to each other. High geolocation accuracy (at most 0.5 pixels of offset) allows for easy co-registration of images across different times and sensors. Here, we assess the latest PlanetScope imagery and evaluate it for geolocation accuracy. For our assessment, we compare the target image to a reference image with known geolocation accuracy (WorldView imagery) and determine the offset between these images by shifting them to maximize their Pearson Cross-Correlation (PCC) value. Offsets required to maximize the PCC give the geolocation accuracy of the target image relative to the reference image. Previously, our global assessment of Planet data revealed large variability in geolocation accuracy from one continent to another. The measured root mean squared errors (RMSEs) range from 5.4 m in North America to 14.9 m in Africa. We have updated this previous assessment to include both their newest SuperDove series as well as a more robust assessment of the temporal stability of PlanetScope's geolocation accuracy.

Alana G. Semple↗

Aircraft scanner data availability via the version 0 Information Management System

As part of the Earth Observing System Data and Information System (EOSDIS) development, NASA and other government agencies have developed an operational prototype of the Information Management System (IMS). The IMS provides access to the data archived at the Distributed Active Archive Centers (DAAC's) that allows users to search through metadata describing the (image) data. Criteria based on sensor name or type, date and time, and geographic location are used to search the archive. Graphical representations of coverage and browse images are available to further refine a user's selection. previously, the EROS Data Center (EDC) DAAC had identified the Advanced SOlid-state Array Spectrometer (ASAS), Airborne Visible and infrared Imaging Spectrometer (AVIRIS), NS-001, and Thermal Infrared Multispectral Scanner (TIMS) as precursor data sets similar to those the DAAC will handle in the Earth Observing System era. Currently, the EDC DAAC staff, in cooperation with NASA, has transcribed TIMS, NS-001, and Thematic Mapper Simulation (TMS) data from Ames Research Center and also TIMS data from Stennis Space Center. During the transcription process, the IMS metadata and browse images were created to populate the inventory at the EDC DAAC. These data sets are now available in the IMS and may be requested from the any of the DAAC's via the IMS.

Mah, G. R.↗

The regression intersection method of adjusting image data for band ratioing

Estimation of the combined path radiance and sensor offset terms is essential in adjusting multispectral image radiance measurements for band ratioing. Commonly applied techniques for making this estimate have required assumptions or ancillary information regarding the reflectance properties of surface materials. This paper presents a technique that is unique in that it provides absolute (not just relative) statistically-derived estimates without the use of ancillary information. It is termed the regression intersection method (RIM). RIM is based on contrasts between the spectral properties of various homogeneous areas in rugged terrain. These areas are selected by examination of the image data alone. Bispectral regression (first principal component) lines are determined for each area and are projected, in pairs, to intersection points. Ideally, the coordinates of these points must equal the measurements for zero ground radiance since that is the only condition under which spectrally different materials can have the same radiance values. The median result from several site-pair and band-pair comparisons is used in order to statistically mitigate noise and minor variations due to natural variability. Tests show that the method is successful in determining correction values for the image data that result in maximum removal of the topographic effect in ratio images.

Crippen, Robert E.↗

Science and Science-Enabling Activities of the SHERLOC and WATSON Imaging Systems in Jezero Crater, Mars

During its first year of operation, the Perseverance rover explored the cratered and fractured floor of Jezero crater on Mars. Here, we report the use of the Scanning Habitability Environments with Raman and Luminescence for Organics and Chemicals (SHERLOC) imaging system that includes two high-resolution cameras, the Autofocus and Contextual Imager (ACI) and Wide Angle Topographic Sensor for Operations and eNgineering (WATSON). ACI is a fixed focus gray scale imager with a resolution of 10.1 μm/pixel whereas WATSON is a variable field of view, variable focus imager capable of resolution down to 14 μm/pixel. WATSON is a reflight of the MArs Hand Lens Imager (MAHLI) imager and has similar capabilities. During first-time activities, WATSON was used to support both science and engineering operations related to sample and abrasion patch assessment and sample collection and caching. WATSON also documented the deployment of the Ingenuity helicopter. The Crater Floor Campaign identified two primary rock units, the Máaz formation and the Séítah formation, which have been interpreted as lava flows and an olivine cumulate, respectively. Interpretation of rock textures with WATSON and ACI images was limited to abraded surfaces because unmodified outcrop surfaces (herein termed “natural surfaces”) show high degrees of dust covering, wind abrasion, and coating by secondary mineral products. WATSON and ACI images support the hypothesis that the material of both the Máaz and Séítah formations consists of largely aqueously altered mafic materials with varying igneous origins.

WATSON↗

Parallel Processing Systems for Passive Ranging During Helicopter Flight

The complexity of rotorcraft missions involving operations close to the ground result in high pilot workload. In order to allow a pilot time to perform mission-oriented tasks, sensor-aiding and automation of some of the guidance and control functions are highly desirable. Images from an electro-optical sensor provide a covert way of detecting objects in the flight path of a low-flying helicopter. Passive ranging consists of processing a sequence of images using techniques based on optical low computation and recursive estimation. The passive ranging algorithm has to extract obstacle information from imagery at rates varying from five to thirty or more frames per second depending on the helicopter speed. We have implemented and tested the passive ranging algorithm off-line using helicopter-collected images. However, the real-time data and computation requirements of the algorithm are beyond the capability of any off-the-shelf microprocessor or digital signal processor. This paper describes the computational requirements of the algorithm and uses parallel processing technology to meet these requirements. Various issues in the selection of a parallel processing architecture are discussed and four different computer architectures are evaluated regarding their suitability to process the algorithm in real-time. Based on this evaluation, we conclude that real-time passive ranging is a realistic goal and can be achieved with a short time.

Sridhar, Bavavar↗

Spectroradiometric calibration of the Thematic Mapper and Multispectral Scanner system

The reduction of the data measured on July 8, 1984 at White Sands, New Mexico is summarized. The radiance incident at the entrance pupil of the LANDSAT 5 sensors have been computed for bands 1 to 4. When these are compared to the digital counts of the TM image, the ground based calibration for this sensor will be given. The image was received from Goddard SFC and is presently being analyzed.

Slater, P. N.↗

Status of the JWST Science Instrument Payload

The James Webb Space Telescope (JWST) Integrated Science Instrument Module (ISIM) system consists of five sensors (4 science): Mid-Infrared Instrument (MIRI), Near Infrared Imager and Slitless Spectrograph (NIRISS), Fine Guidance Sensor (FGS), Near InfraRed Camera (NIRCam), Near InfraRed Spectrograph (NIRSpec); and nine instrument support systems: Optical metering structure system, Electrical Harness System; Harness Radiator System, ISIM Electronics Compartment, ISIM Remote Services Unit, Cryogenic Thermal Control System, Command and Data Handling System, Flight Software System, Operations Scripts System.

JWST Payload↗

Optical system design alternatives for the Moderate-Resolution Imaging Spectrometer-Tilt (MODIS-T) for the Earth Observing System (EOS)

The MODIS consists of two synergistic sensors with a total of 104 spectral bands in the 0.4-14.2-micron range. MODIS-T (Tilt) is one of these sensors. It is a 64-channel imaging spectrometer with a required 10 nm spectral resolution (FWHM) in the 400 to 1040 nm spectral range. The system will have a 1 km IFOV, a wide scan for global coverage in three days, and be capable of being pointed fore and aft of nadir by + or - 50 degrees.

Maymon, Peter W.↗

Lensless Particle Image Velocimetry

The application of lensless imaging to particle image velocimetry (PIV) is demonstrated. Lensless PIV eliminates the need for imaging lenses to measure flow fields near a surface. Only the camera sensor, a thin mask, and computations are required to image particles in a flow field and to compute the velocity field. The small form factor could enable embedded sensors for near-wall measurements. Flow field measurements are obtained simultaneously for a lensless system and lens-based 2D PIV system, and several different reconstruction techniques are demonstrated. The reconstructed particle images and computed velocity fields compare well for both a uniform and shear flow. The potential for stereo and 3D volumetric PIV with a single camera sensor is demonstrated through different image reconstruction approaches.

Lensless imaging↗

Uncertainties in the Geostationary Ocean Color Imager (GOCI) Remote Sensing Reflectance for Assessing Diurnal Variability of Biogeochemical Processes

Short-term (sub-diurnal) biological and biogeochemical processes cannot be fully captured by the current suite of polar-orbiting satellite ocean color sensors, as their temporal resolution is limited to potentially one clear image per day. Geostationary sensors, such as the Geostationary Ocean Color Imager (GOCI) from the Republic of Korea, allow the study of these short-term processes because their orbit permit the collection of multiple images throughout each day for any area within the sensor’s field of regard. Assessing the capability to detect sub-diurnal changes in in-water properties caused by physical and biogeochemical processes characteristic of open ocean and coastal ocean ecosystems, however, requires an understanding of the uncertainties introduced by the instrument and/or geophysical retrieval algorithms. This work presents a study of the uncertainties during the daytime period for an ocean region with characteristically low-productivity with the assumption that only small and undetectable changes occur in the in-water properties due to biogeochemical processes during the daytime period. The complete GOCI mission data were processed using NASA’s SeaDAS/l2gen package. The assumption of homogeneity of the study region was tested using three-day sequences and diurnal statistics. This assumption was found to hold based on the minimal diurnal and day-to-day variability in GOCI data products. Relative differences with respect to the midday value were calculated for each hourly observation of the day in order to investigate what time of the day the variability is greater. Also, the influence of the solar zenith angle in the retrieval of remote sensing reflectances and derived products was examined. Finally, we determined that the uncertainties in water-leaving “remote-sensing” reflectance (Rrs) for the 412, 443, 490, 555, 660 and 680 nm bands on GOCI are 8.05 × 10−4, 5.49 × 10−4, 4.48 × 10−4, 2.51 × 10−4, 8.83 × 10−5, and 1.36 × 10−4 sr−1, respectively, and 1.09 × 10−2 mg m−3 for the chlorophyll-a concentration (Chl-a), 2.09 × 10−3 m−1 for the absorption coefficient of chromophoric dissolved organic matter at 412 nm (ag (412)), and 3.7 mg m−3 for particulate organic carbon (POC). These Rrs values can be considered the threshold values for detectable changes of the in-water properties due to biological, physical or biogeochemical processes from GOCI.

Geostationary Ocean Color Imager (GOCI)↗

Uncertainties in the Geostationary Ocean Color Imager (GOCI) Remote Sensing Reflectance for Assessing Diurnal Variability of Biogeochemical Processes

Short-term (sub-diurnal) biological and biogeochemical processes cannot be fully captured by the current suite of polar-orbiting satellite ocean color sensors, as their temporal resolution is limited to potentially one clear image per day. Geostationary sensors, such as the Geostationary Ocean Color Imager (GOCI) from the Republic of Korea, allow the study of these short-term processes because their orbit permit the collection of multiple images throughout each day for any area within the sensor’s field of regard. Assessing the capability to detect sub-diurnal changes in in-water properties caused by physical and biogeochemical processes characteristic of open ocean and coastal ocean ecosystems, however, requires an understanding of the uncertainties introduced by the instrument and/or geophysical retrieval algorithms. This work presents a study of the uncertainties during the daytime period for an ocean region with characteristically low-productivity with the assumption that only small and undetectable changes occur in the in-water properties due to biogeochemical processes during the daytime period. The complete GOCI mission data were processed using NASA’s SeaDAS/l2gen package. The assumption of homogeneity of the study region was tested using three-day sequences and diurnal statistics. This assumption was found to hold based on the minimal diurnal and day-to-day variability in GOCI data products. Relative differences with respect to the midday value were calculated for each hourly observation of the day in order to investigate what time of the day the variability is greater. Also, the influence of the solar zenith angle in the retrieval of remote sensing reflectances and derived products was examined. Finally, we determined that the uncertainties in water-leaving “remote-sensing” reflectance (Rrs) for the 412,443, 490, 555, 660 and 680 nm bands on GOCI are 8.05 x 10(exp -4), 5.49 x 10(exp -4), 4.48 x 10(exp -4), 2.51 x 10(exp -4), 8.83 x 10(exp -5), and 1.36 x 10(exp -4)/sr, respectively, and 1.09 x 10(exp -2)/cu.mgm for the chlorophyll-a concentration (Chl-a), 2.09 x 10(exp -3)/m for the absorption coefficient of chromophoric dissolved organic matter at 412 nm (a(sub g) (412)), and 3.7 mg/cu.m for particulate organic carbon (POC). These R(sub rs) values can be considered the threshold values for detectable changes of the in-water properties due to biological, physical or biogeochemical processes from GOCI.

Concha, Javier↗

Validation, Comparison, and Integration of GOCI, AHI, MODIS, MISR, and VIIRS Aerosol Optical Depth Over East Asia During the 2016 KORUS-AQ Campaign

Recently launched multichannel geostationary Earth orbit (GEO) satellite sensors, such as the Geostationary Ocean Color Imager (GOCI) and the Advanced Himawari Imager (AHI), provide aerosol products over East Asia with high accuracy, which enables the monitoring of rapid diurnal variations and the transboundary transport of aerosols. Most aerosol studies to date have used low Earth orbit (LEO) satellite sensors, such as the Moderate Resolution Imaging Spectroradiometer (MODIS) and the Multi-angle Imaging Spectroradiometer (MISR), with a maximum of one or two overpass daylight times per day from midlatitudes to low latitudes. Thus, the demand for new GEO observations with high temporal resolution and improved accuracy has been significant. In this study the latest versions of aerosol optical depth (AOD) products from three LEO sensors – MODIS (Dark Target, Deep Blue, and MAIAC), MISR, and the Visible/Infrared Imager Radiometer Suite (VIIRS), along with two GEO sensors (GOCI and AHI), are validated, compared, and integrated for a period during the Korea–United States Air Quality Study (KORUS-AQ) field campaign from 1 May to 12 June 2016 over East Asia. The AOD products analyzed here generally have high accuracy with high R (0.84–0.93) and low RMSE (0.12–0.17), but their error characteristics differ according to the use of several different surface-reflectance estimation methods. High-accuracy near-real-time GOCI and AHI measurements facilitate the detection of rapid AOD changes, such as smoke aerosol transport from Russia to Japan on 18–21 May 2016, heavy pollution transport from China to the Korean Peninsula on 25 May 2016, and local emission transport from the Seoul Metropolitan Area to the Yellow Sea in South Korea on 5 June 2016. These high-temporal-resolution GEO measurements result in more representative daily AOD values and make a greater contribution to a combined daily AOD product assembled by median value selection with a 0.5∘×0.5∘ grid resolution. The combined AOD is spatially continuous and has a greater number of pixels with high accuracy (fraction within expected error range of 0.61) than individual products. This study characterizes aerosol measurements from LEO and GEO satellites currently in operation over East Asia, and the results presented here can be used to evaluate satellite measurement bias and air quality models.

Myungje Choi↗

Daylight imagery of ocean surface waves for wave spectra

A simple second-order model is developed to describe the transformation between surface wave slope and radiance incident on an optical sensor. The model includes azimuth as well as elevation variations in the sky-radiance distribution and their effects on the imaging of wave slopes approaching the sensor azimuth from various directions. The model also includes upwelling radiance. Comparison between the exact transformation from wave slope to radiance and the second-order model suggests that they yield quantitatively similar results. The model is used in physical interpretations of how wave slopes are imaged and in indicating a way of optimizing the linearity and contrast of the transfer function relating wave slope to radiance for various sensor geometries, thereby minimizing sources of error. One-dimensional numerical simulations of the imaging of an analytically generated wave-slope profile demonstrate the utility of this technique in obtaining slope spectra.

Monaldo, F. M.↗

Wichita Climate II: Quantifying and Mapping Urban Heat to Inform Equitable and Sustainable Urban Planning Initiatives in Wichita, Kansas

Wichita, Kansas is experiencing a host of climate threats, particularly extreme heat manifested through Urban Heat Islands (UHI). Heat is unevenly distributed within cities due to factors such as income inequality, historical discriminatory practices like redlining, and divestment in neighborhoods of color. This leads to less vegetation and more heat-absorbing infrastructure in specific communities. Moreover, adverse effects of heat, including heat-related morbidity and mortality, disproportionately impact populations that experience vulnerability through social inequities and structural discrimination. Heat vulnerability is a combination of the factors of heat exposure, sensitivity, and adaptive capacity, and can be harnessed to guide urban heat interventions. This DEVELOP project partnered with the City of Wichita to understand the spatial distribution and drivers of UHIs and heat vulnerability indicators. The team modeled outcomes of tree cover interventions using Landsat 8’s Thermal Infrared Sensor (TIRS) and Operational Land Imager (OLI), Landsat 9 TIRS-2 and OLI-2, and the International Space Station’s Ecosystem Spaceborne Thermal Radiometer Experiment on the International Space Station (ECOSTRESS) sensor, along with the Integrated Valuation of Ecosystem Services and Tradeoffs (InVEST) Urban Cooling model. The team also leveraged statistical analysis by implementing principal component analysis to develop a heat vulnerability index (HVI) specific to Wichita. Ultimately, the project’s outputs will inform the City of Wichita’s Climate Adaptation and Mitigation Plan, identify priority areas for heat mitigation initiatives, and be used in public-facing communications to educate communities on the impacts of urban heat.

Environmental Justice↗

Model of human visual-motion sensing

A model of how humans sense the velocity of moving images is proposed. The model exploits constraints provided by human psychophysics, notably that motion-sensing elements appear tuned for two-dimensional spatial frequency, and by the frequency spectrum of a moving image, namely, that its support lies in the plane in which the temporal frequency equals the dot product of the spatial frequency and the image velocity. The first stage of the model is a set of spatial-frequency-tuned, direction-selective linear sensors. The temporal frequency of the response of each sensor is shown to encode the component of the image velocity in the sensor direction. At the second stage, these components are resolved in order to measure the velocity of image motion at each of a number of spatial locations and spatial frequencies. The model has been applied to several illustrative examples, including apparent motion, coherent gratings, and natural image sequences. The model agrees qualitatively with human perception.

Watson, A. B.↗