Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “imaging and sensing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,117 records · Page 62

Explore Astronaut Photography with the New GIS Data Portal

The Gateway to Astronaut Photography of Earth (GAPE, eol.jsc.nasa.gov) contains the complete collection of all Earth observing photography captured as part of the Crew Earth Observations (CEO) project on the International Space Station. Astronaut photography is a valuable remote sensing data set that can provide images ranging from high resolution (~4m/pixel) nadir views to oblique views through the atmosphere. Nighttime imagery collected as part of CEO constitutes the highest resolution publicly available nighttime visible light data. This data support dozens of research projects looking at urbanization, land use/change, disaster response, and many others. Our team has deployed a new interactive map tool that greatly expands the functionality of the GAPE data set, enabling researchers to easily search our collection of fully georeferenced daytime and nighttime imagery around the world. Users can download the georeferenced tiles directly through the portal or through an API interface. The data hosted on this new tool is growing every day as more images are processed through our auto-georeferencing process.

Kenton R Fisher↗

Parabolic Deformable Mirror Project Development and Device Characterization

Existing state-of-the-art wavefront sensing and control setups for the imaging of exoplanets utilize two high-actuator count flat deformable mirrors (DMs) to control both phase and amplitude aberrations. One of the objectives of the Exoplanet Spectroscopy (ExoSpec) project at Goddard Space Flight Center (GSFC) is to improve upon this regime through the development of parabolic deformable mirrors (PDMs), which can address several of the key limitations in existing setups. Specifically, the need for flat DMs to be located in conjugate pupil planes drives unique packaging challenges that can be overcome by allowing the off-axis imaging elements to be controllable as well. In addition, simulations show that the use of deformable powered elements will increase the overall controllable bandwidth, up to 35% over 5-12 lambda/D. To pursue this effort, the ExoSpec group has begun testing a first-generation parabolic DM, which is already informing a second generation design. This paper will provide a comprehensive update on its characterization, including influence function measurements, linearity analysis, closed-loop wavefront control performance, and thermal stability assessment.

spectroscopy↗

Interpretation of HCMM images: A regional study

Potential users of HCMM data, especially those with only a cursory background in thermal remote sensing are familiarized with the kinds of information contained in the images that can be extracted with some reliability solely from inspection of such standard products as those generated at NASA/GSFC and now achieved in the National Space Science Data Center. Visual analysis of photoimagery is prone to various misimpressions and outright errors brought on by unawareness of the influence of physical factors as well as by sometimes misleading tonal patterns introduced during photoprocessing. The quantitative approach, which relies on computer processing of digital HCMM data, field measurements, and integration of rigorous mathematical models, can usually be used to identify, compensate for, or correct the contributions from at least some of the natural factors and those associated with photoprocessing. Color composite, day-IR, night-IR and visible images of California and Nevada are examined.

Source record↗

The MESUR Mission

The MESUR mission will place a network of small, robust landers on the Martian surface, making a coordinated set of observations for at least one Martian year. MESUR presents some major challenges for development of instruments, instrument deployment systems, and on board data processing techniques. The instrument payload has not yet been selected, but the straw man payload is (1) a three-axis seismometer; (2) a meteorology package that senses pressure, temperature, wind speed and direction, humidity, and sky brightness; (3) an alphaproton-X-ray spectrometer (APXS); (4) a thermal analysis/evolved gas analysis (TA/EGA) instrument; (5) a descent imager, (6) a panoramic surface imager; (7) an atmospheric structure instrument (ASI) that senses pressure, temperature, and acceleration during descent to the surface; and (8) radio science. Because of the large number of landers to be sent (about 16), all these instruments must be very lightweight. All but the descent imager and the ASI must survive landing loads that may approach 100 g. The meteorology package, seismometer, and surface imager must be able to survive on the surface for at least one Martian year. The seismometer requires deployment off the lander body. The panoramic imager and some components of the meteorology package require deployment above the lander body. The APXS must be placed directly against one or more rocks near the lander, prompting consideration of a micro rover for deployment of this instrument. The TA/EGA requires a system to acquire, contain, and heat a soil sample. Both the imagers and, especially, the seismometer will be capable of producing large volumes of data, and will require use of sophisticated data compression techniques.

Squyres, S. W.↗

The Athena Mars Rover Investigation

The Mars Surveyor program requires tools for martian surface exploration, including remote sensing, in-situ sensing, and sample collection. The Athena Mars rover payload is a suite of scientific instruments and sample collection tools designed to: (1) Provide color stereo imaging of martian surface environments, and remotely-sensed point discrimination of mineralogical composition; (2) Determine the elemental and mineralogical composition of martian surface materials; (3) Determine the fine-scale textural properties of these materials; and (4) Collect and store samples. The Athena payload is designed to be implemented on a long-range rover such as the one now under consideration for the 2003 Mars opportunity. The payload is at a high state of maturity, and most of the instruments have now been built for flight.

Squyres, S. W.↗

The 1994 International Geoscience and Remote Sensing Symposium (IGARSS 1994)

The papers presented at the symposium focus on remote sensing, particularly on global monitoring of the earth with emphasis on the solution of environmental problems. Topics discussed include remote sensing of clouds and earth troposphere, sea ice remote sensing, optical remote sensing, land monitoring and thermal sensing, atmospheric sounding and monitoring, atmospheric correction, and satellite imaging data. Other subject areas are ecosystems and vegetation monitoring; ocean winds and surface scattering; ocean waves, currents and bathymetry; satellite oceanography; SAR for remote sensing; neural nets application to remote sensing; geographical information systems; and electromagnetic wave propagation. Also discussed environmental monitoring using ERS-1; Topex/Poseidon results; spaceborne instruments; image processing and classification algorithms; and future space missions.

Source record↗

High speed CMOS imager with motion artifact supression and anti-blooming

An image sensor includes pixels formed on a semiconductor substrate. Each pixel includes a photoactive region in the semiconductor substrate, a sense node, and a power supply node. A first electrode is disposed near a surface of the semiconductor substrate. A bias signal on the first electrode sets a potential in a region of the semiconductor substrate between the photoactive region and the sense node. A second electrode is disposed near the surface of the semiconductor substrate. A bias signal on the second electrode sets a potential in a region of the semiconductor substrate between the photoactive region and the power supply node. The image sensor includes a controller that causes bias signals to be provided to the electrodes so that photocharges generated in the photoactive region are accumulated in the photoactive region during a pixel integration period, the accumulated photocharges are transferred to the sense node during a charge transfer period, and photocharges generated in the photoactive region are transferred to the power supply node during a third period without passing through the sense node. The imager can operate at high shutter speeds with simultaneous integration of pixels in the array. High quality images can be produced free from motion artifacts. High quantum efficiency, good blooming control, low dark current, low noise and low image lag can be obtained.

Pain, Bedabrata↗

Image sensor with motion artifact supression and anti-blooming

An image sensor includes pixels formed on a semiconductor substrate. Each pixel includes a photoactive region in the semiconductor substrate, a sense node, and a power supply node. A first electrode is disposed near a surface of the semiconductor substrate. A bias signal on the first electrode sets a potential in a region of the semiconductor substrate between the photoactive region and the sense node. A second electrode is disposed near the surface of the semiconductor substrate. A bias signal on the second electrode sets a potential in a region of the semiconductor substrate between the photoactive region and the power supply node. The image sensor includes a controller that causes bias signals to be provided to the electrodes so that photocharges generated in the photoactive region are accumulated in the photoactive region during a pixel integration period, the accumulated photocharges are transferred to the sense node during a charge transfer period, and photocharges generated in the photoactive region are transferred to the power supply node during a third period without passing through the sense node. The imager can operate at high shutter speeds with simultaneous integration of pixels in the array. High quality images can be produced free from motion artifacts. High quantum efficiency, good blooming control, low dark current, low noise and low image lag can be obtained.

Pain, Bedabrata↗

Scaling Resolution of Gigapixel Whole Slide Images Using Spatial Decomposition on Convolutional Neural Networks

Gigapixel images are prevalent in scientific domains ranging from remote sensing, and satellite imagery to microscopy, etc. However, training a deep learning model at the natural resolution of those images has been a challenge in terms of both, overcoming the resource limit (e.g. HBM memory constraints), as well as scaling up to a large number of GPUs. In this paper, we trained Residual neural Networks (ResNet) on 22,528 x 22,528-pixel size images using a distributed spatial decomposition method on 2,304 GPUs on the Summit Supercomputer. We applied our method on a Whole Slide Imaging (WSI) dataset from The Cancer Genome Atlas (TCGA) database. WSI images can be in the size of 100,000 x 100,000 pixels or even larger, and in this work we studied the effect of image resolution on a classification task, while achieving state-of-the-art AUC scores. Moreover, our approach doesn't need pixel-level labels, since we're avoiding patching from the WSI images completely, while adding the capability of training arbitrary large-size images. This is achieved through a distributed spatial decomposition method, by leveraging the non-block fat-tree interconnect network of the Summit architecture, which enabled GPU-to-GPU direct communication. Finally, detailed performance analysis results are shown, as well as a comparison with a data-parallel approach when possible.

Tsaris, Aristeidis (aris)↗

Neuro-classification of multi-type Landsat Thematic Mapper data

Neural networks have been successful in image classification and have shown potential for classifying remotely sensed data. This paper presents classifications of multitype Landsat Thematic Mapper (TM) data using neural networks. The Landsat TM Image for March 23, 1987 with accompanying ground observation data for a study area In Miami County, Indiana, U.S.A. was utilized to assess recognition of crop residues. Principal components and spectral ratio transformations were performed on the TM data. In addition, a layer of the geographic information system (GIS) for the study site was incorporated to generate GIS-enhanced TM data. This paper discusses (1) the performance of neuro-classification on each type of data, (2) how neural networks recognized each type of data as a new image and (3) comparisons of the results for each type of data obtained using neural networks, maximum likelihood, and minimum distance classifiers.

Zhuang, Xin↗

Thematic Conference on Remote Sensing for Exploration Geology, 6th, Houston, TX, May 16-19, 1988, Proceedings. Volumes 1 & 2

Papers concerning remote sensing applications for exploration geology are presented, covering topics such as remote sensing technology, data availability, frontier exploration, and exploration in mature basins. Other topics include offshore applications, geobotany, mineral exploration, engineering and environmental applications, image processing, and prospects for future developments in remote sensing for exploration geology. Consideration is given to the use of data from Landsat, MSS, TM, SAR, short wavelength IR, the Geophysical Environmental Research Airborne Scanner, gas chromatography, sonar imaging, the Airborne Visible-IR Imaging Spectrometer, field spectrometry, airborne thermal IR scanners, SPOT, AVHRR, SIR, the Large Format camera, and multitimephase satellite photographs.

Source record↗

Automated Image Registration Using Morphological Region of Interest Feature Extraction

With the recent explosion in the amount of remotely sensed imagery and the corresponding interest in temporal change detection and modeling, image registration has become increasingly important as a necessary first step in the integration of multi-temporal and multi-sensor data for applications such as the analysis of seasonal and annual global climate changes, as well as land use/cover changes. The task of image registration can be divided into two major components: (1) the extraction of control points or features from images; and (2) the search among the extracted features for the matching pairs that represent the same feature in the images to be matched. Manual control feature extraction can be subjective and extremely time consuming, and often results in few usable points. Automated feature extraction is a solution to this problem, where desired target features are invariant, and represent evenly distributed landmarks such as edges, corners and line intersections. In this paper, we develop a novel automated registration approach based on the following steps. First, a mathematical morphology (MM)-based method is used to obtain a scale-orientation morphological profile at each image pixel. Next, a spectral dissimilarity metric such as the spectral information divergence is applied for automated extraction of landmark chips, followed by an initial approximate matching. This initial condition is then refined using a hierarchical robust feature matching (RFM) procedure. Experimental results reveal that the proposed registration technique offers a robust solution in the presence of seasonal changes and other interfering factors. Keywords-Automated image registration, multi-temporal imagery, mathematical morphology, robust feature matching.

Plaza, Antonio↗

Visual Object Recognition and Tracking of Tools

A method has been created to automatically build an algorithm off-line, using computer-aided design (CAD) models, and to apply this at runtime. The object type is discriminated, and the position and orientation are identified. This system can work with a single image and can provide improved performance using multiple images provided from videos. The spatial processing unit uses three stages: (1) segmentation; (2) initial type, pose, and geometry (ITPG) estimation; and (3) refined type, pose, and geometry (RTPG) calculation. The image segmentation module files all the tools in an image and isolates them from the background. For this, the system uses edge-detection and thresholding to find the pixels that are part of a tool. After the pixels are identified, nearby pixels are grouped into blobs. These blobs represent the potential tools in the image and are the product of the segmentation algorithm. The second module uses matched filtering (or template matching). This approach is used for condensing synthetic images using an image subspace that captures key information. Three degrees of orientation, three degrees of position, and any number of degrees of freedom in geometry change are included. To do this, a template-matching framework is applied. This framework uses an off-line system for calculating template images, measurement images, and the measurements of the template images. These results are used online to match segmented tools against the templates. The final module is the RTPG processor. Its role is to find the exact states of the tools given initial conditions provided by the ITPG module. The requirement that the initial conditions exist allows this module to make use of a local search (whereas the ITPG module had global scope). To perform the local search, 3D model matching is used, where a synthetic image of the object is created and compared to the sensed data. The availability of low-cost PC graphics hardware allows rapid creation of synthetic images. In this approach, a function of orientation, distance, and articulation is defined as a metric on the difference between the captured image and a synthetic image with an object in the given orientation, distance, and articulation. The synthetic image is created using a model that is looked up in an object-model database. A composable software architecture is used for implementation. Video is first preprocessed to remove sensor anomalies (like dead pixels), and then is processed sequentially by a prioritized list of tracker-identifiers.

English, James↗

Quantum-enhanced Imaging and Spectroscopy and their Relevance to International Safeguards

As a follow-up to our previous report on quantum sensing for safeguards, here we delve deeper into quantum-enhanced imaging & spectroscopy and address their relevance to international safeguards. Much of the approaches rely on entangled photons, a quantum phenomenon not possible with classical physics, although just correlated photons will work for some applications, such as ghost imaging. We provide a comprehensive survey of quantum approaches, including multiple entangled photon ghost imaging and spectroscopy techniques. Entangled photons for noise reduction are also described, as well as Non-Line-Of-Sight imaging, compressive techniques, and squeezed light. Of particular interest is the generation of entangled photons with large wavelength separation, such as infrared/visible entangled photon pairs. Such entangled pairs would allow interaction with objects in the IR, such as in the molecular “fingerprint” wavelength region, while the recording device captures the visible photons, thus leveraging the high efficiency and lower cost of visible detectors. Unfortunately, entangled x-ray photons are not practical, which would have been useful for safeguards to interrogate shielded materials. Entangled gamma rays are even further beyond reason. We provide our assessment for application of quantum-enhanced imaging & spectroscopy for international safeguards, including suggested improvements to existing IAEA instruments and destructive assay measurements that are done at IAEA lab facilities.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Visible-Infrared Hyperspectral Image Projector

The VisIR HIP generates spatially-spectrally complex scenes. The generated scenes simulate real-world targets viewed by various remote sensing instruments. The VisIR HIP consists of two subsystems: a spectral engine and a spatial engine. The spectral engine generates spectrally complex uniform illumination that spans the wavelength range between 380 nm and 1,600 nm. The spatial engine generates two-dimensional gray-scale scenes. When combined, the two engines are capable of producing two-dimensional scenes with a unique spectrum at each pixel. The VisIR HIP can be used to calibrate any spectrally sensitive remote-sensing instrument. Tests were conducted on the Wide-field Imaging Interferometer Testbed at NASA s Goddard Space Flight Center. The device is a variation of the calibrated hyperspectral image projector developed by the National Institute of Standards and Technology in Gaithersburg, MD. It uses Gooch & Housego Visible and Infrared OL490 Agile Light Sources to generate arbitrary spectra. The two light sources are coupled to a digital light processing (DLP(TradeMark)) digital mirror device (DMD) that serves as the spatial engine. Scenes are displayed on the DMD synchronously with desired spectrum. Scene/spectrum combinations are displayed in rapid succession, over time intervals that are short compared to the integration time of the system under test.

Bolcar, Matthew↗

The Utility of Satellites and Autonomous Remote Sensing Platforms for Monitoring Offshore Aquaculture Farms: A Case Study for Canopy Forming Kelps

The emerging sector of offshore kelp aquaculture represents an opportunity to produce biofuel feedstock to help meet growing energy demand. Giant kelp represents an attractive aquaculture crop due to its rapid growth and production, however precision farming over large scales is required to make this crop economically viable. These demands necessitate high frequency monitoring to ensure outplant success, maximum production, and optimum quality of harvested biomass, while the long distance from shore and large necessary scales of production makes in person monitoring impractical. Remote sensing offers a practical monitoring solution and nascent imaging technologies could be leveraged to provide daily products of the kelp canopy and subsurface structures over unprecedented spatial scales. Here, we evaluate the efficacy of remote sensing from satellites and aerial and underwater autonomous vehicles as potential monitoring platforms for offshore kelp aquaculture farms. Decadal-scale analyses of the Southern California Bight showed that high offshore summertime cloud cover restricts the ability of satellite sensors to provide high frequency direct monitoring of these farms. By contrast, daily monitoring of offshore farms using sensors mounted to aerial and underwater drones seems promising. Small Unoccupied Aircraft Systems (sUAS) carrying lightweight optical sensors can provide estimates of canopy area, density, and tissue nitrogen content on the time and space scales necessary for observing changes in this highly dynamic species. Underwater color imagery can be rapidly classified using deep learning models to identify kelp outplants on a longline farm and high acoustic returns of kelp pneumatocysts from side scan sonar imagery signal an ability to monitor the subsurface development of kelp fronds. Current sensing technologies can be used to develop additional machine learning and spectral algorithms to monitor outplant health and canopy macromolecular content, however future developments in vehicle and infrastructure technologies are necessary to reduce costs and transcend operational limitations for continuous deployment in an offshore setting.

54 ENVIRONMENTAL SCIENCES↗

Reconstruction of an infrared band of meteorological satellite imagery with abductive networks

As the current fleet of meteorological satellites age, the accuracy of the imagery sensed on a spectral channel of the image scanning system is continually and progressively degraded by noise. In time, that data may even become unusable. We describe a novel approach to the reconstruction of the noisy satellite imagery according to empirical functional relationships that tie the spectral channels together. Abductive networks are applied to automatically learn the empirical functional relationships between the data sensed on the other spectral channels to calculate the data that should have been sensed on the corrupted channel. Using imagery unaffected by noise, it is demonstrated that abductive networks correctly predict the noise-free observed data.

Singer, Harvey A.↗