Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image reconstruction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

Advanced Interactive Display Formats for Terminal Area Traffic Control

This research project deals with an on-line dynamic method for automated viewing parameter management in perspective displays. Perspective images are optimized such that a human observer will perceive relevant spatial geometrical features with minimal errors. In order to compute the errors at which observers reconstruct spatial features from perspective images, a visual spatial-perception model was formulated. The model was employed as the basis of an optimization scheme aimed at seeking the optimal projection parameter setting. These ideas are implemented in the context of an air traffic control (ATC) application. A concept, referred to as an active display system, was developed. This system uses heuristic rules to identify relevant geometrical features of the three-dimensional air traffic situation. Agile, on-line optimization was achieved by a specially developed and custom-tailored genetic algorithm (GA), which was to deal with the multi-modal characteristics of the objective function and exploit its time-evolving nature.

Grunwald, Arthur J.↗

The Ames MER Microscopic Imager Toolkit

The Mars Exploration Rovers, Spirit and Opportunity, have spent several successful months on Mars, returning gigabytes of images and spectral data to scientists on Earth. One of the instruments on the MER rovers, the Athena Microscopic Imager (MI), is a fixed focus, megapixel camera providing a plus or minus mm depth of field and a 3lx31mm field of view at a working distance of 63 mm from the lens to the object being imaged. In order to maximize the science return from this instrument, we developed the Ames MI Toolkit and supported its use during the primary mission. The MI Toolkit is a set of programs that operate on collections of MI images, with the goal of making the data more understandable to the scientists on the ground. Because of the limited depth of field of the camera, and the often highly variable topography of the terrain being imaged, MI images of a given rock are often taken as a stack, with the Instrument Deployment Device (IDD) moving along a computed normal vector, pausing every few millimeters for the MI to acquire an image. The MI Toolkit provides image registration and focal section merging, which combine these images to form a single, maximally in-focus image, while compensating for changes in lighting as well as parallax due to the motion of the camera. The MI Toolkit also provides a 3-D reconstruction of the surface being imaged using stereo and can embed 2-D MI images as texture maps into 3-D meshes produced by other imagers on board the rover to provide context. The 2-D images and 3-D meshes output from the Toolkit are easily viewed by scientists using other mission tools, such as Viz or the MI Browser. This paper describes the MI Toolkit in detail, as well as our experience using it with scientists at JPL during the primary MER mission.

Sargent, Randy↗

Disparity coding - An approach for stereo reconstruction

As the possibility of stereo-controlled robots becomes a reality, the need to transmit the stereo pair of images to a ground station or space station for man-in-the-loop supervision will be a necessity. The complexity of transmitting stereo images by coding the preprocessed disparity is presently discussed. The approach demonstrates the quantization, modulation, and reconstruction of the stereo images. Results indicate the accuracy of reconstruction in terms of mean-square-error criterion as a function of the signal-to-noise ratio. Key research issues of interpolation from sparse disparity maps and reconstruction of the stereo pairs in the presence of spatial noise are presented. It is concluded that stereo reconstruction is possible, and the noise constraints are given.

Griswold, N. C.↗

New Insights on Subsurface Imaging of Carbon Nanotubes in Polymer Composites via Scanning Electron Microscopy

Despite many studies of subsurface imaging of carbon nanotube (CNT)-polymer composites via scanning electron microscopy (SEM), significant controversy exists concerning the imaging depth and contrast mechanisms. We studied CNT-polyimide composites and, by threedimensional reconstructions of captured stereo-pair images, determined that the maximum SEM imaging depth was typically hundreds of nanometers. The contrast mechanisms were investigated over a broad range of beam accelerating voltages from 0.3 to 30 kV, and ascribed to modulation by embedded CNTs of the effective secondary electron (SE) emission yield at the polymer surface. This modulation of the SE yield is due to non-uniform surface potential distribution resulting from current flows due to leakage and electron beam induced current. The importance of an external electric field on SEM subsurface imaging was also demonstrated. The insights gained from this study can be generally applied to SEM nondestructive subsurface imaging of conducting nanostructures embedded in dielectric matrices such as graphene-polymer composites, silicon-based single electron transistors, high resolution SEM overlay metrology or e-beam lithography, and have significant implications in nanotechnology.

Zhao, Minhua↗

Autonomous Image Analysis for Future Mars Missions

To explore high priority landing sites and to prepare for eventual human exploration, future Mars missions will involve rovers capable of traversing tens of kilometers. However, the current process by which scientists interact with a rover does not scale to such distances. Specifically, numerous command cycles are required to complete even simple tasks, such as, pointing the spectrometer at a variety of nearby rocks. In addition, the time required by scientists to interpret image data before new commands can be given and the limited amount of data that can be downlinked during a given command cycle constrain rover mobility and achievement of science goals. Experience with rover tests on Earth supports these concerns. As a result, traverses to science sites as identified in orbital images would require numerous science command cycles over a period of many weeks, months or even years, perhaps exceeding rover design life and other constraints. Autonomous onboard science analysis can address these problems in two ways. First, it will allow the rover to preferentially transmit "interesting" images, defined as those likely to have higher science content. Second, the rover will be able to anticipate future commands. For example, a rover might autonomously acquire and return spectra of "interesting" rocks along with a high-resolution image of those rocks in addition to returning the context images in which they were detected. Such approaches, coupled with appropriate navigational software, help to address both the data volume and command cycle bottlenecks that limit both rover mobility and science yield. We are developing fast, autonomous algorithms to enable such intelligent on-board decision making by spacecraft. Autonomous algorithms developed to date have the ability to identify rocks and layers in a scene, locate the horizon, and compress multi-spectral image data. We are currently investigating the possibility of reconstructing a 3D surface from a sequence of images acquired by a robotic arm camera. This would then allow the return of a single completely in focus image constructed only from those portions of individual images that lie within the camera's depth of field. Output from these algorithms could be used to autonomously obtain rock spectra, determine which images should be transmitted to the ground, or to aid in image compression. We will discuss these algorithms and their performance during a recent rover field test.

Gulick, V. C.↗

An Optimized Photoelectron Track Reconstruction Method for Photoelectric X-Ray Polarimeters

We present a data processing algorithm for angular reconstruction and event selection applied to 2-D photoelectron track images from X-ray polarimeters. The method reconstructs the initial emission angle of a photoelectron from the initial portion of the track, which is obtained by continuously cutting a track until the image moments or number of pixels fall below tunable thresholds. In addition, event selection which rejects round tracks quantified with eccentricity and circularity is performed so that polarimetry sensitivity considering a trade-off between the modulation factor and signal acceptance is maximized. The modulation factors with applying track selection are 26.6 ± 0.4, 46.1 ± 0.4, 62.3 ± 0.4, and 61.8 ± 0.3% at 2.7, 4.5, 6.4, and 8.0 keV, respectively, using the same data previously analyzed by Iwakiri et al. (2016), where the corresponding numbers are 26.9±0.4, 43.4±0.4, 54.4±0.3, and 59.1 ± 0.3%. The method improves polarimeter sensitivity by 5%–10% at the high energy end of the band previously presented (Iwakiri et al. 2016).

Kitaguchi, Takao↗

Wavelet-Based Interpolation and Representation of Non-Uniformly Sampled Spacecraft Mission Data

A well-documented problem in the analysis of data collected by spacecraft instruments is the need for an accurate, efficient representation of the data set. The data may suffer from several problems, including additive noise, data dropouts, an irregularly-spaced sampling grid, and time-delayed sampling. These data irregularities render most traditional signal processing techniques unusable, and thus the data must be interpolated onto an even grid before scientific analysis techniques can be applied. In addition, the extremely large volume of data collected by scientific instrumentation presents many challenging problems in the area of compression, visualization, and analysis. Therefore, a representation of the data is needed which provides a structure which is conducive to these applications. Wavelet representations of data have already been shown to possess excellent characteristics for compression, data analysis, and imaging. The main goal of this project is to develop a new adaptive filtering algorithm for image restoration and compression. The algorithm should have low computational complexity and a fast convergence rate. This will make the algorithm suitable for real-time applications. The algorithm should be able to remove additive noise and reconstruct lost data samples from images.

Bose, Tamal↗

1D Projections Readout and Track Reconstruction for the SONTRAC Instrument

Neutron spectroscopy and imaging has improved considerably over the last decade with the advancement of modern scintillating materials and compact, low power readout devices. Though challenging to detect, fast (>0.5 MeV) neutrons are ubiquitous, contribute to the radiation exposure of astronauts and space hardware, and have been effectively used to examine physical processes both locally and within our heliosphere at large. The SOlar Neutron TRACking (SONTRAC) instrument is designed to measure neutrons between 20-200 MeV with good angular sensitivity. SONTRAC consists of orthogonally stacked scintillating fibers readout by silicon photomultipliers to detect and track the recoil protons from double scatter neutron events. Proton tracking provides high-resolution imaging of fast neutronsat energies where the bulk of solar and planetary neutrons resides. The SONTRAC readout system, algorithms for track reconstruction, and tracking performance are presented.

George Suarez↗

Portable Flow Device Using Fourier Ptychography Microscopy and Deep Learning for Detection of Biosignatures

A proof-of-concept, compact, portable Fourier Ptychographic Microscope (FPM) to perform wide field-of-view, high spatial resolution imaging (<1 μm) for biosignature motility in liquid samples, is presented. The FPM has the potential to be developed as a space-based payload for future landers destined to the Ocean Worlds. A portable FPM using an existing Fourier ptychography (FP) algorithm adapted for reconstruction is demonstrated. A NVIDIA Jetson Nano board and camera combined with FP, is used to computationally reconstruct sub-micron resolution images. Additionally, deep learning was employed to perform inferencing prediction which enables the on-edge FPM device.

Fourier↗

Photospheric imaging of the RS CVn system HR 1099

Spectropolarimetric, spectroscopic, and photometric observations of the RS CVn binary system HR 1099 = V711 Tau (K1IV+G5V) were made from Oct. 1988 to Jan. 1991. From Doppler imaging of the unpolarized spectra and the corresponding data, two maximum entropy images of the temperature distribution of the active K1 subgiant at epochs 1988.9 and 1990.9 were derived. Zeeman-Doppler imaging of the circularly polarized spectra has led to the first magnetic maps of a star other than the sun. The fragmentary observations made at epoch 1989.6 suggest that the star's magnetic field lines were emerging radially and/or poloidally from an equatorial warm region at that time, quite likely one of these reconstructed in the 1988.9 temperature image.

Donati, J.-F.↗

Time-resolved diffusion tomographic 2D and 3D imaging in highly scattering turbid media

A method for imaging objects in highly scattering turbid media. According to one embodiment of the invention, the method involves using a plurality of intersecting source/detectors sets and time-resolving equipment to generate a plurality of time-resolved intensity curves for the diffusive component of light emergent from the medium. For each of the curves, the intensities at a plurality of times are then inputted into the following inverse reconstruction algorithm to form an image of the medium: wherein W is a matrix relating output at source and detector positions r.sub.s and r.sub.d, at time t, to position r, .LAMBDA. is a regularization matrix, chosen for convenience to be diagonal, but selected in a way related to the ratio of the noise, to fluctuations in the absorption (or diffusion) X.sub.j that we are trying to determine: .LAMBDA..sub.ij =.lambda..sub.j .delta..sub.ij with .lambda..sub.j = /<.DELTA.Xj.DELTA.Xj> Y is the data collected at the detectors, and X.sup.k is the kth iterate toward the desired absorption information. An algorithm, which combines a two dimensional (2D) matrix inversion with a one-dimensional (1D) Fourier transform inversion is used to obtain images of three dimensional hidden objects in turbid scattering media.

Alfano, Robert R.↗

Time-resolved diffusion tomographic 2D and 3D imaging in highly scattering turbid media

A method for imaging objects in highly scattering turbid media. According to one embodiment of the invention, the method involves using a plurality of intersecting source/detectors sets and time-resolving equipment to generate a plurality of time-resolved intensity curves for the diffusive component of light emergent from the medium. For each of the curves, the intensities at a plurality of times are then inputted into the following inverse reconstruction algorithm to form an image of the medium: ##EQU1## wherein W is a matrix relating output at source and detector positions r.sub.s and r.sub.d, at time t, to position r, .LAMBDA. is a regularization matrix, chosen for convenience to be diagonal, but selected in a way related to the ratio of the noise, to fluctuations in the absorption (or diffusion) X.sub.j that we are trying to determine: .LAMBDA..sub.ij =.lambda..sub.j .delta..sub.ij with .lambda..sub.j = /<.DELTA.Xj.DELTA.Xj> Y is the data collected at the detectors, and X.sup.k is the kth iterate toward the desired absoption information. An algorithm, which combines a two dimensional (2D) matrix inversion with a one-dimensional (1D) Fourier transform inversion is used to obtain images of three dimensional hidden objects in turbid scattering media.

Alfano, Robert R.↗

Time-resolved diffusion tomographic imaging in highly scattering turbid media

A method for imaging objects in highly scattering turbid media. According to one embodiment of the invention, the method involves using a plurality of intersecting source/detectors sets and time-resolving equipment to generate a plurality of time-resolved intensity curves for the diffusive component of light emergent from the medium. For each of the curves, the intensities at a plurality of times are then inputted into the following inverse reconstruction algorithm to form an image of the medium: X.sup.(k+1).spsp.T =?Y.sup.T W+X.sup.(k).spsp.T .LAMBDA.!?W.sup.T W+.LAMBDA.!.sup.-1 wherein W is a matrix relating output at detector position r.sub.d, at time t, to source at position r.sub.s, .LAMBDA. is a regularization matrix, chosen for convenience to be diagonal, but selected in a way related to the ratio of the noise, to fluctuations in the absorption (or diffusion) X.sub.j that we are trying to determine: .LAMBDA..sub.ij =.lambda..sub.j .delta..sub.ij with .lambda..sub.j = /<.DELTA.Xj.DELTA.Xj> Here Y is the data collected at the detectors, and X.sup.k is the kth iterate toward the desired absoption information.

Alfano, Robert R.↗

The Zwicky Transient Facility: Data Processing, Products, and Archive

The Zwicky Transient Facility (ZTF) is a new robotic time-domain survey currently in progress using the Palomar 48-inch Schmidt Telescope. ZTF uses a 47 square degree field with a 600 megapixel camera to scan the entire northern visible sky at rates of ∼3760 square degrees/hour to median depths of g ~ 20.8 and r ~ 20.6 mag (AB, 5σ in 30 sec). We describe the Science Data System that is housed at IPAC, Caltech. This comprises the data-processing pipelines, alert production system, data archive, and user interfaces for accessing and analyzing the products. The real-time pipeline employs a novel image-differencing algorithm, optimized for the detection of point-source transient events. These events are vetted for reliability using a machine-learned classifier and combined with contextual information to generate data-rich alert packets. The packets become available for distribution typically within 13 minutes (95th percentile) of observation. Detected events are also linked to generate candidate moving-object tracks using a novel algorithm. Objects that move fast enough to streak in the individual exposures are also extracted and vetted. We present some preliminary results of the calibration performance delivered by the real-time pipeline. The reconstructed astrometric accuracy per science image with respect to Gaia DR1 is typically 45 to 85 milliarcsec. This is the RMS per-axis on the sky for sources extracted with photometric S/N ≥10 and hence corresponds to the typical astrometric uncertainty down to this limit. The derived photometric precision (repeatability) at bright unsaturated fluxes varies between 8 and 25 millimag. The high end of these ranges corresponds to an airmass approaching ∼2—the limit of the public survey. Photometric calibration accuracy with respect to Pan-STARRS1 is generally better than 2%. The products support a broad range of scientific applications: fast and young supernovae; rare flux transients; variable stars; eclipsing binaries; variability from active galactic nuclei; counterparts to gravitational wave sources; a more complete census of Type Ia supernovae; and solar-system objects.

Frank J. Masci↗

Sparse Superpixel Unmixing for Hyperspectral Image Analysis

Software was developed that automatically detects minerals that are present in each pixel of a hyperspectral image. An algorithm based on sparse spectral unmixing with Bayesian Positive Source Separation is used to produce mineral abundance maps from hyperspectral images. A superpixel segmentation strategy enables efficient unmixing in an interactive session. The algorithm computes statistically likely combinations of constituents based on a set of possible constituent minerals whose abundances are uncertain. A library of source spectra from laboratory experiments or previous remote observations is used. A superpixel segmentation strategy improves analysis time by orders of magnitude, permitting incorporation into an interactive user session (see figure). Mineralogical search strategies can be categorized as supervised or unsupervised. Supervised methods use a detection function, developed on previous data by hand or statistical techniques, to identify one or more specific target signals. Purely unsupervised results are not always physically meaningful, and may ignore subtle or localized mineralogy since they aim to minimize reconstruction error over the entire image. This algorithm offers advantages of both methods, providing meaningful physical interpretations and sensitivity to subtle or unexpected minerals.

Castano, Rebecca↗

35-45 Giga Hertz Transceiver System for Phase and Magnitude Detection

Nondestructive evaluation (NDE) is the science and practice of examining an object in a way that the object's usefulness is not adversely affected. Different types of NDE methods exist but this thesis is based on microwave and millimeter wave NDE using imaging techniques. Microwave NDE is based on illuminating the object under test with a microwave signal and studying the various properties of the reflected signal from the object. This reflected signal contains some information about the inner structure of the object under test. This information may be contained in several parameters including the phase and magnitude of the reflected signal. The goal of this project is to design and build a Q-band coherent transceiver that is capable of measuring the reflected signal's phase and magnitude so that an image of the object under test may be reconstructed. From the several techniques that can be used to construct an image of the object under test, techniques of interest to this work include synthetic aperture focusing technique (SAFT) and microwave holography. The transceiver system should have the ability to sweep a large portion of Q-band frequency range in small frequency steps as quick as possible while the detected phase and magnitude of the reflected signal is very accurate. Several different designs were studied and the final schematic diagram of the transceiver system was determined. One of the most important modules that was designed, implemented and tested in the laboratory was an accurate phase/magnitude detector circuit. The compared results of the scans using the transceiver system and vector network analyzer (VNA) showed that this transceiver system has a great potential to replace a VNA for the purpose of microwave and millimeter wave imaging.

Beni, Aman Aflaki↗

Quantification of Plume-Soil Interaction and Excavation Due to the Sky Crane Descent Stage

The quantification of the particulate erosion that occurs as a result of a rocket exhaust plume impinging on soil during extraterrestrial landings is critical for future robotic and human lander mission design. The aerodynamic environment that results from the reflected plumes results in dust lifting, site alteration and saltation, all of which create a potentially erosive and contaminant heavy environment for the lander vehicle and any surrounding structures. The Mars Science Lab (MSL), weighing nearly one metric ton, required higher levels of thrust from its retro propulsive systems and an entirely new descent system to minimize these effects. In this work we seek to quantify plume soil interaction and its resultant soil erosion caused by the MSL's Sky Crane descent stage engines by performing three dimensional digital terrain and elevation mapping of the Curiosity rover's landing site. Analysis of plume soil interaction altitude and time was performed by detailed examination of the Mars Descent Imager (MARDI) still frames and reconstructed inertial measurement unit (IMU) sensor data. Results show initial plume soil interaction from the Sky Crane's eight engines began at ground elevations greater than 60 meters and more than 25 seconds before the rovers' touchdown event. During this time, viscous shear erosion (VSE) was dominant typically resulting in dusting of the surface with flow propagating nearly parallel to the surface. As the vehicle descended and decreased to four powered engines plume-plume and plume soil interaction increased the overall erosion rate at the surface. Visibility was greatly reduced at a height of roughly 20 meters above the surface and fell to zero ground visibility shortly after. The deployment phase of the Sky Crane descent stage hovering at nearly six meters above the surface showed the greatest amount of erosion with several large particles of soil being kicked up, recirculated, and impacting the bottom of the rover chassis. Image data obtained from MSL's navigation camera (NAVCAM) pairs on Sols 002, 003, and 016 were used to virtually recreate local surface topography and features around the rover by means of stereoscopic depth mapping. Images taken simultaneously by the left and right navigation cameras located on the rover's mast assembly spaced 42 centimeters were used to generate a three dimensional depth map from flat, two dimensional images of the same feature at slightly different angles. Image calibration with physical hardware on the rover and known terrain features were used to provide scaling information that accurately sizes features and regions of interest within the images. Digital terrain mapping analysis performed in this work describe the crater geometry (shape, radius, and depth), eroded volume, volumetric erosion rate, and estimated mass erosion rate of the Hepburn, Sleepy Dragon, Burnside, and Goulburn craters. Crater depths ranged from five to ten centimeters deep influencing an area as wide as two meters in some cases. The craters formed were highly asymmetrical and generally oblong primarily due to the underlying bedrock formations underneath the surface. Comparison with ground tests performed at the NASA AMES Planetary Aeolian Laboratory (PAL) by Mehta showed good agreement with volumetric erosion rates and crater sizes of large particle soil simulants, providing validation to Earth based ground tests of Martian regolith.

Vizcaino, Jeffrey↗

Fast reconstruction of off-axis digital holograms

Hologram reconstruction via the angular spectrum method utilizes fast Fourier transforms which quickly but inefficiently shift between image and pupil planes. We demonstrate hologram reconstruction using discrete transforms over limited regions, decreasing computation time 10x.

Wallace, James K↗