Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Fourier imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Sensing Super-Position: Human Sensing Beyond the Visual Spectrum

The coming decade of fast, cheap and miniaturized electronics and sensory devices opens new pathways for the development of sophisticated equipment to overcome limitations of the human senses. This paper addresses the technical feasibility of augmenting human vision through Sensing Super-position by mixing natural Human sensing. The current implementation of the device translates visual and other passive or active sensory instruments into sounds, which become relevant when the visual resolution is insufficient for very difficult and particular sensing tasks. A successful Sensing Super-position meets many human and pilot vehicle system requirements. The system can be further developed into cheap, portable, and low power taking into account the limited capabilities of the human user as well as the typical characteristics of his dynamic environment. The system operates in real time, giving the desired information for the particular augmented sensing tasks. The Sensing Super-position device increases the image resolution perception and is obtained via an auditory representation as well as the visual representation. Auditory mapping is performed to distribute an image in time. The three-dimensional spatial brightness and multi-spectral maps of a sensed image are processed using real-time image processing techniques (e.g. histogram normalization) and transformed into a two-dimensional map of an audio signal as a function of frequency and time. This paper details the approach of developing Sensing Super-position systems as a way to augment the human vision system by exploiting the capabilities of Lie human hearing system as an additional neural input. The human hearing system is capable of learning to process and interpret extremely complicated and rapidly changing auditory patterns. The known capabilities of the human hearing system to learn and understand complicated auditory patterns provided the basic motivation for developing an image-to-sound mapping system. The human brain is superior to most existing computer systems in rapidly extracting relevant information from blurred, noisy, and redundant images. From a theoretical viewpoint, this means that the available bandwidth is not exploited in an optimal way. While image-processing techniques can manipulate, condense and focus the information (e.g., Fourier Transforms), keeping the mapping as direct and simple as possible might also reduce the risk of accidentally filtering out important clues. After all, especially a perfect non-redundant sound representation is prone to loss of relevant information in the non-perfect human hearing system. Also, a complicated non-redundant image-to-sound mapping may well be far more difficult to learn and comprehend than a straightforward mapping, while the mapping system would increase in complexity and cost. This work will demonstrate some basic information processing for optimal information capture for headmounted systems.

Maluf, David A.↗

Wavefront Control and Image Restoration with Less Computing

PseudoDiversity is a method of recovering the wavefront in a sparse- or segmented- aperture optical system typified by an interferometer or a telescope equipped with an adaptive primary mirror consisting of controllably slightly moveable segments. (PseudoDiversity should not be confused with a radio-antenna-arraying method called pseudodiversity.) As in the cases of other wavefront- recovery methods, the streams of wavefront data generated by means of PseudoDiversity are used as feedback signals for controlling electromechanical actuators of the various segments so as to correct wavefront errors and thereby, for example, obtain a clearer, steadier image of a distant object in the presence of atmospheric turbulence. There are numerous potential applications in astronomy, remote sensing from aircraft and spacecraft, targeting missiles, sighting military targets, and medical imaging (including microscopy) through such intervening media as cells or water. In comparison with prior wavefront-recovery methods used in adaptive optics, PseudoDiversity involves considerably simpler equipment and procedures and less computation. For PseudoDiversity, there is no need to install separate metrological equipment or to use any optomechanical components beyond those that are already parts of the optical system to which the method is applied. In Pseudo- Diversity, the actuators of a subset of the segments or subapertures are driven to make the segments dither in the piston, tilt, and tip degrees of freedom. Each aperture is dithered at a unique frequency at an amplitude of a half wavelength of light. During the dithering, images on the focal plane are detected and digitized at a rate of at least four samples per dither period. In the processing of the image samples, the use of different dither frequencies makes it possible to determine the separate effects of the various dithered segments or apertures. The digitized image-detector outputs are processed in the spatial-frequency (Fourier-transform) domain to obtain measures of the piston, tip, and tilt errors over each segment or subaperture. Once these measures are known, they are fed back to the actuators to correct the errors. In addition, measures of errors that remain after correction by use of the actuators are further utilized in an algorithm in which the image is phase-corrected in the spatial-frequency domain and then transformed back to the spatial domain at each time step and summed with the images from all previous time steps to obtain a final image having a greater signal-to-noise ratio (and, hence, a visual quality) higher than would otherwise be attainable.

Lyon, Richard G.↗

Jitter Correction

Jitter_Correct.m is a MATLAB function that automatically measures and corrects inter-frame jitter in an image sequence to a user-specified precision. In addition, the algorithm dynamically adjusts the image sample size to increase the accuracy of the measurement. The Jitter_Correct.m function takes an image sequence with unknown frame-to-frame jitter and computes the translations of each frame (column and row, in pixels) relative to a chosen reference frame with sub-pixel accuracy. The translations are measured using a Cross Correlation Fourier transformation method in which the relative phase of the two transformed images is fit to a plane. The measured translations are then used to correct the inter-frame jitter of the image sequence. The function also dynamically expands the image sample size over which the cross-correlation is measured to increase the accuracy of the measurement. This increases the robustness of the measurement to variable magnitudes of inter-frame jitter

Waegell, Mordecai J.↗

Computer synthesis of high resolution electron micrographs

Specimen damage, spherical aberration, low contrast and noisy sensors combine to prevent direct atomic viewing in a conventional electron microscope. The paper describes two methods for obtaining ultra-high resolution in biological specimens under the electron microscope. The first method assumes the physical limits of the electron objective lens and uses a series of dark field images of biological crystals to obtain direct information on the phases of the Fourier diffraction maxima; this information is used in an appropriate computer to synthesize a large aperture lens for a 1-A resolution. The second method assumes there is sufficient amplitude scatter from images recorded in focus which can be utilized with a sensitive densitometer and computer contrast stretching to yield fine structure image details. Cancer virus characterization is discussed as an illustrative example. Numerous photographs supplement the text.

Nathan, R.↗

Registration assisted mosaic generation

This paper presents a general strategy for assembling mosaics from numerous individual images where uncertainty exists in the position and orientation of those images. Both of the presented applications relate to remotely operated camera platforms, the first being the Galileo solid state imaging (SSI) camera presently in orbit around Jupiter, and the second being the Imager for Mars Pathfinder (IMP) stereo camera on Mars. A basic strategy in both applications is to determine the correct relative camera pointing followed by direct map projection of the images. It is assumed that approximate camera pointing exists sufficient to locate adjacent images and to place initial tiepoints within reach of the correlator. Spatial correlation is used to fix tiepoints whose initial locations are predicted by the camera pointing. We use either an fast fourier transform (fft) algorithm or a variant of Gruen's scheme permitting limited image rotation and skew. The Gruen correlator has three hierarchical modes: 1) A classical spatial least squares correlation on integral pixel boundaries used when rotation is small. 2) An annealing non-deterministic search used when rotations are unknown. A simplex deterministic search used for the end game. The correlation operation can be performed either interactively or autonomously. The final camera pointing solution relies upon a simplex downhill search in 2n or 3n dimensions where n is the number of images comprising the mosaic and the objective function to be minimized is the disagreement between tiepoint locations predicted from the camera pointing with those observed by the correlator. For Galileo the 3n unknowns are euler angles defining camera pointing in planet coordinates, and for Mars Pathfinder they are 2n unknowns representing commanded azimuth and elevation in the Lander coordinate system.

Lorre, Jean J.↗

The suitability of the ILLIAC IV architecture for image processing

The major architectural features of the ILLIAC IV large scale, array processor are summarized along with their applicability to image processing. Several image processing algorithms are considered, including multispectral classification, texture feature extraction, two-dimensional Fourier transform, and synthetic aperture radar processing. The basic parallelism of the ILLIAC IV (64 processing elements acting in lock-step) is usually fully utilized by the image processing applications. The major architectural aspect of the system with respect to image processing is the relatively small local scratch-pad memory and the long latency time to access the main storage device. The major precision used for the image processing applications is the 32-bit floating point, given a choice of 8-bit integers and 64-bit floating point.

Stevenson, D. K.↗

Fourier-based three-dimensional multistage transformer for aberration correction in multicellular specimens

High-resolution tissue imaging is often compromised by sample-induced optical aberrations that degrade resolution and contrast. Although wavefront sensor-based adaptive optics (AO) can measure these aberrations, such hardware solutions are typically complex, expensive to implement and slow when serially mapping spatially varying aberrations across large fields of view. Here we introduce AOViFT (adaptive optical vision Fourier transformer)—a machine learning-based aberration sensing framework built around a three-dimensional multistage vision transformer that operates on Fourier domain embeddings. AOViFT infers aberrations and restores diffraction-limited performance in puncta-labeled specimens with substantially reduced computational cost, training time and memory footprint compared to conventional architectures or real-space networks. We validated AOViFT on live gene-edited zebrafish embryos, demonstrating its ability to correct spatially varying aberrations using either a deformable mirror or postacquisition deconvolution. By eliminating the need for the guide star and wavefront sensing hardware and simplifying the experimental workflow, AOViFT lowers technical barriers for high-resolution volumetric microscopy across diverse biological samples.

Alshaabi, Thayer [Howard Hughes Medical Institute,↗

Two-phase accurate multiplexed structured image capture (2pAc-MUSIC)

Multiplexed Structural Image Capture (MUSIC) technique uses modulation of light from a scene prior to imaging to encode the temporal evolution of target into spatial frequency shifts, with each shift corresponding to a unique time and resulting in individual distinct snapshots. Computational-processing of the multiplexed single-shot image can recover the nanosecond-resolution scene evolution. One of the limitations is the loss of spatial resolution of the recovered image due to limitations of the low-pass spatial frequency filtering depth. Here we demonstrated that two images with complementary spatial phases can be used to enhance the spatial resolutions. For this application, 2 Phase Accurate (2pAc)-MUSIC is implemented that a scene is encoded with two complementary phases. The increased spatial information captured reduces the lower frequency noise in the Fourier domain found in single-phase MUSIC. A recovery algorithm combines the 180-degree spatial frequency shifted images into a single scene and applies a spatial filter in the Fourier domain that has a larger depth than previously possible to achieve a scene with increased spatial resolution. The 2pAc-MUSIC can effectively enhance the spatial resolution by removing the overlapping zero-order spatial frequencies.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Operation of a deformable mirror device as a Fourier plane phase modulating filter

The operation of a deformable mirror device (DMD) as a Fourier plane phase modulating filter is described. An analysis of the optical characteristics of the DMD elements as phase modulators is summarized. Analytical and experimental results indicating the existence of a quasi-phase-only operational mode are presented. These results are used to specify the mirror deflection required to implement a binary phase-only image correlation operation. An optical correlator system is implemented using the DMD Fourier plane filter and experimental results from this system are compared with computer simulations of the correlator operation.

Florence, James M.↗

Collimated phase measuring deflectometry

Phase measuring deflectometry has been applied for free-form specular surface metrology, but its measured slope results are sensitive to the depth of sample positioning, which is also called the height-slope ambiguity. The objective of this work is to tackle this height-slope ambiguity problem. The main idea is to introduce collimated camera rays using a telecentric imaging lens and collimated structured-light illumination with a Fourier lens. This setup makes the fringe phases become only sensitive to the surface slopes and insensitive to the depth of the sample positioning. In this way, the slope calculation is theoretically independent of the sample depth. We call this new deflectometry technique Collimated Phase Measuring Deflectometry (CPMD). With our developed CPMD experimental setup, the measurement is insensitive to the depth of sample positioning, e.g., the measured height dispersion is less than 30 nm RMS within a 10 mm depth range when measuring a 50-mm-diameter spherical mirror with a 200 mm radius of curvature. In conclusion, the merits and limitations of the proposed CPMD technique are discussed, revealing its prospects in practical metrology applications and potential future investigations.

36 MATERIALS SCIENCE↗

Missing Wedge Completion via Unsupervised Learning with Coordinate Networks

Cryogenic electron tomography (cryoET) is a powerful tool in structural biology, enabling detailed 3D imaging of biological specimens at a resolution of nanometers. Despite its potential, cryoET faces challenges such as the missing wedge problem, which limits reconstruction quality due to incomplete data collection angles. Recently, supervised deep learning methods leveraging convolutional neural networks (CNNs) have considerably addressed this issue; however, their pretraining requirements render them susceptible to inaccuracies and artifacts, particularly when representative training data is scarce. To overcome these limitations, we introduce a proof-of-concept unsupervised learning approach using coordinate networks (CNs) that optimizes network weights directly against input projections. This eliminates the need for pretraining, reducing reconstruction runtime by 3–20× compared to supervised methods. Our in silico results show improved shape completion and reduction of missing wedge artifacts, assessed through several voxel-based image quality metrics in real space and a novel directional Fourier Shell Correlation (FSC) metric. Our study illuminates benefits and considerations of both supervised and unsupervised approaches, guiding the development of improved reconstruction strategies.

42 ENGINEERING↗

Modular, Fast, Two-Dimensional Cyclic Convolver

Proposed high-throughput, real-time synthetic-aperture-radar (SAR) processor built using new, modular, two-dimensional cyclic convolver architecture based on polynomial factorization and designed for very-large-scale integrated (VLSI) circuitry. New architecture reduces cost, size, and power dissipation of SAR processor in comparison to high-speed array-processor approach. Processor also used for other image-and data-processing applications involving two-dimensional Fourier transforms.

Liu, K. Y.↗

The electronically steered thinned array radiometer

An L-band radiometer which allows global imaging of soil moisture from LEO is discussed. The system consists of an array of antennas with amplifiers, a device to cross-correlate the signals from the antennas, and a process to translate the resulting data into an image of brightness temperature over the field of view. The process is based on a Fourier transform relation that exists between the incident electric field strength as a function of incidence angle and electric fields across the aperture plane of the antenna. The system's image reconstruction technique and signal-to-noise performance are examined.

Ruf, C. S.↗

Flux Recovery of a Forward Osmosis Membrane After a Fouling Process

Wastewater treatment through Forward Osmosis (FO) membranes is a process that has been evaluated in the past years as an innovative technology for the Next Generation Life Support Systems. FO technologies are cost effective, and require very low energy consumption, but are subject to membrane fouling. Membrane fouling occurs when unwanted materials accumulate on the active side of the membrane during the wastewater treatment process, which leads to a decrease in membrane flow rates. Membrane fouling can be reversed with the use of antifoulant solutions. The aim of this study is to identify the materials that cause flow rate reduction due to membrane fouling, as well as to evaluate the flux recovery after membrane treatment using commercially available antifoulants. 3D Laser Scanning Microscope images were taken to observe the surface of the membrane. Fourier Transform Infrared (FTIR) spectrometry results identified possible compounds that cause membrane fouling and FO testing results demonstrated flow rate recovery after membrane treatment using antifoulants.

Forward osmosis↗

Solidification Furnace for In Situ Observation of Bulk Transparent Systems and Image Analysis Methods

This paper aims to describe the experimental framework of the Directional Solidification Insert (DSI), installed onboard the International Space Station (ISS), dedicated to the in situ and real-time characterization of the dynamic selection of the solid-liquid interface morphology in bulk samples of transparent materials under diffusive growth conditions. The in situ observation of the solid-liquid interface is an invaluable tool for gaining knowledge on the time-evolution of the interface pattern because the initial morphological instability evolves nonlinearly and undergoes a reorganization process. The result of each experiment, characterized by the sample concentration, a thermal gradient and a pulling rate, is a large number of images. Interpretation of these images necessitates a robust identification of each cell/dendrite position and size during the entire solidification. Several image analysis methods have been developed to achieve this goal reliably despite varying contrast and noise levels, and are described in details. Typical solidification experiments are presented and the dynamics of the pattern formation are analyzed to illustrate the application of the image analysis methods.

Programming languages↗

Digital processing considerations for extraction of ocean wave image spectra from raw synthetic aperture radar data

The digital processing requirements of several algorithms for extracting the spectrum of a detected synthetic aperture radar (SAR) image from the raw SAR data are described and compared. The most efficient algorithms for image spectrum extraction from raw SAR data appear to be those containing an intermediate image formation step. It is shown that a recently developed compact formulation of the image spectrum in terms of the raw data is computationally inefficient when evaluated directly, in comparison with the classical method where matched-filter image formation is an intermediate result. It is also shown that a proposed indirect procedure for digitally implementing the same compact formulation is somewhat more efficient than the classical matched-filtering approach. However, this indirect procedure includes the image formation process as part of the total algorithm. Indeed, the computational savings afforded by the indirect implementation are identical to those obtained in SAR image formation processing when the matched-filtering algorithm is replaced by the well-known 'dechirp-Fourier transform' technique. Furthermore, corrections to account for slant-to-ground range conversion, spherical earth, etc., are often best implemented in the image domain, making intermediate image formation a valuable processing feature.

Lahaie, I. J.↗