SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Radar images of ocean surface waves near hurricane Josephine were acquired with the Shuttle Imaging Radar-B (SIR-B) system on October 12, 1984. Fast Fourier transform analyses of the images were performed along most of the 600-km image track. These data reveal the presence of at least two dominant wave systems which undergo significant spatial variations in wavelength and direction.
Abstract. Phase correlation (PC) is a well-known method for estimating cloud motion vectors (CMVs) from infrared and visible spectrum images. Commonly, phase shift is computed in the small blocks of the images using the fast Fourier transform. In this study, we investigate the performance and the stability of the blockwise PC method by changing the block size, the frame interval, and combinations of red, green, and blue (RGB) channels from the total sky imager (TSI) at the United States Atmospheric Radiation Measurement user facility's Southern Great Plains site. We find that shorter frame intervals, followed by larger block sizes, are responsible for stable estimates of the CMV, as suggested by the higher autocorrelations. The choice of RGB channels has a limited effect on the quality of CMVs, and the red and the grayscale images are marginally more reliable than the other combinations during rapidly evolving low-level clouds. The stability of CMVs was tested at different image resolutions with an implementation of the optimized algorithm on the Sage cyberinfrastructure test bed. We find that doubling the frame rate outperforms quadrupling the image resolution in achieving CMV stability. The correlations of CMVs with the wind data are significant in the range of 0.38–0.59 with a 95 % confidence interval, despite the uncertainties and limitations of both datasets. A comparison of the PC method with constructed data and the optical flow method suggests that the post-processing of the vector field has a significant effect on the quality of the CMV. The raindrop-contaminated images can be identified by the rotation of the TSI mirror in the motion field. The results of this study are critical to optimizing algorithms for edge-computing sensor systems.
Frequency-variable illumination has been used previously to provide high resolution imaging in one dimension. The paper extends the results on this imaging by frequency scanning to derive the expression for a two-dimensional image. This is the Fourier transformation, with respect to the angle and frequency of illumination, of the electric field detected in the far-field region of the object. The case is considered of a rough object and it is shown that for roughness finer than the resolution of the imaging system, the image has a granular appearance corresponding to the classical speckle effect. Large scale phase perturbations lead to the elevation displacement effect.
The present conference discusses topics in the fields of feature extraction and implementation, filter and correlation algorithms, optical correlators, high-level algorithms, and digital image processing for ranging and remote driving. Attention is given to a nonlinear filter derived from topological image features, IR image segmentation through iterative thresholding, orthogonal subspaces for correlation masking, composite filter trees and image recognition via binary search, and features of matrix-coherent optical image processing. Also discussed are multitarget tracking via hybrid joint transform correlator, binary joint Fourier transform correlator considerations, global image processing operations on parallel architectures, real-time implementation of a differential range finder, and real-time binocular stereo range and motion detection.
Deblurring capabilities would significantly improve the scientific return from Space Shuttle crew-acquired images of the Earth and the safety of Space Shuttle missions. Deblurring techniques were developed and demonstrated on two digitized images that were blurred in different ways. The first was blurred by a Gaussian blurring function analogous to that caused by atmospheric turbulence, while the second was blurred by improper focussing. It was demonstrated, in both cases, that the nature of the blurring (Gaussian and Airy) and the appropriate parameters could be obtained from the Fourier transformation of their images. The difficulties posed by the presence of noise necessitated special consideration. It was demonstrated that a modified Wiener frequency filter judiciously constructed to avoid over emphasis of frequency regions dominated by noise resulted in substantially improved images. Several important areas of future research were identified. Two areas of particular promise are the extraction of blurring information directly from the spatial images and improved noise abatement form investigations of select spatial regions and the elimination of spike noise.
Multimodal imaging—the ability to acquire images of an object through more than one imaging mode simultaneously—has opened additional perspectives in areas ranging from astronomy to medicine. In this paper, we report progress toward combining optical and magnetic resonance (MR) imaging in such a “dual” imaging mode. They are attractive in combination because they offer complementary advantages of resolution and speed, especially in the context of imaging in scattering environments. Our approach relies on a specific material platform, microdiamond particles hosting nitrogen vacancy (NV) defect centers that fluoresce brightly under optical excitation and simultaneously “hyperpolarize” lattice C 13 nuclei, making them bright under MR imaging. We highlight advantages of dual-mode optical and MR imaging in allowing background-free particle imaging and describe regimes in which either mode can enhance the other. Leveraging the fact that the two imaging modes proceed in Fourier-reciprocal domains (real and k-space), we propose a sampling protocol that accelerates image reconstruction in sparse-imaging scenarios. Our work suggests interesting possibilities for the simultaneous optical and low-field MR imaging of targeted diamond nanoparticles.
We process and analyze muon airshower data from the NOvA far detector using various image processing algorithms, such as Fast Fourier Transformation, and Hough line transformation. From the processed event images, we calculate multiple parameters for our study. We are looking for physics features, including East-West Asymmetry, anisotropies in right ascension, and seasonal variation. Additionally, we have developed an algorithm to count the multiplicity of muons in the airshower events using the single muon data.
The first physical demonstration of the principle of image reconstruction using a set of images from a diffraction-blurred elongated aperture is reported. This is an optical validation of previous theoretical and numerical simulations of the COSMIC telescope array (coherent optical system of modular imaging collectors). The present experiment utilizes 17 diffraction blurred exposures of a laboratory light source, as imaged by a lens covered by a narrow-slit aperture; the aperture is rotated 10 degrees between each exposure. The images are recorded in digitized form by a CCD camera, Fourier transformed, numerically filtered, and added; the sum is then filtered and inverse Fourier transformed to form the final image. The image reconstruction process is found to be stable with respect to uncertainties in values of all physical parameters such as effective wavelength, rotation angle, pointing jitter, and aperture shape. Future experiments will explore the effects of low counting rates, autoguiding on the image, various aperture configurations, and separated optics.
SAR imaging may be performed with range-resolved reflection data, where a spread-spectrum signal, such as a code division multiple access (CDMA) signal, is transmitted instead of a simple frequency chirp. The reflected spread-spectrum signal may be analyzed to gather range-resolved reflection data. Range-resolved reflection data may be gathered at each angular view. This data may be used to construct a more accurate approximation of the Fourier transform of the desired image than can be done by a conventional SAR approach. The image may be reconstructed from this Fourier transform using Fourier inversion techniques similar to those used in conventional SAR approaches. The range-resolved reflection scheme generally requires somewhat more processing to recover the image as compared with conventional SAR systems, but provides a significantly more stable image with less degradation from effects that plague conventional SAR systems. This can eliminate the need for phase coherency altogether and also eliminate “phase drift,” which leads to image distortion. This may be especially well suited for high resolution imaging of relatively large targets.
Interferometers are widely used in imaging technologies to achieve enhanced spatial resolution, but require that the incoming photons be indistinguishable. In previous work, we built and analyzed color erasure detectors which expand the scope of intensity interferometry to accommodate sources of different colors. Here we demonstrate experimentally how color erasure detectors can achieve improved spatial resolution in an imaging task, well beyond the diffraction limit. Utilizing two 10.9 mm-aperture telescopes and a 0.8 m baseline, we measure the distance between a 1063.6 nm source and a 1064.4 nm source separated by 4.2 mm at a distance of 1.43 km, which surpasses the diffraction limit of a single telescope by about 40 times. Moreover, chromatic intensity interferometry allows us to recover the phase of the Fourier transform of the imaged objects – a quantity that is, in the presence of modest noise, inaccessible to conventional intensity interferometry.
It was experimentally determined whether induced differences in forest canopy chemical composition can be detected using data from the Airborne Imaging Spectrometer (AIS). Treatments were applied to an even-aged forest of Douglas fir trees. Work to date has stressed wet chemical analysis of foilage samples and correction of AIS data. Plot treatments were successful in providing a range of foliar N2 concentrations. Much time was spent investigating and correcting problems with the raw AIS data. Initial problems with groups of drop out lines in the AIS data were traced to the tape recorder and the tape drive. Custom adjustment of the tape drive led to recovery of most missing lines. Remaining individual drop out lines were replaced using average of adjacent lines. Application of a notch filter to the Fourier transform of the image in each band satisfactorily removed vertical striping. The aspect ratio was corrected by resampling the image in the line direction using nearest neighbor interpolation.
A structural-stochastic image model is developed for the analysis and synthesis of cloud images. The ability of the model to characterize the visual appearance of cloud fields observed by satellite with a limited number of parameters is demonstrated. The model merges structural and stochastic information, the stochastic model acting as a local statistical operator applied to the output of the structural model. The structural or large-scale organization of the scene is retrieved from the two-dimensional Fourier representation of the digital image. The pattern generated by the major Fourier components provides a first guess of the scene. The stochastic aspect is described by a Markov model of texture that assumes a binomial probability distribution for the local grey-level variability. This Markov model provides four parameters that represent the clustering strength in the horizontal, vertical and diagonal directions. These parameters are estimated by a standard maximum-likelihood technique. The image can be reproduced with a fair degree of verisimilitude from these parameters. The data compression factor is of the order of one hundred to several hundreds.
Bragg coherent diffractive imaging (BCDI) is a noninvasive microscopy technique that can visualize the shape and internal lattice deviations of crystals with nanoscale spatial resolution and picometer deformation sensitivity. Its strain imaging capability relies on Fourier transform–based iterative phase retrieval algorithms, which are mostly developed under the kinematical approximation. Such approximation prohibits the application of BCDI on larger crystals, which are commonly seen in most emerging functional materials. Understanding the dynamical effect in BCDI, as well as developing a validated method for modeling BCDI at the dynamical diffraction limit, is crucial for applying BCDI to hierarchical systems that contain micron-sized crystals and grains. Thus we report a comparative study on the impact of dynamical diffraction effects by comparing the reconstruction results from two measurements of the same crystal. Forward simulation is implemented to show subtle changes of interference fringes in the diffraction pattern due to the dynamical diffraction, and is compared directly with the experimental data.
The phase retrieval problem, where one aims to recover a complex-valued image from far-field intensity measurements, is a classic problem encountered in a range of imaging applications. Modern phase retrieval approaches usually rely on gradient descent methods in a nonlinear minimization framework. Calculating closed-form gradients for use in these methods is tedious work, and formulating second order derivatives is even more laborious. Additionally, second order techniques often require the storage and inversion of large matrices of partial derivatives, with memory requirements that can be prohibitive for data-rich imaging modalities. We use a reverse-mode automatic differentiation (AD) framework to implement an efficient matrix-free version of the Levenberg-Marquardt (LM) algorithm, a longstanding method that finds popular use in nonlinear least-square minimization problems but which has seen little use in phase retrieval. Furthermore, we extend the basic LM algorithm so that it can be applied for more general constrained optimization problems (including phase retrieval problems) beyond just the least-square applications. Since we use AD, we only need to specify the physics-based forward model for a specific imaging application; the first and second-order derivative terms are calculated automatically through matrix-vector products, without explicitly forming the large Jacobian or Gauss-Newton matrices typically required for the LM method. We demonstrate that this algorithm can be used to solve both the unconstrained ptychographic object retrieval problem and the constrained “blind” ptychographic object and probe retrieval problems, under the popular Gaussian noise model as well as the Poisson noise model. We compare this algorithm to state-of-the-art first order ptychographic reconstruction methods to demonstrate empirically that this method outperforms best-in-class first-order methods: it provides excellent convergence guarantees with (in many cases) a superlinear rate of convergence, all with a computational cost comparable to, or lower than, the tested first-order algorithms.
proposed joint-transform optical correlator (JTOC) would be capable of operating as a real-time pattern-recognition processor. The key correlation-filter reading/writing medium of this JTOC would be an updateable holographic photopolymer. The high-resolution, high-speed characteristics of this photopolymer would enable pattern-recognition processing to occur at a speed three orders of magnitude greater than that of state-of-the-art digital pattern-recognition processors. There are many potential applications in biometric personal identification (e.g., using images of fingerprints and faces) and nondestructive industrial inspection. In order to appreciate the advantages of the proposed JTOC, it is necessary to understand the principle of operation of a conventional JTOC. In a conventional JTOC (shown in the upper part of the figure), a collimated laser beam passes through two side-by-side spatial light modulators (SLMs). One SLM displays a real-time input image to be recognized. The other SLM displays a reference image from a digital memory. A Fourier-transform lens is placed at its focal distance from the SLM plane, and a charge-coupled device (CCD) image detector is placed at the back focal plane of the lens for use as a square-law recorder. Processing takes place in two stages. In the first stage, the CCD records the interference pattern between the Fourier transforms of the input and reference images, and the pattern is then digitized and saved in a buffer memory. In the second stage, the reference SLM is turned off and the interference pattern is fed back to the input SLM. The interference pattern thus becomes Fourier-transformed, yielding at the CCD an image representing the joint-transform correlation between the input and reference images. This image contains a sharp correlation peak when the input and reference images are matched. The drawbacks of a conventional JTOC are the following: The CCD has low spatial resolution and is not an ideal square-law detector for the purpose of holographic recording of interference fringes. A typical state-of-the-art CCD has a pixel-pitch limited resolution of about 100 lines/mm. In contrast, the holographic photopolymer to be used in the proposed JTOC offers a resolution > 2,000 lines/mm. In addition to being disadvantageous in itself, the low resolution of the CCD causes overlap of a DC term and the desired correlation term in the output image. This overlap severely limits the correlation signal-to-noise ratio. The two-stage nature of the process limits the achievable throughput rate. A further limit is imposed by the low frame rate (typical video rates) of low- and medium-cost commercial CCDs.
The author has identified the following significant results. For the recognition of terrain types, spatial signatures are developed from the diffraction patterns of small areas of ERTS-1 images. This knowledge is exploited for the measurements of a small number of meaningful spatial features from the digital Fourier transforms of ERTS-1 image cells containing 32 x 32 picture elements. Using these spatial features and a heuristic algorithm, the terrain types in the vicinity of Phoenix, Arizona were recognized by the computer with a high accuracy. Then, the spatial features were combined with spectral features and using the maximum likelihood criterion the recognition accuracy of terrain types increased substantially. It was determined that the recognition accuracy with the maximum likelihood criterion depends on the statistics of the feature vectors. Nonlinear transformations of the feature vectors are required so that the terrain class statistics become approximately Gaussian. It was also determined that for a given geographic area the statistics of the classes remain invariable for a period of a month but vary substantially between seasons.
Spatially resolved mass spectrometry (MS)-based multi-omics workflows are becoming more utilized for revealing the complex biology that occurs within tissues. However, these approaches commonly require multiple independent tissue sections to analyze the metabolite and protein compositions of these samples. This poses a significant challenge in preserving cell- or region-specific molecular fidelity, as variations between tissue sections can compromise the accurate correlation of molecular data. Here, in this study, we developed workflows for comprehensive multi-omics profiling from a single tissue section (STS) using different MS modalities. We enhanced the functionality of an electrically insulated substrate by employing metal-assisted approaches that enabled both MS-based untargeted spatial metabolomics and proteomics from STS. This allowed metabolite imaging using matrix-assisted laser desorption/ionization-MS imaging (MALDI-MSI), without compromising it for subsequent proteome profiling with laser capture microdissection (LCM)-based technology. Specifically, implementing copper tape as a backing for polyethylene naphthalate (PEN) slides enabled the detection of >140 metabolites across a poplar root tissue section using MALDI-trapped ion mobility spectrometry time of flight (timsTOF)-MS. Afterwards, we detected 6,571 unique proteins from two distinct root regions by leveraging LCM technology coupled to our microdroplet based sample preparation approach. We also developed an alternative workflow utilizing gold-coated PEN substrates for imaging with MALDI-Fourier-transform ion cyclotron resonance (FTICR)-MS, which permitted the profiling of >170 metabolites and the identification of 6,542 unique proteins across a single poplar root tissue section. These results were comparable to using each assay independently without modifications. These approaches offer new opportunities for high-resolution molecular profiling of multiple omics-levels across biological tissues.
Complete theoretical understanding of the most complex superconductors requires a detailed knowledge of the symmetry of the superconducting energy-gap Δ$^α_k$, for all momenta k on the Fermi surface of every band α. While there are a variety of techniques for determining |Δ$^α_k$|, no general method existed to measure the signed values of Δ$^α_k$. Recently, however, a technique based on phase-resolved visualization of superconducting quasiparticle interference (QPI) patterns, centered on a single non-magnetic impurity atom, was introduced. In principle, energy-resolved and phase-resolved Fourier analysis of these images identifies wavevectors connecting all k-space regions where Δ$^α_k$ has the same or opposite sign. But use of a single isolated impurity atom, from whose precise location the spatial phase of the scattering interference pattern must be measured, is technically difficult. Here we introduce a generalization of this approach for use with multiple impurity atoms, and demonstrate its validity by comparing the Δ$^α_k$ it generates to the Δ$^α_k$ determined from single-atom scattering in FeSe where s ± energy-gap symmetry is established. Finally, to exemplify utility, we use the multi-atom technique on LiFeAs and find scattering interference between the hole-like and electron-like pockets as predicted for Δ$^α_k$ of opposite sign.