Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image reconstruction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24

Pair-Wise, Deformable Mirror, Image Plane-Based Diversity Electric Field Estimation for High Contrast Coronagraphy

In this paper we describe the complex electric field reconstruction from image plane intensity measurements for high contrast coronagraphic imaging. A deformable mirror (DM) surface is modied with pairs of complementary shapes to create diversity in the image plane of the science camera where the intensity of the light is measured. Along with the Electric Field Conjugation correction algorithm, this estimation method has been used in various high contrast imaging testbeds to achieve the best contrasts to date both in narrow and in broad band light. We present the basic methodology of estimation in easy to follow list of steps, present results from HCIT and raise several open quations we are confronted with using this method.

coronagraphy↗

Assessment of holographic microscopy for quantifying marine particle size and concentration

Holographic microscopy has emerged as a tool for in situ imaging of microscopic organisms and other particles in the marine environment: appealing because of the relatively larger sampling volume and simpler optical configuration compared to other imaging systems. However, its quantitative capabilities have so far remained uncertain, in part because hologram reconstruction and image recognition have required manual operation. Here, we assess the quantitative skill of our automated hologram processing pipeline (CCV Pipeline), to evaluate the size and concentration measurements of environmental and cultured assemblages of marine plankton particles, and microspheres. Over 1 million particles, ranging from 10 to 200 μm in equivalent spherical diameter, imaged by the 4‐Deep HoloSea digital inline holographic microscope (DIHM) are analyzed. These measurements were collected in parallel with a FlowCam (FC), Imaging FlowCytobot (IFCB), and manual microscope identification. Once corrections for particle location and nonuniform illumination were developed and applied, the DIHM showed an underestimate in ESD of about 3% to 10%, but successfully reproduced the size spectral slope from environmental samples, and the size distribution of cultures (Dunaliella tertiolecta, Heterosigma akashiwo, and Prorocentrum micans) and microspheres. DIHM concentrations (order 1 to 1000 particles ml(exp −1)) showed a linear agreement (r(exp 2) = 0.73) with the other instruments, but individual comparisons at times had large uncertainty. Overall, we found the DIHM and the CCV Pipeline required extensive manual correction, but once corrected, provided concentration and size estimates comparable to the other imaging systems assessed in this study. Holographic cameras are mechanically simple, autonomous, can operate at very high pressures, and provide a larger sampling volume than comparable lens‐based tools. Thus, we anticipate that these characterization efforts will be rewarded with novel discovery in new oceanic environments.

Noah L. Walcutt↗

Adaptive 3D convolutional neural network-based reconstruction method for 3D coherent diffraction imaging

We present a novel adaptive machine-learning based approach for reconstructing three-dimensional (3D) crystals from coherent diffraction imaging. We represent the crystals using spherical harmonics (SH) and generate the corresponding synthetic diffraction patterns. We utilize 3D convolutional neural networks (CNNs) to learn a mapping between 3D diffraction volumes and the SH, which describe the boundary of the physical volumes from which they were generated. We use the 3D CNN-predicted SH coefficients as the initial guesses, which are then fine-tuned using adaptive model-independent feedback for improved accuracy. We also adaptively tune the locations, intensities, and decay rates of collections of radial basis functions in order to reproduce the non-uniform internal structure of 3D objects and demonstrate the method for a synthetic volume that has an internal void and a density ramp.

36 MATERIALS SCIENCE↗

Hybrid achromatic microlenses with high numerical apertures and focusing efficiencies across the visible

Abstract Compact visible wavelength achromats are essential for miniaturized and lightweight optics. However, fabrication of such achromats has proved to be exceptionally challenging. Here, using subsurface 3D printing inside mesoporous hosts we densely integrate aligned refractive and diffractive elements, forming thin high performance hybrid achromatic imaging micro-optics. Focusing efficiencies of 51–70% are achieved for 15μm thick, 90μm diameter, 0.3 numerical aperture microlenses. Chromatic focal length errors of less than 3% allow these microlenses to form high-quality images under broadband illumination (400–700 nm). Numerical apertures upwards of 0.47 are also achieved at the cost of some focusing efficiency, demonstrating the flexibility of this approach. Furthermore, larger area images are reconstructed from an array of hybrid achromatic microlenses, laying the groundwork for achromatic light-field imagers and displays. The presented approach precisely combines optical components within 3D space to achieve thin lens systems with high focusing efficiencies, high numerical apertures, and low chromatic focusing errors, providing a pathway towards achromatic micro-optical systems.

47 OTHER INSTRUMENTATION↗

Test images for the maximum entropy image restoration method

One of the major activities of any experimentalist is data analysis and reduction. In solar physics, remote observations are made of the sun in a variety of wavelengths and circumstances. In no case is the data collected free from the influence of the design and operation of the data gathering instrument as well as the ever present problem of noise. The presence of significant noise invalidates the simple inversion procedure regardless of the range of known correlation functions. The Maximum Entropy Method (MEM) attempts to perform this inversion by making minimal assumptions about the data. To provide a means of testing the MEM and characterizing its sensitivity to noise, choice of point spread function, type of data, etc., one would like to have test images of known characteristics that can represent the type of data being analyzed. A means of reconstructing these images is presented.

Mackey, James E.↗

A full-ring variable-aperture cadmium zinc telluride system for whole-body single photon emission computed tomography: realistic simulations with phantoms

Single photon emission computed tomography (SPECT) is an imaging modality that has demonstrated its utility in a number of clinical indications. Despite this progress, a high sensitivity, high spatial resolution, multi-tracer SPECT with a large field of view suitable for whole-body imaging of a broad range of radiotracers for theranostics is not available. Purpose We have designed a cadmium zinc telluride (CZT) variable-aperture full-ring SPECT scanner instrumented with a broad-energy tungsten collimator intended to fill this technological gap. The final purpose is to provide a multi-tracer solution for brain and whole-body imaging. Our static SPECT scanner breaks the paradigm of the standard dual- and triple-head rotational SPECT systems, utilizing a larger detector area in each scan increasing the sensitivity. We provide a demonstration of the performance of our design using a realistic model of our detector with simulated body-sized 99mTc phantoms. Methods We developed a realistic model of our detector by using a combination of a Geant4 Monte Carlo simulation and a CZT detector response model based on a finite element model. Our approach models the characteristic low-energy tail effect in CZT that noticeably affects the sensitivity and the quality of the scatter correction in CZT detectors. We implement a modified dual energy window scatter correction adapted to include the CZT low-energy tail effect. A dedicated correction is also developed to eliminate the undesirable truncation observed in images given the presence of detector edges and gaps between detectors, due to the non-rotational nature of our device. Corrections for the attenuation, detector response and the presence of collimators are also included. The images are reconstructed using the maximum-likelihood expectation-maximization algorithm implemented in the reconstruction open software STIR. Detector and reconstruction performance are characterized with a Derenzo phantom and a body-sized National Electrical Manufacturers Association (NEMA) Image Quality (IQ) phantom containing 99mTc. Results Our SPECT design can resolve 6.4mm rods in a Derenzo phantom and obtain a good image contrast with the IQ phantom. Explicit testing of the gap and edge correction is provided, showing an excellent performance in eliminating the image truncation artifacts. Our modified scatter correction shows no overestimation of the contrast-recovery ratio for our realistic CZT detector model, as opposed to the cases without correction and with a standard dual-energy window scatter correction. Conclusions In this paper, we further demonstrate the performance of our design for whole-body imaging purposes. This adds to our previous demonstration of improved qualitative and quantitative 99mTc imaging for brain perfusion and 123I imaging for dopamine transport with respect to state-of-the-art NaI dual-head cameras. We show that our design performs similarly to the VERITON SPECT from Spectrum Dynamics, a commercial full-ring CZT SPECT camera, with the potential advantage of the broader energy range of application given by our custom-design tungsten collimators. Here, our device combines high sensitivity and image resolution with a broad-energy imaging application for the purpose of clinical imaging and theranostics of emerging radionuclides.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

3-D Imaging In Virtual Environment: A Scientific Clinical and Teaching Tool

The advent of powerful graphics workstations and computers has led to the advancement of scientific knowledge through three-dimensional (3-D) reconstruction and imaging of biological cells and tissues. The Biocomputation Center at NASA Ames Research Center pioneered the effort to produce an entirely computerized method for reconstruction of objects from serial sections studied in a transmission electron microscope (TEM). The software developed, ROSS (Reconstruction of Serial Sections), is now being distributed to users across the United States through Space Act Agreements. The software is in widely disparate fields such as geology, botany, biology and medicine. In the Biocomputation Center, ROSS serves as the basis for development of virtual environment technologies for scientific and medical use. This report will describe the Virtual Surgery Workstation Project that is ongoing with clinicians at Stanford University Medical Center, and the role of the Visible Human data in the project.

Ross, Muriel D.↗

GNN-based end-to-end reconstruction in the CMS Phase 2 High-Granularity Calorimeter

We present the current stage of research progress towards a one-pass, completely Machine Learning (ML) based imaging calorimeter reconstruction. The model used is based on Graph Neural Networks (GNNs) and directly analyzes the hits in each HGCAL endcap. The ML algorithm is trained to predict clusters of hits originating from the same incident particle by labeling the hits with the same cluster index. We impose simple criteria to assess whether the hits associated as a cluster by the prediction are matched to those hits resulting from any particular individual incident particles. The algorithm is studied by simulating two tau leptons in each of the two HGCAL endcaps, where each tau may decay according to its measured standard model branching probabilities. The simulation includes the material interaction of the tau decay products which may create additional particles incident upon the calorimeter. Using this varied multiparticle environment we can investigate the application of this reconstruction technique and begin to characterize energy containment and performance.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Earth Observing-1 Advanced Land Imager: Imaging Performance On-Orbit

This report analyzes the on-orbit imaging performance of the Advanced Land Imager (ALI) on the Earth Observing-1 satellite. The pre-flight calibrations are first summarized. The methods used to reconstruct and geometrically correct the image data from this push-broom sensor are described. The method used here does not refer to the position and attitude telemetry from the spacecraft. Rather, it is assumed that the image of the scene moves across the focal plane with a constant velocity, which can be ascertained from the image data itself. Next, an assortment of the images so reconstructed is presented. Color images sharpened with the 10-m panchromatic band data are shown, and the algorithm for producing them from the 30-m multispectral data is described. The approach taken for assessing spatial resolution is to compare the sharpness of features in the on-orbit image data with profiles predicted on the basis of the pre-flight calibrations. A large assortment of bridge profiles is analyzed, and very good fits to the predicted shapes are obtained. Lunar calibration scans are analyzed to examine the sharpness of the edge-spread function at the limb of the moon. The darkness of the space beyond the limb is better for this purpose than anything that could be simulated on the ground. From these scans, we find clear evidence of scattering in the optical system, as well as some weak ghost images. Scans of planets and stars are also analyzed. Stars are useful point sources of light at all wavelengths, and delineate the point-spread functions of the system. From a quarter-speed scan over the Pleiades, we find that the ALI can detect 6th magnitude stars. The quality of the reconstructed images verifies the capability of the ALI to produce Landsat-type multi spectral data. The signal-to-noise and panchromatic spatial resolution are considerably superior to those of the existing Landsat sensors. The spatial resolution is confirmed to be as good as it was designed to be.

ALI (ADVANCED LAND IMAGER)↗

Optimum coherent imaging of a limited field of view in the presence of angular and aperture noise

The question of image distribution reconstruction for coherent illumination of an object located in the aperture far zone is considered from first principles without postulating any particular optical spread function. The object function is mathematically modeled as a complex random function of angular coordinates, and it is assumed that the object distribution of interest is angularly limited to a certain a priori assigned field of view (FOV). A linear reconstruction procedure that is uniformly optimal in the FOV is established by using the methods of statistical estimation. Two special cases are examined: imaging a limited sector of a wide-angle random scene and objects in the FOV immersed in a wide-angle background of angular noise. It is noted that the domain of application of the reconstruction method is restricted to microwave frequencies.

Borgiotti, G. V.↗

Computational Ghost Imaging for Remote Sensing

This work relates to the generic problem of remote active imaging; that is, a source illuminates a target of interest and a receiver collects the scattered light off the target to obtain an image. Conventional imaging systems consist of an imaging lens and a high-resolution detector array [e.g., a CCD (charge coupled device) array] to register the image. However, conventional imaging systems for remote sensing require high-quality optics and need to support large detector arrays and associated electronics. This results in suboptimal size, weight, and power consumption. Computational ghost imaging (CGI) is a computational alternative to this traditional imaging concept that has a very simple receiver structure. In CGI, the transmitter illuminates the target with a modulated light source. A single-pixel (bucket) detector collects the scattered light. Then, via computation (i.e., postprocessing), the receiver can reconstruct the image using the knowledge of the modulation that was projected onto the target by the transmitter. This way, one can construct a very simple receiver that, in principle, requires no lens to image a target. Ghost imaging is a transverse imaging modality that has been receiving much attention owing to a rich interconnection of novel physical characteristics and novel signal processing algorithms suitable for active computational imaging. The original ghost imaging experiments consisted of two correlated optical beams traversing distinct paths and impinging on two spatially-separated photodetectors: one beam interacts with the target and then illuminates on a single-pixel (bucket) detector that provides no spatial resolution, whereas the other beam traverses an independent path and impinges on a high-resolution camera without any interaction with the target. The term ghost imaging was coined soon after the initial experiments were reported, to emphasize the fact that by cross-correlating two photocurrents, one generates an image of the target. In CGI, the measurement obtained from the reference arm (with the high-resolution detector) is replaced by a computational derivation of the measurement-plane intensity profile of the reference-arm beam. The algorithms applied to computational ghost imaging have diversified beyond simple correlation measurements, and now include modern reconstruction algorithms based on compressive sensing.

Erkmen, Baris I.↗

Comparison of MSL RCS Jet Computations With Flow Visualization and Velocimetry

Numerical predictions of the Mars Science Laboratory (MSL) reaction control system (RCS) jets interacting with a Mach 10 hypersonic flow are compared to experimental nitric oxide (NO) planar laser-induced fluorescence (PLIF) data. The steady Reynolds Averaged Navier Stokes (RANS) equations using the Baldwin-Barth one-equation turbulence model were solved using the OVERFLOW code. The experimental PLIF data used for comparison consists of qualitative two-dimensional visualization images, qualitative reconstructed three-dimensional flow structures, and quantitative two-dimensional distributions of streamwise velocity. Through modeling of the PLIF signal equation, computational flow images (CFI) were produced and directly compared to the qualitative PLIF data. Post processing of the experimental and simulation data enabled the jet trajectory to be extracted for a more quantitative comparison. The two-dimensional velocity fields were reconstructed through interpolation of a series of single-component velocity profiles. Each distribution of single-component velocity was obtained using molecular tagging velocimetry (MTV). After validating the numerical model, the numerical solution was further examined to gain insight into hypersonic jet-in-crossflow interaction. Future NO-PLIF experiments are proposed based on this analysis.

Johansen, Craig T.↗

Predicting ptychography probe positions using single-shot phase retrieval neural network

Ptychography is a powerful imaging technique that is used in a variety of fields, including materials science, biology, and nanotechnology. However, the accuracy of the reconstructed ptychography image is highly dependent on the accuracy of the recorded probe positions which often contain errors. These errors are typically corrected jointly with phase retrieval through numerical optimization approaches. When the error accumulates along the scan path or when the error magnitude is large, these approaches may not converge with satisfactory result. We propose a fundamentally new approach for ptychography probe position prediction for data with large position errors, where a neural network is used to make single-shot phase retrieval on individual diffraction patterns, yielding the object image at each scan point. The pairwise offsets among these images are then found using a robust image registration method, and the results are combined to yield the complete scan path by constructing and solving a linear equation. We show that our method can achieve good position prediction accuracy for data with large and accumulating errors on the order of 10 2 pixels, a magnitude that often makes optimization-based algorithms fail to converge. For ptychography instruments without sophisticated position control equipment such as interferometers, our method is of significant practical potential.

47 OTHER INSTRUMENTATION↗

A feasibility study of hand kinematics for EVA analysis using magnetic resonance imaging

A new method of analyzing the kinematics of joint motion is developed. Magnetic Resonance Imaging (MRI) offers several distinct advantages. Past methods of studying anatomic joint motion have usually centered on four approaches. These methods are x-ray projection, goniometric linkage analysis, sonic digitization, and landmark measurement of photogrammetry. Of these four, only x-ray is applicable for in vivo studies. The remaining three methods utilize other types of projections of inter-joint measurements, which can cause various types of error. MRI offers accuracy in measurement due to its tomographic nature (as opposed to projection) without the problems associated with x-ray dosage. Once the data acquisition of MR images was complete, the images were processed using a 3D volume rendering workstation. The metacarpalphalangeal (MCP) joint of the left index finger was selected and reconstructed into a three-dimensional graphic display. From the reconstructed volumetric images, measurements of the angles of movement of the applicable bones were obtained and processed by analyzing the screw motion of the MCP joint. Landmark positions were chosen at distinctive locations of the joint at fixed image threshold intensity levels to ensure repeatability. The primarily two dimensional planar motion of this joint was then studied using a method of constructing coordinate systems using three (or more) points. A transformation matrix based on a world coordinate system described the location and orientation of a local target coordinate system. Future research involving volume rendering of MRI data focusing on the internal kinematics of the hand's individual ligaments, cartilage, tendons, etc. will follow. Its findings will show the applicability of MRI to joint kinematics for gaining further knowledge of the hand-glove (power assisted) design for extravehicular activity (EVA).

Dickenson, Rueben D.↗

Steps Toward a Large Space-Based UV/Optical Fizeau Interferometer: The GSFC Fizeau Interferometer Testbed (FIT)

Goddard Space Flight Center is pursuing the development of space-based, long-baseline (0.5km) UV-optical Fizeau imaging interferometers to enable the next major stride toward very high angular resolution astronomical observations. This effort includes the development and operation of the Fizeau Interferometry Testbed (FIT), in collaboration with the Naval Research Lab/NPOI, Univ. of MD, and Sigma Space Corporation. The FIT will be used to explore the principles of and requirements for the Stellar Imager (SI) mission concept (http://hires.gsfc.nasa.gov/~si) and other such Fizeau Interferometers/Sparse Aperture Telescope missions, leading in the end to the Planet Imager (PI), which is the ultimate goal of the current Origins Program. The primary goal of the FIT program is to demonstrate closed-loop control of mirrors (tip, tilt, piston, translation of array elements) and the overall system to keep the optical beams in phase and enable high quality imaging by a many-element (7-30) Fizeau Interferometric System. The FIT will also be used to assess various wave-front reconstruction and sensing and image reconstruction algorithms for utility and accuracy by application to real data generated by the Testbed. In this paper, we describe the design and goals of the system, provide a status report on its construction, and note our future plans.

Carpenter, K. G.↗

Comparison of Mars Science Laboratory Reaction Control System Jet Computations With Flow Visualization and Velocimetry

Numerical predictions of the Mars Science Laboratory reaction control system jets interacting with a Mach 10 hypersonic flow are compared to experimental nitric oxide planar laser-induced fluorescence data. The steady Reynolds Averaged Navier Stokes equations using the Baldwin-Barth one-equation turbulence model were solved using the OVERFLOW code. The experimental fluorescence data used for comparison consists of qualitative two-dimensional visualization images, qualitative reconstructed three-dimensional flow structures, and quantitative two-dimensional distributions of streamwise velocity. Through modeling of the fluorescence signal equation, computational flow images were produced and directly compared to the qualitative fluorescence data.

Bathel, Brett F.↗

Ultrasparse View X-ray Computed Tomography for 4D Imaging

X-ray computed tomography (CT) is a noninvasive, nondestructive approach to imaging materials, material systems, and engineered components in two and three dimensions. Acquisition of three-dimensional (3D) images requires the collection of hundreds or thousands of through-thickness X-ray radiographic images from different angles. Such 3D data acquisition strategies commonly involve suboptimal temporal sampling for in situ and operando studies (4D imaging). Herein, we introduce a sparse-view imaging approach, Tomo-NeRF, which is capable of reconstructing high-fidelity 3D images from <10 twodimensional radiographic images. Experimental 2D and 3D X-ray images were used to test the reconstruction capability in two-view, four-view, and six-view scenarios. Tomo-NeRF is capable of reconstructing 3D images with a structural similarity of 0.9971–0.9975 and a voxel-wise accuracy of 81.83–89.59% from 2D experimentally obtained images. Furthermore, the reconstruction accuracy for the experimentally obtained images is less than the synthetic structures. Experimentally obtained images demonstrate a similarity of 0.9973–0.9984 and a voxelwise accuracy of 84.31–95.77%.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Quantum optical classifier with superexponential speedup

Abstract Classification is a central task in deep learning algorithms. Usually, images are first captured and then processed by a sequence of operations, of which the artificial neuron represents one of the fundamental units. This paradigm requires significant resources that scale (at least) linearly in the image resolution, both in terms of photons and computational operations. Here, we present a quantum optical pattern recognition method for binary classification tasks. It classifies objects without reconstructing their images, using the rate of two-photon coincidences at the output of a Hong-Ou-Mandel interferometer, where both the input and the classifier parameters are encoded into single-photon states. Our method exhibits the behaviour of a classical neuron of unit depth. Once trained, it shows a constant $${{\mathcal{O}}}(1)$$ O ( 1 ) complexity in the number of computational operations and photons required by a single classification. This is a superexponential advantage over a classical artificial neuron.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗