Vision transformer for multi-domain phase retrieval in coherent diffraction imaging
Explore the source record for details and available documents.
SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
No abstract available
No abstract available
This presentation will detail the packaging and hardware chosen for the PRC, the PRC software, and calibration of the instrument.
No abstract provided
Explore the source record for details and available documents.
Ptychographic imaging is a powerful means of imaging beyond the resolution limits of typical x-ray optics. Capturing recovered images from raw ptychographic data, however, requires the solution of an inverse problem, namely, phase retrieval. Phase retrieval algorithms are computationally expensive, which precludes real-time imaging. In this work, we propose PtychoNN, an approach to solve the ptychography data inversion problem based on a deep convolutional neural network. We demonstrate how the proposed method can be used to predict real-space structure and phase at each scan point solely from the corresponding far-field diffraction data. Our results demonstrate the practical application of machine learning to recover high fidelity amplitude and phase contrast images of a real sample hundreds of times faster than current ptychography reconstruction packages. Furthermore, by overcoming the constraints of iterative model-based methods, we can significantly relax sampling constraints on data acquisition while still producing an excellent image of the sample. Besides drastically accelerating acquisition and analysis, this capability has profound implications for the imaging of dose sensitive, dynamic, and extremely voluminous samples.
The nascent field of planet detection has yielded a host of extra-solar planet detections. To date, these detections have been the result of indirect techniques: the planet is inferred by precisely measuring its effect on the host star. Direct observation of extra-solar planets remains a challenging yet compelling goal. In this vein, the Center for Adaptive Optics has proposed a ground-based, high-actuator density extreme A0 system (XAOPI), for a large (~10 m) telescope whose ultimate goal is to directly evidence a specific class of these objects: young and massive planets. Detailed system wave-front error budgets suggest that this system is a feasible, if not an ambitious, proposition. One key element in this error budget is the calibration and maintenance of the science camera wave front with respect to the wave-front sensor which currently as an allowable contribution of ~ 5 nanometers rms. This talk first summarizes the current status of calibration on existing ground-based A0 systems, the magnitude of this effect in the system error budget and current techniques for mitigation. Subsequently, we will explore the nature of this calibration error term, it's source in the non-commonality between the science camera and wave front sensor, and the effect of the temporal evolution of non-commonality. Finally, we will describe preliminary plans for sensing and controlling this error term. The sensing techniques include phase retrieval, phase contrast and external metrology. To conclude, a calibration scenario that meets the stringent requirement for XAOPI will be discussed.
A method of recovering unknown aberrations in an optical system includes collecting intensity data produced by the optical system, generating an initial estimate of a phase of the optical system, iteratively performing a phase retrieval on the intensity data to generate a phase estimate using an initial diversity function corresponding to the intensity data, generating a phase map from the phase retrieval phase estimate, decomposing the phase map to generate a decomposition vector, generating an updated diversity function by combining the initial diversity function with the decomposition vector, generating an updated estimate of the phase of the optical system by removing the initial diversity function from the phase map. The method may further include repeating the process beginning with iteratively performing a phase retrieval on the intensity data using the updated estimate of the phase of the optical system in place of the initial estimate of the phase of the optical system, and using the updated diversity function in place of the initial diversity function, until a predetermined convergence is achieved.
The performance of an optical system (for example, a telescope) is limited by the misalignments and manufacturing imperfections of the optical elements in the system. The impact of these misalignments and imperfections can be quantified by the phase variations imparted on light traveling through the system. Phase retrieval is a methodology for determining these variations. Phase retrieval uses images taken with the optical system and using a light source of known shape and characteristics. Unlike interferometric methods, which require an optical reference for comparison, and unlike Shack-Hartmann wavefront sensors that require special optical hardware at the optical system's exit pupil, phase retrieval is an in situ, image-based method for determining the phase variations of light at the system s exit pupil. Phase retrieval can be used both as an optical metrology tool (during fabrication of optical surfaces and assembly of optical systems) and as a sensor used in active, closed-loop control of an optical system, to optimize performance. One class of phase-retrieval algorithms is the iterative transform algorithm (ITA). ITAs estimate the phase variations by iteratively enforcing known constraints in the exit pupil and at the detector, determined from modeled or measured data. The Variable Sampling Mapping (VSM) technique is a new method for enforcing these constraints in ITAs. VSM is an open framework for addressing a wide range of issues that have previously been considered detrimental to high-accuracy phase retrieval, including undersampled images, broadband illumination, images taken at or near best focus, chromatic aberrations, jitter or vibration of the optical system or detector, and dead or noisy detector pixels. The VSM is a model-to-data mapping procedure. In VSM, fully sampled electric fields at multiple wavelengths are modeled inside the phase-retrieval algorithm, and then these fields are mapped to intensities on the light detector, using the properties of the detector and optical system, for comparison with measured data. Ultimately, this model-to-data mapping procedure enables a more robust and accurate way of incorporating the exit-pupil and image detector constraints, which are fundamental to the general class of ITA phase retrieval algorithms.
The figure depicts the planned Actuated Hybrid Mirror Telescope (AHMT), which is intended to demonstrate a new approach to the design and construction of wide-aperture spaceborne telescopes for astronomy and Earth science. This technology is also appropriate for Earth-based telescopes. The new approach can be broadly summarized as using advanced lightweight mirrors that can be manufactured rapidly at relatively low cost. More specifically, it is planned to use precise replicated metallic nanolaminate mirrors to obtain the required high-quality optical finishes. Lightweight, dimensionally stable silicon carbide (SiC) structures will support the nanolaminate mirrors in the required surface figures. To enable diffraction- limited telescope performance, errors in surface figures will be corrected by use of mirror-shape-control actuators that will be energized, as needed, by a wave-front-sensing and control system. The concepts of nanolaminate materials and mirrors made from nanolaminate materials were discussed in several previous NASA Tech Briefs articles. Nanolaminates constitute a relatively new class of materials that can approach theoretical limits of stiffness and strength. Nanolaminate mirrors are synthesized by magnetron sputter deposition of metallic alloys and/or compounds on optically precise master surfaces to obtain optical-quality reflector surfaces backed by thin shell structures. As an integral part of the deposition process, a layer of gold that will constitute the reflective surface layer is deposited first, eliminating the need for a subsequent and separate reflective-coating process. The crystallographic textures of the nanolaminate will be controlled to optimize the performance of the mirror. The entire deposition process for making a nanolaminate mirror takes less than 100 hours, regardless of the mirror diameter. Each nanolaminate mirror will be bonded to its lightweight SiC supporting structure. The lightweight nanolaminate mirrors and SiC supporting structures will be fabricated from reusable master molds. The mirror-shape-control actuators will be low-power, high-capacitance lead magnesium niobate electrostrictive actuators that will be embedded in the SiC structures. The mode of operation of these actuators will be such that once power was applied, they will change in length and once power was removed, they will maintain dimensional stability to nanometer precision. This mode of operation will enable the use of low-power, minimally complex electronic control circuitry. The wave-front-sensing and control system will be designed and built according to a two-stage architecture. The first stage will be implemented by a Shack- Hartmann (SH) sensor subsystem, which will provide a large capture range. The second, higher-performance stage will be implemented by an image-based wave-front-sensing subsystem that will include a phase-retrieval camera (PRC), and will utilize phase retrieval and other techniques to measure wavefront error directly. Phase retrieval is a process in which multiple images of an unresolved object are iterated to estimate the phase of the optical system that acquired the images. The combination of SH and phase-retrieval sensors will afford the virtues of both a dynamic range of 105 and an accuracy of <10 nm.
Phase retrieval, the problem of recovering lost phase information from measured intensity alone, is an inverse problem that is widely faced in various imaging modalities ranging from astronomy to nanoscale imaging. The current process of phase recovery is iterative in nature. As a result, the image formation is time consuming and computationally expensive, precluding real-time imaging. Here, we use 3D nanoscale X-ray imaging as a representative example to develop a deep learning model to address this phase retrieval problem. We introduce 3D-CDI-NN, a deep convolutional neural network and differential programing framework trained to predict 3D structure and strain, solely from input 3D X-ray coherent scattering data. Our networks are designed to be “physics-aware” in multiple aspects; in that the physics of the X-ray scattering process is explicitly enforced in the training of the network, and the training data are drawn from atomistic simulations that are representative of the physics of the material. We further refine the neural network prediction through a physics-based optimization procedure to enable maximum accuracy at lowest computational cost. 3D-CDI-NN can invert a 3D coherent diffraction pattern to real-space structure and strain hundreds of times faster than traditional iterative phase retrieval methods. Our integrated machine learning and differential programing solution to the phase retrieval problem is broadly applicable across inverse problems in other application areas.
The single-scattering albedo and phase function of African mineral dust are retrieved from ground-based measurements of sky radiance collected in the Florida Keys. The retrieval algorithm employs the radiative transfer equation to solve by iteration for these two properties which best reproduce the observed sky radiance using an assumed aerosol vertical structure and measured aerosol optical depth. Thus, no assumptions regarding particle size, shape, or composition are required. The single-scattering albedo, presented at fourteen wavelengths between 380 and 870 nm, displays a spectral shape expected of iron-bearing minerals but is much higher than current dust models allow. This indicates the absorption of light by mineral dust is significantly overestimated in climate studies. Uncertainty in the retrieved albedo is less than 0.02 due to the small uncertainty in the solar-reflectance-based calibration (12.2%) method employed. The phase function retrieved at 860 nm is very robust under simulations of expected experimental errors, indicating retrieved phase functions at this wavelength may be confidently used to describe aerosol scattering characteristics. The phase function retrieved at 443 nm is very sensitive to expected experimental errors and should not be used to describe aerosol scattering. Radiative forcing by aerosol is the greatest source of uncertainty in current climate models. These results will help reduce uncertainty in the absorption of light by mineral dust. Assessment of the radiative impact of aerosol species is a key component to NASA's Earth System Enterprise.
Abstract The problem of phase retrieval underlies various imaging methods from astronomy to nanoscale imaging. Traditional phase retrieval methods are iterative and are therefore computationally expensive. Deep learning (DL) models have been developed to either provide learned priors or completely replace phase retrieval. However, such models require vast amounts of labeled data, which can only be obtained through simulation or performing computationally prohibitive phase retrieval on experimental datasets. Using 3D X-ray Bragg coherent diffraction imaging (BCDI) as a representative technique, we demonstrate AutoPhaseNN, a DL-based approach which learns to solve the phase problem without labeled data. By incorporating the imaging physics into the DL model during training, AutoPhaseNN learns to invert 3D BCDI data in a single shot without ever being shown real space images. Once trained, AutoPhaseNN can be effectively used in the 3D BCDI data inversion about 100× faster than iterative phase retrieval methods while providing comparable image quality.
A method was developed for performing relatively high-speed wavefront sensing and control to overcome thermal instabilities in a segmented primary mirror telescope [e.g., James Webb Space Telescope (JWST) at L2], by using the onboard fine guidance sensor (FGS) to minimize expense and complexity. This FGS performs centroiding on a bright star to feed the information to the pointing and control system. The proposed concept is to beam split the image of the guide star (or use a single defocused guide star image) to perform wavefront sensing using phase retrieval techniques. Using the fine guidance sensor star image for guiding and fine phasing eliminates the need for other, more complex ways of achieving very accurate sensing and control that is needed for UV-optical applications. The phase retrieval occurs nearly constantly, so passive thermal stability over fourteen days is not required. Using the FGS as the sensor, one can feed segment update information to actuators on the primary mirror that can update the primary mirror segment fine phasing with this frequency. Because the thermal time constants of the primary mirror are very slow compared to this duration, the mirror will appear extremely stable during observations (to the level of accuracy of the sensing and control). The sensing can use the same phase retrieval techniques as the JWST by employing an additional beam splitter, and having each channel go through a weak lens (one positive and one negative). The channels can use common or separate detectors. Phase retrieval can be performed onboard. The actuation scheme would include a coarse stage able to achieve initial alignment of several millimeters of range (similar to JWST and can use a JWST heritage sensing approach in the science camera) and a fine stage capable of continual updates.
Cloud microphysical and optical properties are inferred from the bidirectional reflectances simulated for a single-layered cloud consisting of an external mixture of ice particles and liquid droplets. The reflectances are calculated with a rigorous discrete ordinates radiative transfer model and are functions of the cloud effective particle size, the cloud optical thickness, and the values of the ice fraction in the cloud (i.e., the ratio of ice water content to total water content). In the present light scattering and radiative transfer simulations, the ice fraction is assumed to be vertically homogeneous; the habit (shape) percentage as a function of ice particle size is consistent with that used for the Moderate Resolution Imaging Spectroradiometer (MODIS) operational (Collection 4 and earlier) cloud products; and the surface is assumed to be Lambertian with an albedo of 0.03. Furthermore, error analyses pertaining to the inference of the effective particle sizes and optical thicknesses of mixed-phase clouds are performed. Errors are calculated with respect to the assumption of a cloud containing solely liquid or ice phase particles. The analyses suggest that the effective particle size inferred for a mixed-phase cloud can be underestimated (or overestimated) if pure liquid phase (or pure ice phase) is assumed for the cloud, whereas the corresponding cloud optical thickness can be overestimated (or underestimated).
Technical work during September-December 1990 consisted of: (1) analyzing HST point source images obtained from JPL; (2) retrieving phase information from the images by a direct (noniterative) technique; and (3) characterizing the wavefront aberration due to the errors in the Hubble Space Telescope (HST) mirrors, in a preliminary manner. This work was in support of JPL design of compensating optics for the next generation wide-field planetary camera on HST. This digital technique for phase retrieval from pairs of defocused images, is based on the energy transport equation between these image planes. In addition, an end-to-end wave optics routine, based on the JPL Code 5 prescription of the unaberrated HST and WFPC, was derived for output of the reference phase front when mirror error is absent. Also, the Roddier routine unwrapped the retrieved phase by inserting the required jumps of +/- 2(pi) radians for the sake of smoothness. A least-squares fitting routine, insensitive to phase unwrapping, but nonlinear, was used to obtain estimates of the Zernike polynomial coefficients that describe the aberration. The phase results were close to, but higher than, the expected error in conic constant of the primary mirror suggested by the fossil evidence. The analysis of aberration contributed by the camera itself could be responsible for the small discrepancy, but was not verified by analysis.
The measurement of optical ultrafast laser pulses is done indirectly because the required bandwidth to measure these pulses exceeds the bandwidth of current electronics. As a result, this measurement problem is often posed as a 1-D phase retrieval problem, which is fraught with ambiguities. The phase retrieval method known as ptychography solves this problem by making it possible to measure ultrafast pulses in either the time domain or the frequency domain. One well known algorithm is the principal components generalized projections algorithm (PCGPA) for extracting pulses from Frequency-Resolved Optical Gating (FROG) measurements. In this work, we discuss the development of the PCPGA and introduce new developments including an operator formalism that allows for the convenient addition of external constraints and the development of more robust algorithms. A close cousin, the ptychographic iterative engine will also be covered and compared to the PCGPA. Additional developments using other algorithmic strategies will also be discussed along with new developments combining optics and high-speed electronics to achieve megahertz measurement rates.