Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Super resolution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

A non-stationary image prior combination in super-resolution

Here, a new Bayesian Super-Resolution(SR) image registration and reconstruction method is proposed. The new method utilizes a prior distribution based on a general combination of spatially adaptive, or non-stationary, image filters, which includes an adaptive local strength parameter able to preserve both image edges and textures. With the application of variational techniques, the proposed method allows for the automatic estimation of all problem unknowns. An experimental comparison between state of the art methods and the proposed SR approach has been performed on both synthetic and real images.

97 MATHEMATICS AND COMPUTING↗

TH-EF-BRA-11: Feasibility of Super-Resolution Time-Resolved 4DMRI for Multi-Breath Volumetric Motion Simulation in Radiotherapy Planning

Purpose: To develop a novel super-resolution time-resolved 4DMRI technique to evaluate multi-breath, irregular and complex organ motion without respiratory surrogate for radiotherapy planning. Methods: The super-resolution time-resolved (TR) 4DMRI approach combines a series of low-resolution 3D cine MRI images acquired during free breathing (FB) with a high-resolution breath-hold (BH) 3DMRI via deformable image registration (DIR). Five volunteers participated in the study under an IRB-approved protocol. The 3D cine images with voxel size of 5×5×5 mm{sup 3} at two volumes per second (2Hz) were acquired coronally using a T1 fast field echo sequence, half-scan (0.8) acceleration, and SENSE (3) parallel imaging. Phase-encoding was set in the lateral direction to minimize motion artifacts. The BH image with voxel size of 2×2×2 mm{sup 3} was acquired using the same sequence within 10 seconds. A demons-based DIR program was employed to produce super-resolution 2Hz 4DMRI. Registration quality was visually assessed using difference images between TR 4DMRI and 3D cine and quantitatively assessed using average voxel correlation. The fidelity of the 3D cine images was assessed using a gel phantom and a 1D motion platform by comparing mobile and static images. Results: Owing to voxel intensity similarity using the same MRI scanning sequence, accurate DIR between FB and BH images is achieved. The voxel correlations between 3D cine and TR 4DMRI are greater than 0.92 in all cases and the difference images illustrate minimal residual error with little systematic patterns. The 3D cine images of the mobile gel phantom preserve object geometry with minimal scanning artifacts. Conclusion: The super-resolution time-resolved 4DMRI technique has been achieved via DIR, providing a potential solution for multi-breath motion assessment. Accurate DIR mapping has been achieved to map high-resolution BH images to low-resolution FB images, producing 2Hz volumetric high-resolution 4DMRI. Further validation and improvement are still required prior to clinical applications. This study is in part supported by the NIH (U54CA137788/U54CA132378).

60 APPLIED LIFE SCIENCES↗

Super-resolution stimulated X-ray Raman spectroscopy

Propagation of intense X-ray pulses through dense media has led to the observation of phenomena such as atomic X-ray lasing, self-induced transparency and stimulated X-ray Raman scattering (SXRS)4. SXRS has been long predicted as a means to launch and probe valence-electron wavepackets and as a building block for nonlinear X-ray spectroscopies. However, experimental observations of SXRS to date have not provided spectroscopic information, and theoretical modelling has largely implemented hard-to-realize phase-coherent attosecond pulses. Here we demonstrate SXRS with spectroscopic precision, that is, detection of valence-excited states in neon with a near Fourier-limited joint energy–time resolution of 0.1 eV–40 fs. We used a new covariance analysis between statistically spiky broadband incident X-ray and scattered X-ray Raman pulses. Using 18,000 single shots, we beat not only the incident (about 8 eV) bandwidth but also the approximately 0.2 eV instrumental energy resolution, thus creating super-resolution conditions, in analogy to super-resolved fluorescence microscopy. Our experimental results, supported by ab initio propagation simulations, reveal the competition between lasing in the ion and stimulated Raman scattering in the neutral. We demonstrate enhanced signal collection efficiency and a broad excitation window, surpassing spontaneous Raman efficiencies by orders of magnitude. This stochastic SXRS approach represents a first step towards tracking elementary events that determine chemical outcomes.

nonlinear x-ray spectroscopy↗

Super-resolution optical microscope

A super-resolution microscope avoids the need for complex phase plate optics normally used to produce a doughnut-shaped depletion beam by employing low-intensity regions of common diffraction patterns such as an Airy disk.

Kolkowitz, Shimon↗

A Photoactivatable BODIPY Probe for Localization-based Super-Resolution Cellular Imaging

Here, the synthesis and application of a photoactivatable boron–alkylated BODIPY probe for localization–based super–resolution microscopy is reported. Photoactivation and excitation of the probe is achieved by a previously–unknown boron–photodealkylation reaction with a single low–power visible laser and without requiring the addition of reducing agents or oxygen scavengers in the imaging buffer. These features lead to a versatile probe for localization–based microscopy of biological systems. The probe can be easily linked to nucleophile–containing molecules to target specific cellular organelles. By attaching paclitaxel to the photoactivatable BODIPY, in vitro and in vivo super–resolution imaging of microtubules is demonstrated. This is the first example of single molecule localization–based super–resolution microscopy using a visible–light activated BODIPY compound as a fluorescent probe.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Super-Resolution Study of Polymer Mobility Fluctuations near c *

Nanoscale dynamic heterogeneities in synthetic polymer solutions are detected using super-resolution optical microscopy. To this end, we map concentration fluctuations in polystyrene–toluene solutions with spatial resolution below the diffraction limit, focusing on critical fluctuations near the polymer overlap concentration, c*. Two-photon super-resolution microscopy was adapted to be applicable in an organic solvent, and a home-built STED-FCS system with stimulated emission depletion (STED) was used to perform fluorescence correlation spectroscopy (FCS). The polystyrene serving as the tracer probe (670 kg mol –1 , radius of gyration R G ≈ 35 nm, end-labeled with a bodipy derivative chromophore) was dissolved in toluene at room temperature (good solvent) and mixed with matrix polystyrene (3,840 kg mol –1 , R G ≈ 97 nm, M w /M n = 1.04) whose concentration was varied from dilute to more than 10c*. Whereas for dilute solutions the intensity–intensity correlation function follows a single diffusion process, it splits starting at c* to imply an additional relaxation process provided that the experimental focal area does not greatly exceed the polymer blob size. We identify the slower mode as self-diffusion and the increasingly rapid mode as correlated segment fluctuations that reflect the cooperative diffusion coefficient, D coop . These real-space measurements find quantitative agreement between correlation lengths inferred from dynamic measurements and those from determining the limit below which diffusion coefficients are independent of spot size. Furthermore, this study is considered to illustrate the potential of importing into polymer science the techniques of super-resolution imaging.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Light-sheet Bayesian microscopy enables deep-cell super-resolution imaging of heterochromatin in live human embryonic stem cells

Heterochromatin in the nucleus of human embryonic cells plays an important role in the epigenetic regulation of gene expression. The architecture of heterochromatin and its dynamic organization remain elusive because of the lack of fast and high-resolution deep-cell imaging tools. We enable this task by advancing instrumental and algorithmic implementation of the localization-based super-resolution technique. We present light-sheet Bayesian super-resolution microscopy (LSBM). We adapt lightsheet illumination for super-resolution imaging by using a novel prism-coupled condenser design to illuminate a thin slice of the nucleus with high signal-to-noise ratio. Coupled with a Bayesian algorithm that resolves overlapping fluorophores from high-density areas, we show, for the first time, nanoscopic features of the heterochromatin structure in both fixed and live human embryonic stem cells. The enhanced temporal resolution allows capturing the dynamic change of heterochromatin with a lateral resolution of 50–60 nm on a time scale of 2.3 s. Light-sheet Bayesian microscopy opens up broad new possibilities of probing nanometer-scale nuclear structures and real-time sub-cellular processes and other previously difficult-to-access intracellular regions of living cells at the single-molecule, and single cell level.

59 BASIC BIOLOGICAL SCIENCES↗

Super-resolution reconstruction in frequency, image, and wavelet domains to reduce through-plane partial voluming in MRI

Purpose: To compare and evaluate the use of super-resolution reconstruction (SRR), in frequency, image, and wavelet domains, to reduce through-plane partial voluming effects in magnetic resonance imaging. Methods: The reconstruction of an isotropic high-resolution image from multiple thick-slice scans has been investigated through techniques in frequency, image, and wavelet domains. Experiments were carried out with thick-slice T2-weighted fast spin echo sequence on the Academic College of Radiology MRI phantom, where the reconstructed images were compared to a reference high-resolution scan using peak signal-to-noise ratio (PSNR), structural similarity image metric (SSIM), mutual information (MI), and the mean absolute error (MAE) of image intensity profiles. The application of super-resolution reconstruction was then examined in retrospective processing of clinical neuroimages of ten pediatric patients with tuberous sclerosis complex (TSC) to reduce through-plane partial voluming for improved 3D delineation and visualization of thin radial bands of white matter abnormalities. Results: Quantitative evaluation results show improvements in all evaluation metrics through super-resolution reconstruction in the frequency, image, and wavelet domains, with the highest values obtained from SRR in the image domain. The metric values for image-domain SRR versus the original axial, coronal, and sagittal images were PSNR = 32.26 vs 32.22, 32.16, 30.65; SSIM = 0.931 vs 0.922, 0.924, 0.918; MI = 0.871 vs 0.842, 0.844, 0.831; and MAE = 5.38 vs 7.34, 7.06, 6.19. All similarity metrics showed high correlations with expert ranking of image resolution with MI showing the highest correlation at 0.943. Qualitative assessment of the neuroimages of ten TSC patients through in-plane and out-of-plane visualization of structures showed the extent of partial voluming effect in a real clinical scenario and its reduction using SRR. Blinded expert evaluation of image resolution in resampled out-of-plane views consistently showed the superiority of SRR compared to original axial and coronal image acquisitions. Conclusions: Thick-slice 2D T2-weighted MRI scans are part of many routine clinical protocols due to their high signal-to-noise ratio, but are often severely affected by through-plane partial voluming effects. This study shows that while radiologic assessment is performed in 2D on thick-slice scans, super-resolution MRI reconstruction techniques can be used to fuse those scans to generate a high-resolution image with reduced partial voluming for improved postacquisition processing. Qualitative and quantitative evaluation showed the efficacy of all SRR techniques with the best results obtained from SRR in the image domain. The limitations of SRR techniques are uncertainties in modeling the slice profile, density compensation, quantization in resampling, and uncompensated motion between scans.

60 APPLIED LIFE SCIENCES↗

Localization of Nonblinking Point Sources Using Higher-Order-Mode Detection and Optical Heterodyning: Developing a Strategy for Extending the Scope of Molecular, Super-resolution Imaging

While the stochastic, “blinking” nature of fluorescent systems has enabled the super-resolution of their localization by the fitting of their point-spread functions (PSFs), this strategy cannot be exploited for similar resolution of “nonblinking” systems, such as those that might be encountered in a coherent Raman experiment. An alternative method for subdiffraction-limited imaging lies in the exploitation of optical heterodyning. For example, if a Gaussian PSF (a TEM00 mode) of a point emitter is displaced with respect to the origin of the optical system, photons in the higher-order TEM modes carry information about that displacement. Information concerning the displacement can be extracted from photons in these higher-order modes. These photons can be collected by optical heterodyning, which exploits the large gain in a detector’s response to an optical signal from an emitter coupled to a local oscillator, which is prepared in the TEM of interest, e.g., TEM10. We have generalized and developed the heterodyning technique to localize point emitters via the detection of higher-order spatial modes. We have developed a theoretical approach to find a practical estimation limit of the localization parameters using a realistic model that accounts for shot noise, background noise, and Gaussian noise. To demonstrate the applicability of the method, we designed experiments in which a laser is a surrogate for one and two point emitters. Using the Fisher information and its accompanying Cramér-Rao lower bound, we demonstrate super-resolution localization in these cases: we show that objects can be localized to roughly 2–3 orders of magnitude of their point-spread function’s size for a given optical system. Finally and most importantly, it is suggested that the results will ultimately be generalizable to multiple emitters and, most importantly, to “nonblinking” molecular systems, which will be essential for broadening the scope of super-resolution measurements beyond the limits of fluorescence-based techniques.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

ESM data downscaling: a comparison of super-resolution deep learning models

Abstract Climate projections at fine spatial resolutions are required to conduct accurate risk assessment for critical infrastructure and design adaptation planning. Generating these projections using advanced Earth system models (ESM) requires significant computational resources. To address this issue, various statistical downscaling techniques have been introduced to generate fine-resolution data from coarse-resolution simulations. In this study, we evaluate and compare five deep learning-based downscaling techniques, namely, super-resolution convolutional neural networks, fast super-resolution convolutional neural network ESM, efficient sub-pixel convolutional neural network, enhanced deep residual network (EDRN), and super-resolution generative adversarial network (SRGAN). These techniques are applied to a dataset generated by the Energy Exascale Earth System Model (E3SM), focusing on key surface variables such as surface temperature, shortwave heat flux, and longwave heat flux. Models are trained and validated using paired fine-resolution (0.25 $$^{\circ }$$ ∘ ) and coarse-resolution (1 $$^{\circ }$$ ∘ ) monthly data obtained from a 9-year simulation. Next, blind testing is performed using monthly data obtained from two different years outside of the training and validation set. To evaluate the efficiency of each technique, different statistical metrics are used, including mean squared error (MSE), peak signal-to-noise ratio (PSNR), structural similarity index measure (SSIM), and learned perceptual image patch similarity (LPIPS). The results show that EDRN outperforms other algorithms in terms of PSNR, SSIM, and MSE, but struggles to capture fine-scale features in the data. In contrast, SRGAN, a generative model that uses perceptual loss, excels in capturing fine details at boundaries and internal structures, resulting in lower LPIPS than other methods.

Pawar, Nikhil M. (ORCID:0000000211613289)↗

Super-Resolution Approaches in Three-Dimensions for Classification and Screening of Commercial-Off-The-Shelf Components

X-ray computed tomography is generally a primary step in characterization of defective electronic components, but is generally too slow to screen large lots of components. Super-resolution imaging approaches, in which higher-resolution data is inferred from lower-resolution images, have the potential to substantially reduce collection times for data volumes accessible via x-ray computed tomography. Here we seek to advance existing two-dimensional super-resolution approaches directly to three-dimensional computed tomography data. Multiple scan resolutions over a half order of magnitude of resolution were collected for four classes of commercial electronic components to serve as training data for a deep-learning, super-resolution network. A modular python framework for three-dimensional super-resolution of computed tomography data has been developed and trained over multiple classes of electronic components. Initial training and testing demonstrate the vast promise for these approaches, which have the potential for more than an order of magnitude reduction in collection time for electronic component screening.

47 OTHER INSTRUMENTATION↗

Nanoscale imaging of quantum dot dimers using time-resolved super-resolution microscopy combined with scanning electron microscopy

Abstract Time-resolved super-resolution microscopy was used in conjunction with scanning electron microscopy to image individual colloidal CdSe/CdS semiconductor quantum dots (QD) and QD dimers. The photoluminescence (PL) lifetimes, intensities, and structural parameters were acquired with nanometer scale spatial resolution and sub-nanosecond time resolution. The combination of these two techniques was more powerful than either alone, enabling us to resolve the PL properties of individual QDs within QD dimers as they blinked on and off, measure interparticle distances, and identify QDs that may be participating in energy transfer. The localization precision of our optical imaging technique was ∼3 nm, low enough that the emission from individual QDs within the dimers could be spatially resolved. While the majority of QDs within dimers acted as independent emitters, at least one pair of QDs in our study exhibited lifetime and intensity behaviors consistent with resonance energy transfer from a shorter lifetime and lower intensity donor QD to a longer lifetime and higher intensity acceptor QD. For this case, we demonstrate how the combined super-resolution optical imaging and scanning electron microscopy data can be used to characterize the energy transfer rate.

36 MATERIALS SCIENCE↗

A Photoactivatable BODIPY Probe for Localization‐Based Super‐Resolution Cellular Imaging

Abstract The synthesis and application of a photoactivatable boron‐alkylated BODIPY probe for localization‐based super‐resolution microscopy is reported. Photoactivation and excitation of the probe is achieved by a previously unknown boron‐photodealkylation reaction with a single low‐power visible laser and without requiring the addition of reducing agents or oxygen scavengers in the imaging buffer. These features lead to a versatile probe for localization‐based microscopy of biological systems. The probe can be easily linked to nucleophile‐containing molecules to target specific cellular organelles. By attaching paclitaxel to the photoactivatable BODIPY, in vitro and in vivo super‐resolution imaging of microtubules is demonstrated. This is the first example of single‐molecule localization‐based super‐resolution microscopy using a visible‐light‐activated BODIPY compound as a fluorescent probe.

Wijesooriya, Chamari S.↗

Repurposing a photosynthetic antenna protein as a super-resolution microscopy label

Techniques such as Stochastic Optical Reconstruction Microscopy (STORM) and Structured Illumination Microscopy (SIM) have increased the achievable resolution of optical imaging, but few fluorescent proteins are suitable for super-resolution microscopy, particularly in the far-red and near-infrared emission range. Here we demonstrate the applicability of CpcA, a subunit of the photosynthetic antenna complex in cyanobacteria, for STORM and SIM imaging. The periodicity and width of fabricated nanoarrays of CpcA, with a covalently attached phycoerythrobilin (PEB) or phycocyanobilin (PCB) chromophore, matched the lines in reconstructed STORM images. SIM and STORM reconstructions of Escherichia coli cells harbouring CpcA-labelled cytochrome bd 1 ubiquinol oxidase in the cytoplasmic membrane show that CpcA-PEB and CpcA-PCB are suitable for super-resolution imaging in vivo. The stability, ease of production, small size and brightness of CpcA-PEB and CpcA-PCB demonstrate the potential of this largely unexplored protein family as novel probes for super-resolution microscopy.

59 BASIC BIOLOGICAL SCIENCES↗

Compressive sensing super resolution from multiple observations with application to passive millimeter wave images

In this study we propose a novel framework to obtain high resolution images from compressed sensing imaging systems capturing multiple low resolution images of the same scene. The proposed approach of Compressed Sensing Super Resolution (CSSR), combines existing compressed sensing reconstruction algorithms with a low-resolution to high-resolution approach based on the use of a super Gaussian regularization term. The reconstruction alternates between compressed sensing reconstruction and super resolution reconstruction, including registration parameter estimation. The image estimation subproblem is solved using majorization-minimization while the compressed sensing reconstruction becomes an l 1 -minimization subject to a quadratic constraint. The performed experiments on grayscale and synthetically compressed real millimeter wave images, demonstrate the capability of the proposed framework to provide very good quality super resolved images from multiple low resolution compressed acquisitions.

42 ENGINEERING↗

Solid-immersion fluorescence microscopy with increased emission and super resolution

We investigate solid-immersion fluorescence microscopy suitable for super-resolution nanotechnology and biological imaging, and have observed limit of resolution as small as 15 nm with microspheres, mitochondria, and chromatin fibers. We have further observed that fluorescence efficiency increases with excitation power density, implicating appreciable stimulated emission and increased resolution. We discuss potential advantages of the solid-immersion microscopy, including combined use with previously established super-resolution techniques for reaching deeper beyond the conventional diffraction limit.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Super-resolution of fluorescence-free plasmonic nanoparticles using enhanced dark-field illumination based on wavelength-modulation

Super-resolution imaging of fluorescence-free plasmonic nanoparticles (NPs) was achieved using enhanced dark-field (EDF) illumination based on wavelength-modulation. Indistinguishable adjacent EDF images of 103-nm gold nanoparticles (GNPs), 40-nm gold nanorods (GNRs), and 80-nm silver nanoparticles (SNPs) were modulated at their wavelengths of specific localized surface plasmon scattering. The coordinates (x, y) of each NP were resolved by fitting their point spread functions with a two-dimensional Gaussian. The measured localization precisions of GNPs, GNRs, and SNPs were 2.5 nm, 5.0 nm, and 2.9 nm, respectively. From the resolved coordinates of NPs and the corresponding localization precisions, super-resolution images were reconstructed. Depending on the spontaneous polarization of GNR scattering, the orientation angle of GNRs in two-dimensions was resolved and provided more elaborate localization information. This novel fluorescence-free super-resolution method was applied to live HeLa cells to resolve NPs and provided remarkable subdiffraction limit images.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Super-resolution with a positive epsilon multi-quantum-well super-lens

We design an anisotropic and dichroic quantum metamaterial that is able to achieve super-resolution without the need for a negative permittivity. When exploring the parameters of the structure, we take into account the limits of semiconductor fabrication technology based on quantum well stacks. By heavily doping the structure with free electrons, we infer an anisotropic effective medium with a prolate ellipsoid dispersion curve which allows for near-diffractionless propagation of light (similar to an epsilon-near-zero hyperbolic lens). This, coupled with low absorption, allows us to resolve images at the sub-wavelength scale at distances 6 times greater than equivalent natural materials.

36 MATERIALS SCIENCE↗