Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “super resolution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

DiffLense: a conditional diffusion model for super-resolution of gravitational lensing data

Abstract Gravitational lensing data is frequently collected at low resolution due to instrumental limitations and observing conditions. Machine learning-based super-resolution techniques offer a method to enhance the resolution of these images, enabling more precise measurements of lensing effects and a better understanding of the matter distribution in the lensing system. This enhancement can significantly improve our knowledge of the distribution of mass within the lensing galaxy and its environment, as well as the properties of the background source being lensed. Traditional super-resolution techniques typically learn a mapping function from lower-resolution to higher-resolution samples. However, these methods are often constrained by their dependence on optimizing a fixed distance function, which can result in the loss of intricate details crucial for astrophysical analysis. In this work, we introduce DiffLense , a novel super-resolution pipeline based on a conditional diffusion model specifically designed to enhance the resolution of gravitational lensing images obtained from the Hyper Suprime-Cam Subaru Strategic Program (HSC-SSP). Our approach adopts a generative model, leveraging the detailed structural information present in Hubble space telescope (HST) counterparts. The diffusion model, trained to generate HST data, is conditioned on HSC data pre-processed with denoising techniques and thresholding to significantly reduce noise and background interference. This process leads to a more distinct and less overlapping conditional distribution during the model’s training phase. We demonstrate that DiffLense outperforms existing state-of-the-art single-image super-resolution techniques, particularly in retaining the fine details necessary for astrophysical analyses.

Computer Science↗
DOE OSTI2025

Super-resolution stimulated X-ray Raman spectroscopy

Propagation of intense X-ray pulses through dense media has led to the observation of phenomena such as atomic X-ray lasing, self-induced transparency and stimulated X-ray Raman scattering (SXRS)4. SXRS has been long predicted as a means to launch and probe valence-electron wavepackets and as a building block for nonlinear X-ray spectroscopies. However, experimental observations of SXRS to date have not provided spectroscopic information, and theoretical modelling has largely implemented hard-to-realize phase-coherent attosecond pulses. Here we demonstrate SXRS with spectroscopic precision, that is, detection of valence-excited states in neon with a near Fourier-limited joint energy–time resolution of 0.1 eV–40 fs. We used a new covariance analysis between statistically spiky broadband incident X-ray and scattered X-ray Raman pulses. Using 18,000 single shots, we beat not only the incident (about 8 eV) bandwidth but also the approximately 0.2 eV instrumental energy resolution, thus creating super-resolution conditions, in analogy to super-resolved fluorescence microscopy. Our experimental results, supported by ab initio propagation simulations, reveal the competition between lasing in the ion and stimulated Raman scattering in the neutral. We demonstrate enhanced signal collection efficiency and a broad excitation window, surpassing spontaneous Raman efficiencies by orders of magnitude. This stochastic SXRS approach represents a first step towards tracking elementary events that determine chemical outcomes.

nonlinear x-ray spectroscopy↗
DOE OSTI2023

Super-resolution optical microscope

A super-resolution microscope avoids the need for complex phase plate optics normally used to produce a doughnut-shaped depletion beam by employing low-intensity regions of common diffraction patterns such as an Airy disk.

Kolkowitz, Shimon↗
DOE OSTI2021

Localization of Nonblinking Point Sources Using Higher-Order-Mode Detection and Optical Heterodyning: Developing a Strategy for Extending the Scope of Molecular, Super-resolution Imaging

While the stochastic, “blinking” nature of fluorescent systems has enabled the super-resolution of their localization by the fitting of their point-spread functions (PSFs), this strategy cannot be exploited for similar resolution of “nonblinking” systems, such as those that might be encountered in a coherent Raman experiment. An alternative method for subdiffraction-limited imaging lies in the exploitation of optical heterodyning. For example, if a Gaussian PSF (a TEM00 mode) of a point emitter is displaced with respect to the origin of the optical system, photons in the higher-order TEM modes carry information about that displacement. Information concerning the displacement can be extracted from photons in these higher-order modes. These photons can be collected by optical heterodyning, which exploits the large gain in a detector’s response to an optical signal from an emitter coupled to a local oscillator, which is prepared in the TEM of interest, e.g., TEM10. We have generalized and developed the heterodyning technique to localize point emitters via the detection of higher-order spatial modes. We have developed a theoretical approach to find a practical estimation limit of the localization parameters using a realistic model that accounts for shot noise, background noise, and Gaussian noise. To demonstrate the applicability of the method, we designed experiments in which a laser is a surrogate for one and two point emitters. Using the Fisher information and its accompanying Cramér-Rao lower bound, we demonstrate super-resolution localization in these cases: we show that objects can be localized to roughly 2–3 orders of magnitude of their point-spread function’s size for a given optical system. Finally and most importantly, it is suggested that the results will ultimately be generalizable to multiple emitters and, most importantly, to “nonblinking” molecular systems, which will be essential for broadening the scope of super-resolution measurements beyond the limits of fluorescence-based techniques.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

ESM data downscaling: a comparison of super-resolution deep learning models

Abstract Climate projections at fine spatial resolutions are required to conduct accurate risk assessment for critical infrastructure and design adaptation planning. Generating these projections using advanced Earth system models (ESM) requires significant computational resources. To address this issue, various statistical downscaling techniques have been introduced to generate fine-resolution data from coarse-resolution simulations. In this study, we evaluate and compare five deep learning-based downscaling techniques, namely, super-resolution convolutional neural networks, fast super-resolution convolutional neural network ESM, efficient sub-pixel convolutional neural network, enhanced deep residual network (EDRN), and super-resolution generative adversarial network (SRGAN). These techniques are applied to a dataset generated by the Energy Exascale Earth System Model (E3SM), focusing on key surface variables such as surface temperature, shortwave heat flux, and longwave heat flux. Models are trained and validated using paired fine-resolution (0.25 $$^{\circ }$$ ∘ ) and coarse-resolution (1 $$^{\circ }$$ ∘ ) monthly data obtained from a 9-year simulation. Next, blind testing is performed using monthly data obtained from two different years outside of the training and validation set. To evaluate the efficiency of each technique, different statistical metrics are used, including mean squared error (MSE), peak signal-to-noise ratio (PSNR), structural similarity index measure (SSIM), and learned perceptual image patch similarity (LPIPS). The results show that EDRN outperforms other algorithms in terms of PSNR, SSIM, and MSE, but struggles to capture fine-scale features in the data. In contrast, SRGAN, a generative model that uses perceptual loss, excels in capturing fine details at boundaries and internal structures, resulting in lower LPIPS than other methods.

Pawar, Nikhil M. (ORCID:0000000211613289)↗
DOE OSTI2022

Super-Resolution Approaches in Three-Dimensions for Classification and Screening of Commercial-Off-The-Shelf Components

X-ray computed tomography is generally a primary step in characterization of defective electronic components, but is generally too slow to screen large lots of components. Super-resolution imaging approaches, in which higher-resolution data is inferred from lower-resolution images, have the potential to substantially reduce collection times for data volumes accessible via x-ray computed tomography. Here we seek to advance existing two-dimensional super-resolution approaches directly to three-dimensional computed tomography data. Multiple scan resolutions over a half order of magnitude of resolution were collected for four classes of commercial electronic components to serve as training data for a deep-learning, super-resolution network. A modular python framework for three-dimensional super-resolution of computed tomography data has been developed and trained over multiple classes of electronic components. Initial training and testing demonstrate the vast promise for these approaches, which have the potential for more than an order of magnitude reduction in collection time for electronic component screening.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Nanoscale imaging of quantum dot dimers using time-resolved super-resolution microscopy combined with scanning electron microscopy

Abstract Time-resolved super-resolution microscopy was used in conjunction with scanning electron microscopy to image individual colloidal CdSe/CdS semiconductor quantum dots (QD) and QD dimers. The photoluminescence (PL) lifetimes, intensities, and structural parameters were acquired with nanometer scale spatial resolution and sub-nanosecond time resolution. The combination of these two techniques was more powerful than either alone, enabling us to resolve the PL properties of individual QDs within QD dimers as they blinked on and off, measure interparticle distances, and identify QDs that may be participating in energy transfer. The localization precision of our optical imaging technique was ∼3 nm, low enough that the emission from individual QDs within the dimers could be spatially resolved. While the majority of QDs within dimers acted as independent emitters, at least one pair of QDs in our study exhibited lifetime and intensity behaviors consistent with resonance energy transfer from a shorter lifetime and lower intensity donor QD to a longer lifetime and higher intensity acceptor QD. For this case, we demonstrate how the combined super-resolution optical imaging and scanning electron microscopy data can be used to characterize the energy transfer rate.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Diverse Super-Resolution (diversity_SR) [SWR-21-60]

Deep learning tools for enhancing the spatial resolution of wind data. The software is developed in Python using the TensorFlow deep learning package. Models for diversity super-resolution is provided. Included in the package are pretrained models with example code/data to perform the super-resolution as well as tools of training models for different enhancement- or data-types. The super-resolution is an inherently ill-conditioned problem, with multiple high-resolution fields plausibly mapping to the same coarse field. Considitional GANs provide a framework for generating a distribution of high-resolution realizations from a given low-resolution input. Stochastic estimation is used to inform the network of the expected degree and location of sub-grid diversity. The package includes a pretrained network to generate distributions of 10x-enhanced fields of wind data.

Glaws, Andrew↗
DOE OSTI2022

Galaxy morphologies revealed with Subaru HSC and super-resolution techniques. I. Major merger fractions of L UV ∼ 3–15 L*UV dropout galaxies at z ∼ 4–7

Abstract We perform a super-resolution analysis of the Subaru Hyper Suprime-Cam (HSC) images to estimate the major merger fractions of z ∼ 4–7 dropout galaxies at the bright end of galaxy UV luminosity functions (LFs). Our super-resolution technique improves the spatial resolution of the ground-based HSC images, from ∼1″ to $\lesssim \!\!{0{^{\prime \prime }_{.}}1}$, which is comparable to that of the Hubble Space Telescope, allowing us to identify z ∼ 4–7 bright major mergers at a high completeness value of $\gtrsim \!\!90\%$. We apply the super-resolution technique to 6412, 16, 94, and 13 very bright dropout galaxies at z ∼ 4, 5, 6, and 7, respectively, in a UV luminosity range of LUV ∼ 3–$15\, L_{\rm UV}^*$ corresponding to −24 ≲ MUV ≲ −22. The major merger fractions are estimated to be $f_{\rm merger}\sim 10\%$–$20\%$ at z ∼ 4 and $\sim 50\%$–$70\%$ at z ∼ 5–7, which shows no fmerger difference compared to those of a control faint galaxy sample. Based on the fmerger estimates, we verify contributions of source blending effects and major mergers to the bright-end of double power-law (DPL) shape of z ∼ 4–7 galaxy UV LFs. While these two effects partly explain the DPL shape at LUV ∼ 3–$10\, L_{\rm UV}^*$, the DPL shape cannot be explained at the very bright end of $L_{\rm UV}\gtrsim 10\, L_{\rm UV}^*$, even after the AGN contribution is subtracted. The results support scenarios in which other additional mechanisms such as insignificant mass quenching and low dust obscuration contribute to the DPL shape of galaxy UV LFs.

Shibuya, Takatoshi↗
DOE OSTI2025

Stochastic frequency fluctuation super-resolution imaging

The inherent non-linearity of intensity correlation functions can be used to spatially distinguish identical emitters beyond the diffraction limit, as achieved, for example, in super-resolution optical fluctuation imaging (SOFI). Here, we propose a complementary concept based on spectral correlation functions, termed spectral fluctuation super-resolution (SFSR) imaging. Through theoretical and computational analysis, we show that spatially resolving time-frequency correlation functions in the image plane can improve the imaging resolution by a factor of $\sqrt2$ in most cases and up to twofold for strictly two emitters. This improvement is achieved by quantifying the degree of correlation in spectral fluctuations across the spatial domain. Experimentally, SFSR can be implemented using a combination of interferometry and photon-correlation measurements. The method works for non-blinking emitters and stochastic spectral fluctuations with arbitrary temporal statistics. This suggests its utility in super-resolution microscopy of quantum emitters at low temperatures, where spectral diffusion is often more pronounced than emitter blinking.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Super-Resolution for Renewable Energy Resource Data with Climate Change Impacts (Sup3rCC)

The Super-Resolution for Renewable Energy Resource Data with Climate Change Impacts (Sup3rCC) data is a collection of 4km hourly wind, solar, temperature, humidity, and pressure fields for the contiguous United States under various climate change scenarios. Sup3rCC is downscaled Global Climate Model (GCM) data. The downscaling process was performed using a generative machine learning approach called sup3r: Super-Resolution for Renewable Energy Resource Data (linked below as "Sup3r GitHub Repo"). The data includes both historical and future weather years, although the historical years represent the historical climate, not the actual historical weather that we experienced. You cannot use Sup3rCC data to study historical weather events, although other sup3r datasets may be intended for this. The Sup3rCC data is intended to help researchers study the impact of climate change on energy systems with high levels of wind and solar capacity. Please note that all climate change data is only a representation of the possible future climate and contains significant uncertainty. Analysis of multiple climate change scenarios and multiple climate models can help quantify this uncertainty.

Array↗
DOE OSTI2023

Efficient Super-Resolution of Near-Surface Climate Modeling Using the Fourier Neural Operator

Downscaling methods are critical in efficiently generating high-resolution atmospheric data. However, state-of-the-art statistical or dynamical downscaling techniques either suffer from the high computational cost of running a physical model or require high-resolution data to develop a downscaling tool. Here, we demonstrate a recently proposed zero-shot super-resolution method, the Fourier neural operator (FNO), to efficiently perform downscaling without the need for high-resolution data. Because the FNO learns dynamics in Fourier space, FNO is a resolution-invariant emulator; it can be trained at a coarse resolution and produces emulation at any high resolution. We applied FNO to downscale a 4-km resolution Weather Research and Forecasting (WRF) Model simulation of near-surface heat-related variables over the Great Lakes region. The FNO is driven by the atmospheric forcings, and topographic features used in the WRF model at the same resolution. We incorporated a physics-constrained loss in FNO by using the Clausius-Clapeyron relation to better constrain the relations among the emulated states. Trained on merely 600 WRF snapshots at 4-km resolution, the FNO shows comparable performance with a widely used convolutional network, U-Net, achieving averaged modified Kling-Gupta Efficiency of 0.88 and 0.94 on the test dataset for temperature and pressure, respectively. We then employed the FNO to produce 1-km emulations to reproduce the fine climate features. Further, by taking the WRF simulation as ground truth, we show consistent performances at the two resolutions, suggesting the reliability of FNO in producing high-resolution dynamics. Our study demonstrates the potential of using FNO for zero-shot super-resolution in generating first-order estimation on atmospheric modeling.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Deep Hierarchical Super Resolution for Scientific Data

We present a novel technique for hierarchical super resolution (SR) with neural networks (NNs), which upscales volumetric data represented with an octree data structure to a high-resolution uniform gridwith minimal seam artifacts on octree node boundaries. Our method uses existing state-of-the-art SR models and adds flexibility to upscale input data with varying levels of detail across the domain, instead of only uniform grid data that are supported in previous approaches.The key is to use a hierarchy of SR NNs, each trained to perform 2x SR between two levels of detail, with a hierarchical SR algorithm that minimizes seam artifacts by starting from the coarsest level of detail and working up.We show that our hierarchical approach outperforms baseline interpolation and hierarchical upscaling methods, and demonstrate the usefulness of our proposed approach across three use cases including data reduction using hierarchical downsampling+SR instead of uniform downsampling+SR, computation savings for hierarchical finite-time Lyapunov exponent field calculation, and super-resolving low-resolution simulation results for a high-resolution approximation visualization.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Super-resolution and segmentation deep learning for breast cancer histopathology image analysis

Traditionally, a high-performance microscope with a large numerical aperture is required to acquire high-resolution images. However, the images’ size is typically tremendous. Therefore, they are not conveniently managed and transferred across a computer network or stored in a limited computer storage system. As a result, image compression is commonly used to reduce image size resulting in poor image resolution. Here, we demonstrate custom convolution neural networks (CNNs) for both super-resolution image enhancement from low-resolution images and characterization of both cells and nuclei from hematoxylin and eosin (H&E) stained breast cancer histopathological images by using a combination of generator and discriminator networks so-called super-resolution generative adversarial network-based on aggregated residual transformation (SRGAN-ResNeXt) to facilitate cancer diagnosis in low resource settings. The results provide high enhancement in image quality where the peak signal-to-noise ratio and structural similarity of our network results are over 30 dB and 0.93, respectively. The derived performance is superior to the results obtained from both the bicubic interpolation and the well-known SRGAN deep-learning methods. In addition, another custom CNN is used to perform image segmentation from the generated high-resolution breast cancer images derived with our model with an average Intersection over Union of 0.869 and an average dice similarity coefficient of 0.893 for the H&E image segmentation results. Finally, we propose the jointly trained SRGAN-ResNeXt and Inception U-net Models, which applied the weights from the individually trained SRGAN-ResNeXt and inception U-net models as the pre-trained weights for transfer learning. The jointly trained model’s results are progressively improved and promising. We anticipate these custom CNNs can help resolve the inaccessibility of advanced microscopes or whole slide imaging (WSI) systems to acquire high-resolution images from low-performance microscopes located in remote-constraint settings.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

Optical super-resolution microscopy in polymer science

The advent of optical super-resolution microscopy (OSRM) over two decades ago has transformed light-mediated interrogation of systems down to the nanoscale. This innovative set of approaches to optics breaks the so-called diffraction limit of light (~200 nm), allowing for the first time to use optics in the far field to visualize behavior on nanoscopic length scales. While these visualization tools have rapidly found widespread use in biology and related fields, their implementation in materials and, more specifically, in polymer science has been far slower. To overcome possible barriers and highlight possible future directions, we present in this paper an introduction to OSRM for polymer scientists, beginning with an overview of relevant techniques and existing optical probes. We then show and examine the first examples of OSRM adaptation across major areas of polymer science, including: polymerization and structural characterization, self-assembly and solution behavior, bulk structure and behavior, crystallization, gel structure and behavior, phase transitions, and biofunctionality. We hope and anticipate that the discussions provided in this review will draw the attention of the polymer community to the capacities of these hitherto underexplored optical visualization techniques to further transform polymer science.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Strictly Enforcing Invertibility and Conservation in CNN-Based Super Resolution for Scientific Datasets

Abstract Recently, deep convolutional neural networks (CNNs) have revolutionized image “super resolution” (SR), dramatically outperforming past methods for enhancing image resolution. They could be a boon for the many scientific fields that involve imaging or any regularly gridded datasets: satellite remote sensing, radar meteorology, medical imaging, numerical modeling, and so on. Unfortunately, while SR-CNNs produce visually compelling results, they do not necessarily conserve physical quantities between their low-resolution inputs and high-resolution outputs when applied to scientific datasets. Here, a method for “downsampling enforcement” in SR-CNNs is proposed. A differentiable operator is derived that, when applied as the final transfer function of a CNN, ensures the high-resolution outputs exactly reproduce the low-resolution inputs under 2D-average downsampling while improving performance of the SR schemes. The method is demonstrated across seven modern CNN-based SR schemes on several benchmark image datasets, and applications to weather radar, satellite imager, and climate model data are shown. The approach improves training time and performance while ensuring physical consistency between the super-resolved and low-resolution data. Significance Statement Recent advancements in using deep learning to increase the resolution of images have substantial potential across the many scientific fields that use images and image-like data. Most image super-resolution research has focused on the visual quality of outputs, however, and is not necessarily well suited for use with scientific data where known physics constraints may need to be enforced. Here, we introduce a method to modify existing deep neural network architectures so that they strictly conserve physical quantities in the input field when “super resolving” scientific data and find that the method can improve performance across a wide range of datasets and neural networks. Integration of known physics and adherence to established physical constraints into deep neural networks will be a critical step before their potential can be fully realized in the physical sciences.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Quantum Super-resolution Bioimaging using Massively Entangled Multimode Squeezed Light

This report presents a new method for realizing a super-resolution quantum imaging using massively entangled multimode squeezed light (MEMSL). Each branch of the entangled multimode light interacts with the sample and bears the spatially varying optical phase delay. When imaging optics with finite pupil sizes are used, information is lost. Thanks to the analyticity in the Fourier plane, a noiseless measurement would recover the lost information and accomplish super resolution imaging beating the Rayleigh diffraction limit. I proved rigorously in a fully quantum formalism and presented that (1) such information recovery is possible and (2) the information recovery can be accomplished with much less resources when MEMSL is used than those needed in any non-entangled or non-squeezed classical imaging method. Furthermore, the action of the optical loss in the imaging system that degrades the imaging performance is also rigorously analyzed and presented. Several bioimaging applications that can benefit tremendously from the proposed quantum imaging scheme are also suggested.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

Mesh-based super-resolution of fluid flows with multiscale graph neural networks

A graph neural network (GNN) approach is introduced in this work which enables mesh-based three-dimensional super-resolution of fluid flows. In this framework, the GNN is designed to operate not on the full mesh-based field at once, but on localized meshes of elements (or cells) directly. To facilitate mesh-based GNN representations in a manner similar to spectral (or finite) element discretizations, a baseline GNN layer (termed a message passing layer, which updates local node properties) is modified to account for synchronization of coincident graph nodes, rendering compatibility with commonly used element-based mesh connectivities. Furthermore, the architecture is multiscale in nature, and is comprised of a combination of coarse-scale and fine-scale message passing layer sequences (termed processors) separated by a graph unpooling layer. The coarse-scale processor embeds a query element (alongside a set number of neighboring coarse elements) into a single latent graph representation using coarse-scale synchronized message passing over the element neighborhood, and the fine-scale processor leverages additional message passing operations on this latent graph to correct for interpolation errors. Demonstration studies are performed using hexahedral mesh-based data from Taylor–Green Vortex and backward-facing step flow simulations at Reynolds numbers of 1600 and 3200. Through analysis of both global and local errors, the results ultimately show how the GNN is able to produce accurate super-resolved fields compared to targets in both coarse-scale and multiscale model configurations. Reconstruction errors for fixed architectures were found to increase in proportion to the Reynolds number. Geometry extrapolation studies on a separate cavity flow configuration show promising cross-mesh capabilities of the super-resolution strategy.

Backward-facing step↗