SEARCH · Engineering Papers

Results for “Super resolution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Diverse Super-Resolution (diversity_SR) [SWR-21-60]

Deep learning tools for enhancing the spatial resolution of wind data. The software is developed in Python using the TensorFlow deep learning package. Models for diversity super-resolution is provided. Included in the package are pretrained models with example code/data to perform the super-resolution as well as tools of training models for different enhancement- or data-types. The super-resolution is an inherently ill-conditioned problem, with multiple high-resolution fields plausibly mapping to the same coarse field. Considitional GANs provide a framework for generating a distribution of high-resolution realizations from a given low-resolution input. Stochastic estimation is used to inform the network of the expected degree and location of sub-grid diversity. The package includes a pretrained network to generate distributions of 10x-enhanced fields of wind data.

Glaws, Andrew↗

DOE OSTI2022

Galaxy morphologies revealed with Subaru HSC and super-resolution techniques. I. Major merger fractions of L UV ∼ 3–15 L*UV dropout galaxies at z ∼ 4–7

Abstract We perform a super-resolution analysis of the Subaru Hyper Suprime-Cam (HSC) images to estimate the major merger fractions of z ∼ 4–7 dropout galaxies at the bright end of galaxy UV luminosity functions (LFs). Our super-resolution technique improves the spatial resolution of the ground-based HSC images, from ∼1″ to $\lesssim \!\!{0{^{\prime \prime }_{.}}1}$, which is comparable to that of the Hubble Space Telescope, allowing us to identify z ∼ 4–7 bright major mergers at a high completeness value of $\gtrsim \!\!90\%$. We apply the super-resolution technique to 6412, 16, 94, and 13 very bright dropout galaxies at z ∼ 4, 5, 6, and 7, respectively, in a UV luminosity range of LUV ∼ 3–$15\, L_{\rm UV}^*$ corresponding to −24 ≲ MUV ≲ −22. The major merger fractions are estimated to be $f_{\rm merger}\sim 10\%$–$20\%$ at z ∼ 4 and $\sim 50\%$–$70\%$ at z ∼ 5–7, which shows no fmerger difference compared to those of a control faint galaxy sample. Based on the fmerger estimates, we verify contributions of source blending effects and major mergers to the bright-end of double power-law (DPL) shape of z ∼ 4–7 galaxy UV LFs. While these two effects partly explain the DPL shape at LUV ∼ 3–$10\, L_{\rm UV}^*$, the DPL shape cannot be explained at the very bright end of $L_{\rm UV}\gtrsim 10\, L_{\rm UV}^*$, even after the AGN contribution is subtracted. The results support scenarios in which other additional mechanisms such as insignificant mass quenching and low dust obscuration contribute to the DPL shape of galaxy UV LFs.

Shibuya, Takatoshi↗

NASA NTRS2014

A Super-Resolution Laser Altimetry Concept

A super-resolution laser altimetry technique has been proposed to provide improved lidar altimetry from Cloud Aerosol Lidar and Infrared Pathfinder Satellite Observation (CALIPSO) lidar data, and it is applicable to other similar atmospheric profiling lidar with low-pass filters. To achieve high altimetry resolution, the new technique relies on an empirical relationship between the peak signal ratio and the distance between land surface and the peak signal range bin center, which is directly derived from the CALIPSO lidar measurements and does not require the CALIPSO's transient response. The CALIPSO surface elevation results in Northern America retrieved by the new technique agree with the National Elevation Database high resolution elevation maps, and the comparisons suggest that the precision of the technique is much better than 1.4 m. The preliminary data product of land surface elevation retrieved by the new technique from CALIPSO lidar measurements is available to the altimetry community for evaluation.

Lu, Xiaomei↗

DOE OSTI2025

Stochastic frequency fluctuation super-resolution imaging

The inherent non-linearity of intensity correlation functions can be used to spatially distinguish identical emitters beyond the diffraction limit, as achieved, for example, in super-resolution optical fluctuation imaging (SOFI). Here, we propose a complementary concept based on spectral correlation functions, termed spectral fluctuation super-resolution (SFSR) imaging. Through theoretical and computational analysis, we show that spatially resolving time-frequency correlation functions in the image plane can improve the imaging resolution by a factor of $\sqrt2$ in most cases and up to twofold for strictly two emitters. This improvement is achieved by quantifying the degree of correlation in spectral fluctuations across the spatial domain. Experimentally, SFSR can be implemented using a combination of interferometry and photon-correlation measurements. The method works for non-blinking emitters and stochastic spectral fluctuations with arbitrary temporal statistics. This suggests its utility in super-resolution microscopy of quantum emitters at low temperatures, where spectral diffusion is often more pronounced than emitter blinking.

47 OTHER INSTRUMENTATION↗

DOE OSTI2019

Multiresolution Localization with Temporal Scanning for Super-Resolution Diffuse Optical Imaging of Fluorescence

A super-resolution optical imaging method is introduced that relies on the distinct temporal information associated with each fluorescent optical reporter to determine its spatial position to high precision with measurements of heavily scattered light. This multiple-emitter localization approach uses a diffusion equation forward model in a cost function, and has the potential to achieve micron-scale spatial resolution through centimeters of tissue. Utilizing some degree of temporal separation for the reporter emissions, position and emission strength are determined using a computationally efficient time stripping multiresolution algorithm. The method circumvents the spatial resolution challenges faced by earlier optical imaging approaches using a diffusion equation forward model, and is promising for in vivo applications. For example, in principle, the approach could be used to localize individual neurons firing throughout a rodent brain, enabling direct imaging of neural network activity.

42 ENGINEERING↗

DOE OSTI2023

Super-Resolution for Renewable Energy Resource Data with Climate Change Impacts (Sup3rCC)

The Super-Resolution for Renewable Energy Resource Data with Climate Change Impacts (Sup3rCC) data is a collection of 4km hourly wind, solar, temperature, humidity, and pressure fields for the contiguous United States under various climate change scenarios. Sup3rCC is downscaled Global Climate Model (GCM) data. The downscaling process was performed using a generative machine learning approach called sup3r: Super-Resolution for Renewable Energy Resource Data (linked below as "Sup3r GitHub Repo"). The data includes both historical and future weather years, although the historical years represent the historical climate, not the actual historical weather that we experienced. You cannot use Sup3rCC data to study historical weather events, although other sup3r datasets may be intended for this. The Sup3rCC data is intended to help researchers study the impact of climate change on energy systems with high levels of wind and solar capacity. Please note that all climate change data is only a representation of the possible future climate and contains significant uncertainty. Analysis of multiple climate change scenarios and multiple climate models can help quantify this uncertainty.

Array↗

DOE OSTI2023

Efficient Super-Resolution of Near-Surface Climate Modeling Using the Fourier Neural Operator

Downscaling methods are critical in efficiently generating high-resolution atmospheric data. However, state-of-the-art statistical or dynamical downscaling techniques either suffer from the high computational cost of running a physical model or require high-resolution data to develop a downscaling tool. Here, we demonstrate a recently proposed zero-shot super-resolution method, the Fourier neural operator (FNO), to efficiently perform downscaling without the need for high-resolution data. Because the FNO learns dynamics in Fourier space, FNO is a resolution-invariant emulator; it can be trained at a coarse resolution and produces emulation at any high resolution. We applied FNO to downscale a 4-km resolution Weather Research and Forecasting (WRF) Model simulation of near-surface heat-related variables over the Great Lakes region. The FNO is driven by the atmospheric forcings, and topographic features used in the WRF model at the same resolution. We incorporated a physics-constrained loss in FNO by using the Clausius-Clapeyron relation to better constrain the relations among the emulated states. Trained on merely 600 WRF snapshots at 4-km resolution, the FNO shows comparable performance with a widely used convolutional network, U-Net, achieving averaged modified Kling-Gupta Efficiency of 0.88 and 0.94 on the test dataset for temperature and pressure, respectively. We then employed the FNO to produce 1-km emulations to reproduce the fine climate features. Further, by taking the WRF simulation as ground truth, we show consistent performances at the two resolutions, suggesting the reliability of FNO in producing high-resolution dynamics. Our study demonstrates the potential of using FNO for zero-shot super-resolution in generating first-order estimation on atmospheric modeling.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Deep Hierarchical Super Resolution for Scientific Data

We present a novel technique for hierarchical super resolution (SR) with neural networks (NNs), which upscales volumetric data represented with an octree data structure to a high-resolution uniform gridwith minimal seam artifacts on octree node boundaries. Our method uses existing state-of-the-art SR models and adds flexibility to upscale input data with varying levels of detail across the domain, instead of only uniform grid data that are supported in previous approaches.The key is to use a hierarchy of SR NNs, each trained to perform 2x SR between two levels of detail, with a hierarchical SR algorithm that minimizes seam artifacts by starting from the coarsest level of detail and working up.We show that our hierarchical approach outperforms baseline interpolation and hierarchical upscaling methods, and demonstrate the usefulness of our proposed approach across three use cases including data reduction using hierarchical downsampling+SR instead of uniform downsampling+SR, computation savings for hierarchical finite-time Lyapunov exponent field calculation, and super-resolving low-resolution simulation results for a high-resolution approximation visualization.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Super-resolution and segmentation deep learning for breast cancer histopathology image analysis

Traditionally, a high-performance microscope with a large numerical aperture is required to acquire high-resolution images. However, the images’ size is typically tremendous. Therefore, they are not conveniently managed and transferred across a computer network or stored in a limited computer storage system. As a result, image compression is commonly used to reduce image size resulting in poor image resolution. Here, we demonstrate custom convolution neural networks (CNNs) for both super-resolution image enhancement from low-resolution images and characterization of both cells and nuclei from hematoxylin and eosin (H&E) stained breast cancer histopathological images by using a combination of generator and discriminator networks so-called super-resolution generative adversarial network-based on aggregated residual transformation (SRGAN-ResNeXt) to facilitate cancer diagnosis in low resource settings. The results provide high enhancement in image quality where the peak signal-to-noise ratio and structural similarity of our network results are over 30 dB and 0.93, respectively. The derived performance is superior to the results obtained from both the bicubic interpolation and the well-known SRGAN deep-learning methods. In addition, another custom CNN is used to perform image segmentation from the generated high-resolution breast cancer images derived with our model with an average Intersection over Union of 0.869 and an average dice similarity coefficient of 0.893 for the H&E image segmentation results. Finally, we propose the jointly trained SRGAN-ResNeXt and Inception U-net Models, which applied the weights from the individually trained SRGAN-ResNeXt and inception U-net models as the pre-trained weights for transfer learning. The jointly trained model’s results are progressively improved and promising. We anticipate these custom CNNs can help resolve the inaccessibility of advanced microscopes or whole slide imaging (WSI) systems to acquire high-resolution images from low-performance microscopes located in remote-constraint settings.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2020

Optical super-resolution microscopy in polymer science

The advent of optical super-resolution microscopy (OSRM) over two decades ago has transformed light-mediated interrogation of systems down to the nanoscale. This innovative set of approaches to optics breaks the so-called diffraction limit of light (~200 nm), allowing for the first time to use optics in the far field to visualize behavior on nanoscopic length scales. While these visualization tools have rapidly found widespread use in biology and related fields, their implementation in materials and, more specifically, in polymer science has been far slower. To overcome possible barriers and highlight possible future directions, we present in this paper an introduction to OSRM for polymer scientists, beginning with an overview of relevant techniques and existing optical probes. We then show and examine the first examples of OSRM adaptation across major areas of polymer science, including: polymerization and structural characterization, self-assembly and solution behavior, bulk structure and behavior, crystallization, gel structure and behavior, phase transitions, and biofunctionality. We hope and anticipate that the discussions provided in this review will draw the attention of the polymer community to the capacities of these hitherto underexplored optical visualization techniques to further transform polymer science.

36 MATERIALS SCIENCE↗

DOE OSTI2023

Strictly Enforcing Invertibility and Conservation in CNN-Based Super Resolution for Scientific Datasets

Abstract Recently, deep convolutional neural networks (CNNs) have revolutionized image “super resolution” (SR), dramatically outperforming past methods for enhancing image resolution. They could be a boon for the many scientific fields that involve imaging or any regularly gridded datasets: satellite remote sensing, radar meteorology, medical imaging, numerical modeling, and so on. Unfortunately, while SR-CNNs produce visually compelling results, they do not necessarily conserve physical quantities between their low-resolution inputs and high-resolution outputs when applied to scientific datasets. Here, a method for “downsampling enforcement” in SR-CNNs is proposed. A differentiable operator is derived that, when applied as the final transfer function of a CNN, ensures the high-resolution outputs exactly reproduce the low-resolution inputs under 2D-average downsampling while improving performance of the SR schemes. The method is demonstrated across seven modern CNN-based SR schemes on several benchmark image datasets, and applications to weather radar, satellite imager, and climate model data are shown. The approach improves training time and performance while ensuring physical consistency between the super-resolved and low-resolution data. Significance Statement Recent advancements in using deep learning to increase the resolution of images have substantial potential across the many scientific fields that use images and image-like data. Most image super-resolution research has focused on the visual quality of outputs, however, and is not necessarily well suited for use with scientific data where known physics constraints may need to be enforced. Here, we introduce a method to modify existing deep neural network architectures so that they strictly conserve physical quantities in the input field when “super resolving” scientific data and find that the method can improve performance across a wide range of datasets and neural networks. Integration of known physics and adherence to established physical constraints into deep neural networks will be a critical step before their potential can be fully realized in the physical sciences.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Quantum Super-resolution Bioimaging using Massively Entangled Multimode Squeezed Light

This report presents a new method for realizing a super-resolution quantum imaging using massively entangled multimode squeezed light (MEMSL). Each branch of the entangled multimode light interacts with the sample and bears the spatially varying optical phase delay. When imaging optics with finite pupil sizes are used, information is lost. Thanks to the analyticity in the Fourier plane, a noiseless measurement would recover the lost information and accomplish super resolution imaging beating the Rayleigh diffraction limit. I proved rigorously in a fully quantum formalism and presented that (1) such information recovery is possible and (2) the information recovery can be accomplished with much less resources when MEMSL is used than those needed in any non-entangled or non-squeezed classical imaging method. Furthermore, the action of the optical loss in the imaging system that degrades the imaging performance is also rigorously analyzed and presented. Several bioimaging applications that can benefit tremendously from the proposed quantum imaging scheme are also suggested.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2025

Mesh-based super-resolution of fluid flows with multiscale graph neural networks

A graph neural network (GNN) approach is introduced in this work which enables mesh-based three-dimensional super-resolution of fluid flows. In this framework, the GNN is designed to operate not on the full mesh-based field at once, but on localized meshes of elements (or cells) directly. To facilitate mesh-based GNN representations in a manner similar to spectral (or finite) element discretizations, a baseline GNN layer (termed a message passing layer, which updates local node properties) is modified to account for synchronization of coincident graph nodes, rendering compatibility with commonly used element-based mesh connectivities. Furthermore, the architecture is multiscale in nature, and is comprised of a combination of coarse-scale and fine-scale message passing layer sequences (termed processors) separated by a graph unpooling layer. The coarse-scale processor embeds a query element (alongside a set number of neighboring coarse elements) into a single latent graph representation using coarse-scale synchronized message passing over the element neighborhood, and the fine-scale processor leverages additional message passing operations on this latent graph to correct for interpolation errors. Demonstration studies are performed using hexahedral mesh-based data from Taylor–Green Vortex and backward-facing step flow simulations at Reynolds numbers of 1600 and 3200. Through analysis of both global and local errors, the results ultimately show how the GNN is able to produce accurate super-resolved fields compared to targets in both coarse-scale and multiscale model configurations. Reconstruction errors for fixed architectures were found to increase in proportion to the Reynolds number. Geometry extrapolation studies on a separate cavity flow configuration show promising cross-mesh capabilities of the super-resolution strategy.

Backward-facing step↗

DOE OSTI2019

Dynamic super-resolution structured illumination imaging in the living brain

Cells in the brain act as components of extended networks. Therefore, to understand neurobiological processes in a physiological context, it is essential to study them in vivo. Super-resolution microscopy has spatial resolution beyond the diffraction limit, thus promising to provide structural and functional insights that are not accessible with conventional microscopy. However, to apply it to in vivo brain imaging, we must address the challenges of 3D imaging in an optically heterogeneous tissue that is constantly in motion. We optimized image acquisition and reconstruction to combat sample motion and applied adaptive optics to correcting sample-induced optical aberrations in super-resolution structured illumination microscopy (SIM) in vivo. Lastly, we imaged the brains of live zebrafish larvae and mice and observed the dynamics of dendrites and dendritic spines at nanoscale resolution.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2018

Time reversal and phase coherent music techniques for super-resolution ultrasound imaging

Systems and methods for super-resolution ultrasound imaging using a windowed and generalized TR-MUSIC algorithm that divides the imaging region into overlapping sub-regions and applies the TR-MUSIC algorithm to the windowed backscattered ultrasound signals corresponding to each sub-region. The algorithm is also structured to account for the ultrasound attenuation in the medium and the finite-size effects of ultrasound transducer elements. A modified TR-MUSIC imaging algorithm is used to account for ultrasound scattering from both density and compressibility contrasts. The phase response of ultrasound transducer elements is accounted for in a PC-MUSIC system.

47 OTHER INSTRUMENTATION↗

DOE OSTI2018

Windowed time-reversal music technique for super-resolution ultrasound imaging

47 OTHER INSTRUMENTATION↗

DOE OSTI2024

STSR-INR: Spatiotemporal super-resolution for multivariate time-varying volumetric data via implicit neural representation

Implicit neural representation (INR) has surfaced as a promising direction for solving different scientific visualization tasks due to its continuous representation and flexible input and output settings. We present STSR-INR, an INR solution for generating simultaneous spatiotemporal super-resolution for multivariate time-varying volumetric data. Inheriting the benefits of the INR-based approach, STSR-INR supports unsupervised learning and permits data upscaling with arbitrary spatial and temporal scale factors. Unlike existing GAN- or INR-based super-resolution methods, STSR-INR focuses on tackling variables or ensembles and enabling joint training across datasets of various spatiotemporal resolutions. Here we achieve this capability via a variable embedding scheme that learns latent vectors for different variables. In conjunction with a modulated structure in the network design, we employ a variational auto-decoder to optimize the learnable latent vectors to enable latent-space interpolation. To combat the slow training of INR, we leverage a multi-head strategy to improve training and inference speed with significant speedup. We demonstrate the effectiveness of STSR-INR with multiple scalar field datasets and compare it with conventional tricubic+linear interpolation and state-of-the-art deep-learning-based solutions (STNet and CoordNet).

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Determinants of synapse diversity revealed by super-resolution quantal transmission and active zone imaging

Neural circuit function depends on the pattern of synaptic connections between neurons and the strength of those connections. Synaptic strength is determined by both postsynaptic sensitivity to neurotransmitter and the presynaptic probability of action potential evoked transmitter release (P r ). Whereas morphology and neurotransmitter receptor number indicate postsynaptic sensitivity, presynaptic indicators and the mechanism that sets P r remain to be defined. To address this, we developed QuaSOR, a super-resolution method for determining P r from quantal synaptic transmission imaging at hundreds of glutamatergic synapses at a time. We mapped the P r onto super-resolution 3D molecular reconstructions of the presynaptic active zones (AZs) of the same synapses at the Drosophila larval neuromuscular junction (NMJ). We find that P r varies greatly between synapses made by a single axon, quantify the contribution of key AZ proteins to P r diversity and find that one of these, Complexin, suppresses spontaneous and evoked transmission differentially, thereby generating a spatial and quantitative mismatch between release modes. Transmission is thus regulated by the balance and nanoscale distribution of release-enhancing and suppressing presynaptic proteins to generate high signal-to-noise evoked transmission.

59 BASIC BIOLOGICAL SCIENCES↗