Consensus Multi-Image Super Resolution
Explore the source record for details and available documents.
Sun, Yufang↗
SEARCH · Engineering Papers
Results for “super resolution”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Physics-based Neural Super-resolution: Training high resolution models using low resolution data
Explore the source record for details and available documents.
Robertson, Andreas Euan [Sandia National Laborator↗
Super-Resolution Processing of FDTR Measurement Data for Defect Detection
Explore the source record for details and available documents.
Tencer, John Thomas [Sandia National Laboratories ↗
Tilt-AutoFocus: Automated Light Sheet Illuminator Compatible with Super Resolution and Single Molecule Imaging
Explore the source record for details and available documents.
Baumann, Chris↗
On the effectiveness of neural operators at zero-shot weather downscaling
Machine-learning (ML) methods have shown great potential for weather downscaling. These data-driven approaches provide a more efficient alternative for producing high-resolution weather datasets and forecasts compared to physics-based numerical simulations. Neural operators, which learn solution operators for a family of partial differential equations, have shown great success in scientific ML applications involving physics-driven datasets. Neural operators are grid-resolution-invariant and are often evaluated on higher grid resolutions than they are trained on, i.e., zero-shot super-resolution. Given their promising zero-shot super-resolution performance on dynamical systems emulation, we present a critical investigation of their zero-shot weather downscaling capabilities, which is when models are tasked with producing high-resolution outputs using higher upsampling factors than are seen during training. To this end, we create two realistic downscaling experiments with challenging upsampling factors (e.g., 8x and 15x) across data from different simulations: the European Centre for Medium-Range Weather Forecasts Reanalysis version 5 (ERA5) and the Wind Integration National Dataset Toolkit. While neural operator-based downscaling models perform better than interpolation and a simple convolutional baseline, we show the surprising performance of an approach that combines a powerful transformer-based model with parameter-free interpolation at zero-shot weather downscaling. We find that this Swin-Transformer-based approach mostly outperforms models with neural operator layers in terms of average error metrics, whereas an Enhanced Super-Resolution Generative Adversarial Network-based approach is better than most models in terms of capturing the physics of the ground truth data. We suggest their use in future work as strong baselines.
17 WIND ENERGY↗
Electrochemically modulated single-molecule localization microscopy for in vitro imaging cytoskeletal protein structures
A new concept of electrochemically modulated single-molecule localization super-resolution imaging is developed. Applications of single-molecule localization super-resolution microscopy have been limited due to insufficient availability of qualified fluorophores with favorable low duty cycles. The key for the new concept is that the “On” state of a redox-active fluorophore with unfavorable high duty cycle could be driven to “Off” state by electrochemical potential modulation and thus become available for single-molecule localization imaging. The new concept was carried out using redox-active cresyl violet with unfavorable high duty cycle as a model fluorophore by synchronizing electrochemical potential scanning with a single-molecule localization microscope. The two cytoskeletal protein structures, the microtubules from porcine brain and the actins from rabbit muscle, were selected as the model target structures for the conceptual imaging in vitro. The super-resolution images of microtubules and actins were obtained from precise single-molecule localizations determined by modulating the On/Off states of single fluorophore molecules on the cytoskeletal proteins via electrochemical potential scanning. Importantly, this method could allow more fluorophores even with unfavorable photophysical properties to become available for a wider and more extensive application of single-molecule localization microscopy.
electrochemical modulation↗
Artificial Intelligence-Enhanced CMIP6 Climate Projections Across the Conterminous United States
This dataset comprises high-resolution climate projections at 1/24 degree grid (~4km) over the conterminous United States (CONUS) based on ten Global Climate Models (GCMs) that are part of the Coupled Models Intercomparison Project phase 6 (CMIP6). The CMIP6 GCMs are downscaled using two artificial intelligence (AI) techniques, primarily based on the computer vision approach called super-resolution. We train two separate networks: super-resolution convolutional neural network (SRCNN) and super-resolution generative adversarial network (SRGAN). The networks are trained using Daymet observations, originally available at a 1 km resolution. For training purposes, the Daymet data is interpolated to 1/24 degree (~4km), 0.25 degree and 1 degree, which serve as high, intermediate and low-resolution inputs respectively. For each of the SRCNN and SRGAN network, we use a two-step resolution enhancement, the first step generates 4x refinement from 1 degree to 0.25 degree and the second step generates 6x refinement from 0.25 degree to 1/24 degree (~4km). We downscale daily scale precipitation, maximum temperature and minimum temperature for the six CMIP6 GCMs for 1980 to 2019 in the historical period and 2020 to 2059 in the near-term future under the shared socioeconomic pathway 585 and 245 (SSP585 and SSP245) emission scenarios. We also perform double bias-correction with Daymet observations using a quantile mapping approach, first for GCMs prior to making predictions at 1 degree grid and second after making final predictions at ~4km.
13 HYDRO ENERGY↗
Removal of Homogeneous Broadening from 1 H-Detected Multidimensional Solid-State NMR Spectra
1 H-detected magic-angle spinning (MAS) NMR experiments have revolutionized the NMR studies of biological and inorganic solids by providing unparalleled sensitivity and resolution. Despite these gains, homogeneous broadening, originating from the incomplete removal of homonuclear dipolar interactions under fast MAS, remains highly prevalent and limits the achievable resolution. In direct analogy to super-resolution microscopy methods, we show that resolution beyond that currently achievable by fast MAS alone can be obtained by experiment-driven deconvolution. Following the acquisition of a single 2D NMR spectrum to measure the frequency-dependent homogeneous lineshapes, any number of 1 H-detected spectra can be enhanced in resolution, yielding comparable spectra as obtained with twice the MAS frequency. In conclusion, the versatility of this approach is demonstrated in the enhancement of single- and double-quantum homonuclear correlation spectra, in addition to heteronuclear correlation spectra acquired on a surface organometallic complex and the protein GB1.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
A staged deep learning approach to spatial refinement in 3D temporal atmospheric transport
High-resolution spatiotemporal simulations effectively capture the complexities of atmospheric plume dispersion in complex terrain. However, their high computational cost makes them impractical for applications requiring rapid responses or iterative processes, such as optimization, uncertainty quantification, or inverse modeling. To address this challenge, this work introduces the Dual-Stage Temporal Three-dimensional UNet Super-resolution (DST3D-UNet-SR) model, a highly efficient deep learning model for plume dispersion predictions. DST3D-UNet-SR is composed of two sequential modules: the temporal module (TM), which predicts the transient evolution of a plume in complex terrain from low-resolution temporal data, and the spatial refinement module (SRM), which subsequently enhances the spatial resolution of the TM predictions. We train DST3D-UNet-SR using a comprehensive dataset derived from high-resolution large eddy simulations (LES) of plume transport. We propose the DST3D-UNet-SR model to significantly accelerate LES of three-dimensional (3D) plume dispersion by three orders of magnitude. Additionally, the model demonstrates the ability to dynamically adapt to evolving conditions through the incorporation of new observational data, substantially improving prediction accuracy in high-concentration regions near the source.
3D temporal sequences↗
Real-time inference and extrapolation with Time-Conditioned UNet: Applications in hypersonic flows, incompressible flows, and global temperature forecasting
Neural Operators are fast and accurate surrogates for nonlinear mappings between functional spaces within training domains. Extrapolation beyond the training domain remains a grand challenge across all application areas. We present Time-Conditioned UNet (TC-UNet) as an operator learning method to solve time-dependent PDEs continuously in time without any temporal discretization, including in extrapolation scenarios. TC-UNet incorporates the temporal evolution of the PDE into its architecture by combining a parameter conditioning approach with the attention mechanism from the Transformer architecture. After training, TC-UNet makes real-time inferences on an arbitrary temporal grid. We demonstrate its extrapolation capability on a climate problem by estimating the global temperature for several years and also for inviscid hypersonic flow around a double cone. We propose different training strategies involving temporal bundling and sub-sampling. We demonstrate performance improvements for several benchmarks, performing extrapolation for long time intervals and zero-shot super-resolution time.
Deep learning↗
Characterizing Absolute Orientations in DNA Self-Assembly of Single Molecules
DNA self-assembly of single molecules (i.e., dyes) with deterministic orientations is a powerful approach for engineering mo-lecular excitons. However, current determination methods of the dye orientation relative to DNA do not account for the orien-tation of the dye plane, which is a missing degree of freedom needed to define absolute three-dimensional orientations. In this work, we combine fluorescence-detected linear dichroism, defocused dipole imaging, and DNA points accumulation for imaging in nanoscale topography (DNA-PAINT) super-resolution microscopy to determine the absolute three-dimensional orientations of single Cy5 dyes relative to host DNA duplexes which includes the dye plane orientation. The data revealed that the absorption and emission dipoles are perpendicular to the DNA duplex, and the mean dye plane is parallel to the DNA bases, which supports the notion that Cy5 dyes intercalate between DNA base pairs. The presented methodology will inspire the investigation of the dye plane orientation for controlling dye arrangement configurations beyond spontaneous π-stacking between dyes as well as achieving novel dye-DNA arrangements.
36 MATERIALS SCIENCE↗
DNA-PAINT Imaging with Hydrogel Imprinting and Clearing
Hydrogel-embedding is a versatile technique in fluorescence microscopy, offering stabilization, optical clearing, and the physical expansion of biological specimens. DNA-PAINT is a super-resolution microscopy approach based on the diffusion and transient binding of fluorescently labeled oligos, but its feasibility in hydrogels has not yet been explored. In this study, we demonstrate that polyacrylamide hydrogels support sufficient diffusion for effective DNA-PAINT imaging. Using acrydite-anchored oligonucleotides imprinted from patterned DNA origami nanostructures and microtubule filaments in fixed cells, we find that hydrogel embedding preserves docking strand positioning at the nanoscale. Sample clearing via protease treatment had minor structural effects on the microtubule structure and enhanced diffusion and accessibility to hydrogel-imprinted docking strands. Our work demonstrates promising potential for diffusion and binding-based fluorescence imaging applications in hydrogel-embedded samples.
DNA origami↗
Imaging from Macro to Nanoscale: Multimodal Advances in Chemical and Biomedical Imaging
Imaging increasingly serves as a multiscale framework for linking molecular mechanisms to cellular behavior, tissue architecture, and organ phenotypes in biology and unraveling fundamental processes in chemistry, physics and materials science. This Perspective highlights recent advances in chemical and biomedical imaging across macro-, micro-, and nanoscales, using representative examples published in Chemical and Biomedical Imaging (CBMI). At the macroscale, we discuss chemically selective MRI, including endogenous and exogenous CEST strategies, together with photoacoustic imaging as a hybrid modality with functional and chemical contrast. At the microscale, we consider fluorescence, label-free optical and vibrational imaging, and selected X-ray approaches that expand sensitivity, specificity, and temporal resolution in biological and materials systems. At the nanoscale, we highlight super-resolution fluorescence microscopy, single-molecule methods, tip-enhanced Raman spectroscopy, and correlative imaging strategies that resolve local heterogeneity and molecular organization. Across scales, a common theme emerges that advances in probes, contrast mechanisms, instrumentation, and sample handling are enabling chemically informed imaging that connects molecular specificity with biological context.
multiscale imaging↗
Deconstruction by C. thermocellum —from microbe mediated to dynamic redistribution of cellulosomes
Clostridium thermocellum is one of the most efficient microorganisms for the deconstruction of cellulosic biomass. To achieve this high level of cellulolytic activity, C. thermocellum uses large multienzyme complexes known as cellulosomes to break down complex polysaccharides, notably cellulose, found in plant cell walls. The attachment of bacterial cells to the nearby substrate via the cellulosome has been hypothesized to be the reason for this high efficiency. The region lying between the cell and the substrate has shown great variation and dynamics that are affected by the growth stage of cells and the substrate used for growth. Here, we used both super-resolution imaging and machine-learning approaches to study the distribution of C. thermocellum cellulosomes at different stages of growth. We show that C. thermocellum initially retains its cellulosomes primarily on the cell surface but then relocates large cellulosome clusters to the interface with biomass, therefore depleting its cell surface of cellulosomes. These results indicate dynamic redistribution of cellulosomes during growth, with a functional shift toward substrate-associated degradation later during growth on biomass.
09 BIOMASS FUELS↗
High-Resolution South American Wind Resource Data Downscaled with Generative Machine Learning Conditioned on Near-Surface Observations
High-resolution historical wind data was developed for the entirety of South America using the innovative Super-Resolution for Renewable Resource Data (sup3r) machine learning framework. The publicly available Sup3rWind South America dataset represents a significant advancement in wind resource data generation, leveraging generative machine learning conditioned on near-surface observations from the Meteorological Assimilation Data Ingest System (MADIS) to efficiently and accurately downscale coarse reanalysis data from the European Centre for Medium-Range Weather Forecasts (ERA5). This approach produces fine-scale, spatially and temporally coherent wind and meteorological fields hundreds of times more computationally efficient than traditional numerical weather modeling methods, enabling access to high-fidelity wind information across both continental and offshore regions. Sup3rWind South America builds on the earlier Sup3rWind Ukraine dataset through improvements in model architecture and outputs conditioned on near-surface observation inputs. As with the Ukraine data release, this dataset includes wind speed, wind direction, temperature, relative humidity, and pressure at a horizontal resolution of ~2 km, representing a 15x spatial enhancement relative to the 31 km ERA5 grid. Wind speed and direction are provided at 5-minute resolution, a 12x temporal refinement compared to the hourly ERA5 data, while temperature, relative humidity, and pressure remain at hourly resolution. The data covers all years from 2005 to 2024. Before downscaling, ERA5 inputs were bias-corrected using long-term monthly means and a limited number of quality-controlled observations to align large-scale statistics with regional conditions. The resulting dataset is the first publicly available high-resolution timeseries wind record that provides full spatial coverage of South America. Model validation demonstrates strong agreement with observations across several statistical metrics, consistent with other state-of-the-art high-resolution wind resource datasets. The potential applications of Sup3rWind South America span renewable energy resource assessment, energy system modeling, and grid resilience analysis. The 20-year record and high spatial and temporal resolution support accurate estimation of long-term energy yield and the economic feasibility of potential wind development sites. Continuous coverage across both continental and offshore regions enables comprehensive site prospecting within exclusive economic zones. The 2 km, 5-minute resolution data provide the spatial and temporal variability required for power system simulation, operational planning, and regional risk assessments.
17 WIND ENERGY↗
F-Hash: Feature-Based Hash Design for Time-Varying Volume Visualization via Multi-Resolution Tesseract Encoding
Interactive time-varying volume visualization is challenging due to its complex spatiotemporal features and sheer size of the dataset. Recent works transform the original discrete time-varying volumetric data into continuous Implicit Neural Representations (INR) to address the issues of compression, rendering, and super-resolution in both spatial and temporal domains. However, training the INR takes a long time to converge, especially when handling large-scale time-varying volumetric datasets. In this work, we proposed F-Hash, a novel feature-based multi-resolution Tesseract encoding architecture to greatly enhance the convergence speed compared with existing input encoding methods for modeling time-varying volumetric data. The proposed design incorporates multi-level collision-free hash functions that map dynamic 4D multi-resolution embedding grids without bucket waste, achieving high encoding capacity with compact encoding parameters. Our encoding method is agnostic to time-varying feature detection methods, making it a unified encoding solution for feature tracking and evolution visualization. Experiments show the F-Hash achieves state-of-the-art convergence speed in training various time-varying volumetric datasets for diverse features. We also proposed an adaptive ray marching algorithm to optimize the sample streaming for faster rendering of the time-varying neural representation.
deep learning↗
Second-generation downscaled earth system model data using generative machine learning
The second-generation Sup3rCC dataset provides high-resolution meteorological data generated through the downscaling of multiple earth system models (ESMs) from the Coupled Model Intercomparison Project Phase 6 (CMIP6). This downscaling is performed through application of a generative machine learning approach called Super-Resolution for Renewable Resource Data (sup3r). This dataset builds on the first-generation Sup3rCC data by applying improved bias correction methods and adding downscaled precipitation to the output variables. As with the first Sup3rCC version, the data still include temperature, wind speed and direction at multiple heights, pressure, three components of downwelling solar radiation, and relative humidity—all at 4-kilometer (km) hourly resolution over the contiguous United States. This is a 25x spatial enhancement and 24x temporal enhancement of the source 100-km daily-average ESM data. This extension of the Sup3rCC dataset includes data from six ESMs from two shared socioeconomic pathways (SSPs) totaling 400 years of data with multiple future projections of changing meteorological conditions. The scenario selection was based on a structured evaluation of historical ESM skill and comprehensive representation of possible trajectories of future climate change in temperature, humidity, precipitation, solar irradiance, and near-surface wind speeds. The inclusion of multiple future projections is intended to enable users to assess key drivers of un 36 certainty and variability. All data are double-bias corrected, resulting in a product that can be used out-of-the-box for energy system analysis with minimal historical bias. The potential applications of Sup3rCC data extend to various topics in renewable energy resource assessment, energy systems modeling, and grid resilience studies. High-resolution future meteorological projections are critical for evaluating the effects of changing meteorological conditions on renewable energy generation, energy demand, and for optimizing energy storage and grid infrastructure. The 4-km hourly resolution of the downscaled data enables understanding of spatial and temporal variability at the scales necessary for energy system operational planning. In addition, the dataset can support risk assessments by providing detailed information on possible future extreme weather events and long-term meteorological variability at scales relevant to energy infrastructure. By offering an enhanced representation of possible future meteorological conditions, the second-generation Sup3rCC dataset enables more precise modeling of energy resilience and adaptation strategies in response to changing meteorological conditions.
24 POWER TRANSMISSION AND DISTRIBUTION↗
Downscaled Earth System Model Data for Resilient Energy System Planning
The second-generation Sup3rCC dataset provides high-resolution meteorological data generated through the downscaling of multiple earth system models (ESMs) from the Coupled Model Intercomparison Project Phase 6 (CMIP6). This downscaling is performed through application of a generative machine learning approach called Super-Resolution for Renewable Resource Data (sup3r). This dataset builds on the first-generation Sup3rCC data by applying improved bias correction methods and adding downscaled precipitation to the output variables. In this presentation, we explore the output characteristics of the dataset and various validation analyses. We also present and discuss plans for the integration of this data into power system planning models using a decision-making under deep uncertainty (DMDU) methodology.
97 MATHEMATICS AND COMPUTING↗