Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Sub-pixel resolution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

Assessment of the Imaging Properties of Plastic Scintillators at FP60R for Neutron Imaging Applications [Slides]

4mm thick Stilbene gives the brightest signal but at the cost of resolution. 1 and 2 cm BC412 gave the highest resolution images. The HI-LY scintillator is better suited for DD neutrons. Future work includes: measurements this summer using an event-mode imaging camera which promises sub-pixel resolution through center-of-mass techniques, opportunities for DD neutron tests during laser-driven z-pinch experiments at UNR, and assess scatter within scintillator.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Ultrafast CMOS image sensors and data-enabled super-resolution for multimodal radiographic imaging and tomography

We summarize recent progress in ultrafast Complementary Metal Oxide Semiconductor (CMOS) image sensor development and the application of neural networks for post-processing of CMOS and charge-coupled device (CCD) image data to achieve sub-pixel resolution (thus ‘super-resolution’). The combination of novel CMOS pixel designs and data-enabled image post-processing provides a promising path towards ultrafast high-resolution multi-modal radiographic imaging and tomography applications.

47 OTHER INSTRUMENTATION↗

Ultrafast CMOS image sensors and data-enabled super-resolution for multimodal radiographic imaging and tomography

We summarize recent progress in ultrafast Complementary Metal Oxide Semiconductor (CMOS) image sensor development and the application of neural networks for post-processing of CMOS and charge-coupled device (CCD) image data to achieve sub-pixel resolution (thus $super$-$resolution$). The combination of novel CMOS pixel designs and data-enabled image post-processing provides a promising path towards ultrafast high-resolution multi-modal radiographic imaging and tomography applications.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Light-powered end-to-end neutron detection and imaging with an edge-deployed optical AI chip

Neutron detection is widely used in many applications including nuclear physics, nuclear energy, nuclear technologies and nuclear safeguards. Developing an end-to-end neutron detection and imaging workflow paves way towards fully automated processes for many applications. We implemented an automated workflow for neutron detection experiments which use a solid state image sensor to capture neutron hits as a digital image. We deploy the workflow to an edge-based optical neural network (ONN) to increase the radiation-hardness and lifetime of neutron detection instruments. We present a two-stage neural network framework for detection of neutrons at sub-pixel resolution. The first stage uses a region proposal network to efficiently detect and extract neutron hits from the input camera image. The second stage feeds the extracted hits into a fully connected neural network to predict the sub-pixel hit position. The performance of the two-stage framework is evaluated using the edge-based ONN. The results show that we can achieve above 96% neutron detection accuracy as well as sub-pixel and sub-micron position resolution, while enjoying the advantages of the ONN hardware including radiation-hardness, low energy consumption and high computing speed for integrated edge camera and hardware deployment, when compared with electronic counterparts.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Sub-pixel high-resolution imaging of high-energy x-rays inspired by sub-wavelength optical imaging

We have developed and demonstrated an image super-resolution method—XR-UNLOC: X-Ray UNsupervised particle LOCalization—for hard x-rays measured with fast-frame-rate detectors that is an adaptation of the principle of photo-activated localization microscopy (PALM) and stochastic optical reconstruction microscopy (STORM), which enabled biological fluorescence imaging at sub-optical-wavelength scales. We demonstrate the approach on experimental coherent Bragg diffraction data measured with 52 keV x-rays from a nanocrystalline sample. From this sample, we resolve the fine fringe detail of a high-energy x-ray Bragg coherent diffraction pattern to an upsampling factor of 16 of the native pixel pitch of 30 μ m of a charge-integrating fastCCD detector. This was accomplished by analysis of individual photon locations in a series of “nearly-dark” instances of the diffraction pattern that each contain only a handful of photons. Central to our approach was the adaptation of the UNLOC photon fitting routine for PALM/STORM to the hard x-ray regime to handle much smaller point spread functions, which required a different statistical test for photon detection and for sub-pixel localization. A comparison to a photon-localization strategy used in the x-ray community (“droplet analysis”) showed that XR-UNLOC provides significant improvement in super-resolution. We also developed a metric by which to estimate the limit of reliable upsampling with XR-UNLOC under a given set of experimental conditions in terms of the signal-to-noise ratio of a photon detection event and the size of the point spread function for guiding future x-ray experiments in many disciplines where detector pixelation limits must be overcome.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

mpfit: a robust method for fitting atomic resolution images with multiple Gaussian peaks

The standard technique for sub-pixel estimation of atom positions from atomic resolution scanning transmission electron microscopy images relies on fitting intensity maxima or minima with a two-dimensional Gaussian function. While this is a widespread method of measurement, it can be error prone in images with non-zero aberrations, strong intensity differences between adjacent atoms or in situations where the neighboring atom positions approach the resolution limit of the microscope. Here we demonstrate mpfit, an atom finding algorithm that iteratively calculates a series of overlapping two-dimensional Gaussian functions to fit the experimental dataset and then subsequently uses a subset of the calculated Gaussian functions to perform sub-pixel refinement of atom positions. Based on both simulated and experimental datasets presented in this work, this approach gives lower errors when compared to the commonly used single Gaussian peak fitting approach and demonstrates increased robustness over a wider range of experimental conditions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

ESM data downscaling: a comparison of super-resolution deep learning models

Abstract Climate projections at fine spatial resolutions are required to conduct accurate risk assessment for critical infrastructure and design adaptation planning. Generating these projections using advanced Earth system models (ESM) requires significant computational resources. To address this issue, various statistical downscaling techniques have been introduced to generate fine-resolution data from coarse-resolution simulations. In this study, we evaluate and compare five deep learning-based downscaling techniques, namely, super-resolution convolutional neural networks, fast super-resolution convolutional neural network ESM, efficient sub-pixel convolutional neural network, enhanced deep residual network (EDRN), and super-resolution generative adversarial network (SRGAN). These techniques are applied to a dataset generated by the Energy Exascale Earth System Model (E3SM), focusing on key surface variables such as surface temperature, shortwave heat flux, and longwave heat flux. Models are trained and validated using paired fine-resolution (0.25 $$^{\circ }$$ ∘ ) and coarse-resolution (1 $$^{\circ }$$ ∘ ) monthly data obtained from a 9-year simulation. Next, blind testing is performed using monthly data obtained from two different years outside of the training and validation set. To evaluate the efficiency of each technique, different statistical metrics are used, including mean squared error (MSE), peak signal-to-noise ratio (PSNR), structural similarity index measure (SSIM), and learned perceptual image patch similarity (LPIPS). The results show that EDRN outperforms other algorithms in terms of PSNR, SSIM, and MSE, but struggles to capture fine-scale features in the data. In contrast, SRGAN, a generative model that uses perceptual loss, excels in capturing fine details at boundaries and internal structures, resulting in lower LPIPS than other methods.

Pawar, Nikhil M. (ORCID:0000000211613289)↗

Landscape-scale characterization of Arctic tundra vegetation composition, structure, and function with a multi-sensor unoccupied aerial system

The Arctic is experiencing some of the most rapid climate change on Earth, with strong impacts on tundra ecosystems that are characterized by high land-surface and vegetation heterogeneity. Previous studies have explored this complexity using satellite remote sensing, however these typically coarse spatial resolution data have generally missed sub-pixel heterogeneity, leaving critical gaps in our understanding of tundra vegetation dynamics from the community to landscape scales. To address these gaps, we collected very high-resolution (1-5 cm) optical, structural, and thermal data at three low-Arctic tundra sites on the Seward Peninsula, Alaska, using a multi-sensor unoccupied aerial system (UAS). We examined the application of these data to studying tundra vegetation dynamics, by quantifying (1) canopy height and thermoregulation (leaf-air temperature) of representative plant functional types (PFTs), (2) fine-scale patterns of vegetation composition across landscapes, and (3) impacts of fine-scale vegetation composition on landscape-scale variation of canopy height and thermoregulation. Our results show that deciduous tall shrubs (those that can potentially grow >2 m) had a strong cooling effect, with canopy temperatures significantly lower than local air temperatures and other PFTs. Increased cover of tall shrubs also had the potential to reduce the cover of low-stature PFTs across the landscape, potentially associated with their closed canopy (i.e., increased light competition) and strong thermoregulation. To understand the connections between fine-scale vegetation composition and large-scale ecosystem processes, we produced a random forest model which showed that fine-scale PFT composition accounted for 86.8% and 74.2% of the landscape-scale variation in canopy height and thermoregulation, respectively. These findings highlight the importance of spatially detailed characterization of tundra PFTs to improve our ecological understanding and model representation of tundra vegetation, also transcend our study to show the need for continued collection of similar datasets to better understand the impacts of surface heterogeneity on the mapping and modeling of tundra ecosystem dynamics, as well as assist with conservation management and biodiversity monitoring strategies.

54 ENVIRONMENTAL SCIENCES↗

Unrolled Video Super-Resolution Network with Autoregressive Prior for the Case of Known Motion

Real-time detection and classification of distant objects is necessary for many national security applications. However, when objects are far from the sensor, they occupy only a small number of pixels in the captured video, limiting the amount of visual detail available for recognition. State-of-the-art classification methods typically rely on high-resolution (HR) video streams to capture characteristic object features, but obtaining such detail is challenging for distant objects that occupy only a few pixels. This motivates the development of video super-resolution (VSR) methods that enhance object classification by recovering fine details from low-pixel representations. Current VSR methods rely either on model-based optimization, which is interpretable but computationally expensive, or on learning-based approaches, which are efficient and high-performing but often lack flexibility and interpretability. In this report, we propose an end-to-end trainable unrolled VSR network, UVSRNet, which super-resolves each frame in a video by exploiting sub-pixel motion between neighboring low-resolution (LR) frames as well as incorporating high-frequency detail from previously super-resolved frames. In particular, by unrolling a plug-and-play (PnP) half-quadratic splitting (HQS) algorithm, we leverage a model-based data-fitting module alongside a learning-based autoregressive prior module. This combination yields a method that maintains the flexibility and interpretability of model-based methods while achieving the performance advantages of learning-based methods.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Radar Super Resolution using a Deep Convolutional Neural Network

Super-resolution involves synthetically increasing the resolution of gridded data beyond its native resolution. Typically, this is done using interpolation schemes, which estimate sub-grid scale values from neighboring data, and perform the same operation everywhere regardless of the large-scale context, or by requiring a network of radars with overlapping fields of view. Recently, significant progress has been made in single image super resolution using convolutional neural networks. Conceptually, a neural network may be able to learn relations between large scale precipitation features and the associated sub-pixel scale variability and outperform interpolation schemes. Here, we use a deep convolutional neural network to artificially enhance the resolution of NEXRAD PPI scans. The model is trained on 6-months of reflectivity observations from the Langley Hill WA (KLGX) radar, and we find that it substantially outperforms common interpolation schemes for x4 and x8 resolution increases based on several objective error and perceptual quality metrics.

radar, machine learning, super resolution, Remote ↗

Multiscale assessment of land surface phenology from harmonized Landsat 8 and Sentinel-2, PlanetScope, and PhenoCam imagery

As the spatial and temporal resolution of remotely sensed imagery has improved over the last four decades, algorithms for monitoring and mapping seasonal changes in surface properties have evolved rapidly. Most recently, the availability of daily PlanetScope imagery has created new opportunities for monitoring the land surface phenology (LSP) of terrestrial ecosystems at high spatial resolution. However, the quality and value of LSP information from PlanetScope imagery have not been systematically examined. In this paper, we evaluate the character and quality of LSP information derived from PlanetScope by comparing time series of vegetation indices and LSP metrics from PlanetScope to corresponding time series and LSP metrics derived from Harmonized Landsat 8 and Sentinel-2 (HLS) imagery and PhenoCams at six sites that span a diverse range of land cover types and climate. Results show that vegetation index time series from all three data sources show high temporal correlation, and LSP metrics derived from HLS, PlanetScope, and PhenoCam show high agreement with negligible bias. Semi-variograms for phenometrics estimated from PlanetScope imagery indicate that the majority of spatial variance captured in PlanetScope phenometrics occurs well below the spatial resolution HLS imagery. At the same time, LSP metrics from HLS are most strongly correlated with the 50–75% quantiles of 3 m LSP metrics from PlanetScope. This indicates that HLS captures the average phenology at sub-pixel scale captured in PlanetScope imagery. Here, our results represent the first comprehensive comparison of LSP metrics estimated from PlanetScope and publicly available moderate spatial resolution imagery, and provide insights regarding: (1) the quality and character of LSP metrics derived from HLS and PlanetScope; and (2) the relative merits and trade-offs associated with the use of each data source for LSP studies.

54 ENVIRONMENTAL SCIENCES↗

Discorpy : algorithms and software for camera calibration and correction

Camera or lens-based detector calibration is essential for spatial accuracy in applications like dimensional tomography, optical metrology, and computer vision. Many methods and software exist yet there is still a lack of approaches that achieve both high accuracy and robustness while being easy to use and capable of handling a wide range of distortions. Radial lens distortion is common in high-resolution X-ray detector optics used in parallel-beam tomography at synchrotrons. Achieving sub-pixel accuracy requires calibrating with an optical target image. Although methods for characterizing radial distortion are well established, acquired images often also include perspective distortion and optical center offset. Here, we present our approaches to individually characterize and correct both types of distortion using a single calibration image, implemented in the Discorpy software.

36 MATERIALS SCIENCE↗

Quantification of Sub-Pixel Dynamics in High-Speed Neutron Imaging

The high penetration depth of neutrons through many metals and other common materials makes neutron imaging an attractive method for non-destructively probing the internal structure and dynamics of objects or systems that may not be accessible by conventional means, such as X-ray or optical imaging. While neutron imaging has been demonstrated to achieve a spatial resolution below 10 μm and temporal resolution below 10 μs, the relatively low flux of neutron sources and the limitations of existing neutron detectors have, until now, dictated that these cannot be achieved simultaneously, which substantially restricts the applicability of neutron imaging to many fields of research that could otherwise benefit from its unique capabilities. In this work, we present an attenuation modeling approach to the quantification of sub-pixel dynamics in cyclic ensemble neutron image sequences of an automotive gasoline direct injector at a 5 μs time scale with a spatial noise floor in the order of 5 μm.

47 OTHER INSTRUMENTATION↗

Super-resolution model for overlapping peak detection and improved spatial resolution in high-energy diffraction microscopy

Reconstruction quality in Far-field High-Energy Diffraction Microscopy (FF-HEDM) is limited by the spatial resolution of area detectors and the frequent occurrence of overlapping diffraction spots. To address these challenges, we developed a super-resolution (SR) framework using convolutional neural networks (CNNs) to recreate 2D diffraction peaks at up to ×8 resolution from raw detector data. A specialized simulation tool was created to generate synthetic training datasets with varying degrees of peak overlap. Integrated into the Microstructural Imaging using Diffraction Analysis Software (MIDAS), the SR model improves the spatial accuracy and precision of 3D grain reconstruction by an order of magnitude. This approach provides a robust solution for investigation of complex micromechanical states and material classes where the analysis is limited by the presence of overlapping peaks. Furthermore, the methodology developed here can potentially be extended to other techniques that require sub-pixel accuracy for high-fidelity data analysis.

High-energy diffraction microscopy↗