Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “IMAGE”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

CLAIRE—Parallelized Diffeomorphic Image Registration for Large-Scale Biomedical Imaging Applications

We study the performance of CLAIRE—a diffeomorphic multi-node, multi-GPU image-registration algorithm and software—in large-scale biomedical imaging applications with billions of voxels. At such resolutions, most existing software packages for diffeomorphic image registration are prohibitively expensive. As a result, practitioners first significantly downsample the original images and then register them using existing tools. Our main contribution is an extensive analysis of the impact of downsampling on registration performance. We study this impact by comparing full-resolution registrations obtained with CLAIRE to lower resolution registrations for synthetic and real-world imaging datasets. Our results suggest that registration at full resolution can yield a superior registration quality—but not always. For example, downsampling a synthetic image from 10243 to 2563 decreases the Dice coefficient from 92% to 79%. However, the differences are less pronounced for noisy or low contrast high resolution images. CLAIRE allows us not only to register images of clinically relevant size in a few seconds but also to register images at unprecedented resolution in reasonable time. The highest resolution considered are CLARITY images of size 2816×3016×1162. To the best of our knowledge, this is the first study on image registration quality at such resolutions.

Himthani, Naveen↗
DOE OSTI2023

Image Processing Pipeline for Fluoroelastomer Crystallite Detection in Atomic Force Microscopy Images

Phase transformations in materials systems can be tracked using atomic force microscopy (AFM), enabling the examination of surface properties and macroscale morphologies. In situ measurements investigating phase transformations generate large datasets of time-lapse image sequences. The interpretation of the resulting image sequences, guided by domain-knowledge, requires manual image processing using handcrafted masks. Here this approach is time-consuming and restricts the number of images that can be processed. Her in this study, we developed an automated image processing pipeline which integrates image detection and segmentation methods. We examine five time-series AFM videos of various fluoroelastomer phase transformations. The number of image sequences per video ranges from a hundred to a thousand image sequences. The resulting image processing pipeline aims to automatically classify and analyze images to enable batch processing. Using this pipeline, the growth of each individual fluoroelastomer crystallite can be tracked through time. We incorporated statistical analysis into the pipeline to investigate trends in phase transformations between different fluoroelastomer batches. Understanding these phase transformations is crucial, as it can provide valuable insights into manufacturing processes, improve product quality, and possibly lead to the development of more advanced fluoroelastomer formulations.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Development of high throughput light-sheet fluorescence lifetime imaging microscopy for 3D functional imaging of metabolic pathways in plant and microorganisms (Final Technical Report)

This research program will enable new biochemical contrast in the nanosecond lifetime domain through use of the recently demonstrated electro-optic fluorescence lifetime imaging technique (EO-FLIM) for wide-field lifetime imaging. The Stanford/Stanford Linear Accelerator Center multidisciplinary collaboration -- physics, applied physics, and structural biology -- will develop a light-sheet fluorescence lifetime imaging microscope for functional studies of microbial and plant metabolic pathways and dynamic interactions between plants and microorganisms in the rhizosphere. The proposed approach overcomes the imaging time bottleneck associated with existing fluorescence lifetime imaging methods. Initial demonstrations have shown a factor of 100,000 improvement in photon throughput compared to existing methods. High photon efficiency allowed the first wide-field fluorescence lifetime imaging of single molecules. Recent work has improved the technique’s repetition rate to enable compatibility with mode-locked lasers and demonstrated the combination of wide-field fluorescence lifetime imaging with super-resolution localization microscopy, observations of single molecule dynamics, and observation of donor lifetime quenching in single-molecule imaging. These results were achieved on standard camera sensors and would not have been possible with other wide-field approaches. The throughput and photon economy of the EO-FLIM method enables new BER-relevant imaging opportunities. In particular, scanned single- and two-photon light-sheet excitation will be used to achieve volumetric imaging with time-domain contrast.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

Integrative Quantitative-Phase and Airy Light-Sheet Imaging

Light-sheet microscopy enables considerable speed and phototoxicity gains, while quantitative-phase imaging confers label-free organelle recognition and metabolic information that are inaccessible by conventional methods. We report the fusion of these two modalities onto a standard inverted microscope that retains compatibility with microfluidics. We describe the utilization of an accelerating Airy-beam light-sheet yielding identical imaging areas with interferometry, and an application in unmasking the effects of cellular noise on metabolic compartmentalization.

Biological sciences, Biological techniques, Micros↗
DOE OSTI2024

Simulating image coaddition with the Nancy Grace Roman Space Telescope – II. Analysis of the simulated images and implications for weak lensing

One challenge for applying current weak lensing analysis tools to the Nancy Grace Roman Space Telescope is that individual images will be undersampled. Our companion paper presented an initial application of Imcom – an algorithm that builds an optimal mapping from input to output pixels to reconstruct a fully sampled combined image – on the Roman image simulations. In this paper, we measure the output noise power spectra, identify the sources of the major features in the power spectra, and show that simple analytic models that ignore sampling effects underestimate the power spectra of the coadded noise images. We compute the moments of both idealized injected stars and fully simulated stars in the coadded images, and their one- and two-point statistics. We show that the idealized injected stars have root-mean-square ellipticity errors (1–6) × 10 -4 per component depending on the band; the correlation functions are ≥2 orders of magnitude below requirements, indicating that the image combination step itself is using a small fraction of the overall Roman second moment error budget, although the fourth moments are larger and warrant further investigation. The stars in the simulated sky images, which include blending and chromaticity effects, have correlation functions near the requirement level (and below the requirement level in a wide-band image constructed by stacking all four filters). We evaluate the noise-induced biases in the ellipticities of injected stars, and explain the resulting trends with an analytical model. We conclude by enumerating the next steps in developing an image coaddition pipeline for Roman.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Source shape estimation for neutron imaging systems using convolutional neural networks

Neutron imaging systems are important diagnostic tools for characterizing the physics of inertial confinement fusion reactions at the National Ignition Facility (NIF). In particular, neutron images give diagnostic information on the size, symmetry, and shape of the fusion hot spot and surrounding cold fuel. Images are formed via collection of neutron flux from the source using a system of aperture arrays and scintillator-based detectors. Currently, reconstruction of fusion source geometry from the collected neutron images is accomplished by solving a computationally intensive maximum likelihood estimation problem via expectation maximization. In contrast, it is often useful to have simple representations of the overall source geometry that can be computed quickly. In this work, we develop convolutional neural networks (CNNs) to reconstruct the outer contours of simple source geometries. We compare the performance of the CNN for penumbral and pinhole data and provide experimental demonstrations of our methods on both non-noisy and noisy data.

Machine learning, neutron imaging, source reconstr↗
DOE OSTI2022

Design and demonstration of a low‐field magnetic resonance imaging rhizotron for in‐field imaging of energy sorghum roots

Abstract Root phenotyping provides critical information to plant breeders for developing varieties with improved drought tolerance, greater root biomass, and greater nutrient use efficiency. Phenotyping roots in the natural environment is important for understanding the effect of the soil environment on root genotypic expressions. The goal of this work was to design and test a field‐scale mobile low‐field magnetic resonance imaging (LF‐MRI) Rhizotron that produces actionable root phenotyping data. We demonstrated this novel technology for root visualization and quantification using a LF‐MRI Rhizotron operating at 47 mT with two soil types. The LF‐MRI Rhizotron weights 453 kg, with a height of 90 cm, a diameter of 28 cm and an imaging field of view of 28 cm × 28 cm. The unit was operated in a Belk clay (Entic Hapluderts) and Weswood silt loam (Udifluventic Halustepts) generating 2‐D and 3‐D image data sets. The 2‐D image data had a collection time of 16.5 min per image at an image resolution of 2.2 mm per pixel. The 3‐D data had a collection time of 13 h per image with a 2.2 × 2.2 × 2.2 mm voxel resolution. Low‐field magnetic resonance imaging worked well for visualizing roots in moderate to high clay soils, demonstrating the potential for this technology; however, the broad application of this platform is hampered due to the prohibitively long scanning time to obtain 3‐D images. By increasing the field strength, and therefore the signal‐to‐noise ratio, faster scan times can enable a more useful system for root phenotyping.

Bagnall, G. Cody↗
DOE OSTI2022

An image classification deep-learning algorithm for shrapnel detection from ultrasound images

Ultrasound imaging is essential for non-invasively diagnosing injuries where advanced diagnostics may not be possible. However, image interpretation remains a challenge as proper expertise may not be available. In response, artificial intelligence algorithms are being investigated to automate image analysis and diagnosis. Here, we highlight an image classification convolutional neural network for detecting shrapnel in ultrasound images. As an initial application, different shrapnel types and sizes were embedded first in a tissue mimicking phantom and then in swine thigh tissue. The algorithm architecture was optimized stepwise by minimizing validation loss and maximizing F1 score. The final algorithm design trained on tissue phantom image sets had an F1 score of 0.95 and an area under the ROC curve of 0.95. It maintained higher than a 90% accuracy for each of 8 shrapnel types. When trained only on swine image sets, the optimized algorithm format had even higher metrics: F1 and area under the ROC curve of 0.99. Overall, the algorithm developed resulted in strong classification accuracy for both the tissue phantom and animal tissue. This framework can be applied to other trauma relevant imaging applications such as internal bleeding to further simplify trauma medicine when resources and image interpretation are scarce.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

SNIa Cosmology Analysis Results from Simulated LSST Images: From Difference Imaging to Constraints on Dark Energy

Abstract The Vera Rubin Observatory Legacy Survey of Space and Time (LSST) is expected to process ∼10 6 transient detections per night. For precision measurements of cosmological parameters and rates, it is critical to understand the detection efficiency, magnitude limits, artifact contamination levels, and biases in the selection and photometry. Here we rigorously test the LSST Difference Image Analysis (DIA) pipeline using simulated images from the Rubin Observatory LSST Dark Energy Science Collaboration Data Challenge (DC2) simulation for the Wide-Fast-Deep survey area. DC2 is the first large-scale (300 deg 2 ) image simulation of a transient survey that includes realistic cadence, variable observing conditions, and CCD image artifacts. We analyze ∼15 deg 2 of DC2 over a 5 yr time span in which artificial point sources from Type Ia supernova (SNIa) light curves have been overlaid onto the images. The magnitude limits per filter are u = 23.66 mag, g = 24.69 mag, r = 24.06 mag, i = 23.45 mag, z = 22.54 mag, and y = 21.62 mag. The artifact contamination levels are ∼90% of all detections, corresponding to ∼1000 artifacts deg –2 in g band, and falling to 300 deg –2 in y band. The photometry has biases <1% for magnitudes 19.5 < m < 23. Our DIA performance on simulated images is similar to that of the Dark Energy Survey difference-imaging pipeline on real images. We also characterize DC2 image properties to produce catalog-level simulations needed for distance bias corrections. We find good agreement between DC2 data and simulations for distributions of signal-to-noise ratio, redshift, and fitted light-curve properties. Applying a realistic SNIa cosmology analysis for redshifts z < 1, we recover the input cosmology parameters to within statistical uncertainties.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Manifold projection image segmentation for nano-XANES imaging

As spectral imaging techniques are becoming more prominent in science, advanced image segmentation algorithms are required to identify appropriate domains in these images. We present a version of image segmentation called manifold projection image segmentation (MPIS) that is generally applicable to a broad range of systems without the need for training because MPIS uses unsupervised machine learning with a few physically motivated hyperparameters. We apply MPIS to nanoscale x-ray absorption near edge structure (XANES) imaging, where XANES spectra are collected with nanometer spatial resolution. We show the superiority of manifold projection over linear transformations, such as the commonly used principal component analysis (PCA). Moreover, MPIS maintains accuracy while reducing computation time and sensitivity to noise compared to the standard nano-XANES imaging analysis procedure. Finally, we demonstrate how multimodal information, such as x-ray fluorescence data and spatial location of pixels, can be incorporated into the MPIS framework. We propose that MPIS is adaptable for any spectral imaging technique, including scanning transmission x-ray microscopy, where the length scale of domains is larger than the resolution of the experiment.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Considerations for three-dimensional image reconstruction from experimental data in coherent diffractive imaging

The Datasets folder contains 3 datasets, corresponding to the datasets mentioned in the article with 670, 2691 and 586 images. The Runs folder has all the runs used. Besides the images itself it also contains tags for each image under `/entry_1/image_1/detector_and_photon_corrected/tags`. The `headings` attribute gives the name of each tag. The `Jonas Strict` tag corresponds to the 670 images, the `Redflamingo` tag to the 2691 images and the `Redflamingo_Ida_subset` tag to the 586 images. The final dataset with 260 images can be obtained from `Datasets/amoc6914-Redflamingo-manual-586.h5` and use the `/model/diameterNM` group to select the 260 images with size closest to 214 nm.

AMO↗
DOE OSTI2023

Plasmonic nanorod probes’ journey inside plant cells for in vivo SERS sensing and multimodal imaging

Nanoparticle-based platforms are gaining strong interest in plant biology and bioenergy research to monitor and control biological processes in whole plants. However, in vivo monitoring of biomolecules using nanoparticles inside plant cells remains challenging due to the impenetrability of the plant cell wall to nanoparticles beyond the exclusion limits (5-20 nm). To overcome this physical barrier, we have designed unique bimetallic silver-coated gold nanorods (AuNR@Ag) capable of entering plant cells, while conserving key plasmonic properties in the near-infrared (NIR). To demonstrate cellular internalization and tracking of the nanorods inside plant tissue, we used a comprehensive multimodal imaging approach that included transmission electron microscopy (TEM), confocal fluorescence microscopy, two-photon luminescence (TPL), X-ray fluorescence microscopy (XRF), and photoacoustics imaging (PAI). We successfully acquired SERS signals of nanorods in vivo inside plant cells of tobacco leaves. On the same leaf samples, we applied orthogonal imaging methods, TPL and PAI techniques for in vivo imaging of the nanorods. This study first demonstrates the intracellular internalization of AuNR@Ag inside whole plant systems for in vivo SERS analysis in tobacco cells. This work demonstrates the potential of this nanoplatform as a new nanotool for intracellular in vivo biosensing for plant biology.

Cupil-Garcia, Vanessa↗
DOE OSTI2023

Deep-Learning Electron Diffractive Imaging

Here, we report the development of deep-learning coherent electron diffractive imaging at subangstrom resolution using convolutional neural networks (CNNs) trained with only simulated data. We experimentally demonstrate this method by applying the trained CNNs to recover the phase images from electron diffraction patterns of twisted hexagonal boron nitride, monolayer graphene, and a gold nanoparticle with comparable quality to those reconstructed by a conventional ptychographic algorithm. Fourier ring correlation between the CNN and ptychographic images indicates the achievement of a resolution in the range of 0.70 and 0.55 Å. We further develop CNNs to recover the probe function from the experimental data. The ability to replace iterative algorithms with CNNs and perform real-time atomic imaging from coherent diffraction patterns is expected to find applications in the physical and biological sciences.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

Survey of Image Denoising Methods for Medical Image Classification

Medical imaging devices, such as X-ray machines, inherently produce images that suffer from visual noise. Our objectives were to (i.) determine the effect of image denoising on a medical image classification task, and (ii.) determine if there exists a correlation between image denoising performance and medical image classification performance. We performed the medical image classification task on chest X-rays using the DenseNet-121 convolutional neural network (CNN) and used the peak signal-to-noise ratio (PSNR) and structural similarity (SSIM) metrics as the image denoising performance measures. We first found that different denoising methods can make a statistically significant difference in classification performance for select labels. We also found that denoising methods affect fine-tuned models more than randomly-initialized models and that fine-tuned models have significantly higher and more uniform performance than randomly-initialized models. Lastly, we found that there is no significant correlation between PSNR and SSIM values and classification performance for our task.

Michael, Peter↗
DOE OSTI2022

To image, or not to image: class-specific diffractive cameras with all-optical erasure of undesired objects

Abstract Privacy protection is a growing concern in the digital era, with machine vision techniques widely used throughout public and private settings. Existing methods address this growing problem by, e.g., encrypting camera images or obscuring/blurring the imaged information through digital algorithms. Here, we demonstrate a camera design that performs class-specific imaging of target objects with instantaneous all-optical erasure of other classes of objects. This diffractive camera consists of transmissive surfaces structured using deep learning to perform selective imaging of target classes of objects positioned at its input field-of-view. After their fabrication, the thin diffractive layers collectively perform optical mode filtering to accurately form images of the objects that belong to a target data class or group of classes, while instantaneously erasing objects of the other data classes at the output field-of-view. Using the same framework, we also demonstrate the design of class-specific permutation and class-specific linear transformation cameras, where the objects of a target data class are pixel-wise permuted or linearly transformed following an arbitrarily selected transformation matrix for all-optical class-specific encryption, while the other classes of objects are irreversibly erased from the output image. The success of class-specific diffractive cameras was experimentally demonstrated using terahertz (THz) waves and 3D-printed diffractive layers that selectively imaged only one class of the MNIST handwritten digit dataset, all-optically erasing the other handwritten digits. This diffractive camera design can be scaled to different parts of the electromagnetic spectrum, including, e.g., the visible and infrared wavelengths, to provide transformative opportunities for privacy-preserving digital cameras and task-specific data-efficient imaging.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Real-time image denoising of mixed Poisson–Gaussian noise in fluorescence microscopy images using ImageJ

Fluorescence microscopy imaging speed is fundamentally limited by the measurement signal-to-noise ratio (SNR). To improve image SNR for a given image acquisition rate, computational denoising techniques can be used to suppress noise. However, common techniques to estimate a denoised image from a single frame either are computationally expensive or rely on simple noise statistical models. These models assume Poisson or Gaussian noise statistics, which are not appropriate for many fluorescence microscopy applications that contain quantum shot noise and electronic Johnson–Nyquist noise, therefore a mixture of Poisson and Gaussian noise. In this paper, we show convolutional neural networks (CNNs) trained on mixed Poisson and Gaussian noise images to overcome the limitations of existing image denoising methods. The trained CNN is presented as an open-source ImageJ plugin that performs real-time image denoising (within tens of milliseconds) with superior performance (SNR improvement) compared to conventional fluorescence microscopy denoising methods. The method is validated on external datasets with out-of-distribution noise, contrast, structure, and imaging modalities from the training data and consistently achieves high-performance ( > <#comment/> 8 d B ) denoising in less time than other fluorescence microscopy denoising methods.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Extracting the Subhalo Mass Function from Strong Lens Images with Image Segmentation

Abstract Detecting substructure within strongly lensed images is a promising route to shed light on the nature of dark matter. However, it is a challenging task, which traditionally requires detailed lens modeling and source reconstruction, taking weeks to analyze each system. We use machine learning to circumvent the need for lens and source modeling and develop a neural network to both locate subhalos in an image as well as determine their mass using the technique of image segmentation. The network is trained on images with a single subhalo located near the Einstein ring across a wide range of apparent source magnitudes. The network is then able to resolve subhalos with masses m ≳ 10 8.5 M ⊙ . Training in this way allows the network to learn the gravitational lensing of light, and, remarkably, it is then able to detect entire populations of substructure, even for locations further away from the Einstein ring than those used in training. Over a wide range of the apparent source magnitude, the false-positive rate is around three false subhalos per 100 images, coming mostly from the lightest detectable subhalo for that signal-to-noise ratio. With good accuracy and a low false-positive rate, counting the number of pixels assigned to each subhalo class over multiple images allows for a measurement of the subhalo mass function (SMF). When measured over three mass bins from 10 9 –10 10 M ⊙ the SMF slope is recovered with an error of 36% for 50 images, and this improves to 10% for 1000 images with Hubble Space Telescope-like noise.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2019

On the possibility of a significant improvement in the quality of a quantum ghost image by registering an additional image in the object channel

A modification of the classical scheme of the quantum ghost image formation is considered, in which an image of the object under study is formed and recorded in the object channel. This image is used together with the ghost image to construct an estimate of the transparency distribution of the object. It is shown that this technique reduces the image quality worsening associated with the non-unit quantum efficiency of the sensors, even when the quantum image obtained in the object channel is additionally distorted by noise due to photons that did not interact with the object. (image processing)

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗