Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “images”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Development of high throughput light-sheet fluorescence lifetime imaging microscopy for 3D functional imaging of metabolic pathways in plant and microorganisms (Final Technical Report)

This research program will enable new biochemical contrast in the nanosecond lifetime domain through use of the recently demonstrated electro-optic fluorescence lifetime imaging technique (EO-FLIM) for wide-field lifetime imaging. The Stanford/Stanford Linear Accelerator Center multidisciplinary collaboration -- physics, applied physics, and structural biology -- will develop a light-sheet fluorescence lifetime imaging microscope for functional studies of microbial and plant metabolic pathways and dynamic interactions between plants and microorganisms in the rhizosphere. The proposed approach overcomes the imaging time bottleneck associated with existing fluorescence lifetime imaging methods. Initial demonstrations have shown a factor of 100,000 improvement in photon throughput compared to existing methods. High photon efficiency allowed the first wide-field fluorescence lifetime imaging of single molecules. Recent work has improved the technique’s repetition rate to enable compatibility with mode-locked lasers and demonstrated the combination of wide-field fluorescence lifetime imaging with super-resolution localization microscopy, observations of single molecule dynamics, and observation of donor lifetime quenching in single-molecule imaging. These results were achieved on standard camera sensors and would not have been possible with other wide-field approaches. The throughput and photon economy of the EO-FLIM method enables new BER-relevant imaging opportunities. In particular, scanned single- and two-photon light-sheet excitation will be used to achieve volumetric imaging with time-domain contrast.

47 OTHER INSTRUMENTATION↗

Integrative Quantitative-Phase and Airy Light-Sheet Imaging

Light-sheet microscopy enables considerable speed and phototoxicity gains, while quantitative-phase imaging confers label-free organelle recognition and metabolic information that are inaccessible by conventional methods. We report the fusion of these two modalities onto a standard inverted microscope that retains compatibility with microfluidics. We describe the utilization of an accelerating Airy-beam light-sheet yielding identical imaging areas with interferometry, and an application in unmasking the effects of cellular noise on metabolic compartmentalization.

Biological sciences, Biological techniques, Micros↗

Simulating image coaddition with the Nancy Grace Roman Space Telescope – II. Analysis of the simulated images and implications for weak lensing

One challenge for applying current weak lensing analysis tools to the Nancy Grace Roman Space Telescope is that individual images will be undersampled. Our companion paper presented an initial application of Imcom – an algorithm that builds an optimal mapping from input to output pixels to reconstruct a fully sampled combined image – on the Roman image simulations. In this paper, we measure the output noise power spectra, identify the sources of the major features in the power spectra, and show that simple analytic models that ignore sampling effects underestimate the power spectra of the coadded noise images. We compute the moments of both idealized injected stars and fully simulated stars in the coadded images, and their one- and two-point statistics. We show that the idealized injected stars have root-mean-square ellipticity errors (1–6) × 10 -4 per component depending on the band; the correlation functions are ≥2 orders of magnitude below requirements, indicating that the image combination step itself is using a small fraction of the overall Roman second moment error budget, although the fourth moments are larger and warrant further investigation. The stars in the simulated sky images, which include blending and chromaticity effects, have correlation functions near the requirement level (and below the requirement level in a wide-band image constructed by stacking all four filters). We evaluate the noise-induced biases in the ellipticities of injected stars, and explain the resulting trends with an analytical model. We conclude by enumerating the next steps in developing an image coaddition pipeline for Roman.

79 ASTRONOMY AND ASTROPHYSICS↗

Source shape estimation for neutron imaging systems using convolutional neural networks

Neutron imaging systems are important diagnostic tools for characterizing the physics of inertial confinement fusion reactions at the National Ignition Facility (NIF). In particular, neutron images give diagnostic information on the size, symmetry, and shape of the fusion hot spot and surrounding cold fuel. Images are formed via collection of neutron flux from the source using a system of aperture arrays and scintillator-based detectors. Currently, reconstruction of fusion source geometry from the collected neutron images is accomplished by solving a computationally intensive maximum likelihood estimation problem via expectation maximization. In contrast, it is often useful to have simple representations of the overall source geometry that can be computed quickly. In this work, we develop convolutional neural networks (CNNs) to reconstruct the outer contours of simple source geometries. We compare the performance of the CNN for penumbral and pinhole data and provide experimental demonstrations of our methods on both non-noisy and noisy data.

Machine learning, neutron imaging, source reconstr↗

Design and demonstration of a low‐field magnetic resonance imaging rhizotron for in‐field imaging of energy sorghum roots

Abstract Root phenotyping provides critical information to plant breeders for developing varieties with improved drought tolerance, greater root biomass, and greater nutrient use efficiency. Phenotyping roots in the natural environment is important for understanding the effect of the soil environment on root genotypic expressions. The goal of this work was to design and test a field‐scale mobile low‐field magnetic resonance imaging (LF‐MRI) Rhizotron that produces actionable root phenotyping data. We demonstrated this novel technology for root visualization and quantification using a LF‐MRI Rhizotron operating at 47 mT with two soil types. The LF‐MRI Rhizotron weights 453 kg, with a height of 90 cm, a diameter of 28 cm and an imaging field of view of 28 cm × 28 cm. The unit was operated in a Belk clay (Entic Hapluderts) and Weswood silt loam (Udifluventic Halustepts) generating 2‐D and 3‐D image data sets. The 2‐D image data had a collection time of 16.5 min per image at an image resolution of 2.2 mm per pixel. The 3‐D data had a collection time of 13 h per image with a 2.2 × 2.2 × 2.2 mm voxel resolution. Low‐field magnetic resonance imaging worked well for visualizing roots in moderate to high clay soils, demonstrating the potential for this technology; however, the broad application of this platform is hampered due to the prohibitively long scanning time to obtain 3‐D images. By increasing the field strength, and therefore the signal‐to‐noise ratio, faster scan times can enable a more useful system for root phenotyping.

Bagnall, G. Cody↗

An image classification deep-learning algorithm for shrapnel detection from ultrasound images

Ultrasound imaging is essential for non-invasively diagnosing injuries where advanced diagnostics may not be possible. However, image interpretation remains a challenge as proper expertise may not be available. In response, artificial intelligence algorithms are being investigated to automate image analysis and diagnosis. Here, we highlight an image classification convolutional neural network for detecting shrapnel in ultrasound images. As an initial application, different shrapnel types and sizes were embedded first in a tissue mimicking phantom and then in swine thigh tissue. The algorithm architecture was optimized stepwise by minimizing validation loss and maximizing F1 score. The final algorithm design trained on tissue phantom image sets had an F1 score of 0.95 and an area under the ROC curve of 0.95. It maintained higher than a 90% accuracy for each of 8 shrapnel types. When trained only on swine image sets, the optimized algorithm format had even higher metrics: F1 and area under the ROC curve of 0.99. Overall, the algorithm developed resulted in strong classification accuracy for both the tissue phantom and animal tissue. This framework can be applied to other trauma relevant imaging applications such as internal bleeding to further simplify trauma medicine when resources and image interpretation are scarce.

59 BASIC BIOLOGICAL SCIENCES↗

SNIa Cosmology Analysis Results from Simulated LSST Images: From Difference Imaging to Constraints on Dark Energy

Abstract The Vera Rubin Observatory Legacy Survey of Space and Time (LSST) is expected to process ∼10 6 transient detections per night. For precision measurements of cosmological parameters and rates, it is critical to understand the detection efficiency, magnitude limits, artifact contamination levels, and biases in the selection and photometry. Here we rigorously test the LSST Difference Image Analysis (DIA) pipeline using simulated images from the Rubin Observatory LSST Dark Energy Science Collaboration Data Challenge (DC2) simulation for the Wide-Fast-Deep survey area. DC2 is the first large-scale (300 deg 2 ) image simulation of a transient survey that includes realistic cadence, variable observing conditions, and CCD image artifacts. We analyze ∼15 deg 2 of DC2 over a 5 yr time span in which artificial point sources from Type Ia supernova (SNIa) light curves have been overlaid onto the images. The magnitude limits per filter are u = 23.66 mag, g = 24.69 mag, r = 24.06 mag, i = 23.45 mag, z = 22.54 mag, and y = 21.62 mag. The artifact contamination levels are ∼90% of all detections, corresponding to ∼1000 artifacts deg –2 in g band, and falling to 300 deg –2 in y band. The photometry has biases <1% for magnitudes 19.5 < m < 23. Our DIA performance on simulated images is similar to that of the Dark Energy Survey difference-imaging pipeline on real images. We also characterize DC2 image properties to produce catalog-level simulations needed for distance bias corrections. We find good agreement between DC2 data and simulations for distributions of signal-to-noise ratio, redshift, and fitted light-curve properties. Applying a realistic SNIa cosmology analysis for redshifts z < 1, we recover the input cosmology parameters to within statistical uncertainties.

79 ASTRONOMY AND ASTROPHYSICS↗

Manifold projection image segmentation for nano-XANES imaging

As spectral imaging techniques are becoming more prominent in science, advanced image segmentation algorithms are required to identify appropriate domains in these images. We present a version of image segmentation called manifold projection image segmentation (MPIS) that is generally applicable to a broad range of systems without the need for training because MPIS uses unsupervised machine learning with a few physically motivated hyperparameters. We apply MPIS to nanoscale x-ray absorption near edge structure (XANES) imaging, where XANES spectra are collected with nanometer spatial resolution. We show the superiority of manifold projection over linear transformations, such as the commonly used principal component analysis (PCA). Moreover, MPIS maintains accuracy while reducing computation time and sensitivity to noise compared to the standard nano-XANES imaging analysis procedure. Finally, we demonstrate how multimodal information, such as x-ray fluorescence data and spatial location of pixels, can be incorporated into the MPIS framework. We propose that MPIS is adaptable for any spectral imaging technique, including scanning transmission x-ray microscopy, where the length scale of domains is larger than the resolution of the experiment.

36 MATERIALS SCIENCE↗

Considerations for three-dimensional image reconstruction from experimental data in coherent diffractive imaging

The Datasets folder contains 3 datasets, corresponding to the datasets mentioned in the article with 670, 2691 and 586 images. The Runs folder has all the runs used. Besides the images itself it also contains tags for each image under `/entry_1/image_1/detector_and_photon_corrected/tags`. The `headings` attribute gives the name of each tag. The `Jonas Strict` tag corresponds to the 670 images, the `Redflamingo` tag to the 2691 images and the `Redflamingo_Ida_subset` tag to the 586 images. The final dataset with 260 images can be obtained from `Datasets/amoc6914-Redflamingo-manual-586.h5` and use the `/model/diameterNM` group to select the 260 images with size closest to 214 nm.

AMO↗

Plasmonic nanorod probes’ journey inside plant cells for in vivo SERS sensing and multimodal imaging

Nanoparticle-based platforms are gaining strong interest in plant biology and bioenergy research to monitor and control biological processes in whole plants. However, in vivo monitoring of biomolecules using nanoparticles inside plant cells remains challenging due to the impenetrability of the plant cell wall to nanoparticles beyond the exclusion limits (5-20 nm). To overcome this physical barrier, we have designed unique bimetallic silver-coated gold nanorods (AuNR@Ag) capable of entering plant cells, while conserving key plasmonic properties in the near-infrared (NIR). To demonstrate cellular internalization and tracking of the nanorods inside plant tissue, we used a comprehensive multimodal imaging approach that included transmission electron microscopy (TEM), confocal fluorescence microscopy, two-photon luminescence (TPL), X-ray fluorescence microscopy (XRF), and photoacoustics imaging (PAI). We successfully acquired SERS signals of nanorods in vivo inside plant cells of tobacco leaves. On the same leaf samples, we applied orthogonal imaging methods, TPL and PAI techniques for in vivo imaging of the nanorods. This study first demonstrates the intracellular internalization of AuNR@Ag inside whole plant systems for in vivo SERS analysis in tobacco cells. This work demonstrates the potential of this nanoplatform as a new nanotool for intracellular in vivo biosensing for plant biology.

Cupil-Garcia, Vanessa↗

Deep-Learning Electron Diffractive Imaging

Here, we report the development of deep-learning coherent electron diffractive imaging at subangstrom resolution using convolutional neural networks (CNNs) trained with only simulated data. We experimentally demonstrate this method by applying the trained CNNs to recover the phase images from electron diffraction patterns of twisted hexagonal boron nitride, monolayer graphene, and a gold nanoparticle with comparable quality to those reconstructed by a conventional ptychographic algorithm. Fourier ring correlation between the CNN and ptychographic images indicates the achievement of a resolution in the range of 0.70 and 0.55 Å. We further develop CNNs to recover the probe function from the experimental data. The ability to replace iterative algorithms with CNNs and perform real-time atomic imaging from coherent diffraction patterns is expected to find applications in the physical and biological sciences.

47 OTHER INSTRUMENTATION↗

Survey of Image Denoising Methods for Medical Image Classification

Medical imaging devices, such as X-ray machines, inherently produce images that suffer from visual noise. Our objectives were to (i.) determine the effect of image denoising on a medical image classification task, and (ii.) determine if there exists a correlation between image denoising performance and medical image classification performance. We performed the medical image classification task on chest X-rays using the DenseNet-121 convolutional neural network (CNN) and used the peak signal-to-noise ratio (PSNR) and structural similarity (SSIM) metrics as the image denoising performance measures. We first found that different denoising methods can make a statistically significant difference in classification performance for select labels. We also found that denoising methods affect fine-tuned models more than randomly-initialized models and that fine-tuned models have significantly higher and more uniform performance than randomly-initialized models. Lastly, we found that there is no significant correlation between PSNR and SSIM values and classification performance for our task.

Michael, Peter↗

To image, or not to image: class-specific diffractive cameras with all-optical erasure of undesired objects

Abstract Privacy protection is a growing concern in the digital era, with machine vision techniques widely used throughout public and private settings. Existing methods address this growing problem by, e.g., encrypting camera images or obscuring/blurring the imaged information through digital algorithms. Here, we demonstrate a camera design that performs class-specific imaging of target objects with instantaneous all-optical erasure of other classes of objects. This diffractive camera consists of transmissive surfaces structured using deep learning to perform selective imaging of target classes of objects positioned at its input field-of-view. After their fabrication, the thin diffractive layers collectively perform optical mode filtering to accurately form images of the objects that belong to a target data class or group of classes, while instantaneously erasing objects of the other data classes at the output field-of-view. Using the same framework, we also demonstrate the design of class-specific permutation and class-specific linear transformation cameras, where the objects of a target data class are pixel-wise permuted or linearly transformed following an arbitrarily selected transformation matrix for all-optical class-specific encryption, while the other classes of objects are irreversibly erased from the output image. The success of class-specific diffractive cameras was experimentally demonstrated using terahertz (THz) waves and 3D-printed diffractive layers that selectively imaged only one class of the MNIST handwritten digit dataset, all-optically erasing the other handwritten digits. This diffractive camera design can be scaled to different parts of the electromagnetic spectrum, including, e.g., the visible and infrared wavelengths, to provide transformative opportunities for privacy-preserving digital cameras and task-specific data-efficient imaging.

47 OTHER INSTRUMENTATION↗

Real-time image denoising of mixed Poisson–Gaussian noise in fluorescence microscopy images using ImageJ

Fluorescence microscopy imaging speed is fundamentally limited by the measurement signal-to-noise ratio (SNR). To improve image SNR for a given image acquisition rate, computational denoising techniques can be used to suppress noise. However, common techniques to estimate a denoised image from a single frame either are computationally expensive or rely on simple noise statistical models. These models assume Poisson or Gaussian noise statistics, which are not appropriate for many fluorescence microscopy applications that contain quantum shot noise and electronic Johnson–Nyquist noise, therefore a mixture of Poisson and Gaussian noise. In this paper, we show convolutional neural networks (CNNs) trained on mixed Poisson and Gaussian noise images to overcome the limitations of existing image denoising methods. The trained CNN is presented as an open-source ImageJ plugin that performs real-time image denoising (within tens of milliseconds) with superior performance (SNR improvement) compared to conventional fluorescence microscopy denoising methods. The method is validated on external datasets with out-of-distribution noise, contrast, structure, and imaging modalities from the training data and consistently achieves high-performance ( > <#comment/> 8 d B ) denoising in less time than other fluorescence microscopy denoising methods.

47 OTHER INSTRUMENTATION↗

Extracting the Subhalo Mass Function from Strong Lens Images with Image Segmentation

Abstract Detecting substructure within strongly lensed images is a promising route to shed light on the nature of dark matter. However, it is a challenging task, which traditionally requires detailed lens modeling and source reconstruction, taking weeks to analyze each system. We use machine learning to circumvent the need for lens and source modeling and develop a neural network to both locate subhalos in an image as well as determine their mass using the technique of image segmentation. The network is trained on images with a single subhalo located near the Einstein ring across a wide range of apparent source magnitudes. The network is then able to resolve subhalos with masses m ≳ 10 8.5 M ⊙ . Training in this way allows the network to learn the gravitational lensing of light, and, remarkably, it is then able to detect entire populations of substructure, even for locations further away from the Einstein ring than those used in training. Over a wide range of the apparent source magnitude, the false-positive rate is around three false subhalos per 100 images, coming mostly from the lightest detectable subhalo for that signal-to-noise ratio. With good accuracy and a low false-positive rate, counting the number of pixels assigned to each subhalo class over multiple images allows for a measurement of the subhalo mass function (SMF). When measured over three mass bins from 10 9 –10 10 M ⊙ the SMF slope is recovered with an error of 36% for 50 images, and this improves to 10% for 1000 images with Hubble Space Telescope-like noise.

79 ASTRONOMY AND ASTROPHYSICS↗

Gamma-ray imaging of Np-237 metal using an organic glass imager

Neutron and gamma-ray imaging systems are deployed within the field of nuclear safeguards for the detection and localization of special nuclear materials and other materials of interest. 237 Np is one of these materials of interest due its presence in spent nuclear fuel and potential for use in nuclear weapons when purified. Here, for the first time, a 6 kg neptunium sphere (98.8 wt% 237 Np) was measured using a dual-particle imager, from the University of Michigan, consisting of organic glass and inorganic scintillators. The novel composition of organic glass scintillator was recently developed at Sandia National Labs and has been used in particle imaging systems due to its time resolution and particle discrimination capabilities. Gamma-ray energy spectra from single and coincident events were extracted and the sequencing of Compton scatter and photoelectric absorption gamma-ray events was used to generate images using simple backprojection. The emissions of interest in this work are the 312 keV and 416 keV gamma rays from 233 Pa, a daughter isotope from the neptunium decay series. The results of this work show that there is close agreement between the true source location in angular space and the converged location from the gamma ray images created using the system. The gamma spectroscopy from single and coincident events also identified the characteristic emission from the daughter isotope and could be used to assist with the identification of 237 Np. Furthermore, successful localization of the source with 5 s of data demonstrates the practical application of the imaging system for imaging and detection of material in weapons-useable quantities.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Imaging from Macro to Nanoscale: Multimodal Advances in Chemical and Biomedical Imaging

Imaging increasingly serves as a multiscale framework for linking molecular mechanisms to cellular behavior, tissue architecture, and organ phenotypes in biology and unraveling fundamental processes in chemistry, physics and materials science. This Perspective highlights recent advances in chemical and biomedical imaging across macro-, micro-, and nanoscales, using representative examples published in Chemical and Biomedical Imaging (CBMI). At the macroscale, we discuss chemically selective MRI, including endogenous and exogenous CEST strategies, together with photoacoustic imaging as a hybrid modality with functional and chemical contrast. At the microscale, we consider fluorescence, label-free optical and vibrational imaging, and selected X-ray approaches that expand sensitivity, specificity, and temporal resolution in biological and materials systems. At the nanoscale, we highlight super-resolution fluorescence microscopy, single-molecule methods, tip-enhanced Raman spectroscopy, and correlative imaging strategies that resolve local heterogeneity and molecular organization. Across scales, a common theme emerges that advances in probes, contrast mechanisms, instrumentation, and sample handling are enabling chemically informed imaging that connects molecular specificity with biological context.

multiscale imaging↗