Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image acquisition”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Fast image acquisition system and method using pulsed light illumination and sample scanning to capture optical micrographs with sub-micron features

An optical inspection system for detecting sub-micron features on a sample component. The system may have a controller, a camera responsive to the controller for capturing images, an objective lens able to capture submicron scale features on the sample component, and a pulsed light source. The pulsed light source may be used to generate light pulses. The camera may be controlled to acquire images, using the objective lens, only while the pulsed light source is providing light pulses illuminating a portion of the sample component. Relative movement between the sample component and the objective lens is provided to enable at least one of a desired subportion or an entirety of the sample component to be scanned with the camera.

Yoo, Jae Hyuck↗
DOE OSTI2021

A Framework for Patient-Centered Pathways of Care for Radiopharmaceutical Therapy: An ASTRO Consensus Document

Radiopharmaceutical therapy (RPT) is an area of projected growth and importance with several agents in clinical use, new agents in late-phase clinical trials, and many others under testing and development. This article proposes a framework for developing pathways of care that can be broadly applied to all RPTs, representing the current status of RPT. It suggests foundational elements for many pathways of care for patients with cancer and concludes with areas in active development and the future horizon for RPT treatment centers. Developing a framework for patient-centered pathways of care is a critical step in establishing RPT as standard therapy for patients with a diverse spectrum of cancers. This expected increase in RPT treatment options will affect a much larger population of patients with complex cancer. It will also require enhanced coordination and collaboration among appropriately qualified personnel with diverse expertise in image acquisition, image interpretation, quantitative imaging, dosimetry calculation, radiation quality assurance and safety as well as oncology care and RPT-induced sequelae and response assessment. The essential role of this evolving RPT care team within multidisciplinary oncology care is a cornerstone of this framework for a patient-centered pathway of care for RPT. Given the status of current RPT practice and the horizon for future applications, this patient-centered pathway of care guidance is timely and should help inform future clinical RPT practice paradigms. A task force was recruited from the Theranostic Working Group of the American Society for Radiation Oncology (ASTRO) in May 2019 with equal representation from the nuclear medicine community. The task force expanded on a framework that was originally conceived by the Working Group for patient-centered care. This framework was developed to incorporate the strengths of both radiation oncologists and nuclear medicine physicians. The manuscript was then developed by the task force and posted on the ASTRO website for a 6-week public comment period ending in July 2020. Comments were adjudicated, and the draft was sent to external organizations for potential endorsement. This document was sent to the ASTRO Board of Directors in October 2020 for approval.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2022

Deep learning-based noise filtering toward millisecond order imaging by using scanning transmission electron microscopy

Application of scanning transmission electron microscopy (STEM) to in situ observation will be essential in the current and emerging data-driven materials science by taking STEM’s high affinity with various analytical options into account. As is well known, STEM’s image acquisition time needs to be further shortened to capture a targeted phenomenon in real-time as STEM’s current temporal resolution is far below the conventional TEM’s. However, rapid image acquisition in the millisecond per frame or faster generally causes image distortion, poor electron signals, and unidirectional blurring, which are obstacles for realizing video-rate STEM observation. Here we show an image correction framework integrating deep learning (DL)-based denoising and image distortion correction schemes optimized for STEM rapid image acquisition. By comparing a series of distortion corrected rapid scan images with corresponding regular scan speed images, the trained DL network is shown to remove not only the statistical noise but also the unidirectional blurring. This result demonstrates that rapid as well as high-quality image acquisition by STEM without hardware modification can be established by the DL. The DL-based noise filter could be applied to in-situ observation, such as dislocation activities under external stimuli, with high spatio-temporal resolution.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

An automated fast neutron computed tomography instrument with on-line focusing for non-destructive evaluation

A fast neutron tomography imaging instrument has been designed, built, and tested at The Ohio State University 500 kW Research Reactor on a fast neutron beamline with a peak neutron flux ≈5.4 × 107 n·cm−2·s−1 at 1.6 MeV median neutron energy. The instrument and beamline are also configurable for thermal neutron imaging. The imaging apparatus is composed of a lens coupled, water-cooled Electron Multiplying Charge Coupled Device camera, a front-surface mirror, and a high light yield plastic Polyvinyl toluene scintillator. The instrument sits on a mobile cart. A total of 5 motion-control stages are built into the system for XYZ and rotational degrees of freedom for sample positioning; the fifth stage fine tunes the focal distance between the camera and the scintillator to achieve on-line focusing. A Python code with a user-friendly graphical user interface controls the fully automated image acquisition, not requiring user interaction, yet facilitating tracking of the image acquisition. A complete fast neutron computed tomography dataset with 360 projections requires less than 3 h, with 30 s per projection. On-line focusing is accomplished with a commercial, off-the-shelf, dielectrically actuated liquid lens. Finally, tomographic reconstructions are visualized using the Livermore Tomography Tools software package. The effective pixel size (width and height) is ≈0.1058 mm, yielding a minimum voxel size of 0.1058 × 0.1058 × 0.1058 mm3, and produces a spatial resolution of 231 μm when calculated from knife-edge measurements.

Bisbee, M. G. (ORCID:0000000313466697)↗
DOE OSTI2024

Atomic resolution scanning transmission electron microscopy at liquid helium temperatures for quantum materials

Fundamental quantum phenomena in condensed matter, ranging from correlated electron systems to quantum information processors, manifest their emergent characteristics and behaviors predominantly at low temperatures. This necessitates the use of liquid helium (LHe) cooling for experimental observation. Atomic resolution scanning transmission electron microscopy combined with LHe cooling (cryo-STEM) provides a powerful characterization technique to probe local atomic structural modulations and their coupling with charge, spin and orbital degrees-of-freedom in quantum materials. However, achieving atomic resolution in cryo-STEM is exceptionally challenging, primarily due to sample drifts arising from temperature changes and noises associated with LHe bubbling, turbulent gas flow, etc. In this work, we demonstrate atomic resolution cryo-STEM imaging at LHe temperatures using a commercial side-entry LHe cooling holder. Firstly, we examine STEM imaging performance as a function of He gas flow rate, identifying two primary noise sources: He-gas pulsing and He-gas bubbling. Secondly, we propose two strategies to achieve low noise conditions for atomic resolution STEM imaging: either by temporarily suppressing He gas flow rate using the needle valve or by acquiring images during the natural warming process. Lastly, we show the applications of image acquisition methods and image processing techniques in investigating structural phase transitions in Cr 2 Ge 2 Te 6 , CuIr 2 S 4 , and CrCl 3 . In conclusion, our findings represent an advance in the field of atomic resolution electron microscopy imaging for quantum materials and devices at LHe temperatures, which can be applied to other commercial side-entry LHe cooling TEM holders.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Advancing Cross-Sectional Scanning Electron Microscopy of Perovskite Solar Cells

Organic–inorganic perovskites are an emerging class of photovoltaic materials. Despite achieving power conversion efficiencies surpassing 26%, the challenge of perovskite stability including degradation during exposure to operational conditions such as light, heat, humidity, water, oxygen, and electric fields is well known. Related, perovskite instability has limited high-resolution electron imaging and characterization techniques that can be used for understanding degradation mechanisms. Furthermore, we demonstrate perovskite device cross-section preparation using mechanical polishing in a water-free environment with cryogenic Ar ion milling. Scanning electron microscopy was then used in both backscattered electron and secondary electron imaging modes to obtain information about layer structure, grain aggregate structure, and compositional heterogeneity. Monte Carlo CASINO simulations inform optimum beam conditions and image acquisition parameters and the effects of accelerating voltage, dwell times, and frame averaging for practical image acquisition are reported.

14 SOLAR ENERGY↗
DOE OSTI2022

Automated defect identification in electroluminescence images of solar modules

Solar photovoltaic (PV) modules are susceptible to manufacturing defects, mishandling problems or extreme weather events that can limit energy production or cause early device failure. Trained professionals use electroluminescence (EL) images to identify defects in modules, however, field surveys or inline image acquisition can generate millions of EL images, which are infeasible to analyze by rote inspection. Here, we develop a rapid automatic computer vision pipeline (~0.5 seconds/module) to analyze EL images and identify defects including cracks, intra-cell defects, oxygen-induced defects, and solder disconnections. Defect identification is achieved with a machine learning model (Random Forest, ResNet models and YOLO) trained on 762 manually-labeled EL images of PV modules. We compare model performance on an imbalanced real-world validation set containing 134 EL images and determine that ResNet18 and YOLO are the optimal models; we next evaluated these models on a dedicated testing set (129 module images) with resulting macro F1 scores of 0.83 (ResNet18) and 0.78 (YOLO). Using a field EL survey of a PV power plant damaged in a vegetation fire, we analyze 18,954 EL images (2.4 million cells) and inspect the spatial distribution of defects on the solar modules. The results find increased frequency of ‘crack’, ‘solder’ and ‘intra-cell’ defects on the edges of the solar module closest to the ground after fire. We also find an abnormal increase of striation rings on cells which were assumed to be caused mainly in fabrication process. Our methods are published as open-source software. It can also be used to identify other kinds of defects or process different types of solar cells with minor modification on models by transfer learning.

14 SOLAR ENERGY↗
DOE OSTI2023

Coarse-to-fine Task-driven Inpainting for Geoscience Images

The processing and recognition of geoscience images have wide applications. Most of existing researches focus on understanding the high-quality geoscience images by assuming that all the images are clear. However, in many real-world cases, the geoscience images might contain occlusions during the image acquisition. This problem actually implies the image inpainting problem in computer vision and multimedia. As far as we know, all the existing image inpainting algorithms learn to repair the occluded regions for a better visualization quality, they are excellent for natural images but not good enough for geoscience images, and they never consider the following geoscience task when developing inpainting methods. Here, this paper aims to repair the occluded regions for a better geoscience task performance and advanced visualization quality simultaneously, without changing the current deployed deep learning based geoscience models. Because of the complex context of geoscience images, we propose a coarse-to-fine encoder-decoder network with the help of designed coarse-to-fine adversarial context discriminators to reconstruct the occluded image regions. Due to the limited data of geoscience images, we propose a MaskMix based data augmentation method, which augments inpainting masks instead of augmenting original images, to exploit the limited geoscience image data. The experimental results on three public geoscience datasets for remote sensing scene recognition, cross-view geolocation and semantic segmentation tasks respectively show the effectiveness and accuracy of the proposed method. The code is available at: https://github.com/HMS97/Task-driven-Inpainting.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Machine Learning Algorithms for Automated NIF Capsule Mandrel Selection

Small shells, approximately 2 mm in diameter, made from Poly(α-methylstyrene) (PAMS) are used as mandrels in the production of glow discharge polymer capsules located at the center of inertial confinement fusion experiments. The visual inspection process of microscope images of these shell mandrels, including detection of micron-sized defects on the shell surface as well as the handling and sorting, is a very labor-intensive, repetitive, and highly subjective process that stands to benefit greatly from automation. As part of an effort to decrease the number of labor hours spent in capsule handling, inspection, and metrology, the development of robotic systems was presented in a paper by Carlson et al., “Automation in Target Fabrication” [Fusion Sci. Technol., Vol. 70, p. 274 (2016)]. The current work expands the automated image acquisition systems developed previously and adds the use of convolutional neural networks to select capsules best suited for use in the downstream production process. Through the use of these machine learning algorithms, the selection process becomes robust, repeatable, and operator independent. Finally, as an added benefit the system developed as part of this work is able to provide defect statistics on entire shell batches and feed this information upstream to the production team.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Mapping O 2 concentration in ex-vivo tissue samples on a fast PLIM macro-imager

O 2 PLIM microscopy was employed in various studies, however current platforms have limitations in sensitivity, image acquisition speed, accuracy and general usability. We describe a new PLIM imager based on the Timepix3 camera (Tpx3cam) and its application for imaging of O 2 concentration in various tissue samples stained with a nanoparticle based probe, NanO 2 -IR. Upon passive staining of mouse brain, lung or intestinal tissue surface with minute quantities of NanO 2 -IR or by microinjecting the probe into the lumen of small or large intestine fragments, robust phosphorescence intensity and lifetime signals were produced, which allow mapping of O 2 in the tissue within 20 s. Inhibition of tissue respiration or limitation of O 2 diffusion to tissue produced the anticipated increases or decreases in O 2 levels, respectively. The difference in O 2 concentration between the colonic lumen and air-exposed serosal surface was around 140 µM. Furthermore, subcutaneous injection of 5 µg of the probe in intact organs (a paw or tail of sacrificed mice) enabled efficient O 2 imaging at tissue depths of up to 0.5 mm. Overall, the PLIM imager holds promise for metabolic imaging studies with various ex vivo models of animal tissue, and also for use in live animals.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Integrative Quantitative-Phase and Airy Light-Sheet Imaging

Light-sheet microscopy enables considerable speed and phototoxicity gains, while quantitative-phase imaging confers label-free organelle recognition and metabolic information that are inaccessible by conventional methods. We report the fusion of these two modalities onto a standard inverted microscope that retains compatibility with microfluidics. We describe the utilization of an accelerating Airy-beam light-sheet yielding identical imaging areas with interferometry, and an application in unmasking the effects of cellular noise on metabolic compartmentalization.

Biological sciences, Biological techniques, Micros↗
DOE OSTI2025

Ultra-high Information-content Chemical Imaging with Broadband Coherent Anti-Stokes Raman and Two-photon Fluorescence Lifetime Microscopy

Raman fingerprint spectroscopy and fluorescence lifetime imaging are emerging tools for studying metabolic profiles of biological specimens. While Raman fingerprint spectroscopy detects intrinsic molecular vibrations that reflect the molecular composition and chemical environment of a sample, fluorescence lifetime imaging measures changes in the excited-state lifetime of fluorophores that are sensitive to their microenvironments. Here, we present a multimodal imaging platform combining broadband coherent anti-Stokes Raman scattering (BCARS) and two-photon fluorescence lifetime imaging (2p-FLIM) microscopy that can acquire biologically relevant Raman fingerprint spectra and fluorescence lifetime signals in vivo and simultaneously. The tremendous chemical information obtained from spatially co-registered BCARS and 2p-FLIM images allows us to characterize the subtle differences between sub-cellular compartments and verify the potential false-positive results generated by fluorescence imaging alone. This is demonstrated by directly comparing the BCARS, 2p-FLIM, and two-photon excitation fluorescence(TPEF) signals simultaneously obtained from the same dye-stained organelle in the live, intact C. elegans expressing a green fluorescent protein (GFP) marker. In this work, we introduce the BCARS/2p-FLIM/TPEF setup scheme, the image acquisition steps, data processing, and representative results showing that the cross-modality imaging method enables rigorous characterization and in vivo detection at sub-cellular resolution. Furthermore, this protocol provides a framework for simultaneous chemical and fluorescence lifetime imaging to improve the accuracy of biological interpretation in complex living systems.

Xu, Haoyu [Georgia Institute of Technology, Atlant↗
DOE OSTI2024

Optical Flow Diagnostics of Counter Fluidization of Gravity-Driven Moving Packed Bed for a CSP Receiver Section Featuring Staggered Array of Cylindrical Pins

Particle fluidized beds have the potential to improve the efficiency of heat transfer in concentrated solar receiver furnace for use in next generation concentrated solar power (CSP) plants. This study presents an experimental investigation on the flow characterization of vertically downward moving packed bed with counter fluidization through an array of jets. To control the bubble size and its distribution in the bubbling fluidized bed, an array of cylindrical pin fins was arranged uniformly across the test article. The flow visualization was performed on the surface of transparent glass coated with electrically conductive materials for electrostatic dissipation purposes. The image acquisition was carried out via high-speed camera at a frequency of ~ 1kHz. The acquired images were analyzed in pairs with the help of a modern optical flow algorithm capable of calculating the movement of dense particle flow in the fluidized bed by tracking the light intensity of each predefined window of the frames. A comparison of fluidized beds with plane and pin-finned channels revealed distinct bubble behavior. Pin-finned channels were found to produce a larger number of small-sized bubbles, while plane channels generated fewer but larger bubbles at any given instant. The presence of pin fins was observed to reduce bubble size by preventing bubble merging and splitting larger bubbles when they encountered a pin.

concentrating solar power↗
DOE OSTI2026

Improving 3D reconstruction quality for root phenotyping: assessing the impact of camera calibration and imaging parameters

Arate 3D reconstruction is essential for high-throughput plant phenotyping, particularly for studying complex structures such as root systems. While photogrammetry and Structure from Motion (SfM) techniques have become widely used for 3D root imaging, the camera settings used are often underreported in studies, and the impact of camera calibration on model accuracyccu remains largely underexplored in plant science. In this study, we systematically evaluate the effects of focus, aperture, exposure time, and gain settings on the quality of 3D root models made with a multi-camera scanning system. We show through a series of experiments that calibration significantly improves model quality, with focus misalignment and shallow depth of field (DoF) being the most important factors affecting reconstruction accuracy. Our results further show that proper calibration has a greater effect on reducing noise than filtering it during post-processing, emphasizing the importance of optimizing image acquisition rather than relying solely on computational corrections. This work improves the repeatability and accuracy of 3D root imaging for phenotyping pipelines by giving useful calibration guidelines. This leads to better trait quantification for use in crop research and plant breeding in downstream analysis.

3D reconstruction↗
DOE OSTI2022

Real-time image denoising of mixed Poisson–Gaussian noise in fluorescence microscopy images using ImageJ

Fluorescence microscopy imaging speed is fundamentally limited by the measurement signal-to-noise ratio (SNR). To improve image SNR for a given image acquisition rate, computational denoising techniques can be used to suppress noise. However, common techniques to estimate a denoised image from a single frame either are computationally expensive or rely on simple noise statistical models. These models assume Poisson or Gaussian noise statistics, which are not appropriate for many fluorescence microscopy applications that contain quantum shot noise and electronic Johnson–Nyquist noise, therefore a mixture of Poisson and Gaussian noise. In this paper, we show convolutional neural networks (CNNs) trained on mixed Poisson and Gaussian noise images to overcome the limitations of existing image denoising methods. The trained CNN is presented as an open-source ImageJ plugin that performs real-time image denoising (within tens of milliseconds) with superior performance (SNR improvement) compared to conventional fluorescence microscopy denoising methods. The method is validated on external datasets with out-of-distribution noise, contrast, structure, and imaging modalities from the training data and consistently achieves high-performance ( > <#comment/> 8 d B ) denoising in less time than other fluorescence microscopy denoising methods.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Differential programming enabled functional imaging with Lorentz transmission electron microscopy

Abstract Lorentz transmission electron microscopy is an advanced characterization technique that enables the simultaneous imaging of both the microstructure and functional properties of materials. Information such as magnetization and electric potentials is carried by the phase of the electron wave, and is lost during image acquisition. Various methods have been proposed to retrieve the phase of the electron wavefunction using intensities of the acquired images, most of which work only in the small defocus limit. Imaging at strong defoci not only carries more quantitative phase information, but is essential to the study of weak magnetic and electrostatic fields at the nanoscale. In this work we develop a method based on differentiable programming to solve the inverse problem of phase retrieval. We show that our method maintains a high spatial resolution and robustness against noise even at the upper defocus limit of the microscope. More importantly, our proposed method can go beyond recovering just the phase information. We demonstrate this by retrieving the electron-optical parameters of the contrast transfer function alongside the electron exit wavefunction.

97 MATHEMATICS AND COMPUTING↗