Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image acquisition”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Atomic‐Resolution Imaging of Halide Perovskites Using Electron Microscopy

Abstract Atomic‐resolution imaging of halide perovskites (HPs) using transmission electron microscopy (TEM) is challenging because of the sensitivity of their structures to the electron beam. In this article, recent achievements in this area are reviewed, covering both all‐inorganic and organic–inorganic hybrid HPs, with an emphasis on the specific imaging conditions that have proven to be effective in avoiding electron beam‐induced structural damage. The discussion focusses on the total electron dose that HPs can bear before being damaged and the effects of different imaging modes, accelerating voltages, and temperatures. The crucial role of a direct‐detection electron‐counting camera in reducing the required electron dose is outlined, which is indispensable for imaging extremely sensitive organic–inorganic hybrid perovskites. In addition to reviewing published works, the results of initial attempts to perform atomic‐resolution elemental mapping for an all‐inorganic HP and image a hybrid HP using scanning TEM are introduced. The preparation of a TEM specimen from macroscopic crystals or devices of HPs, which is very important for practical applications but has not yet received attention, is also discussed. This article aims to provide guidance on the acquisition of atomic‐resolution TEM images of HPs and inspire the development of more imaging technologies for sensitive materials.

Song, Kepeng↗
DOE OSTI2024

Super Resolving Unrolled Neural Networks for Remote Sensing

In remote sensing systems, the capabilities of the system are constrained by the complex interactions between size, weight, and power (SWAP) of potential designs. In electro-optical (EO) systems, examples of these critical parameters include the system’s sensitivity and resolution. Those parameters can be increased by ever larger optical apertures and focal planes but at the cost of more SWAP. Multi-image super resolution (MISR) techniques allow resolution to be enhanced via computation rather than more sophisticated optical hardware. These algorithms combine multiple images together into a single, higher resolution image, trading temporal resolution and computation for spatial resolution. Fielded MISR techniques, such as Drizzle, can require several hundred images to create a single super resolved image, implying reduced temporal resolution, increased data acquisition load, and limiting mission applications. Iterative techniques, such as model-based image reconstruction and compressive sensing, have been shown to create super resolved images using fewer images than Drizzle. They do this by posing an optimization problem that balances accuracy between a highly accurate physical model and an image model. In the case of super resolution, the physical model is defined by the relation between low resolution input images and the desired high resolution output image. The image model encodes some assumptions about the super resolved image. These assumptions are meant to suppress reconstruction artifacts that arise due to deterministic physical model error, stochastic measurement noise, and potential undersampling. In practice, the performance of iterative methods are limited by imaging models compatible with optimization. Deep learning-based methods can effectively learn image models of arbitrary complexity, but lack the theoretical explainability and robustness of iterative techniques. Consensus equilibrium (CE) generalizes the iterative techniques beyond optimization, enabling blackbox algorithms such as traditional and neural image denoisers to be used as the image model. CE-based approaches retain much of the explainability and robustness of iterative techniques while allowing the expressiveness of machine learning image models to be used. Additionally, by unrolling iterations of CE with an embedded image denoiser, the image denoiser can be further trained and specialized to the specific application with potentially higher quality reconstructions. Under this project, we demonstrated the feasibility of training an unrolled neural network based upon CE. While we didn’t train one, we showed that the CE process is differentiable and its gradient can be tractably computed. We also explored the usage of a variants of CE akin to generative neural works. Most importantly, we applied the CE framework to a number of problems including non-blind deconvolution, upsampling, single-image super resolution, MISR, event-based sensing, and saturated deconvolution. Our MISR prototype creates high quality reconstructions with an order of magnitude fewer images than previous approaches and, critically, produces these reconstructions fast enough for practical usage.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Advanced techniques in automated high-resolution scanning transmission electron microscopy

Scanning transmission electron microscopy is a common tool used to study the atomic structure of materials. It is an inherently multimodal tool allowing for the simultaneous acquisition of multiple information channels. Despite its versatility, however, experimental workflows currently rely heavily on experienced human operators and can only acquire data from small regions of a sample at a time. Here, we demonstrate a flexible pipeline-based system for high-throughput acquisition of atomic-resolution structural data using an all-piezo sample stage applied to large-scale imaging of nanoparticles and multimodal data acquisition. As a result, the system is available as part of the user program of the Molecular Foundry at Lawrence Berkeley National Laboratory.

4D-STEM↗
DOE OSTI2021

Upscaling X-ray nanoimaging to macroscopic specimens

Upscaling X-ray nanoimaging to macroscopic specimens has the potential for providing insights across multiple length scales, but its feasibility has long been an open question. By combining the imaging requirements and existing proof-of-principle examples in large-specimen preparation, data acquisition and reconstruction algorithms, the authors provide imaging time estimates for howX-ray nanoimaging can be scaled to macroscopic specimens. To arrive at this estimate, a phase contrast imaging model that includes plural scattering effects is used to calculate the required exposure and corresponding radiation dose. The coherent X-ray flux anticipated from upcoming diffraction-limited light sources is then considered. This imaging time estimation is in particular applied to the case of the connectomes of whole mouse brains. To image the connectome of the whole mouse brain, electron microscopy connectomics might require years, whereas optimized X-ray microscopy connectomics could reduce this to one week. Furthermore, this analysis points to challenges that need to be overcome (such as increased X-ray detector frame rate) and opportunities that advances in artificial-intelligence-based `smart' scanning might provide. While the technical advances required are daunting, it is shown that X-ray microscopy is indeed potentially applicable to nanoimaging of millimetre- or even centimetre-size specimens.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Hyperspectral and Nanosecond Temporal Resolution Widefield Infrared Photothermal Heterodyne Imaging

Label-free, bond-selective imaging offers new opportunities for fundamental and applied studies in chemistry, biology, and materials science. Preventing its broader application to investigating spectrally congested specimens are issues related to low sensitivity as well as low spatial and temporal resolution. Here, we demonstrate a widefield, mid-infrared (MIR) photothermal imaging technique, called widefield Infrared Photothermal Heterodyne imaging (wIR-PHI), that massively parallelizes acquisition of MIR absorption data through use of a high-speed complementary metal-oxide-semiconductor camera. wIR-PHI possesses notable features that include: spatial resolution significantly below the MIR diffraction limit, hyperspectral imaging capabilities, high sensitivity, and ~100 ns temporal resolution. Here, the first two features are highlighted by hyperspectral imaging of proximally close poly(methyl methacrylate) (PMMA) and polystyrene (PS) nanoparticles where clear, bond-specific imaging of nanoparticles, separated by less than the MIR diffraction limit, is demonstrated. Sensitivity is highlighted by imaging individual PMMA and PS nanoparticles with radii between r = 97-556 nm. This leads to a current, peak absorption cross-section limit-of-detection of σ abs = 1.9× 10 –16 cm 2 . wIR-PHI's 100 ns temporal resolution is simultaneously demonstrated by observing the decay of photothermal contrast on individual nanoparticles on a ~200-6000 ns timescale. In whole, wIR-PHI’s dramatic increase in acquisition speed opens opportunities for future MIR kinetic imaging and spectroscopic studies of important chemical, biological, and material processes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Particle-Tracking Proton Computed Tomography—Data Acquisition, Preprocessing, and Preconditioning

Proton CT (pCT) is a promising new imaging technique that can reconstruct relative stopping power (RSP) more accurately than x-ray CT in each cubic millimeter voxel of the patient. This, in turn, will result in better proton range accuracy and, therefore, smaller planned tumor volumes (PTV). The hardware description and some reconstructed images have previously been reported. In a series of two contributions, we focus on presenting the software algorithms that convert pCT detector data to the final reconstructed pCT images for application in proton treatment planning. There were several options on how to accomplish this, and we will describe our solutions at each stage of the data processing chain. In the first paper of this series, we present the data acquisition with the pCT tracking and energy-range detectors and how the data are preprocessed, including the conversion to the well-formatted track information from tracking data and water-equivalent path length from the data of a calibrated multi-stage energy-range detector. These preprocessed data are then used for the initial image formation with an FDK cone-beam CT algorithm. The output of data acquisition, preprocessing, and FDK reconstruction is presented along with illustrative imaging results for two phantoms, including a pediatric head phantom. The second paper in this series will demonstrate the use of iterative solvers in conjunction with the superiorization methodology to further improve the images resulting from the upfront FDK image reconstruction and the implementation of these algorithms on a hybrid CPU/GPU computer cluster.

42 ENGINEERING↗
DOE OSTI2023

Recurrent and convolutional neural networks for sequential multispectral optoacoustic tomography ( MSOT ) imaging

Abstract Multispectral optoacoustic tomography (MSOT) is a beneficial technique for diagnosing and analyzing biological samples since it provides meticulous details in anatomy and physiology. However, acquiring high through‐plane resolution volumetric MSOT is time‐consuming. Here, we propose a deep learning model based on hybrid recurrent and convolutional neural networks to generate sequential cross‐sectional images for an MSOT system. This system provides three modalities (MSOT, ultrasound, and optoacoustic imaging of a specific exogenous contrast agent) in a single scan. This study used ICG‐conjugated nanoworms particles (NWs‐ICG) as the contrast agent. Instead of acquiring seven images with a step size of 0.1 mm, we can receive two images with a step size of 0.6 mm as input for the proposed deep learning model. The deep learning model can generate five other images with a step size of 0.1 mm between these two input images meaning we can reduce acquisition time by approximately 71%.

Juhong, Aniwat↗
DOE OSTI2021

New Orthophoto Generation Strategies from UAV and Ground Remote Sensing Platforms for High-Throughput Phenotyping

Remote sensing platforms have become an effective data acquisition tool for digital agriculture. Imaging sensors onboard unmanned aerial vehicles (UAVs) and tractors are providing unprecedented high-geometric-resolution data for several crop phenotyping activities (e.g., canopy cover estimation, plant localization, and flowering date identification). Among potential products, orthophotos play an important role in agricultural management. Traditional orthophoto generation strategies suffer from several artifacts (e.g., double mapping, excessive pixilation, and seamline distortions). The above problems are more pronounced when dealing with mid- to late-season imagery, which is often used for establishing flowering date (e.g., tassel and panicle detection for maize and sorghum crops, respectively). In response to these challenges, this paper introduces new strategies for generating orthophotos that are conducive to the straightforward detection of tassels and panicles. The orthophoto generation strategies are valid for both frame and push-broom imaging systems. The target function of these strategies is striking a balance between the improved visual appearance of tassels/panicles and their geolocation accuracy. The new strategies are based on generating a smooth digital surface model (DSM) that maintains the geolocation quality along the plant rows while reducing double mapping and pixilation artifacts. Moreover, seamline control strategies are applied to avoid having seamline distortions at locations where the tassels and panicles are expected. The quality of generated orthophotos is evaluated through visual inspection as well as quantitative assessment of the degree of similarity between the generated orthophotos and original images. Several experimental results from both UAV and ground platforms show that the proposed strategies do improve the visual quality of derived orthophotos while maintaining the geolocation accuracy at tassel/panicle locations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Fast quantum ghost imaging with a single-photon-sensitive time-stamping camera

Quantum ghost imaging (QGI) leverages correlations between entangled photon pairs to reconstruct an image using light that has never physically interacted with an object. Despite extensive research interest, this technique has long been hindered by slow acquisition speeds, due to the use of raster-scanned detectors or the slow response of intensified cameras. Here, we utilize a single-photon-sensitive time-stamping camera to perform QGI at ultra-low-light levels with rapid data acquisition and processing times, achieving high-resolution and high-contrast images in under 1 min. Our work addresses the trade-off between image quality, optical power, data acquisition time, and data processing time in QGI, paving the way for practical applications in biomedical and quantum-secured imaging.

Mavian, Alex (ORCID:0000000279448830)↗
DOE OSTI2020

Deep medical image analysis with representation learning and neuromorphic computing

Deep learning is increasingly used in medical imaging, improving many steps of the processing chain, from acquisition to segmentation and anomaly detection to outcome prediction. Yet significant challenges remain: (i) image-based diagnosis depends on the spatial relationships between local patterns, something convolution and pooling often do not capture adequately; (ii) data augmentation, the de facto method for learning three-dimensional pose invariance, requires exponentially many points to achieve robust improvement; (iii) labelled medical images are much less abundant than unlabelled ones, especially for heterogeneous pathological cases; and (iv) scanning technologies such as magnetic resonance imaging can be slow and costly, generally without online learning abilities to focus on regions of clinical interest. To address these challenges, novel algorithmic and hardware approaches are needed for deep learning to reach its full potential in medical imaging.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Striving to translate shale physics across ten orders of magnitude: What have we learned?

Shales will play an important role in the successful transition of energy from fossil-based resources to renewables in the coming decades. Aside from being a significant source of low-carbon intensity fuels, like natural gas, they also serve as geologic seals of subsurface formations that may be used to isolate nuclear waste, sequester CO 2 , or store intermittent energy (e.g., solar hydrogen). Despite their importance, shales pose significant engineering and environmental challenges due to their nanoporous structure and extreme heterogeneity that spans at least ~10 orders of magnitude in spatial scale. Two challenges inhibit a system-level understanding: (1) the physics of fluid flow and phase behavior in shales are poorly understood due to the dominant molecular interactions between minerals and fluids under confinement, and (2) the apparent lack of scale separation that prevents a reliable (closed) description of the physics at any single scale of observation. In this review, we focus on the latter issue and discuss scale translation, which in its broadest sense is transforming data or simulations from one spatiotemporal scale to another. While effective scale translation is not exclusive to shales, but all geologic porous media, the need for it is especially acute in shales given their high degree of heterogeneity. Classical theories like homogenization, while indispensable, fail when scales are not separated. Other methods, like numerical upscaling, scale-translate in only one direction: small to large, but not the reverse, called downscaling. However, the confluence of advances in three areas are bringing challenging problems such as shales within reach: increased computational power and scalable algorithms; high-resolution imaging and multi-modal data acquisition; and machine learning to process massive amounts of data. While these advances equip geoscientists with a wide array of experimental and computational tools, no individual tool can probe the entire gamut of heterogeneity in shales. Their effective use, therefore, requires an ability to bridge between various data types obtained at different scales. The aim of this review is to present a coherent account of computational and experimental methods that may be used to achieve just that, i.e., to perform scale translation. We provide a broader definition of scale translation, one that transcends classical homogenization and upscaling methods, but is consistent with them and accommodates notions like downscaling and data translation. After a brief introduction to homogenization, we review hybrid methods, numerical upscaling and its recent extensions, multiscale computing, high-resolution imaging, and machine learning. We place particular emphasis on multiscale computing and propose an algorithmic framework to bridge between the pore (micro) and Darcy (macro) scales. Throughout the paper, we draw comparisons between the various methods and highlight their (often hidden) similarities, differences, benefits, and pitfalls. We finally conclude with two case studies on shales that exemplify some of the methods presented.

58 GEOSCIENCES↗
DOE OSTI2024

Deep learning-driven super-resolution in Raman hyperspectral imaging: Efficient high-resolution reconstruction from low-resolution data

Deep learning (DL) has become an indispensable tool in hyperspectral data analysis, automatically extracting valuable features from complex, high-dimensional datasets. Super-resolution reconstruction, an essential aspect of hyperspectral data, involves enhancing spatial resolution, particularly relevant to low-resolution hyperspectral data. Yet, the pursuit of super-resolution in hyperspectral analysis is fraught with challenges, including acquiring ground truth high-resolution data for training, generalization, and scalability. The pressing issue of extended spectral acquisition times, notably for high-resolution scans, is a significant roadblock in hyperspectral imaging. Super-resolution methods offer a promising solution by providing higher spatial resolution data to expedite data collection and yield more efficient outcomes. This paper delves into a practical application of these concepts using Raman imaging, where spectral acquisition times can be prohibitively long. In this context, DL-based super-resolution models demonstrate their efficacy by predicting and reconstructing high-resolution Raman data from low-resolution input, eliminating the need for resource-intensive high-resolution scans. While previous work often relied on substantial high-resolution datasets, this study showcases the ability to achieve similar outcomes even with limited data, presenting a more practical and cost-effective approach. In conclusion, the results offer a glimpse into the transformative potential of this technology to streamline hyperspectral imaging applications by saving valuable time and resources through the successful generation of high-resolution data from low-resolution inputs.

42 ENGINEERING↗
DOE OSTI2021

Five-second STEM dislocation tomography for 300 nm thick specimen assisted by deep-learning-based noise filtering

Scanning transmission electron microscopy (STEM) is suitable for visualizing the inside of a relatively thick specimen than the conventional transmission electron microscopy, whose resolution is limited by the chromatic aberration of image forming lenses, and thus, the STEM mode has been employed frequently for computed electron tomography based three-dimensional (3D) structural characterization and combined with analytical methods such as annular dark field imaging or spectroscopies. However, the image quality of STEM is severely suffered by noise or artifacts especially when rapid imaging, in the order of millisecond per frame or faster, is pursued. Here we demonstrate a deep-learning-assisted rapid STEM tomography, which visualizes 3D dislocation arrangement only within five-second acquisition of all the tilt-series images even in a 300 nm thick steel specimen. The developed method offers a new platform for various in situ or operando 3D microanalyses in which dealing with relatively thick specimens or covering media like liquid cells are required.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Simple through-plane spatial filter for 2D MRI projections

A simple spatial filter for 2D projection MR imaging is introduced. It works in the third (unresolved) direction to eliminate uniform or slowly varying interfering background signals. A constant amplitude gradient pulse in the unresolved direction is applied at the same time as the usual phase encode gradient during 2D acquisition. The filter is demonstrated for root imaging in soil, where background soil water signals can be troublesome. The filter suppresses the soil water signal while preserving the desired signal of plant roots. Fundamental to the operation of the filter is that the roots are sparse in the image domain, meaning there are relatively few pixels with multiple roots present. Here, the performance of the through-plane filter is demonstrated and compares favorably to more conventional in-plane spatial filtering.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

Megahertz-rate shock-wave distortion cancellation via phase conjugate digital in-line holography

Abstract Holography is a powerful tool for three-dimensional imaging. However, in explosive, supersonic, hypersonic, cavitating, or ionizing environments, shock-waves and density gradients impart phase distortions that obscure objects in the field-of-view. Capturing time-resolved information in these environments also requires ultra-high-speed acquisition. To reduce phase distortions and increase imaging rates, we introduce an ultra-high-speed phase conjugate digital in-line holography (PCDIH) technique. In this concept, a coherent beam passes through the shock-wave distortion, reflects off a phase conjugate mirror, and propagates back through the shock-wave, thereby minimizing imaging distortions from phase delays. By implementing the method using a pulse-burst laser setup at up to 5 million-frames-per-second, time-resolved holograms of ultra-fast events are now possible. This technique is applied for holographic imaging through laser-spark plasma-generated shock-waves and to enable three-dimensional tracking of explosively generated hypersonic fragments. Simulations further advance our understanding of physical processes and experiments demonstrate ultra-high-speed PCDIH techniques for capturing dynamics.

Science & Technology - Other Topics↗
DOE OSTI2025

The LSST Camera (LSSTCam)

The LSST Camera is the sole instrument for the NSF-DOE Vera C. Rubin Observatory and consists of a 3.2 gigapixel focal plane mosaic with in-vacuum controllers, dedicated guider and wavefront CCDs, a three-element corrector whose largest lens is 1.55m in diameter, six optical interference filters covering a 320-1050nm band pass with an out-of-plane filter exchange mechanism, and camera slow control and data acquisition systems capable of digitizing each image in 2 seconds.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

In vitro investigation of protein assembly by combined microscopy and infrared spectroscopy at the nanometer scale

The nanoscale structure and dynamics of proteins on surfaces has been extensively studied using various imaging techniques, such as transmission electron microscopy and atomic force microscopy (AFM) in liquid environments. These powerful imaging techniques, however, can potentially damage or perturb delicate biological material and do not provide chemical information, which prevents a fundamental understanding of the dynamic processes underlying their evolution under physiological conditions. Here, we use a platform developed in our laboratory that enables acquisition of infrared (IR) spectroscopy and AFM images of biological material in physiological liquids with nanometer resolution in a cell closed by atomically thin graphene membranes transparent to IR photons. In this work, we studied the self-assembly process of S-layer proteins at the graphene-aqueous solution interface. The graphene acts also as the membrane separating the solution containing the proteins and Ca 2+ ions from the AFM tip, thus eliminating sample damage and contamination effects. The formation of S-layer protein lattices and their structural evolution was monitored by AFM and by recording the amide I and II IR absorption bands, which reveal the noncovalent interaction between proteins and their response to the environment, including ionic strength and solvation. Our measurement platform opens unique opportunities to study biological material and soft materials in general.

59 BASIC BIOLOGICAL SCIENCES↗