Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Image reconstruction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Improving ICARUS Track Reconstruction Algorithms

The ICARUS experiment is part of the Short-Baseline Neutrino (SBN) program at Fermilab. The main goal of the experiment is to investigate the possibility of sterile neutrinos in the O(1 eV) mass region and provide clarification of the anomaly detected from the Liquid Scintillator Neutrino Detector (LSND) and MiniBooNE experiments. The ICARUS-T600 detector is a Liquid Argon Time Projection Chamber (LAr-TPC), that can provide excellent 3D imaging and calorimetric reconstruction of any ionizing particles. This detection technique allows a detailed study of neutrino interactions, spanning a wide energy spectrum (from a few keV to several hundreds of GeV). The detector consists of two identical adjacent modules, filled with a total of 760 tons of ultra-pure liquid argon. Each module houses two LAr-TPCs separated by a common cathode with a maximum drift distance of 1.5 m, equivalent to about 1 ms drift time for the nominal $500$ V/m electric drift field. The anode is made of three parallel wire planes positioned 3 mm apart, where the stainless-steel wires are oriented on each plane at a different angle with respect to the horizontal direction ($+60^\degree$,$-60^\degree$,$0^\degree$). The first two planes (Induction 1 and Induction 2) provide a non-destructive charge measurement, whereas the ionization charge is fully collected by the last collection plane. In total, 53248 wires with a 3 mm pitch and length up to 9 m are installed in the detector. In the first stage of the reconstruction, segments of waveforms corresponding to physical signals (hits) are searched for in the deconvolved wire waveform with a threshold-based hit-finding algorithm. Each hit is then fitted with a Gaussian, whose area is proportional to the number of drift electrons generating the signal. In the second stage of the reconstruction, hits are passed as input to Pandora, a framework software composed of different pattern recognition algorithms, that performs a 3D reconstruction of the full image recorded in the collected event, including the identification of interaction vertices and tracks and showers inside the TPC. These are organized into a hierarchical structure (called slice) of particles generated starting from a primary interaction vertex. In some cases, related to the inefficiencies in the hit detection or excessive deflection of the particle trajectory, Pandora breaks the particle's track into two or more smaller pieces and considers each piece as an independent track. We studied this phenomenon focusing on primary muons from ν_μ CC interactions contained in a single module with a track at least 20 cm long, to exclude delta rays. The study determined that about $7-8\%$ of the muon tracks are broken. Approximately $80\%$ of the times, Pandora assigns all segments of the track to the same slice (intra-slice track split), while in the remaining $20\%$ of the cases, one of the segments is associated with another slice (extra-slice track split). To mitigate this phenomenon, we designed an algorithm that detects and stitches the tracks broken by Pandora for the intra-slice split. In Monte Carlo simulations, the algorithm showed an efficiency exceeding $80\%$ and a purity exceeding $93\%$.

Ricci, Alessandro Maria [Pisa U.; INFN, Pisa] (ORC↗

Noise reduction in X-ray photon correlation spectroscopy with convolutional neural networks encoder–decoder models

Abstract Like other experimental techniques, X-ray photon correlation spectroscopy is subject to various kinds of noise. Random and correlated fluctuations and heterogeneities can be present in a two-time correlation function and obscure the information about the intrinsic dynamics of a sample. Simultaneously addressing the disparate origins of noise in the experimental data is challenging. We propose a computational approach for improving the signal-to-noise ratio in two-time correlation functions that is based on convolutional neural network encoder–decoder (CNN-ED) models. Such models extract features from an image via convolutional layers, project them to a low dimensional space and then reconstruct a clean image from this reduced representation via transposed convolutional layers. Not only are ED models a general tool for random noise removal, but their application to low signal-to-noise data can enhance the data’s quantitative usage since they are able to learn the functional form of the signal. We demonstrate that the CNN-ED models trained on real-world experimental data help to effectively extract equilibrium dynamics’ parameters from two-time correlation functions, containing statistical noise and dynamic heterogeneities. Strategies for optimizing the models’ performance and their applicability limits are discussed.

36 MATERIALS SCIENCE↗

Image Deconvolution and Point-spread Function Reconstruction with STARRED: A Wavelet-based Two-channel Method Optimized for Light-curve Extraction

We present starred, a point-spread function (PSF) reconstruction, two-channel deconvolution, and light-curve extraction method designed for high-precision photometric measurements in imaging time series. An improved resolution of the data is targeted rather than an infinite one, thereby minimizing deconvolution artifacts. In addition, starred performs a joint deconvolution of all available data, accounting for epoch-to-epoch variations of the PSF and decomposing the resulting deconvolved image into a point source and an extended source channel. The output is a high-signal-to-noise-ratio, high-resolution frame combining all data and the photometry of all point sources in the field of view as a function of time. Of note, starred also provides exquisite PSF models for each data frame. We showcase three applications of starred in the context of the imminent LSST survey and of JWST imaging: (i) the extraction of supernovae light curves and the scene representation of their host galaxy; (ii) the extraction of lensed quasar light curves for time-delay cosmography; and (iii) the measurement of the spectral energy distribution of globular clusters in the "Sparkler," a galaxy at redshift z = 1.378 strongly lensed by the galaxy cluster SMACS J0723.3-7327. starred is implemented in jax, leveraging automatic differentiation and graphics processing unit acceleration. This enables the rapid processing of large time-domain data sets, positioning the method as a powerful tool for extracting light curves from the multitude of lensed or unlensed variable and transient objects in the Rubin-LSST data, even when blended with intervening objects.

79 ASTRONOMY AND ASTROPHYSICS↗

Lensless X-Ray Nanoimaging: Revolutions and opportunities

Lensless x-ray nanoimaging is providing 3D views of a wide range of materials with a spatial resolution better than 20 nanometers. These advances are enabled in part by dramatic gains in coherent x-ray flux, but they also rely on advances in signal processing to obtain images from coherent diffraction data. Here, we outline the various imaging approaches, the associated reconstruction methods, and highlight opportunities for future advances.

42 ENGINEERING↗

End-to-end orientation estimation from 2D cryo-EM1images

Cryo-electron microscopy (cryo-EM) is a Nobel Prize-winning technique for deter-mining high-resolution 3D structures of biological macromolecules. A 3D structure is reconstructed from hundreds of thousands of noisy 2D projection images. However, existing 3D reconstruction methods are still time-consuming, and one of the major computational bottlenecks is to recover the unknown orientation of the particle in16each 2D image. The dominant methods typically exploit expensive global search on each image to estimate the missing orientations. Here, a novel end-to-end supervised learning method is introduced to directly recover the missing orientations from 2D cryo-EM images. A neural network is used to approximate the mapping from images to orientations. Furthermore, a robust loss function is proposed for optimizing the parameters of the network, which can handle both asymmetric and symmetric 3D structures. Experiments on synthetic datasets with various symmetry types confirm that the neural network is capable of recovering orientations from 2D cryo-EM images, and the results on one real cryo-EM dataset further demonstrate its potential in more challenging imaging conditions.

3D reconstruction↗

Integrated photonic encoder for low power and high-speed image processing

Abstract Modern lens designs are capable of resolving greater than 10 gigapixels, while advances in camera frame-rate and hyperspectral imaging have made data acquisition rates of Terapixel/second a real possibility. The main bottlenecks preventing such high data-rate systems are power consumption and data storage. In this work, we show that analog photonic encoders could address this challenge, enabling high-speed image compression using orders-of-magnitude lower power than digital electronics. Our approach relies on a silicon-photonics front-end to compress raw image data, foregoing energy-intensive image conditioning and reducing data storage requirements. The compression scheme uses a passive disordered photonic structure to perform kernel-type random projections of the raw image data with minimal power consumption and low latency. A back-end neural network can then reconstruct the original images with structural similarity exceeding 90%. This scheme has the potential to process data streams exceeding Terapixel/second using less than 100 fJ/pixel, providing a path to ultra-high-resolution data and image acquisition systems.

47 OTHER INSTRUMENTATION↗

Video-rate Raman-based metabolic imaging by Airy light-sheet illumination and photon-sparse detection

Despite its massive potential, Raman imaging represents just a modest fraction of all research and clinical microscopy to date. This is due to the ultralow Raman scattering cross-sections of most biomolecules that impose low-light or photon-sparse conditions. Bioimaging under such conditions is suboptimal, as it either results in ultralow frame rates or requires increased levels of irradiance. Here, we overcome this tradeoff by introducing Raman imaging that operates at both video rates and 1,000-fold lower irradiance than state-of-the-art methods. To accomplish this, we deployed a judicially designed Airy light-sheet microscope to efficiently image large specimen regions. Further, we implemented subphoton per pixel image acquisition and reconstruction to confront issues arising from photon sparsity at just millisecond integrations. We demonstrate the versatility of our approach by imaging a variety of samples, including the three-dimensional (3D) metabolic activity of single microbial cells and the underlying cell-to-cell variability. To image such small-scale targets, we again harnessed photon sparsity to increase magnification without a field-of-view penalty, thus, overcoming another key limitation in modern light-sheet microscopy.

60 APPLIED LIFE SCIENCES↗

Characterization of a SiPM-based monolithic neutron scatter camera using dark counts

The Single Volume Scatter Camera (SVSC) Collaboration aims to develop portable neutron imaging systems for a variety of applications in nuclear non-proliferation. Conventional double-scatter neutron imagers are composed of several separate detector volumes organized in at least two planes. A neutron must scatter in two of these detector volumes for its initial trajectory to be reconstructed. As such, these systems typically have a large footprint and poor geometric efficiency. We report on the design and characterization of a prototype monolithic neutron scatter camera that is intended to significantly improve upon the geometrical shortcomings of conventional neutron cameras. The detector consists of a 50 mm×56 mm× 60 mm monolithic block of EJ-204 plastic scintillator instrumented on two faces with arrays of 64 Hamamatsu S13360-6075PE silicon photomultipliers (SiPMs). The electronic crosstalk is limited to < 5% between adjacent channels and < 0.1% between all other channel pairs. SiPMs introduce a significantly elevated dark count rate over PMTs, as well as correlated noise from after-pulsing and optical crosstalk. In this article, we characterize the dark count rate and optical crosstalk and present a modified event reconstruction likelihood function that accounts for them. We find that the average dark count rate per SiPM is 4.3 MHz with a standard deviation of 1.5 MHz among devices. The analysis method we employ to measure internal optical crosstalk also naturally yields the mean and width of the single-electron pulse height. Here, we calculate separate contributions to the width of the single-electron pulse-height from electronic noise and avalanche fluctuations. We demonstrate a timing resolution for a single-photon pulse to be (128 ± 4) ps. Finally, coincidence analysis is employed to measure external (pixel-to-pixel) optical crosstalk. We present a map of the average external crosstalk probability between 2×4 groups of SiPMs, as well as the in-situ timing characteristics extracted from the coincidence analysis. Further work is needed to characterize the performance of the camera at reconstructing single- and double-site interactions, as well as image reconstruction.

47 OTHER INSTRUMENTATION↗

3D reconstruction of an inertial-confinement fusion implosion with neural networks using multiple heterogeneous data sources

3D asymmetries are major degradation mechanisms in inertial-confinement fusion implosions at the National Ignition Facility (NIF). These asymmetries can be diagnosed and reconstructed with the neutron imaging system (NIS) on three lines of sight around the NIF target chamber. Conventional tomographic reconstructions are used to reconstruct the 3D morphology of the implosion using NIS [Volegov et al., J. Appl. Phys. 127, 083301 (2020)], but the problem is ill-posed with only three imaging lines of sight. Asymmetries can also be diagnosed with the real-time neutron activation diagnostics (RTNAD) and the neutron time-of-flight (nToF) suite. Since the NIS, RTNAD, and nToF each sample a different part of the implosion using different physical principles, we propose that it is possible to overcome the limitations of too few imaging lines of sight by performing 3D reconstructions that combine information from all three heterogeneous data sources. This work presents a new machine learning-based reconstruction technique to do just this. By using a simple physics model and group of neural networks to map 3D morphologies to data, this technique can easily account for data of multiple different types. A simple proof-of-principle is presented, demonstrating that this technique can accurately reconstruct a hot-spot shape using synthetic primary neutron images and a hot-spot velocity vector. In particular, the hot-spot’s asymmetry, quantified as spherical harmonic coefficients, is reconstructed to within ±4% of the radius in 90% of test cases. In the future, this technique will be applied to actual NIS, RTNAD, and nToF data to better understand 3D asymmetries at the NIF.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Concurrent multi-peak Bragg coherent x-ray diffraction imaging of 3D nanocrystal lattice displacement via global optimization

Abstract In this paper we demonstrated a method to reconstruct vector-valued lattice distortion fields within nanoscale crystals by optimization of a forward model of multi-reflection Bragg coherent diffraction imaging (MR-BCDI) data. The method flexibly accounts for geometric factors that arise when making BCDI measurements, is amenable to efficient inversion with modern optimization toolkits, and allows for globally constraining a single image reconstruction to multiple Bragg peak measurements. This is enabled by a forward model that emulates the multiple Bragg peaks of a MR-BCDI experiment from a single estimate of the 3D crystal sample. We present this forward model, we implement it within the stochastic gradient descent optimization framework, and we demonstrate it with simulated and experimental data of nanocrystals with inhomogeneous internal lattice displacement. We find that utilizing a global optimization approach to MR-BCDI affords a reliable path to convergence of data which is otherwise challenging to reconstruct.

36 MATERIALS SCIENCE↗

XRFtomo

Based on [1], XRFtomo brings together a variety of image processing tools used for preparing, processing and reconstructing 3D renditions of samples imaged using a synchrotron-based x-ray fluorescence (XRF) microprobe or nanoprobe at the Advanced Photon Source (APS). This software bridges the gap between data acquisition and visualization by providing tools to adjust for misalignment in the imaging process and tools for running reconstructions[2], all with the use of a GUI or command line. XRFtomo accepts .h5 files processed through MAPS[3] and it outputs reconstructed cross-sections, projections, sinograms, metadata, and a configuration file with last-used parameters for rapid processing the next time the program is launched. These images serve as inputs for other 3D visualization software for generating volumetric renderings and animations.

Marin, Fabrico↗

Three-Dimensional Ultrastructure of Arabidopsis Cotyledons Infected with Colletotrichum higginsianum

We used serial block-face scanning electron microscopy (SBF-SEM) to study the host–pathogen interface between Arabidopsis cotyledons and the hemibiotrophic fungus Colletotrichum higginsianum. By combining high-pressure freezing and freeze-substitution with SBF-SEM, followed by segmentation and reconstruction of the imaging volume using the freely accessible software IMOD, we created 3D models of the series of cytological events that occur during the Colletotrichum–Arabidopsis susceptible interaction. We found that the host cell membranes underwent massive expansion to accommodate the rapidly growing intracellular hypha. As the fungal infection proceeded from the biotrophic to the necrotrophic stage, the host cell membranes went through increasing levels of disintegration culminating in host cell death. Intriguingly, we documented autophagosomes in proximity to biotrophic hyphae using transmission electron microscopy (TEM) and a concurrent increase in autophagic flux between early to mid/late biotrophic phase of the infection process. Occasionally, we observed osmiophilic bodies in the vicinity of biotrophic hyphae using TEM only and near necrotrophic hyphae under both TEM and SBF-SEM. Overall, we established a method for obtaining serial SBF-SEM images, each with a lateral ( x-y) pixel resolution of 10 nm and an axial ( z) resolution of 40 nm, that can be reconstructed into interactive 3D models using the IMOD. Application of this method to the Colletotrichum–Arabidopsis pathosystem allowed us to more fully understand the spatial arrangement and morphological architecture of the fungal hyphae after they penetrate epidermal cells of Arabidopsis cotyledons and the cytological changes the host cell undergoes as the infection progresses toward necrotrophy. [Formula: see text] Copyright © 2024 The Author(s). This is an open access article distributed under the CC BY 4.0 International license .

Biochemistry & Molecular Biology↗

Coarse-to-fine Task-driven Inpainting for Geoscience Images

The processing and recognition of geoscience images have wide applications. Most of existing researches focus on understanding the high-quality geoscience images by assuming that all the images are clear. However, in many real-world cases, the geoscience images might contain occlusions during the image acquisition. This problem actually implies the image inpainting problem in computer vision and multimedia. As far as we know, all the existing image inpainting algorithms learn to repair the occluded regions for a better visualization quality, they are excellent for natural images but not good enough for geoscience images, and they never consider the following geoscience task when developing inpainting methods. Here, this paper aims to repair the occluded regions for a better geoscience task performance and advanced visualization quality simultaneously, without changing the current deployed deep learning based geoscience models. Because of the complex context of geoscience images, we propose a coarse-to-fine encoder-decoder network with the help of designed coarse-to-fine adversarial context discriminators to reconstruct the occluded image regions. Due to the limited data of geoscience images, we propose a MaskMix based data augmentation method, which augments inpainting masks instead of augmenting original images, to exploit the limited geoscience image data. The experimental results on three public geoscience datasets for remote sensing scene recognition, cross-view geolocation and semantic segmentation tasks respectively show the effectiveness and accuracy of the proposed method. The code is available at: https://github.com/HMS97/Task-driven-Inpainting.

97 MATHEMATICS AND COMPUTING↗

Bragg edge imaging (BEI) of B12W and M8N socket sections of the Arecibo telescope

From neutron user principal investigator: We kindly request the public release of three neutron imaging datasets through ONCat. All datasets were collected from two forensic specimens, B12W and M8N, sectioned from zinc-filled steel-wire sockets recovered from the collapsed Arecibo Telescope. The dataset titled “Neutron radiographs of B12W and M8N socket sections of the Arecibo telescope” contains normalized two-dimensional (2D) neutron radiographs of the specimens, showing the geometry and spatial distribution of the steel wires embedded within the zinc matrix, as well as internal features such as voids and cracks. The dataset titled “Neutron computed tomography of B12W and M8N socket sections of the Arecibo telescope” contains normalized 2D neutron projection images acquired over a range of specimen rotation angles for one selected region of each specimen. These projection images were used to reconstruct three-dimensional (3D) tomographic volumes that reveal the embedded-wire geometry and internal defects. The dataset titled “Bragg edge imaging (BEI) of B12W and M8N socket sections of the Arecibo telescope” contains six time-of-flight (TOF) neutron imaging datasets, three from each specimen, acquired at regions of interest selected based on the radiographs. The spatially resolved 2D TOF images show the zinc matrix and embedded steel wires, and the wavelength-dependent neutron transmission data were used to characterize crystallographic texture within the zinc. All components and their condition are in the public domain as they are the property of the National Science Foundation (NSF). The neutron imaging data, part geometries, and detailed forensic information have been widely published in the Arecibo Telescope Collapse Forensic Report by Thornton Tomasetti Engineers and others (NASA report and NASEM report).

Bilheux, Hassina↗

Imaging moiré flat bands in three-dimensional reconstructed WSe 2 /WS 2 superlattices

Moiré superlattices in transition metal dichalcogenide (TMD) heterostructures can host novel correlated quantum phenomena due to the interplay of narrow moiré flat bands and strong, long-range Coulomb interactions. However, microscopic knowledge of the atomically reconstructed moiré superlattice and resulting flat bands is still lacking, which is critical for fundamental understanding and control of the correlated moiré phenomena. Here we quantitatively study the moiré flat bands in three-dimensional (3D) reconstructed WSe 2 /WS 2 moiré superlattices by comparing scanning tunnelling spectroscopy (STS) of high-quality exfoliated TMD heterostructure devices with ab initio simulations of TMD moiré superlattices. A strong 3D buckling reconstruction accompanied by large in-plane strain redistribution is identified in our WSe 2 /WS 2 moiré heterostructures. STS imaging demonstrates that this results in a remarkably narrow and highly localized K-point moiré flat band at the valence band edge of the heterostructure. A series of moiré flat bands are observed at different energies that exhibit varying degrees of localization. Our observations contradict previous simplified theoretical models but agree quantitatively with ab initio simulations that fully capture the 3D structural reconstruction. Furthermore, our results reveal that the strain redistribution and 3D buckling in TMD heterostructures dominate the effective moiré potential and the corresponding moiré flat bands at the Brillouin zone K points.

36 MATERIALS SCIENCE↗

Single-frame far-field diffractive imaging with randomized illumination

We introduce a single-frame diffractive imaging method called randomized probe imaging (RPI). In RPI, a sample is illuminated by a structured probe field containing speckles smaller than the sample’s typical feature size. Quantitative amplitude and phase images are then reconstructed from the resulting far-field diffraction pattern. The experimental geometry of RPI is straightforward to implement, requires no near-field optics, and is applicable to extended samples. When the resulting data are analyzed with a complimentary algorithm, reliable reconstructions which are robust to missing data are achieved. To realize these benefits, a resolution limit associated with the numerical aperture of the probe-forming optics is imposed. RPI therefore offers an attractive modality for quantitative X-ray phase imaging when temporal resolution and reliability are critical but spatial resolution in the tens of nanometers is sufficient. We discuss the method, introduce a reconstruction algorithm, and present two proof-of-concept experiments: one using visible light, and one using soft X-rays.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Subject-specific multi-scale modeling of the fate of inhaled aerosols

Determining the fate of inhaled aerosols in the respiratory system is essential in assessing the potential toxicity of inhaled airborne materials, responses to airborne pathogens, or in improving inhaled drug delivery. The availability of high-resolution clinical lung imaging and advances in the reconstruction of lung airways from CT images have led to the development of subject-specific in-silico 3D models of aerosol dosimetry, often referred to as computational fluid-particle-dynamics (CFPD) models. As CFPD models require extensive computing resources, they are typically confined to the upper and large airways. These models can be combined with lower-dimensional models to form multiscale models that predict the transport and deposition of inhaled aerosols in the entire respiratory tract. Understanding where aerosols deposit is only the first of potentially several key events necessary to predict an outcome, being a detrimental health effect or a therapeutic response. To that end, multiscale approaches that combine CFPD with physiologically-based pharmacokinetics (PBPK) models have been developed to evaluate the absorption, distribution, metabolism, and excretion (ADME) of toxic or medicinal chemicals in one or more compartments of the human body. CFPD models can also be combined with host cell dynamics (HCD) models to assess regional immune system responses. Here, this paper reviews the state of the art of these different multiscale approaches and discusses the potential role of personalized or subject-specific modeling in respiratory health.

60 APPLIED LIFE SCIENCES↗