Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

Associated Particle Imaging of Neutron Inelastic Scatter: 3-D Reconstruction, Capabilities, and Challenges

Associated particle imaging (API) offers unique advantages for 3-D imaging of neutron inelastic scatter, including single-view tomographic imaging and data acquisition when access is limited to only one side of the interrogated object. However, widespread adoption of neutron inelastic scatter imaging has been impeded by several inherent challenges, most prominently spatial resolution, self-attenuation, and statistical noise. Here, in this work, the capabilities and challenges of neutron inelastic scatter imaging are investigated. Instead of focusing on a single imaging application, we identify imaging principles that hold for various neutron inelastic scatter imaging techniques. The primary challenges for 3-D imaging are characterized. The inherent spatial resolution in the time-of-flight (TOF) dimension is derived based on the known system timing resolution and scan geometry. Three reconstruction algorithms are described and demonstrated, including the introduction of modern iterative reconstruction incorporating a physics-based system model. Simulation is leveraged to demonstrate imaging capability with varying coincidence count levels and system timing resolution. An example of measured data with both back-scatter and forward-scatter detector positioning is presented. System design characteristics and their effects on image quality are identified. The imaging framework presented in this article has the potential to facilitate growth of 3-D neutron inelastic scatter API by identifying applications that are a good match for the technique and by targeting system development resources toward the requirements of a specific imaging task.

Associated particle imaging (API)↗

Profile Images and Annotations for Vehicle Re-identification Algorithms (PRIMAVERA)

This dataset contains 636,246 profile images of vehicles representing 13,963 unique vehicles. The data was collected by a set of roadside sensors over the course of three years. Each time a vehicle passed by one of the sensors, a series of images was collected. The images were processed to detect and localize each vehicle, and a license plate reader collocated with the sensor was used to provide a unique ID for the vehicle. Actual license plate numbers have been obfuscated by replacing with an arbitrary numerical ID for each vehicle. After localizing the vehicle in each image, the original RGB image was rotated, scaled, and shifted to produce a new RGB image of size 234x234 pixels such that the outermost two wheels are located at predetermined pixel locations in the image. In this way, all vehicle images are aligned to one another. This registration process occasionally results in a portion of certain vehicles being cutoff at the edges of the image. The dataset has been partitioned into two sets called training and validation. The two partitions no common vehicles, i.e., a vehicle present in one partition is guaranteed not to be present in the other. In this way, an algorithm can be validated against a set of new vehicles that were not seen during the training process. The training set contains 543,926 images from 64,440 vehicle passes representing 11,918 unique vehicles, while the validation set contains 92,320 images from 10,991 vehicle passes representing 2,045 unique vehicles. Vehicle images are organized by directories corresponding to unique vehicles. The file naming scheme is as follows: veh_{vehID}_tr_{passID}_{frameID}_{elevation}_{timeofday}.jpg where {vehID} is the vehicle ID (unique across the entire dataset), {passID} is an identifier for each tracked vehicle pass (unique across the entire dataset), {frameID} is the index of the frame within the given vehicle pass starting at 0, {elevation} is a two-letter string indicating whether the sensor was elevated (el) or at ground-level (gl), and {timeofday} is a two-letter string indicating whether the image was captured during daytime (dt) or nighttime (nt).

image↗

Quantum ghost imaging microscopy depth-of-field study

Quantum ghost imaging approaches have been proposed to enhance biological microscopy, for example, using 2D visible detectors to provide IR images or providing additional dimensions of spatial or spectral information. Toward the goal of making such imaging schemes practical, we compare image quality and depth-of-field between traditional images and ghost images at the same excitation levels. We measure how image quality and depth-of-field depend on the parameters of the entangled light produced using type-I spontaneous parametric down-conversion (SPDC). We use a pair of time-synchronized, photon-timing single-photon avalanche diode (SPAD) array detectors to capture two distinct microscope imaging paths simultaneously on a photon-pair-by-photon-pair basis: one in a traditional imaging pathway and the other a quantum ghost imaging pathway. We calculate the depth-of-field, resolution, contrast, and signal-to-noise ratio (SNR) through the parameter space of a β-Barium Borate (BBO) type-I bulk non-linear crystal length and angle. Our results provide a basis for choosing parameters for quantum ghost imaging with type-I SPDC sources.

47 OTHER INSTRUMENTATION↗

Data-driven high-fidelity 2D microstructure reconstruction via non-local patch-based image inpainting

Microstructure reconstruction problems are usually limited to the representation with finitely many number of phases, e.g. binary and ternary. However, images of microstructure obtained through experimental, for example, using microscope, are often represented as a RGB or grayscale image. Because the phase-based representation is discrete, more rigid, and provides less flexibility in modeling the microstructure, as compared to RGB or grayscale image, there is a loss of information in the conversion. In this paper, a microstructure reconstruction method, which produces images at the fidelity of experimental microscopy, i.e. RGB or grayscale image, is proposed without introducing any physics-based microstructure descriptor. Furthermore, the image texture is preserved and the microstructure image is represented with continuous variables (as in RGB or grayscale images), instead of binary or categorical variables, which results in a high-fidelity image of microstructure reconstruction. The advantage of the proposed method is its quality of reconstruction, which can be applied to any other binary or multiphase 2D microstructure. The proposed method can be thought of as a subsampling approach to expand the microstructure dataset, while preserving its image texture. Moreover, the size of the reconstructed image is more flexible, compared to other machine learning microstructure reconstruction method, where the size must be fixed beforehand. In addition, the proposed method is capable of joining the microstructure images taken at different locations to reconstruct a larger microstructure image. A significant advantage of the proposed method is to remedy the data scarcity problem in materials science, where experimental data is scare and hard to obtain. The proposed method can also be applied to generate statistically equivalent microstructures, which has a strong implication in microstructure-related uncertainty quantification applications. The proposed microstructure reconstruction method is demonstrated with the UltraHigh Carbon Steel micrograph DataBase (UHCSDB).

97 MATHEMATICS AND COMPUTING↗

Accurate surface estimation from high-resolution 3D microwave images

Active millimeter and microwave imaging techniques can be used to create a high-resolution 3D image volume of a target’s reflectivity. Millimeter-wave imaging is commonly used for personnel security screening and numerous other applications. Backprojection based image reconstruction techniques form a 3D complex-valued volume. The complex-valued volume is commonly reduced to a real-valued volume by taking the magnitude. For anomaly detection and cross image registration of an object it is beneficial to generate an accurate representation of an object’s surface. Extracting a smooth and accurate surface from a magnitude only image is challenging. One difficulty is the magnitude image has limited resolution in the depth direction which normally limits precision to a moderate fraction of the depth resolution. Another difficulty is that the magnitude of the image depends heavily on the geometry and orientation of the object being imaged. The phase information in a complex-valued image volume provides a means to decouple the magnitude of the image from the geometry of an object and provide precision much finer than the depth resolution would indicate. This enables the generation of a smooth and accurate point cloud representation of the surface of an imaged object. A method to extract a point cloud from the phase information in a 3D complex-valued millimeter-wave image volume is developed and results with simulated and experimental data are presented.

Clark, Richard T.↗

Ultrasparse View X-ray Computed Tomography for 4D Imaging

X-ray computed tomography (CT) is a noninvasive, nondestructive approach to imaging materials, material systems, and engineered components in two and three dimensions. Acquisition of three-dimensional (3D) images requires the collection of hundreds or thousands of through-thickness X-ray radiographic images from different angles. Such 3D data acquisition strategies commonly involve suboptimal temporal sampling for in situ and operando studies (4D imaging). Herein, we introduce a sparse-view imaging approach, Tomo-NeRF, which is capable of reconstructing high-fidelity 3D images from <10 twodimensional radiographic images. Experimental 2D and 3D X-ray images were used to test the reconstruction capability in two-view, four-view, and six-view scenarios. Tomo-NeRF is capable of reconstructing 3D images with a structural similarity of 0.9971–0.9975 and a voxel-wise accuracy of 81.83–89.59% from 2D experimentally obtained images. Furthermore, the reconstruction accuracy for the experimentally obtained images is less than the synthetic structures. Experimentally obtained images demonstrate a similarity of 0.9973–0.9984 and a voxelwise accuracy of 84.31–95.77%.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Deep-learning-guided high-resolution subsurface reflectivity imaging with application to ground-penetrating radar data

Subsurface reflectivity imaging is one of the most important geophysical characterization methods for revealing subsurface structures. In many cases, accurate subsurface reflectivity imaging is challenging because of, for example, random or coherent noise in the data and sparse source-receiver observation geometry. Here, we develop a deep-learning-guided iterative imaging method to improve subsurface structure imaging. Specifically, we train a supervised neural network to infer a noise-free, high-resolution image from a noisy, low-resolution image and use this estimated image as guidance to regularize least-squares imaging. We develop a systematic method to generate high-quality synthetic training data (data-label pairs) to train the guidance neural network. The trained neural network can provide high-fidelity predictions even for field-data images that are not in the training data. We validate our new imaging method using one synthetic and two field ground-penetrating radar data examples, and find that our method can produce clean, high-resolution subsurface reflectivity images where existing single-pass and least-squares imaging methods fail due to noise and insufficient data coverage.

58 GEOSCIENCES↗

Do Remote Camera Arrangements and Image Capture Settings Improve Individual Identification of Golden Eagles?

Individual identification of animals from camera traps has become an important task in wildlife research, but camera deployment methods often do not facilitate this important undertaking. Identification of individual golden eagles (Aquila chrysaetos) is possible using uniquely marked rectrices, but no studies have explored methods to maximize the rate of individual identification from camera images. Furthermore, our objectives were to assess whether different camera heights (1 m vs. 3 m), image capture settings (one image after a 1-min delay vs. burst of 5 images after a 30 sec delay), and arrangements relative to bait (dorsally vs. ventrally aimed) affected views of rectrices on golden eagles and our ability to identify individuals. We conducted our study from 15 December 2016 to 3 March 2017 on the Savannah River Site, South Carolina. First, we developed a scoring system based on views of rectrices and used a linear mixed-effects model to compare image scores among different camera arrangements and image settings. Next, after identifying individual eagles, we used generalized linear mixed-effects models to compare total individual eagle detections, total days an individual was detected, and probability of obtaining an unknown individual identification among camera arrangements and settings. Overall, we scored a total of 27,499 images, with 8,083 providing views of marked rectrices that allowed identification of 18 individual eagles. Average image scores and proportion of images suitable for individual identification were higher from elevated (3 m) camera arrangements than standard arrangements (1 m) across sites. Regardless of camera height, faster frequency of image capture provided more images that could be used to identify individuals and the most trap days per individual. Researchers and managers should consider deploying elevated cameras traps with faster frequency of image capture to improve data quality and potential for analysis of golden eagle populations and trends across the species’ range.

60 APPLIED LIFE SCIENCES↗

Multi-scale fusion algorithm of intensity and polarization-difference images based on edge information enhancement

To better integrate complementary and redundant information from different source images, improve the edge information, and facilitate the target detection. A multi-scale fusion algorithm of intensity and polarization-difference (PD) images based on edge information enhancement is proposed. Firstly, intensity images are obtained by the polarization information analysis method. PD images are obtained by the adaptive polarization-difference imaging approach based on the principle of minimum mutual information. Secondly, guided filter, affine transformations and Block-Matching and 3D filtering are embedded in visibility enhancement to improve the intensity and PD images. Thirdly, the two images are decomposed into high-frequency and low-frequency images by the dual-tree complex wavelet transform (DT-CWT). The high-frequency and low-frequency images are fused by the fusion rules based on edge detection and the regional variance matching degree respectively. Finally, the fusion image is obtained by the inverse DT-CWT. Experimental results demonstrate that fusion images of the proposed algorithm are significantly improved in information entropy, average gradient, and spatial frequency. Compared with the existing methods, it can achieve a better edge enhancement for images in a turbid medium.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Ray-tracing image simulations of transparent objects with complex shape and inhomogeneous refractive index

Optical images of transparent three-dimensional objects can be different from a replica of the object’s cross section in the image plane, due to refraction at the surface or in the body of the object. Simulations of the object’s image are thus needed for the visualization and validation of physical models. We report ray tracing image simulations that achieved high physical fidelity, reproducing optical behaviors and image features not rendered in previous studies. We replicated brightfield microscopy images of drops with complex shapes, and images of pressure and shock waves traveling inside them. For high physical fidelity, the simulations must replicate the spatial and angular distribution of illumination rays, and both the experiment and the simulation must be designed for accurate optical modeling. The simulations are highly sensitive to the properties of the drops and can be used to diagnose and refine fluid dynamics models. The simulated images can also be optimized to extract multiple 3D properties from experimental images. Compared to specialized single-shot 3D imaging methods, this approach has the advantage that it preserves the experimental simplicity, the high resolution, and the visual interpretability characteristic to basic optical imaging. The techniques introduced here are directly applicable to optical microscopy, so they can be used in other fields, such as microfluidics and biology, to expand the type and the accuracy of three-dimensional information that can be extracted from basic optical images.

Cavitation↗

Deep machine learning-assisted multiphoton microscopy to reduce light exposure and expedite imaging

Two-photon excitation fluorescence (2PEF) allows imaging of tissue up to about one millimeter in thickness. Typically, reducing fluorescence excitation exposure reduces the quality of the image. However, using deep learning super resolution techniques, these low-resolution images can be converted to high-resolution images. This work explores improving human tissue imaging by applying deep learning to maximize image quality while reducing fluorescence excitation exposure. We analyze two methods: a method based on U-Net, and a patch-based regression method. Both methods are evaluated on a skin dataset and an eye dataset. The eye dataset includes 1200 paired high power and low power images of retinal organoids. The skin dataset contains multiple frames of each sample of human skin. High-resolution images were formed by averaging 70 frames for each sample and low-resolution images were formed by averaging the first 7 and 15 frames for each sample. The skin dataset includes 550 images for each of the resolution levels. We track two measures of performance for the two methods: mean squared error (MSE) and structural similarity index measure (SSIM). For the eye dataset, the patches method achieves an average MSE of 27,611 compared to 146,855 for the U-Net method, and an average SSIM of 0.636 compared to 0.607 for the U-Net method. For the skin dataset, the patches method achieves an average MSE of 3.768 compared to 4.032 for the U-Net method, and an average SSIM of 0.824 compared to 0.783 for the U-Net method. Despite better performance on image quality, the patches method is worse than the U-Net method when comparing the speed of prediction, taking 303 seconds to predict one image compared to less than one second for the U-Net method.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Neutron Transmission Imaging with a Portable D-T Neutron Generator

Fast-neutron transmission imaging provides complementary information to x-ray transmission imaging. While fast neutron imaging resolution is generally below x-ray imaging, 14-MeV neutrons have an advantage over portable x-ray systems. Neutrons have higher transmission through high-Z materials due to a more uniform attenuation as a function of material atomic number Z compared to X-rays, and can therefore image low-Z materials inside high-Z materials. As a result, portable neutron transmission imaging has many applications, including inspection of concrete and welds for corrosion in vehicles, bridges, and other infrastructure, measurement of material levels in containers, and inspection of suspicious packages. Fast-neutron imaging is also more practical for field use than thermal-neutron imaging due to the size and shielding requirements typical of thermal-imaging systems compared to the availability of small 14.1 MeV D-T neutron generators. However, there are limitations in portable fast-neutron imaging systems, including limited neutron output, limited light produced by neutron scintillators, and lower resolution due to neutron source spot size and 2-3 mm scintillator thickness. In addition, digital-panel dark-noise is roughly 100x higher than neutron scintillator light, and variations in noise across the panel and in time is comparable to the imaging signal. Here we discuss recent efforts in developing a portable fast-neutron radiography system, including an improved neutron scintillator, mitigation of panel noise, and new commercial portable D-T neutron generators. We also present MCNP efforts to model neutron imaging, including scintillator resolution and the effects of neutron scattering from the object and surrounding materials.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Bayesian Spatially Varying Multi-Regularization Image Deblurring

Many scientific experiments such as those found in astronomy, geology, microbiology, and X-ray radiography require the use of high-energy instruments to capture images. Since blur and noise are inevitably present in any imaging system, the images must be \deblurred" to extract the full information content. Mathematically, image deblurring is an ill-posed inverse problem that requires regularization. The regularization, in turn, has a large effect on the deblurred image: different regularization strengths, and types, lead to drastically different reconstructions. Moreover, many images contain a mixture of smooth and sharp features which suggests the use of multi-regularization, i.e., varying the type of regularization (e.g. Tikhonov or total variation) across the image. We address these issues by formulating the image deblurring problem within a hierarchical Bayesian framework in which we spatially adapt the strength of the regularization and also vary the regularization type across the image. In this way, the image itself, along with corresponding regularization strength at each pixel, are described jointly by a posterior distribution which we can sample by Markov chain Monte Carlo (MCMC) methods. We illustrate our techniques on simplified test problems and apply them to high-energy X-ray images taken at the Nevada National Security Site. Numerical tests show that our new method is robustly applicable and increases the quality of the image reconstruction when compared to other (Bayesian) methods.

97 MATHEMATICS AND COMPUTING↗

The Role of Quantum Science Concepts in Enhancing Sensing and Imaging Technologies: Applications for Biology: Proceedings of a Workshop

Quantum concepts hold the potential to enable significant advances in sensing and imaging technologies that could be vital to the study of biological systems. The workshop Quantum Science Concepts in Enhancing Sensing and Imaging Technologies: Applications for Biology, held online March 8–10, 2021, was organized to examine the research and development needs to advance biological applications of quantum technology. Hosted by the National Academies of Sciences, Engineering, and Medicine, the event brought together experts working on state-of-the-art, quantum-enabled technologies and scientists who are interested in applying these technologies to biological systems. Through talks, panels, and discussions, the workshop facilitated a better understanding of the current and future biological applications of quantum-enabled technologies in fields such as microbiology, molecular biology, cell biology, plant science, mycology, and many others. The workshop was organized around three main themes. The first, quantum in biology, examined quantum concepts that are hypothesized to be important for life processes and that researchers are working to observe through biological imaging and sensing. The second, quantum for biology, addressed ways to use quantum concepts to enhance technologies for biological imaging and sensing. The third, biology for quantum, offered a wider discussion of how the frontiers of biological imaging and sensing could enable future study using quantum concepts, tools, or technologies. Throughout the workshop, participants identified a wide range of emerging approaches and opportunities at the intersection of quantum physics and biological sensing and imaging. During the workshop, there were some differences in how each speaker defined the term quantum. During one of the panels, Prem Kumar offered thoughts on what phenomena are classical versus quantum, explaining that techniques get progressively more quantum as you move from just having superposition to having superposition with measurement and entanglement. Another explanation from Clarice Aiello delineates the definition into several levels. This includes a base level of “quantum-ness,” which reflects that all matter is made of atoms, and when these particles are isolated they behave based on quantum mechanical principles. A second level is related to quantum coherence, where a single quantum object might be found in a coherent superposition state. A final level, which she described as the quantum-entangled level, involves multiple quantum systems which are entangled among themselves. Overall, the workshop touched on concepts such as superposition, entanglement, and squeezing and their potential implications for communication, computing, and simulation, in addition to the workshop’s main focal area, biological sensing and imaging. At the opening of the workshop, Thorsten Ritz of the University of California, Irvine, identified two questions at the heart of quantum biology: Is the machinery of life quantum mechanical, and can quantum mechanics be used to study the machinery of life in new ways? Participants highlighted systems in which researchers have explored these questions, from the vast array of molecular interactions involved in biological processes such as photosynthesis, to the mechanics involved in cellular functions such as differentiation and aggregation, to the role of oscillating magnetic fields in flight orientation among birds. Sensing and imaging technologies are crucial to biological research; these technologies could both enhance the study of quantum effects and be enhanced by quantum concepts. A critical challenge in biological research is to develop imaging and sensing tools that do not damage or interfere with the often fragile and fleeting systems being studied. Attendees discussed a variety of established and emerging technologies that could enhance noninvasive biological imaging, including single- and two-photon spectroscopy, single-molecule spectroscopy, quantum illumination, ghost imaging, and cryo-electron microscopy. One example came from Marlan Scully who gave a keynote address on the first day of the workshop. Scully emphasized the use of different laser technologies, which exhibit coherence and other quantum properties, in moving toward real-world biological applications, such as the detection of SARS-CoV-2. Both tools and theory will play an important role in advancing quantum biology research and applications. Several participants suggested theorists and experimentalists should work in tandem to understand and model biological processes. While physics often reduces systems to their simplest forms for fundamental insights, participants also noted the value of observing and understanding biological systems in all their “messiness,” capturing both the inner workings of biological systems and the complex interactions that occur within and between organisms. In discussions among participants, several attendees stressed the need to match emerging tools with the right scientific questions. Rather than developing quantum technologies as “a hammer looking for a nail,” participants emphasized a focus on exploring the problems these technologies are best suited to address. For example, it is important to consider the size of the phenomenon being studied, the timescales that are important in answering the scientific question, and other relevant considerations. Every tool along the spectrum from classical to quantum involves its own set of trade-offs. For example, Ted Laurence of the Lawrence Livermore National Laboratory said that quantum measurements, such as single photon counting, fluorescence transitions, and lasers, can take longer to produce the same results as classical measurements. These quantum measurements, however, do not require calibration and can enable new research questions to be answered. Prem Kumar, Northwestern University, noted that, despite their promise, quantum approaches should not be used simply for the sake of using quantum, especially in situations where classical approaches better meet the needs of the researcher. Understanding and applying quantum concepts could enable advances in a wide range of application areas including energy, synthetic biology, medicine, and sustainability. For example, Michelle O’Malley, University of California, Santa Barbara, described how improved noninvasive imaging approaches could help capture the complex interactions and functions involved in the breakdown of organic matter by microbial communities and lead to new technologies for capturing valuable products from plant waste. Several other participants discussed needs in tracking the movement of metabolites and molecules in microbial communities for insights into nutrient cycling in environments such as soil. Margaret Ahmad, Sorbonne University, discussed potential opportunities to leverage the magnetic properties of cryptochromes to advance new treatment approaches for diseases such as COVID-19 and cancer. Looking toward the future development of the field, participants discussed challenges to advancing quantum biology that arise from disciplinary disconnects between physicists and biologists. The siloing of academic research disciplines represents a significant barrier to progress. Disconnects in terminology, motivations and priorities, and structural barriers to collaborative work underscore the need for concerted efforts to bridge these divides. Attendees and speakers offered suggestions for resolving these divergences, establishing a shared language, moving the field forward, and fostering meaningful feedback between disciplines. Overall, participants stressed a need for balance, open communication, collaboration, unity, and clear dialogue on trade-offs between quantum and classical approaches. Keiko Torii, The University of Texas at Austin, said that the best collaborations happen when the project provides mutual advantages that can show off everyone’s talents, each team finds the work interesting, and partners develop a camaraderie to pursue new knowledge. To enable near- and long-term opportunities in this space, participants suggested that exploratory, high-risk funding could improve existing instrumentation to explore quantum enhancement collaboratively. They also emphasized the need for collaboration between quantum physicists and sensing/imaging scientists, which could be advanced through a dedicated quantum biology investigator program. People, even more than technology, will be crucial to the future of quantum biology. Participants explored training, education, and workforce needs to further develop this burgeoning field and cultivate the next generation of scientists. While many programs are still in their nascent stages, participants highlighted examples of approaches and programs being developed at various types of institutions to engage students and professional scientists in quantum biology research. Several participants stressed the need for an inclusive approach, spanning disciplines as well as communities to foster a diverse field fueled by the intellectual contributions of a wide range of people, including historically under-resourced schools and students. To increase awareness and excitement about quantum physics and related areas of biology, attendees suggested capitalizing on the “buzz” around quantum. Several participants emphasized the need to start early, introducing students to quantum concepts and their appealing “weirdness” in K–12 education. Engaging students early—before they become entrenched in traditional disciplinary siloes as typically happens in graduate school—could help to galvanize interest in the area and foster a generation of scientists with the interdisciplinary mindset and skills needed to advance this interdisciplinary field. While these efforts could be advanced at many levels and across multiple sectors, several participants suggested a national quantum biology center could be a valuable hub to coordinate and support quantum biology education and workforce development across academia, industry, and government.

59 BASIC BIOLOGICAL SCIENCES↗

Sequential Image Recovery Using Joint Hierarchical Bayesian Learning

Abstract Recovering temporal image sequences (videos) based on indirect, noisy, or incomplete data is an essential yet challenging task. We specifically consider the case where each data set is missing vital information, which prevents the accurate recovery of the individual images. Although some recent (variational) methods have demonstrated high-resolution image recovery based on jointly recovering sequential images, there remain robustness issues due to parameter tuning and restrictions on the type of sequential images. Here, we present a method based on hierarchical Bayesian learning for the joint recovery of sequential images that incorporates prior intra- and inter-image information. Our method restores the missing information in each image by “borrowing” it from the other images. More precisely, we couple sequential images by penalizing their pixel-wise difference. The corresponding penalty terms (one for each pixel and pair of subsequent images) are treated as weakly-informative random variables that favor small pixel-wise differences but allow occasional outliers. As a result, all of the individual reconstructions yield improved accuracy. Our method can be used for various data acquisitions and allows for uncertainty quantification. Some preliminary results indicate its potential use for sequential deblurring and magnetic resonance imaging.

Xiao, Yao↗

Anisotropic neutron response of trans-stilbene and impact on a handheld dual particle imager

Here this manuscript details measurements of the anisotropic light-output response of trans-stilbene, henceforth referred to as stilbene, along the three primary crystal planes and analyzes how this anisotropic response impacts neutron image reconstruction in a handheld dual particle imager (H2DPI). A prototype H2DPI composed of stilbene pillars (6 x 6 x 50 mm 3 ) coupled to silicon photomultipliers was built and is capable of imaging both fast neutrons and gamma rays from kilogram quantities of special nuclear material. Stilbene was chosen as the scintillating medium for the imager because of its pulse shape discrimination capability, time resolution and relatively high light output. A drawback to using stilbene, however, is the anisotropic response. A recoiling proton from a neutron elastic-scattering event in stilbene will yield different amounts of scintillation light depending on the direction of the recoiling proton with respect to the crystal lattice. This manuscript analyzes how this anisotropic response impacts neutron image reconstruction in 4π. The light output in the three primary crystal planes of stilbene were independently measured 6–7 times for proton recoil energies ranging from 0.5–5.0 MeV using a quasi-monoenergetic time-of-flight neutron source. The measured light-output data in the three crystal planes were fit with a semi-empirical function based on Birks’ formula. These fits were used to reconstruct the location of a 252 Cf source in front of the imager (0°, -0.8°), to the left of the imager (-90°, -0.8°) and directly above the imager (0°, 90°) to determine if it is necessary to apply the directionally-dependent response of stilbene to accurately reconstruct source locations. A bootstrapping technique was applied to the measured data sets to produce 1000 images composed of 2000 cone projections for each source location and each measured light-output curve. List-mode maximum likelihood expectation maximization was applied to each image; the highest pixel location and the full width at half maximum (FWHM) were then recorded. The average and standard deviations of these parameters were taken for each set of images. The maximum difference in the average azimuthal pixel location when varying between the appropriate and incorrect light-output curves for the source locations at (0°, -0.8°) and (-90°, -0.8°) were respectively found to be 1.85 ± 1.39° and 2.03 ± 1.78°. All other pixel locations and FWHMs were within a single standard deviation of uncertainty. Taken together, the anisotropic response of stilbene has negligible impact on the neutron image reconstruction capability of the H2DPI.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

A unified large language model–based framework for heterogeneous PV image diagnosis

With advances in imaging technologies, modern photovoltaic (PV) systems generate large volumes of heterogeneous image data, including visible, electroluminescence (EL), and infrared (IR) images. Existing PV image analysis models, particularly deep learning approaches, are typically task-specific and lack cross-modality generalization. To address this limitation, this paper proposes an open-source large language model (LLM)–based unified framework for heterogeneous PV image diagnostics. Through task-aware diagnostic prompting, the framework enables analysis of visible, EL, and IR images within a single pipeline, supporting both zero-shot and few-shot inference and binary and multiclass classification. It is compatible with state-of-the-art multimodal LLMs, including ChatGPT, Gemini, Claude, Qwen, and CLIP. The framework is evaluated on PV module condition classification (clean, soiling, snow, hail, and bird droppings) using visible images, cell crack detection using EL images, and hotspot detection using IR images. GPT-5.1 in few-shot mode achieves the best performance, with classification accuracy exceeding 97.3%. Open-source models such as Qwen and CLIP also deliver competitive results on visible images (around 90% accuracy), though their performance is more limited on EL and IR modalities. On the full ELPV dataset, the framework achieves 83.5% zero-shot accuracy, within 2.8% of the supervised CNN baseline, confirming scalability to larger benchmarks. Practical aspects such as reproducibility, response latency, and confidence estimation are systematically analyzed. The framework operates across PV image modalities without modality- or task-specific training, making it well suited as a rapid pre-screening tool to support downstream detailed diagnostics. A benchmark dataset of diverse labeled PV images is also released.

Li, Baojie↗

Deblurring galaxy images with Tikhonov regularization on magnitude domain

Abstract We propose a regularization-based deblurring method that works efficiently for galaxy images. The spatial resolution of a ground-based telescope is generally limited by seeing conditions and is much worse than space-based telescopes. This circumstance has generated considerable research interest in the restoration of spatial resolution. Since image deblurring is a typical inverse problem and often ill-posed, solutions tend to be unstable. To obtain a stable solution, much research has adopted regularization-based methods for image deblurring, but the regularization term is not necessarily appropriate for galaxy images. Although galaxies have an exponential or Sérsic profile, the conventional regularization assumes the image profiles to behave linearly in space. The significant deviation between the assumption and real situations leads to blurring of the images and smoothing out the detailed structures. Clearly, regularization on logarithmic domain, i.e., magnitude domain, should provide a more appropriate assumption, which we explore in this study. We formulate a problem of deblurring galaxy images by an objective function with a Tikhonov regularization term on a magnitude domain. We introduce an iterative algorithm minimizing the objective function with a primal–dual splitting method. We investigate the feasibility of the proposed method using simulation and observation images. In the simulation, we blur galaxy images with a realistic point spread function and add both Gaussian and Poisson noise. For the evaluation with the observed images, we use galaxy images taken by the Subaru HSC-SSP. Both of these evaluations show that our method successfully recovers the spatial resolution of the deblurred images and significantly outperforms the conventional methods. The code is publicly available from the GitHub 〈https://github.com/kzmurata-astro/PSFdeconv_amag〉.

Murata, Kazumi↗