Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “images”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Computational Imaging for Intelligence in Highly Scattering Aerosols (Final Report)

Natural and man-made degraded visual environments pose major threats to national security. The random scattering and absorption of light by tiny particles suspended in the air reduces situational awareness and causes unacceptable down-time for critical systems and operations. To improve the situation, we have developed several approaches to interpret the information contained within scattered light to enhance sensing and imaging in scattering media. These approaches were tested at the Sandia National Laboratory Fog Chamber facility and with tabletop fog chambers. Computationally efficient light transport models were developed and leveraged for computational sensing. The models are based on a weak angular dependence approximation to the Boltzmann or radiative transfer equation that appears to be applicable in both the moderate and highly scattering regimes. After the new model was experimentally validated, statistical approaches for detection, localization, and imaging of objects hidden in fog were developed and demonstrated. A binary hypothesis test and the Neyman-Pearson lemma provided the highest theoretically possible probability of detection for a specified false alarm rate and signal-to-noise ratio. Maximum likelihood estimation allowed estimation of the fog optical properties as well as the position, size, and reflection coefficient of an object in fog. A computational dehazing approach was implemented to reduce the effects of scatter on images, making object features more readily discernible. We have developed, characterized, and deployed a new Tabletop Fog Chamber capable of repeatably generating multiple unique fog-analogues for optical testing in degraded visual environments. We characterized this chamber using both optical and microphysical techniques. In doing so we have explored the ability of droplet nucleation theory to describe the aerosols generated within the chamber, as well as Mie scattering theory to describe the attenuation of light by said aerosols, and correlated the aerosol microphysics to optical properties such as transmission and meteorological optical range (MOR). This chamber has proved highly valuable and has supported multiple efforts inclusive to and exclusive of this LDRD project to test optics in degraded visual environments. Circularly polarized light has been found to maintain its polarization state better than linearly polarized light when propagating through fog. This was demonstrated experimentally in both the visible and short-wave infrared (SWIR) by imaging targets made of different commercially available retroreflective films. It was found that active circularly polarized imaging can increase contrast and range compared to linearly polarized imaging. We have completed an initial investigation of the capability for machine learning methods to reduce the effects of light scattering when imaging through fog. Previously acquired experimental long-wave images were used to train an autoencoder denoising architecture. Overfitting was found to be a problem because of lack of variability in the object type in this data set. The lessons learned were used to collect a well labeled dataset with much more variability using the Tabletop Fog Chamber that will be available for future studies. We have developed several new sensing methods using speckle intensity correlations. First, the ability to image moving objects in fog was shown, establishing that our unique speckle imaging method can be implemented in dynamic scattering media. Second, the speckle decorrelation over time was found to be sensitive to fog composition, implying extensions to fog characterization. Third, the ability to distinguish macroscopically identical objects on a far-subwavelength scale was demonstrated, suggesting numerous applications ranging from nanoscale defect detection to security. Fourth, we have shown the capability to simultaneously image and localize hidden objects, allowing the speckle imaging method to be effective without prior object positional information. Finally, an interferometric effect was presented that illustrates a new approach for analyzing speckle intensity correlations that may lead to more effective ways to localize and image moving objects. All of these results represent significant developments that challenge the limits of the application of speckle imaging and open important application spaces. A theory was developed and simulations were performed to assess the potential transverse resolution benefit of relative motion in structured illumination for radar systems. Results for a simplified radar system model indicate that significant resolution benefits are possible using data from scanning a structured beam over the target, with the use of appropriate signal processing.

58 GEOSCIENCES↗
DOE OSTI2021

Mimicking of corruption in images

Methods and systems are provided to generate an uncorrupted version of an image given an observed image that is a corrupted version of the image. In some embodiments, a corruption mimicking (“CM”) system iteratively trains a corruption mimicking network (“CMN”) to generate corrupted images given modeled images, updates latent vectors based on differences between the corrupted images and observed images, and applies a generator to the latent vectors to generate modeled images. The training, updating, and applying are performed until modeled images that are input to the CMN result in corrupted images that approximate the observed images. Because the CMN is trained to mimic the corruption of the observed images, the final modeled images represented the uncorrupted version of the observed images.

Anirudh, Rushil↗
DOE OSTI2023

High-throughput terahertz imaging: progress and challenges

Abstract Many exciting terahertz imaging applications, such as non-destructive evaluation, biomedical diagnosis, and security screening, have been historically limited in practical usage due to the raster-scanning requirement of imaging systems, which impose very low imaging speeds. However, recent advancements in terahertz imaging systems have greatly increased the imaging throughput and brought the promising potential of terahertz radiation from research laboratories closer to real-world applications. Here, we review the development of terahertz imaging technologies from both hardware and computational imaging perspectives. We introduce and compare different types of hardware enabling frequency-domain and time-domain imaging using various thermal, photon, and field image sensor arrays. We discuss how different imaging hardware and computational imaging algorithms provide opportunities for capturing time-of-flight, spectroscopic, phase, and intensity image data at high throughputs. Furthermore, the new prospects and challenges for the development of future high-throughput terahertz imaging systems are briefly introduced.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Scaling deep learning for material imaging with a pseudo 3D model for domain transfer

The recent introduction of deep learning methods for image processing has greatly advanced the characterization of materials using three-dimensional (3D) X-ray imaging techniques. However, deep learning models often have difficulty performing consistently across images owing to unavoidable variations in imaging conditions, which create inconsistencies even for the same material. As a result, networks must frequently be retrained for new datasets, limiting their applicability and generalization. Thus, it is critical to reduce the variations between images to enable a single model to process multiple datasets. Herein, we introduce P3T-Net, a pseudo-3D domain transfer network that transfers diverse 3D images into a uniform domain before processing using deep learning models. Remarkably, P3T-Net enables the reuse of previously trained networks for processing new images and considerably reduces the computational cost of transferring 3D images across domains. These unique capabilities were demonstrated in the following scenarios: (i) image enhancement of fast scans for geological rock and hydrogen fuel cells, (ii) enhancement of images to match the quality of multi-source imaging for lithium-ion batteries, (iii) accurate segmentation of images captured under different conditions, and (iv) tera-scale 3D transfer (10 11 voxels) on a single GPU. Overall, the proposed approach addresses cross-domain inconsistencies across various materials and conditions, thereby enabling more robust and generalizable deep learning solutions for a wide range of material imaging tasks.

25 ENERGY STORAGE↗
DOE OSTI2021

Background-free dual-mode optical and 13 C magnetic resonance imaging in diamond particles

Multimodal imaging—the ability to acquire images of an object through more than one imaging mode simultaneously—has opened additional perspectives in areas ranging from astronomy to medicine. In this paper, we report progress toward combining optical and magnetic resonance (MR) imaging in such a “dual” imaging mode. They are attractive in combination because they offer complementary advantages of resolution and speed, especially in the context of imaging in scattering environments. Our approach relies on a specific material platform, microdiamond particles hosting nitrogen vacancy (NV) defect centers that fluoresce brightly under optical excitation and simultaneously “hyperpolarize” lattice C 13 nuclei, making them bright under MR imaging. We highlight advantages of dual-mode optical and MR imaging in allowing background-free particle imaging and describe regimes in which either mode can enhance the other. Leveraging the fact that the two imaging modes proceed in Fourier-reciprocal domains (real and k-space), we propose a sampling protocol that accelerates image reconstruction in sparse-imaging scenarios. Our work suggests interesting possibilities for the simultaneous optical and low-field MR imaging of targeted diamond nanoparticles.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Associated Particle Imaging of Neutron Inelastic Scatter: 3-D Reconstruction, Capabilities, and Challenges

Associated particle imaging (API) offers unique advantages for 3-D imaging of neutron inelastic scatter, including single-view tomographic imaging and data acquisition when access is limited to only one side of the interrogated object. However, widespread adoption of neutron inelastic scatter imaging has been impeded by several inherent challenges, most prominently spatial resolution, self-attenuation, and statistical noise. Here, in this work, the capabilities and challenges of neutron inelastic scatter imaging are investigated. Instead of focusing on a single imaging application, we identify imaging principles that hold for various neutron inelastic scatter imaging techniques. The primary challenges for 3-D imaging are characterized. The inherent spatial resolution in the time-of-flight (TOF) dimension is derived based on the known system timing resolution and scan geometry. Three reconstruction algorithms are described and demonstrated, including the introduction of modern iterative reconstruction incorporating a physics-based system model. Simulation is leveraged to demonstrate imaging capability with varying coincidence count levels and system timing resolution. An example of measured data with both back-scatter and forward-scatter detector positioning is presented. System design characteristics and their effects on image quality are identified. The imaging framework presented in this article has the potential to facilitate growth of 3-D neutron inelastic scatter API by identifying applications that are a good match for the technique and by targeting system development resources toward the requirements of a specific imaging task.

Associated particle imaging (API)↗
DOE OSTI2022

Profile Images and Annotations for Vehicle Re-identification Algorithms (PRIMAVERA)

This dataset contains 636,246 profile images of vehicles representing 13,963 unique vehicles. The data was collected by a set of roadside sensors over the course of three years. Each time a vehicle passed by one of the sensors, a series of images was collected. The images were processed to detect and localize each vehicle, and a license plate reader collocated with the sensor was used to provide a unique ID for the vehicle. Actual license plate numbers have been obfuscated by replacing with an arbitrary numerical ID for each vehicle. After localizing the vehicle in each image, the original RGB image was rotated, scaled, and shifted to produce a new RGB image of size 234x234 pixels such that the outermost two wheels are located at predetermined pixel locations in the image. In this way, all vehicle images are aligned to one another. This registration process occasionally results in a portion of certain vehicles being cutoff at the edges of the image. The dataset has been partitioned into two sets called training and validation. The two partitions no common vehicles, i.e., a vehicle present in one partition is guaranteed not to be present in the other. In this way, an algorithm can be validated against a set of new vehicles that were not seen during the training process. The training set contains 543,926 images from 64,440 vehicle passes representing 11,918 unique vehicles, while the validation set contains 92,320 images from 10,991 vehicle passes representing 2,045 unique vehicles. Vehicle images are organized by directories corresponding to unique vehicles. The file naming scheme is as follows: veh_{vehID}_tr_{passID}_{frameID}_{elevation}_{timeofday}.jpg where {vehID} is the vehicle ID (unique across the entire dataset), {passID} is an identifier for each tracked vehicle pass (unique across the entire dataset), {frameID} is the index of the frame within the given vehicle pass starting at 0, {elevation} is a two-letter string indicating whether the sensor was elevated (el) or at ground-level (gl), and {timeofday} is a two-letter string indicating whether the image was captured during daytime (dt) or nighttime (nt).

image↗
DOE OSTI2024

Quantum ghost imaging microscopy depth-of-field study

Quantum ghost imaging approaches have been proposed to enhance biological microscopy, for example, using 2D visible detectors to provide IR images or providing additional dimensions of spatial or spectral information. Toward the goal of making such imaging schemes practical, we compare image quality and depth-of-field between traditional images and ghost images at the same excitation levels. We measure how image quality and depth-of-field depend on the parameters of the entangled light produced using type-I spontaneous parametric down-conversion (SPDC). We use a pair of time-synchronized, photon-timing single-photon avalanche diode (SPAD) array detectors to capture two distinct microscope imaging paths simultaneously on a photon-pair-by-photon-pair basis: one in a traditional imaging pathway and the other a quantum ghost imaging pathway. We calculate the depth-of-field, resolution, contrast, and signal-to-noise ratio (SNR) through the parameter space of a β-Barium Borate (BBO) type-I bulk non-linear crystal length and angle. Our results provide a basis for choosing parameters for quantum ghost imaging with type-I SPDC sources.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Accurate surface estimation from high-resolution 3D microwave images

Active millimeter and microwave imaging techniques can be used to create a high-resolution 3D image volume of a target’s reflectivity. Millimeter-wave imaging is commonly used for personnel security screening and numerous other applications. Backprojection based image reconstruction techniques form a 3D complex-valued volume. The complex-valued volume is commonly reduced to a real-valued volume by taking the magnitude. For anomaly detection and cross image registration of an object it is beneficial to generate an accurate representation of an object’s surface. Extracting a smooth and accurate surface from a magnitude only image is challenging. One difficulty is the magnitude image has limited resolution in the depth direction which normally limits precision to a moderate fraction of the depth resolution. Another difficulty is that the magnitude of the image depends heavily on the geometry and orientation of the object being imaged. The phase information in a complex-valued image volume provides a means to decouple the magnitude of the image from the geometry of an object and provide precision much finer than the depth resolution would indicate. This enables the generation of a smooth and accurate point cloud representation of the surface of an imaged object. A method to extract a point cloud from the phase information in a 3D complex-valued millimeter-wave image volume is developed and results with simulated and experimental data are presented.

Clark, Richard T.↗
DOE OSTI2023

Ultrasparse View X-ray Computed Tomography for 4D Imaging

X-ray computed tomography (CT) is a noninvasive, nondestructive approach to imaging materials, material systems, and engineered components in two and three dimensions. Acquisition of three-dimensional (3D) images requires the collection of hundreds or thousands of through-thickness X-ray radiographic images from different angles. Such 3D data acquisition strategies commonly involve suboptimal temporal sampling for in situ and operando studies (4D imaging). Herein, we introduce a sparse-view imaging approach, Tomo-NeRF, which is capable of reconstructing high-fidelity 3D images from <10 twodimensional radiographic images. Experimental 2D and 3D X-ray images were used to test the reconstruction capability in two-view, four-view, and six-view scenarios. Tomo-NeRF is capable of reconstructing 3D images with a structural similarity of 0.9971–0.9975 and a voxel-wise accuracy of 81.83–89.59% from 2D experimentally obtained images. Furthermore, the reconstruction accuracy for the experimentally obtained images is less than the synthetic structures. Experimentally obtained images demonstrate a similarity of 0.9973–0.9984 and a voxelwise accuracy of 84.31–95.77%.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Deep-learning-guided high-resolution subsurface reflectivity imaging with application to ground-penetrating radar data

Subsurface reflectivity imaging is one of the most important geophysical characterization methods for revealing subsurface structures. In many cases, accurate subsurface reflectivity imaging is challenging because of, for example, random or coherent noise in the data and sparse source-receiver observation geometry. Here, we develop a deep-learning-guided iterative imaging method to improve subsurface structure imaging. Specifically, we train a supervised neural network to infer a noise-free, high-resolution image from a noisy, low-resolution image and use this estimated image as guidance to regularize least-squares imaging. We develop a systematic method to generate high-quality synthetic training data (data-label pairs) to train the guidance neural network. The trained neural network can provide high-fidelity predictions even for field-data images that are not in the training data. We validate our new imaging method using one synthetic and two field ground-penetrating radar data examples, and find that our method can produce clean, high-resolution subsurface reflectivity images where existing single-pass and least-squares imaging methods fail due to noise and insufficient data coverage.

58 GEOSCIENCES↗
DOE OSTI2021

Do Remote Camera Arrangements and Image Capture Settings Improve Individual Identification of Golden Eagles?

Individual identification of animals from camera traps has become an important task in wildlife research, but camera deployment methods often do not facilitate this important undertaking. Identification of individual golden eagles (Aquila chrysaetos) is possible using uniquely marked rectrices, but no studies have explored methods to maximize the rate of individual identification from camera images. Furthermore, our objectives were to assess whether different camera heights (1 m vs. 3 m), image capture settings (one image after a 1-min delay vs. burst of 5 images after a 30 sec delay), and arrangements relative to bait (dorsally vs. ventrally aimed) affected views of rectrices on golden eagles and our ability to identify individuals. We conducted our study from 15 December 2016 to 3 March 2017 on the Savannah River Site, South Carolina. First, we developed a scoring system based on views of rectrices and used a linear mixed-effects model to compare image scores among different camera arrangements and image settings. Next, after identifying individual eagles, we used generalized linear mixed-effects models to compare total individual eagle detections, total days an individual was detected, and probability of obtaining an unknown individual identification among camera arrangements and settings. Overall, we scored a total of 27,499 images, with 8,083 providing views of marked rectrices that allowed identification of 18 individual eagles. Average image scores and proportion of images suitable for individual identification were higher from elevated (3 m) camera arrangements than standard arrangements (1 m) across sites. Regardless of camera height, faster frequency of image capture provided more images that could be used to identify individuals and the most trap days per individual. Researchers and managers should consider deploying elevated cameras traps with faster frequency of image capture to improve data quality and potential for analysis of golden eagle populations and trends across the species’ range.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2026

Ray-tracing image simulations of transparent objects with complex shape and inhomogeneous refractive index

Optical images of transparent three-dimensional objects can be different from a replica of the object’s cross section in the image plane, due to refraction at the surface or in the body of the object. Simulations of the object’s image are thus needed for the visualization and validation of physical models. We report ray tracing image simulations that achieved high physical fidelity, reproducing optical behaviors and image features not rendered in previous studies. We replicated brightfield microscopy images of drops with complex shapes, and images of pressure and shock waves traveling inside them. For high physical fidelity, the simulations must replicate the spatial and angular distribution of illumination rays, and both the experiment and the simulation must be designed for accurate optical modeling. The simulations are highly sensitive to the properties of the drops and can be used to diagnose and refine fluid dynamics models. The simulated images can also be optimized to extract multiple 3D properties from experimental images. Compared to specialized single-shot 3D imaging methods, this approach has the advantage that it preserves the experimental simplicity, the high resolution, and the visual interpretability characteristic to basic optical imaging. The techniques introduced here are directly applicable to optical microscopy, so they can be used in other fields, such as microfluidics and biology, to expand the type and the accuracy of three-dimensional information that can be extracted from basic optical images.

Cavitation↗
DOE OSTI2020

Deep machine learning-assisted multiphoton microscopy to reduce light exposure and expedite imaging

Two-photon excitation fluorescence (2PEF) allows imaging of tissue up to about one millimeter in thickness. Typically, reducing fluorescence excitation exposure reduces the quality of the image. However, using deep learning super resolution techniques, these low-resolution images can be converted to high-resolution images. This work explores improving human tissue imaging by applying deep learning to maximize image quality while reducing fluorescence excitation exposure. We analyze two methods: a method based on U-Net, and a patch-based regression method. Both methods are evaluated on a skin dataset and an eye dataset. The eye dataset includes 1200 paired high power and low power images of retinal organoids. The skin dataset contains multiple frames of each sample of human skin. High-resolution images were formed by averaging 70 frames for each sample and low-resolution images were formed by averaging the first 7 and 15 frames for each sample. The skin dataset includes 550 images for each of the resolution levels. We track two measures of performance for the two methods: mean squared error (MSE) and structural similarity index measure (SSIM). For the eye dataset, the patches method achieves an average MSE of 27,611 compared to 146,855 for the U-Net method, and an average SSIM of 0.636 compared to 0.607 for the U-Net method. For the skin dataset, the patches method achieves an average MSE of 3.768 compared to 4.032 for the U-Net method, and an average SSIM of 0.824 compared to 0.783 for the U-Net method. Despite better performance on image quality, the patches method is worse than the U-Net method when comparing the speed of prediction, taking 303 seconds to predict one image compared to less than one second for the U-Net method.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2021

Neutron Transmission Imaging with a Portable D-T Neutron Generator

Fast-neutron transmission imaging provides complementary information to x-ray transmission imaging. While fast neutron imaging resolution is generally below x-ray imaging, 14-MeV neutrons have an advantage over portable x-ray systems. Neutrons have higher transmission through high-Z materials due to a more uniform attenuation as a function of material atomic number Z compared to X-rays, and can therefore image low-Z materials inside high-Z materials. As a result, portable neutron transmission imaging has many applications, including inspection of concrete and welds for corrosion in vehicles, bridges, and other infrastructure, measurement of material levels in containers, and inspection of suspicious packages. Fast-neutron imaging is also more practical for field use than thermal-neutron imaging due to the size and shielding requirements typical of thermal-imaging systems compared to the availability of small 14.1 MeV D-T neutron generators. However, there are limitations in portable fast-neutron imaging systems, including limited neutron output, limited light produced by neutron scintillators, and lower resolution due to neutron source spot size and 2-3 mm scintillator thickness. In addition, digital-panel dark-noise is roughly 100x higher than neutron scintillator light, and variations in noise across the panel and in time is comparable to the imaging signal. Here we discuss recent efforts in developing a portable fast-neutron radiography system, including an improved neutron scintillator, mitigation of panel noise, and new commercial portable D-T neutron generators. We also present MCNP efforts to model neutron imaging, including scintillator resolution and the effects of neutron scattering from the object and surrounding materials.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Bayesian Spatially Varying Multi-Regularization Image Deblurring

Many scientific experiments such as those found in astronomy, geology, microbiology, and X-ray radiography require the use of high-energy instruments to capture images. Since blur and noise are inevitably present in any imaging system, the images must be \deblurred" to extract the full information content. Mathematically, image deblurring is an ill-posed inverse problem that requires regularization. The regularization, in turn, has a large effect on the deblurred image: different regularization strengths, and types, lead to drastically different reconstructions. Moreover, many images contain a mixture of smooth and sharp features which suggests the use of multi-regularization, i.e., varying the type of regularization (e.g. Tikhonov or total variation) across the image. We address these issues by formulating the image deblurring problem within a hierarchical Bayesian framework in which we spatially adapt the strength of the regularization and also vary the regularization type across the image. In this way, the image itself, along with corresponding regularization strength at each pixel, are described jointly by a posterior distribution which we can sample by Markov chain Monte Carlo (MCMC) methods. We illustrate our techniques on simplified test problems and apply them to high-energy X-ray images taken at the Nevada National Security Site. Numerical tests show that our new method is robustly applicable and increases the quality of the image reconstruction when compared to other (Bayesian) methods.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

The Role of Quantum Science Concepts in Enhancing Sensing and Imaging Technologies: Applications for Biology: Proceedings of a Workshop

Quantum concepts hold the potential to enable significant advances in sensing and imaging technologies that could be vital to the study of biological systems. The workshop Quantum Science Concepts in Enhancing Sensing and Imaging Technologies: Applications for Biology, held online March 8–10, 2021, was organized to examine the research and development needs to advance biological applications of quantum technology. Hosted by the National Academies of Sciences, Engineering, and Medicine, the event brought together experts working on state-of-the-art, quantum-enabled technologies and scientists who are interested in applying these technologies to biological systems. Through talks, panels, and discussions, the workshop facilitated a better understanding of the current and future biological applications of quantum-enabled technologies in fields such as microbiology, molecular biology, cell biology, plant science, mycology, and many others. The workshop was organized around three main themes. The first, quantum in biology, examined quantum concepts that are hypothesized to be important for life processes and that researchers are working to observe through biological imaging and sensing. The second, quantum for biology, addressed ways to use quantum concepts to enhance technologies for biological imaging and sensing. The third, biology for quantum, offered a wider discussion of how the frontiers of biological imaging and sensing could enable future study using quantum concepts, tools, or technologies. Throughout the workshop, participants identified a wide range of emerging approaches and opportunities at the intersection of quantum physics and biological sensing and imaging. During the workshop, there were some differences in how each speaker defined the term quantum. During one of the panels, Prem Kumar offered thoughts on what phenomena are classical versus quantum, explaining that techniques get progressively more quantum as you move from just having superposition to having superposition with measurement and entanglement. Another explanation from Clarice Aiello delineates the definition into several levels. This includes a base level of “quantum-ness,” which reflects that all matter is made of atoms, and when these particles are isolated they behave based on quantum mechanical principles. A second level is related to quantum coherence, where a single quantum object might be found in a coherent superposition state. A final level, which she described as the quantum-entangled level, involves multiple quantum systems which are entangled among themselves. Overall, the workshop touched on concepts such as superposition, entanglement, and squeezing and their potential implications for communication, computing, and simulation, in addition to the workshop’s main focal area, biological sensing and imaging. At the opening of the workshop, Thorsten Ritz of the University of California, Irvine, identified two questions at the heart of quantum biology: Is the machinery of life quantum mechanical, and can quantum mechanics be used to study the machinery of life in new ways? Participants highlighted systems in which researchers have explored these questions, from the vast array of molecular interactions involved in biological processes such as photosynthesis, to the mechanics involved in cellular functions such as differentiation and aggregation, to the role of oscillating magnetic fields in flight orientation among birds. Sensing and imaging technologies are crucial to biological research; these technologies could both enhance the study of quantum effects and be enhanced by quantum concepts. A critical challenge in biological research is to develop imaging and sensing tools that do not damage or interfere with the often fragile and fleeting systems being studied. Attendees discussed a variety of established and emerging technologies that could enhance noninvasive biological imaging, including single- and two-photon spectroscopy, single-molecule spectroscopy, quantum illumination, ghost imaging, and cryo-electron microscopy. One example came from Marlan Scully who gave a keynote address on the first day of the workshop. Scully emphasized the use of different laser technologies, which exhibit coherence and other quantum properties, in moving toward real-world biological applications, such as the detection of SARS-CoV-2. Both tools and theory will play an important role in advancing quantum biology research and applications. Several participants suggested theorists and experimentalists should work in tandem to understand and model biological processes. While physics often reduces systems to their simplest forms for fundamental insights, participants also noted the value of observing and understanding biological systems in all their “messiness,” capturing both the inner workings of biological systems and the complex interactions that occur within and between organisms. In discussions among participants, several attendees stressed the need to match emerging tools with the right scientific questions. Rather than developing quantum technologies as “a hammer looking for a nail,” participants emphasized a focus on exploring the problems these technologies are best suited to address. For example, it is important to consider the size of the phenomenon being studied, the timescales that are important in answering the scientific question, and other relevant considerations. Every tool along the spectrum from classical to quantum involves its own set of trade-offs. For example, Ted Laurence of the Lawrence Livermore National Laboratory said that quantum measurements, such as single photon counting, fluorescence transitions, and lasers, can take longer to produce the same results as classical measurements. These quantum measurements, however, do not require calibration and can enable new research questions to be answered. Prem Kumar, Northwestern University, noted that, despite their promise, quantum approaches should not be used simply for the sake of using quantum, especially in situations where classical approaches better meet the needs of the researcher. Understanding and applying quantum concepts could enable advances in a wide range of application areas including energy, synthetic biology, medicine, and sustainability. For example, Michelle O’Malley, University of California, Santa Barbara, described how improved noninvasive imaging approaches could help capture the complex interactions and functions involved in the breakdown of organic matter by microbial communities and lead to new technologies for capturing valuable products from plant waste. Several other participants discussed needs in tracking the movement of metabolites and molecules in microbial communities for insights into nutrient cycling in environments such as soil. Margaret Ahmad, Sorbonne University, discussed potential opportunities to leverage the magnetic properties of cryptochromes to advance new treatment approaches for diseases such as COVID-19 and cancer. Looking toward the future development of the field, participants discussed challenges to advancing quantum biology that arise from disciplinary disconnects between physicists and biologists. The siloing of academic research disciplines represents a significant barrier to progress. Disconnects in terminology, motivations and priorities, and structural barriers to collaborative work underscore the need for concerted efforts to bridge these divides. Attendees and speakers offered suggestions for resolving these divergences, establishing a shared language, moving the field forward, and fostering meaningful feedback between disciplines. Overall, participants stressed a need for balance, open communication, collaboration, unity, and clear dialogue on trade-offs between quantum and classical approaches. Keiko Torii, The University of Texas at Austin, said that the best collaborations happen when the project provides mutual advantages that can show off everyone’s talents, each team finds the work interesting, and partners develop a camaraderie to pursue new knowledge. To enable near- and long-term opportunities in this space, participants suggested that exploratory, high-risk funding could improve existing instrumentation to explore quantum enhancement collaboratively. They also emphasized the need for collaboration between quantum physicists and sensing/imaging scientists, which could be advanced through a dedicated quantum biology investigator program. People, even more than technology, will be crucial to the future of quantum biology. Participants explored training, education, and workforce needs to further develop this burgeoning field and cultivate the next generation of scientists. While many programs are still in their nascent stages, participants highlighted examples of approaches and programs being developed at various types of institutions to engage students and professional scientists in quantum biology research. Several participants stressed the need for an inclusive approach, spanning disciplines as well as communities to foster a diverse field fueled by the intellectual contributions of a wide range of people, including historically under-resourced schools and students. To increase awareness and excitement about quantum physics and related areas of biology, attendees suggested capitalizing on the “buzz” around quantum. Several participants emphasized the need to start early, introducing students to quantum concepts and their appealing “weirdness” in K–12 education. Engaging students early—before they become entrenched in traditional disciplinary siloes as typically happens in graduate school—could help to galvanize interest in the area and foster a generation of scientists with the interdisciplinary mindset and skills needed to advance this interdisciplinary field. While these efforts could be advanced at many levels and across multiple sectors, several participants suggested a national quantum biology center could be a valuable hub to coordinate and support quantum biology education and workforce development across academia, industry, and government.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Sequential Image Recovery Using Joint Hierarchical Bayesian Learning

Abstract Recovering temporal image sequences (videos) based on indirect, noisy, or incomplete data is an essential yet challenging task. We specifically consider the case where each data set is missing vital information, which prevents the accurate recovery of the individual images. Although some recent (variational) methods have demonstrated high-resolution image recovery based on jointly recovering sequential images, there remain robustness issues due to parameter tuning and restrictions on the type of sequential images. Here, we present a method based on hierarchical Bayesian learning for the joint recovery of sequential images that incorporates prior intra- and inter-image information. Our method restores the missing information in each image by “borrowing” it from the other images. More precisely, we couple sequential images by penalizing their pixel-wise difference. The corresponding penalty terms (one for each pixel and pair of subsequent images) are treated as weakly-informative random variables that favor small pixel-wise differences but allow occasional outliers. As a result, all of the individual reconstructions yield improved accuracy. Our method can be used for various data acquisitions and allows for uncertainty quantification. Some preliminary results indicate its potential use for sequential deblurring and magnetic resonance imaging.

Xiao, Yao↗