Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “imaging and sensing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

All-optical image denoising using a diffractive visual processor

Abstract Image denoising, one of the essential inverse problems, targets to remove noise/artifacts from input images. In general, digital image denoising algorithms, executed on computers, present latency due to several iterations implemented in, e.g., graphics processing units (GPUs). While deep learning-enabled methods can operate non-iteratively, they also introduce latency and impose a significant computational burden, leading to increased power consumption. Here, we introduce an analog diffractive image denoiser to all-optically and non-iteratively clean various forms of noise and artifacts from input images – implemented at the speed of light propagation within a thin diffractive visual processor that axially spans <250 × λ, where λ is the wavelength of light. This all-optical image denoiser comprises passive transmissive layers optimized using deep learning to physically scatter the optical modes that represent various noise features, causing them to miss the output image Field-of-View (FoV) while retaining the object features of interest. Our results show that these diffractive denoisers can efficiently remove salt and pepper noise and image rendering-related spatial artifacts from input phase or intensity images while achieving an output power efficiency of ~30–40%. We experimentally demonstrated the effectiveness of this analog denoiser architecture using a 3D-printed diffractive visual processor operating at the terahertz spectrum. Owing to their speed, power-efficiency, and minimal computational overhead, all-optical diffractive denoisers can be transformative for various image display and projection systems, including, e.g., holographic displays.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Nonlinear encoding in diffractive information processing using linear optical materials

Nonlinear encoding of optical information can be achieved using various forms of data representation. Here, we analyze the performances of different nonlinear information encoding strategies that can be employed in diffractive optical processors based on linear materials and shed light on their utility and performance gaps compared to the state-of-the-art digital deep neural networks. For a comprehensive evaluation, we used different datasets to compare the statistical inference performance of simpler-to-implement nonlinear encoding strategies that involve, e.g., phase encoding, against data repetition-based nonlinear encoding strategies. We show that data repetition within a diffractive volume (e.g., through an optical cavity or cascaded introduction of the input data) causes the loss of the universal linear transformation capability of a diffractive optical processor. Therefore, data repetition-based diffractive blocks cannot provide optical analogs to fully connected or convolutional layers commonly employed in digital neural networks. However, they can still be effectively trained for specific inference tasks and achieve enhanced accuracy, benefiting from the nonlinear encoding of the input information. Our results also reveal that phase encoding of input information without data repetition provides a simpler nonlinear encoding strategy with comparable statistical inference accuracy to data repetition-based diffractive processors. Our analyses and conclusions would be of broad interest to explore the push-pull relationship between linear material-based diffractive optical systems and nonlinear encoding strategies in visual information processors.

42 ENGINEERING↗
DOE OSTI2026

Detection and imaging of chemicals and hidden explosives using terahertz time-domain spectroscopy and deep learning

Detecting concealed chemicals and explosives remains a critical challenge in global security. Terahertz time-domain spectroscopy (THz-TDS) offers a promising non-invasive and stand-off detection technique owing to its ability to penetrate optically opaque materials without causing ionization damage. While many chemicals exhibit distinct spectral features in the terahertz range, conventional terahertz-based detection methods often struggle in real-world environments, where variations in sample geometry, thickness, and packaging can lead to inconsistent spectral responses. In this study, we present a chemical imaging system that integrates THz-TDS with deep learning to enable accurate pixel-level identification and classification of different explosives. Operating in reflection mode and enhanced with plasmonic nanoantenna arrays, our THz-TDS system achieves a peak dynamic range of 96 dB and a detection bandwidth of 4.5 THz, supporting practical, stand-off operation. By analyzing individual time-domain pulses with deep neural networks, the system exhibits strong resilience to environmental variations and sample inconsistencies. Blind testing across eight chemicals—including pharmaceutical excipients and explosive compounds—resulted in an average classification accuracy of 99.42% at the pixel level. Notably, the system maintained an average accuracy of 88.83% when detecting explosives concealed under opaque paper coverings, demonstrating its robust generalization capability. These results highlight the potential of combining advanced terahertz spectroscopy with neural networks for highly sensitive and specific chemical and explosive detection in diverse and operationally relevant scenarios.

Imaging and sensing↗
DOE OSTI2020

Imaging grain microstructure in a model ceramic energy material with optically generated coherent acoustic phonons

Characterization of microstructure, chemistry and function of advanced energy materials remains a challenge for instrumentation science with tremendous opportunity for new discoveries. This active area of research is starting to make considerable strides with examples ranging from methodologies that employ bright X-rays, electron microscopy and optical spectroscopy. However, further development of instruments, capable of multimodal measurements, is necessary to fully reveal complex microstructure evolution in realistic environments and dynamical systems that are far from equilibrium. In this regard, laser-based instruments have a unique advantage as multiple measurement methodologies are easily combined into a single instrument using standard optics. A new pump-probe method that uses optically generated acoustic phonons is expanding standard optical characterization by providing depth resolved information. Here we report on a noteworthy extension of this pump-probe method to image grain microstructure in ceria. Rich information regarding the orientation of individual crystallites is obtained by monitoring acoustic phonon velocities and noting how the polarization of the probe beam influences the detected signal amplitude. When paired with other optical microscopies, this methodology will provide new perspectives for optical characterization of ceramic materials.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Frequency comb ptychoscopy

Multiheterodyne techniques using frequency combs—radiation sources whose lines are perfectly evenly-spaced—have revolutionized science. By beating sources with the many lines of a comb, their spectra are recovered. Even so, these approaches are fundamentally limited to probing coherent sources, such as lasers. They are unable to measure most spectra that occur in nature. Here we present frequency comb ptychoscopy, a technique that allows for the spectrum of any complex broadband source to be retrieved using a comb. In this approach, the spectrum is reconstructed by unfolding the simultaneous beating of a source with each comb line. We demonstrate this both theoretically and experimentally, at microwave frequencies. This approach can reconstruct the spectrum of nearly any complex source to high resolution, and the speed, resolution, and generality of this technique will allow chip-scale frequency combs to have an impact in a wide swath of new applications, such as remote sensing and passive spectral imaging.

42 ENGINEERING↗
DOE OSTI2021

Determination of X-ray detection limit and applications in perovskite X-ray detectors

X-ray detection limit and sensitivity are important figure of merits for perovskite X-ray detectors, but literatures lack a valid mathematic expression for determining the lower limit of detection for a perovskite X-ray detector. In this work, we present a thorough analysis and new method for X-ray detection limit determination based on a statistical model that correlates the dark current and the X-ray induced photocurrent with the detection limit. The detection limit can be calculated through the measurement of dark current and sensitivity with an easy-to-follow practice. Alternatively, the detection limit may also be obtained by the measurement of dark current and photocurrent when repeatedly lowering the X-ray dose rate. While the material quality is critical, we show that the device architecture and working mode also have a significant influence on the sensitivity and the detection limit. Our work establishes a fair comparison metrics for material and detector development.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Dynamic-quenching of a single-photon avalanche photodetector using an adaptive resistive switch

One of the most common approaches for quenching single-photon avalanche diodes is to use a passive resistor in series with it. A drawback of this approach has been the limited recovery speed of the single-photon avalanche diodes. High resistance is needed to quench the avalanche, leading to slower recharging of the single-photon avalanche diodes depletion capacitor. We address this issue by replacing a fixed quenching resistor with a bias-dependent adaptive resistive switch. Reversible generation of metallic conduction enables switching between low and high resistance states under unipolar bias. As an example, using a Pt/Al 2 O 3 /Ag resistor with a commercial silicon single-photon avalanche diodes, we demonstrate avalanche pulse widths as small as ~30 ns, 10× smaller than a passively quenched approach, thus significantly improving the single-photon avalanche diodes frequency response. The experimental results are consistent with a model where the adaptive resistor dynamically changes its resistance during discharging and recharging the single-photon avalanche diodes.

42 ENGINEERING↗
DOE OSTI2023

Learning diffractive optical communication around arbitrary opaque occlusions

Abstract Free-space optical communication becomes challenging when an occlusion blocks the light path. Here, we demonstrate a direct communication scheme, passing optical information around a fully opaque, arbitrarily shaped occlusion that partially or entirely occludes the transmitter’s field-of-view. In this scheme, an electronic neural network encoder and a passive, all-optical diffractive network-based decoder are jointly trained using deep learning to transfer the optical information of interest around the opaque occlusion of an arbitrary shape. Following its training, the encoder-decoder pair can communicate any arbitrary optical information around opaque occlusions, where the information decoding occurs at the speed of light propagation through passive light-matter interactions, with resilience against various unknown changes in the occlusion shape and size. We also validate this framework experimentally in the terahertz spectrum using a 3D-printed diffractive decoder. Scalable for operation in any wavelength regime, this scheme could be particularly useful in emerging high data-rate free-space communication systems.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Integrated photonic encoder for low power and high-speed image processing

Abstract Modern lens designs are capable of resolving greater than 10 gigapixels, while advances in camera frame-rate and hyperspectral imaging have made data acquisition rates of Terapixel/second a real possibility. The main bottlenecks preventing such high data-rate systems are power consumption and data storage. In this work, we show that analog photonic encoders could address this challenge, enabling high-speed image compression using orders-of-magnitude lower power than digital electronics. Our approach relies on a silicon-photonics front-end to compress raw image data, foregoing energy-intensive image conditioning and reducing data storage requirements. The compression scheme uses a passive disordered photonic structure to perform kernel-type random projections of the raw image data with minimal power consumption and low latency. A back-end neural network can then reconstruct the original images with structural similarity exceeding 90%. This scheme has the potential to process data streams exceeding Terapixel/second using less than 100 fJ/pixel, providing a path to ultra-high-resolution data and image acquisition systems.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

All-optical phase conjugation using diffractive wavefront processing

Abstract Optical phase conjugation (OPC) is a nonlinear technique used for counteracting wavefront distortions, with applications ranging from imaging to beam focusing. Here, we present a diffractive wavefront processor to approximate all-optical phase conjugation. Leveraging deep learning, a set of diffractive layers was optimized to all-optically process an arbitrary phase-aberrated input field, producing an output field with a phase distribution that is the conjugate of the input wave. We experimentally validated this wavefront processor by 3D-fabricating diffractive layers and performing OPC on phase distortions never seen during training. Employing terahertz radiation, our diffractive processor successfully performed OPC through a shallow volume that axially spans tens of wavelengths. We also created a diffractive phase-conjugate mirror by combining deep learning-optimized diffractive layers with a standard mirror. Given its compact, passive and multi-wavelength nature, this diffractive wavefront processor can be used for various applications, e.g., turbidity suppression and aberration correction across different spectral bands.

42 ENGINEERING↗
DOE OSTI2025

Imaging solvated oxygen atoms with a femtosecond laser

As a powerful oxidant, atomic oxygen (O) holds considerable promise for a variety of biomedical and industrial applications. However, the inability to quantify solvated oxygen atoms has prevented the determination of the fundamental parameters governing its behaviour in relevant aqueous environments. Here, we directly image ground-state oxygen atoms in water using femtosecond two-photon absorption laser-induced fluorescence. Measurements show that oxygen atoms persist for tens of microseconds in water, penetrating hundreds of micrometres into the liquid. This observed longevity has significant implications, suggesting a need to re-evaluate existing models of solvated atomic oxygen reactivity and transport. Beyond atomic oxygen, this technique is broadly applicable to other solvated atomic species of interest, including nitrogen (N) and hydrogen (H). This work establishes that radical atomic species can be quantified in liquid with ultrafast laser spectroscopy, providing the basis for the determination of key properties including reaction rates, chemical lifetimes, and Henry’s law constants.

Fluorescence spectroscopy↗
DOE OSTI2020

Three-state nematicity in the triangular lattice antiferromagnet Fe 1/3 NbS 2

Nematic order is the breaking of rotational symmetry in the presence of translational invariance. While originally defined in the context of liquid crystals, the concept of nematic order has arisen in crystalline matter with discrete rotational symmetry, most prominently in the tetragonal Fe-based superconductors where the parent state is four-fold symmetric. In this case the nematic director takes on only two directions, and the order parameter in such 'Ising-nematic' systems is a simple scalar. In this study, using a spatially resolved optical polarimetry technique, we show that a qualitatively distinct nematic state arises in the triangular lattice antiferromagnet Fe 1/3 NbS 2 . The crucial difference is that the nematic order on the triangular lattice is a Z 3 or three-state Potts-nematic order parameter. As a consequence, the anisotropy axes of response functions such as the resistivity tensor can be continuously reoriented by external perturbations. This discovery lays the groundwork for devices that exploit analogies with nematic liquid crystals.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Diffraction data from aerosolized Coliphage PR772 virus particles imaged with the Linac Coherent Light Source

Single Particle Imaging (SPI) with intense coherent X-ray pulses from X-ray free-electron lasers (XFELs) has the potential to produce molecular structures without the need for crystallization or freezing. Here we present a dataset of 285,944 diffraction patterns from aerosolized Coliphage PR772 virus particles injected into the femtosecond X-ray pulses of the Linac Coherent Light Source (LCLS). Additional exposures with background information are also deposited. The diffraction data were collected at the Atomic, Molecular and Optical Science Instrument (AMO) of the LCLS in 4 experimental beam times during a period of four years. The photon energy was either 1.2 or 1.7 keV and the pulse energy was between 2 and 4 mJ in a focal spot of about 1.3 μm x 1.7 μm full width at half maximum (FWHM). The X-ray laser pulses captured the particles in random orientations. The data offer insight into aerosolised virus particles in the gas phase, contain information relevant to improving experimental parameters, and provide a basis for developing algorithms for image analysis and reconstruction.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Mapping of inhomogeneous quasi-3D electrostatic field in electro-optic materials

Abstract This paper describes a new method for direct measurement and evaluation of the inhomogeneous electrostatic vector field with translational symmetry in electro-optic materials exhibiting the Pockels effect. It is based on the evaluation of maximum transmittance of low intensity light passing through a sample under a voltage bias. Here, the sample is located between rotating crossed polarizers, and camera images are obtained at each point to determine the electric field. The evaluation procedure is demonstrated using data acquired on a CdZnTeSe quasi-hemispheric semiconductor gamma-ray detector. In addition to CdTe-related compounds, the method can be used for various other materials showing $$\overline{4}3m$$ 4 ¯ 3 m symmetry such as GaAs, CdTe, GaP, 3C-SiC, and ZnS. Furthermore, it can be generalized to other crystalline materials showing the Pockels effect. The method can be used to probe the space charge and the electric field in several kinds of electronic components and devices, as well as provide useful data on the role of defects, contact configurations and other surface and bulk inhomogeneities in the material that can affect the distribution of the internal electric field.

36 MATERIALS SCIENCE↗
DOE OSTI2021

A gain series method for accurate EMCCD calibration

Abstract Calibration of the gain and digital conversion factor of an EMCCD is necessary for accurate photon counting. We present a new method to quickly calibrate multiple gain settings of an EMCCD camera. Acquiring gain-series calibration data and analyzing the resulting images with the EMCCD noise model more accurately estimates the gain response of the camera. Furthermore, we develop a method to compare the results from different calibration approaches. Gain-series calibration outperforms all other methods in this self-consistency test.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Multicolor multifocal 3D microscopy using in-situ optimization of a spatial light modulator

Abstract Multifocal microscopy enables high-speed three-dimensional (3D) volume imaging by using a multifocal grating in the emission path. This grating is typically designed to afford a uniform illumination of multifocal subimages for a single emission wavelength. Using the same grating for multicolor imaging results in non-uniform subimage intensities in emission wavelengths for which the grating is not designed. This has restricted multifocal microscopy applications for samples having multicolored fluorophores. In this paper, we present a multicolor multifocal microscope implementation which uses a Spatial Light Modulator (SLM) as a single multifocal grating to realize near-uniform multifocal subimage intensities across multiple wavelength emission bands. Using real-time control of an in-situ-optimized SLM implemented as a multifocal grating, we demonstrate multicolor multifocal 3D imaging over three emission bands by imaging multicolored particles as well as Escherichia coli ( E. coli ) interacting with human liver cancer cells, at $$\sim 2.5$$ ∼ 2.5 multicolor 3D volumes per second acquisition speed. Our multicolor multifocal method is adaptable across SLM hardware, emission wavelength band locations and number of emission bands, making it particularly suited for researchers investigating fast processes occurring across a volume where multiple species are involved.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Coupling a recurrent neural network to SPAD TCSPC systems for real-time fluorescence lifetime imaging

Fluorescence lifetime imaging (FLI) has been receiving increased attention in recent years as a powerful diagnostic technique in biological and medical research. However, existing FLI systems often suffer from a tradeoff between processing speed, accuracy, and robustness. Inspired by the concept of Edge Artificial Intelligence (Edge AI), we propose a robust approach that enables fast FLI with no degradation of accuracy. This approach couples a recurrent neural network (RNN), which is trained to estimate the fluorescence lifetime directly from raw timestamps without building histograms, to SPAD TCSPC systems, thereby drastically reducing transfer data volumes and hardware resource utilization, and enabling real-time FLI acquisition. We train two variants of the RNN on a synthetic dataset and compare the results to those obtained using center-of-mass method (CMM) and least squares fitting (LS fitting). Results demonstrate that two RNN variants, gated recurrent unit (GRU) and long short-term memory (LSTM), are comparable to CMM and LS fitting in terms of accuracy, while outperforming them in the presence of background noise by a large margin. To explore the ultimate limits of the approach, we derive the Cramer-Rao lower bound of the measurement, showing that RNN yields lifetime estimations with near-optimal precision. To demonstrate real-time operation, we build a FLI microscope based on an existing SPAD TCSPC system comprising a 32 x 32 SPAD sensor named Piccolo. Four quantized GRU cores, capable of processing up to 4 million photons per second, are deployed on the Xilinx Kintex-7 FPGA that controls the Piccolo. Powered by the GRU, the FLI setup can retrieve real-time fluorescence lifetime images at up to 10 frames per second. The proposed FLI system is promising and ideally suited for biomedical applications, including biological imaging, biomedical diagnostics, and fluorescence-assisted surgery, etc.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Quantitative phase imaging by gradient retardance optical microscopy

Abstract Quantitative phase imaging (QPI) has become a vital tool in bioimaging, offering precise measurements of wavefront distortion and, thus, of key cellular metabolism metrics, such as dry mass and density. However, only a few QPI applications have been demonstrated in optically thick specimens, where scattering increases background and reduces contrast. Building upon the concept of structured illumination interferometry, we introduce Gradient Retardance Optical Microscopy (GROM) for QPI of both thin and thick samples. GROM transforms any standard Differential Interference Contrast (DIC) microscope into a QPI platform by incorporating a liquid crystal retarder into the illumination path, enabling independent phase-shifting of the DIC microscope's sheared beams. GROM greatly simplifies related configurations, reduces costs, and eradicates energy losses in parallel imaging modalities, such as fluorescence. We successfully tested GROM on a diverse range of specimens, from microbes and red blood cells to optically thick (~ 300 μm) plant roots without fixation or clearing.

47 OTHER INSTRUMENTATION↗