Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “image sensor”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

High-throughput terahertz imaging: progress and challenges

Abstract Many exciting terahertz imaging applications, such as non-destructive evaluation, biomedical diagnosis, and security screening, have been historically limited in practical usage due to the raster-scanning requirement of imaging systems, which impose very low imaging speeds. However, recent advancements in terahertz imaging systems have greatly increased the imaging throughput and brought the promising potential of terahertz radiation from research laboratories closer to real-world applications. Here, we review the development of terahertz imaging technologies from both hardware and computational imaging perspectives. We introduce and compare different types of hardware enabling frequency-domain and time-domain imaging using various thermal, photon, and field image sensor arrays. We discuss how different imaging hardware and computational imaging algorithms provide opportunities for capturing time-of-flight, spectroscopic, phase, and intensity image data at high throughputs. Furthermore, the new prospects and challenges for the development of future high-throughput terahertz imaging systems are briefly introduced.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Anti-distortion bioinspired camera with an inhomogeneous photo-pixel array

The bioinspired camera, comprising a single lens and a curved image sensor—a photodiode array on a curved surface—, was born of flexible electronics. Its economical build lends itself well to space-constrained machine vision applications. The curved sensor, much akin to the retina, helps image focusing, but the curvature also creates a problem of image distortion, which can undermine machine vision tasks such as object recognition. Here we report an anti-distortion single-lens camera, where 4096 silicon photodiodes arrayed on a curved surface in a nonuniform pattern assimilated to the distorting optics are the key to anti-distortion engineering. That is, the photo-pixel distribution pattern itself is warped in the same manner as images are warped, which correctively reverses distortion. Acquired images feature no appreciable distortion across a 120° horizontal view, as confirmed by their neural-network recognition accuracies. This distortion correction via photo-pixel array reconfiguration is a form of in-sensor computing.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2022

Design of the high-yield time-gated x-ray hot-spot imager for OMEGA

Time-resolved x-ray self-emission imaging of hot spots in inertial confinement fusion experiments along several lines of sight provides critical information on the pressure and the transient morphology of the hot spot on the University of Rochester’s OMEGA Laser System. At least three quasi-orthogonal lines of sight are required to infer the tomographic information of the hot spots of deuterium–tritium cryogenic layered implosions. OMEGA currently has two time-gated x-ray hot-spot imagers: the time-resolved Kirkpatrick–Baez x-ray microscope and the single-line-of-sight, time-resolved x-ray imager (SLOS-TRXI). The time-gated x-ray hot-spot imager (XRHSI) is being developed for use on OMEGA as the third line of sight for the high-yield operation of up to 4 × 10 14 neutrons. XRHSI follows the SLOS-TRXI concept; however, it will have improved spatial and temporal resolutions of 5 μm and 20 ps, respectively. The simultaneous operation of the three instruments will provide 3-D reconstructions of the assembled hot-spot fuel at various times through peak thermonuclear output. The technical approach consists of a pinhole array imager and demagnifying time-dilation drift tube that are coupled to two side-by-side hybrid complementary metal–oxide semiconductor (hCMOS) image sensors. To minimize the background and to harden the diagnostics, an angled drift-tube assembly shifting the hCMOS sensors out of the direct line of sight and neutron shielding will be applied. As a result, the technical design space for the instrument will be discussed and the conceptual design will be presented.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Light-powered end-to-end neutron detection and imaging with an edge-deployed optical AI chip

Neutron detection is widely used in many applications including nuclear physics, nuclear energy, nuclear technologies and nuclear safeguards. Developing an end-to-end neutron detection and imaging workflow paves way towards fully automated processes for many applications. We implemented an automated workflow for neutron detection experiments which use a solid state image sensor to capture neutron hits as a digital image. We deploy the workflow to an edge-based optical neural network (ONN) to increase the radiation-hardness and lifetime of neutron detection instruments. We present a two-stage neural network framework for detection of neutrons at sub-pixel resolution. The first stage uses a region proposal network to efficiently detect and extract neutron hits from the input camera image. The second stage feeds the extracted hits into a fully connected neural network to predict the sub-pixel hit position. The performance of the two-stage framework is evaluated using the edge-based ONN. The results show that we can achieve above 96% neutron detection accuracy as well as sub-pixel and sub-micron position resolution, while enjoying the advantages of the ONN hardware including radiation-hardness, low energy consumption and high computing speed for integrated edge camera and hardware deployment, when compared with electronic counterparts.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

Optics-Free Chip-Scale Intraoperative Imaging Using NIR-Excited Upconverting Nanoparticles

Here we present an optics-free CMOS image sensor that incorporates a novel time-gated dual-photodiode pixel design to allow filter- and lens-less image acquisition of near-infrared-excited (NIR-excited) upconverting nanoparticles. Recent biomedical advances have highlighted the benefits of NIR excitation, but NIR interaction with silicon has remained a challenge, even with high-performance optical blocking filters. Using a secondary diode and a dual-photodiode design, this sensor is able to remove the 100s of mV of NIR background on pixels and bring it down to single-digit mV level, nearing its noise floor of 2.2 mV rms, not achievable with any optical filter. Non-linear effects of background cancellation using the diode pair has been mitigated using an initial one-time pixel-level curve fitting and calibration in a post-processing setting. This imager comprises a highly linear 11 fF metal-oxide-metal (MOM) capacitor and includes integrated angle-selective gratings to reject oblique light and enhance sharpness. Each pixel also includes two distinct correlated double sampling schemes, to remove low frequency flicker noise and systematic offset in the datapath. We demonstrate the performance of this imager using pulsed NIR-excited upconverting nanoparticles on standard United-States-Air-Force (USAF) resolution targets and achieve an SNR of 15 dB, while keeping NIR background below 6 mV. This 36-by-80-pixel array measures only 2.3 mm by 4.8 mm and can be thinned down to 25 µm, allowing it to become surgically compatible with intraoperative instruments and equipment, while remaining optics-free.

42 ENGINEERING↗
DOE OSTI2025

NWB Sensors Infrared Cloud Imager Data Products from SGP

NWB Sensors is a company which has developed a commercially available Infrared Cloud Imager (ICI). For more information, consult the company's webpage, https://www.nwbsensors.com/infrared-cloud-imager. To validate the radiometric accuracy of the ICI, NWB Sensors deployed it to the ARM SGP User Facility in 2023. The primary motivation of this deployment was to perform an intercomparison between the ICI and the Atmospheric Emitted Radiance Interferometer (AERI). The AERI spectral radiance data product can be integrated across the response function of the ICI and directly compared to the zenith radiance observed by the ICI. In addition, the ICI uses proprietary models of the downwelling clear-sky radiance in its cloud processing algorithms. They are based on surface meteorology and precipitable water vapor (PWV). These models were validated by comparing their predicted radiances to those derived from radiative transfer models of the ARM radiosondes. Finally, PWV observations derived from the ICI's onboard GNSS-based PWV retrieval system were compared against those from the microwave radiometer. This dataset contains the ICI radiance and cloud data products.

Atmosphere↗
DOE OSTI2024

Event-to-Video Conversion for Overhead Object Detection

Collecting overhead imagery using an event camera is desirable due to the energy efficiency of the image sensor compared to standard cameras. However, event cameras complicate downstream image processing, especially for complex tasks such as object detection. In this paper, we investigate the viability of event streams for overhead object detection. We demonstrate that across a number of standard modeling approaches, there is a significant gap in performance between dense event representations and corresponding RGB frames. We establish that this gap is, in part, due to a lack of overlap between the event representations and the pre-training data that the object detectors were initially trained on through a number of experiments. Then, apply an off-the-shelf event-to-video conversion tool that converts event streams into gray-scale video to close this gap. We demonstrate that this approach results in a large performance increase, outperforming even event-specific object detection techniques on our overhead target task. These results suggest that better aligning event representations with existing large pre-trained models may result in greater short-term performance gains compared to end-to-end event-specific architectural improvements.

machine learning (ML), computer vision, Neuromorph↗
DOE OSTI2022

Super resolution for magneto-optical microscopy

Sub-diffraction limited magneto-optical microscopy, such as Kerr or Faraday effect microscopy, provide many advantages to fields of science and technology for measuring, or imaging, the magnetization structures and magnetization domains of materials. Disclosed is a method and system for performing sub-diffraction limited magneto-optic microscopy. The method includes positioning a microlens or microlens layer relative to a surface of a sample to image the surface of the sample, forming a photonic nanojet to probe the surface of the sample, and receiving light reflected by the surface of the sample or transmitted through the sample at an imaging sensor. The methods and associated systems and devices enable sub-diffraction limited imaging of magnetic domains at resolutions 2 to 8 times the classical diffraction limit.

te Velthuis, Suzanne Gabriëlle Everdine↗
DOE OSTI2024

LumaCam: a novel class of position-sensitive event mode particle detectors using scintillator screens

A new type of position-sensitive detectors is gaining attention in the neutron community. They are scintillator based detectors that detect the scintillation light on an individual photon basis via an image intensifier and a fast image sensor. Their readout operates in event mode i.e. it produces information about individual neutron interactions, reconstructed from the sensor data, thus enabling to achieve superior spatial and temporal resolutions compared to regular detectors. Although the development of current detectors is focused on neutrons, the concept is also applicable to the detection of other particles such as high-energy photons. This document provides a description on how these detectors are built, how they operate, and what their characteristics are. An example of a detector implementation based on a Timepix3 chip is described to illustrate the detector concept. This includes a detailed description of the algorithm that reconstructs the neutron interactions from the sensor data, one of the core components that sets it apart from established scintillator-based imaging detectors. Energy-resolved epithermal neutron radiography was performed at the ISIS EMMA beamline with this detector, illustrating some of the fundamental differences in the data that can be produced with the new type of detector compared to more established types of scintillator based neutron detectors. The term LumaCam is proposed to refer to this new class of position-sensitive event-mode detectors.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Combined Optical and Radio–Frequency Perspectives on the Time Evolution of Lightning Measured by the FORTE Satellite

We use a cluster feature data set for the Fast On-orbit Recording of Transient Events (FORTE) satellite that combines detections from its pixelated Lightning Locating System (LLS), photodiode detector (PDD) and Radio-Frequency (RF) instrumentation to generate statistics describing the frequency and timing of lightning events detected by each instrument during lightning flashes. Coincident observations from the same vantage point allow us to directly compare flash details that can be resolved by the wide Field of View (FOV) instruments relative to the pixelated LLS—whose design is based on NASA's Lightning Imaging Sensor. We find that both the PDD and RF system typically generate more detections than the lightning imager (mean: 1.5 PDD events per LLS group, 2 RF events per LLS group) from pulses that are either not sufficiently bright in the optical band (in the case of RF) or that lack the optical energy density (in the case of the PDD) required to trigger one of the pixels on the LLS imaging array. This includes additional activity before the first LLS group or after the final LLS group. These FORTE results demonstrate that certain lightning processes would be better resolved by wide-FOV optical and RF instruments than lightning imagers. Current/future space-based missions that use/plan to use similar instruments will improve our understanding of flash evolution by resolving details missed by lightning imagers.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

A Cryogenic Readout IC with 100 KSPS in-Pixel ADC for Skipper CCD-in-CMOS Sensors

The Skipper CCD-in-CMOS Parallel Read-Out Circuit (SPROCKET) is a mixed-signal front-end design for the readout of Skipper CCD-in-CMOS image sensors. SPROCKET is fabricated in a 65 nm CMOS process and each pixel occupies a 50$\mu$m $\times$ 50$\mu$m footprint. SPROCKET is intended to be heterogeneously integrated with a Skipper-in-CMOS sensor array, such that one readout pixel is connected to a multiplexed array of nine Skipper-in-CMOS pixels to enable massively parallel readout. The front-end includes a variable gain preamplifier, a correlated double sampling circuit, and a 10-bit serial successive approximation register (SAR) ADC. The circuit achieves a sample rate of 100 ksps with 0.48 $\mathrm{e^-_{rms}}$ equivalent noise at the input to the ADC. SPROCKET achieves a maximum dynamic range of 9,000 $e^-$ at the lowest gain setting (or 900 $e^-$ at the lowest noise setting). The circuit operates at 100 Kelvin with a power consumption of 40 $\mu W$ per pixel. A SPROCKET test chip was submitted in September 2022, and test results will be presented at the conference.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

High Yield Xray Imager Final Design Review

The High Yield Xray Imager (HYXI) is a new NIF target diagnostic system currently under development. The goal of HYXI is to provide high-fidelity, high temporal resolution x-ray imaging capability on high yield NIF implosions at 10MJ and above. The HYXI instrument design concept is based on the combination of two technologies that have been successfully utilized at the NIF on previous instruments, electron pulse-dilation and hybrid-CMOS sensor imaging. The combination of these two techniques will give HYXI sufficient data quality to ascertain differences in hot spot formation dynamics between high and low yield implosions. This information will highlight the critical hot spot conditions needed for ignition and burn. The HYXI design leverages the successful operation of the PDIXI x-ray imager at the NIF on multi MJ yield shots. A new radiation tolerant CMOS imaging array (HYPERION) is being developed to eliminate the significant background noise which limits the data quality of PDIXI. We successfully placed the contract with Advanced hCMOS Systems (AHS) to develop the HYPERION sensor, which fulfils our criteria to place long lead time item procurements by end of FY24. The HYXI Final Design Review was completed at the end of Q4 FY24 (Sep 24 th and Sep 30 th ). The HYXI project is a multi-year effort with a phased approach to be bring up system functionality over time in parallel with the development and fabrication effort of the HYPERION CMOS imaging array. In Phase 1, time-integrated x-ray images on NIF DT experiments will be collected starting in Q3 FY25. In Phase 2 of the project, time-resolved imaging with HYXI utilizing a spare microchannel plate detector back-end will begin in Q3 FY26. Phase 3 concludes the project with the installation of the HYPERION sensor array and the final performance qualification of the HYXI instrument which is scheduled for Q3 FY27 as discussed in the PDR and MRT report on this project in FY23.

42 ENGINEERING↗
DOE OSTI2023

Validating a Tethered Balloon System and Optical Technologies for Marine Wildlife Detection and Tracking

The interactions between marine wildlife and marine energy devices are not well understood, leading to regulatory delays for device deployments and testing. Technologies that enable marine wildlife observations can help to fill data gaps and reduce uncertainties about animal–device interactions. A validation test conducted in Galveston Bay near La Porte, Texas, in December 2022 used a technology package consisting of a tethered balloon system and three independent sensor systems, including three-band visible, eight-band multispectral, and single-band thermal to detect three marine-mammal-shaped surrogates. The field campaign aimed to provide an initial step to evaluating the use of the TBS and the effectiveness of the sensor suite for marine wildlife observations and detection. From 2 December to 7 December 2022, 6 flights were conducted under varying altitudes and environmental conditions resulting in the collection of 5454 images. A subset of the images was classified and analyzed with two collection criteria including Beaufort wind force scale and TBS altitude to assess a range of observations of a surrogate from near-shore to offshore based on pixel count. The results of this validation test demonstrate the potential for using TBSs and imaging sensors for marine wildlife observations and offer valuable information for further development and application of this technology for marine energy and other blue economy sectors.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Advances in detection for neutron reflectometry with time-resolved imaging detectors

Thermal neutron detection in neutron scattering science is a challenging endeavour due to a limited number of technologies which are sensitive to these weakly interacting particles. While many improvements to conventional detectors are underway at various facilities, there is a great opportunity to make a leap in performance by combining the spatial resolution benefits of imaging and the temporal resolution and background discrimination of event-driven radiation detectors. This idea has been realized by using a neutron sensitive scintillator read out by a single-photon sensitive camera based on a Timepix3 ASIC. We demonstrate how such data-driven imaging sensors can enable unprecedented performance in neutron reflectometry using the ASTERIX instrument at the Los Alamos Neutron Scattering Center. Several samples were measured with both the new and a conventional 3 He detector systems. The results from this work demonstrate that these imaging based systems can satisfy performance parameters for the future QIKR reflectometer to be built at the Second Target Station at Oak Ridge National Laboratory. Further improvements to the detector are already underway which will allow streamlined and expedited experiments. We demonstrate at least a two order of magnitude increase in detection rate at an acceptable dead time and introduce a new way of tuning the detector efficiency using light collecting optics to accommodate highly intense direct beams which cannot be measured with any current detectors without severe attenuation. This will allow measurements of complete reflectometry profiles and using a single sample measurement combined with fewer direct beam calibration measurements on QIKR and potentially other reflectometers.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Milestone report for MRT 8479: High Yield Xray Imager Preliminary Design Review

The High Yield Xray Imager (HYXI) is a new NIF target diagnostic system currently under development. The goal of HYXI is to provide high-fidelity, high temporal resolution x-ray imaging capability on high yield NIF implosions at 10MJ and above. The HYXI instrument design concept is based on the combination of two technologies that have been successfully utilized at the NIF on previous instruments, electron pulse-dilation and hybrid-CMOS sensor imaging. The combination of these two techniques will give HYXI sufficient data quality to ascertain differences in hot spot formation dynamics between high and low yield implosions. This information will highlight the critical hot spot conditions needed for ignition and burn. The HYXI design leverages the successful operation of the PDIXI x-ray imager at the NIF on multi-MJ yield shots. Also, a new radiation tolerance CMOS imaging array is being developed to eliminate the significant background noise which limits the data quality of PDIXI. The HYXI Preliminary Design Review was completed at the end of Q4 FY23. The HYXI project is a multi-year effort with a phased approach to be bring up system functionality over time in parallel with the development and fabrication effort of the new CMOS imaging array. Initial time integrated NIF data will be collected in Q2 FY25, first time resolved imaging with Daedalus starting in Q2 FY26 and the final performance qualification of the complete HYXI system is scheduled for Q2 FY27.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

CASPI: collaborative photon processing for active single-photon imaging

Image sensors capable of capturing individual photons have made tremendous progress in recent years. However, this technology faces a major limitation. Because they capture scene information at the individual photon level, the raw data is sparse and noisy. Here we propose CASPI: Collaborative Photon Processing for Active Single-Photon Imaging, a technology-agnostic, application-agnostic, and training-free photon processing pipeline for emerging high-resolution single-photon cameras. By collaboratively exploiting both local and non-local correlations in the spatio-temporal photon data cubes, CASPI estimates scene properties reliably even under very challenging lighting conditions. We demonstrate the versatility of CASPI with two applications: LiDAR imaging over a wide range of photon flux levels, from a sub-photon to high ambient regimes, and live-cell autofluorescence FLIM in low photon count regimes. We envision CASPI as a basic building block of general-purpose photon processing units that will be implemented on-chip in future single-photon cameras.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

End–to–End Metasurface Design for Temperature Imaging via Broadband Planck‐Radiation Regression

A theoretical framework is presented for temperature imaging from long-wavelength infrared (LWIR) thermal radiation (e.g., 8–12 µm) through the end-to-end design of a metasurface-optics frontend and a computational-reconstruction backend. A new nonlinear reconstruction algorithm, “Planck regression”, is introduced to reconstruct the temperature map from a gray scale sensor image, even in the presence of severe chromatic aberration, by exploiting black body and optical physics particular to thermal imaging. This algorithm is combined with an end-to-end approach that optimizes manufacturable, single-layer metasurfaces to yield the most accurate reconstruction. The designs demonstrate high-quality, noise-robust reconstructions of arbitrary temperature maps (including completely random images) in simulations of an ultra-compact thermal-imaging device. Here, it is also shown that Planck regression is much more generalizable to arbitrary images than a straightforward neural-network reconstruction, which requires a large training set of domain-specific images.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Evaluation of UAV-derived multimodal remote sensing data for biomass prediction and drought tolerance assessment in bioenergy sorghum

Screening for drought tolerance is critical to ensure high biomass production of bioenergy sorghum in arid or semi-arid environments. The bottleneck in drought tolerance selection is the challenge of accurately predicting biomass for a large number of genotypes. Although biomass prediction by low-altitude remote sensing has been widely investigated on various crops, the performance of the predictions are not consistent, especially when applied in a breeding context with hundreds of genotypes. In some cases, biomass prediction of a large group of genotypes benefited from multimodal remote sensing data; while in other cases, the benefits were not obvious. In this study, we evaluated the performance of single and multimodal data (thermal, RGB, and multispectral) derived from an unmanned aerial vehicle (UAV) for biomass prediction for drought tolerance assessments within a context of bioenergy sorghum breeding. The biomass of 360 sorghum genotypes grown under well-watered and water-stressed regimes was predicted with a series of UAV-derived canopy features, including canopy structure, spectral reflectance, and thermal radiation features. Biomass predictions using canopy features derived from the multimodal data showed comparable performance with the best results obtained with the single modal data with coefficients of determination (R 2 ) ranging from 0.40 to 0.53 under water-stressed environment and 0.11 to 0.35 under well-watered environment. The significance in biomass prediction was highest with multispectral followed by RGB and lowest with the thermal sensor. Finally, two well-recognized yield-based drought tolerance indices were calculated from ground truth biomass data and UAV predicted biomass, respectively. Results showed that the geometric mean productivity index outperformed the yield stability index in terms of the potential for reliable predictions by the remotely sensed data. Collectively, this study demonstrated a promising strategy for the use of different UAV-based imaging sensors to quantify yield-based drought tolerance.

09 BIOMASS FUELS↗