Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Event camera”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Radiation Imaging with Event Camera

Neuromorphic or event-based imaging is a new, commercially available sensor technology inspired by how the human eye works. Instead of measuring frames at a fixed rate, the camera measures changes in pixel intensity asynchronously. This difference in readout architecture results in a high dynamic range and low latency. Event-based cameras have been used in a variety of applications, including object tracking, navigation, and lidar technologies. However, event-based cameras have not been adequately researched for their ability to image high-energy particles. This report explores the use of an event camera for imaging alpha, beta, and X-rays particles, when coupled with scintillator screens to convert high-energy particles into visible light. Methods to process event data were developed and are presented here, along with the results. The event camera can measure alpha and beta particles with comparable performance to that of a conventional camera. Event cameras can also image higher-activity sources and offer the possibility of discriminating particle interaction types on the basis of timing differences, which typical cameras cannot do. Additionally, event cameras can image objects with an X-ray source when the source strength dynamically changes but does not create a high-contrast image during static X-ray measurement.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Energy-resolved neutron imaging and diffraction including grain orientation mapping using event camera technology

Time-of-flight neutron diffraction and energy-resolved imaging each provide unique perspectives into material properties. Neutron diffraction is useful for assessing microstructural parameters such as phase composition, texture, and dislocation densities, though it typically provides averaged data over the sampled volume. Energy-resolved imaging, on the other hand, offers both spatial and spectral information by detecting Bragg edges and neutron absorption resonances, which enables detailed mapping of microstructure and isotopic composition. When combined, these techniques have the potential to enrich our understanding of material behavior across different scales, enhancing our understanding of complex materials. Traditionally, these modalities are conducted on separate instruments, which is time-consuming and poses challenges for data integration. Here, we report the integration of the LumaCam, an event-mode energy-resolved neutron imaging camera with the HIPPO time-of-flight diffractometer at LANSCE. This integration enables simultaneous diffraction and imaging across the full spectrum, with analysis optimized for diffraction and Bragg-edge imaging in the thermal range (0.45–10 Å) and resonance imaging in the epithermal range (0.5–3000 eV), facilitating comprehensive multi-modal analysis. We demonstrate its capabilities through case studies, including spatial mapping of grain orientations in a steel sample and accurate thickness estimations for irregular samples including a depleted uranium cylinder and a natural silver-containing mineral specimen. The combined setup enhances real-time sample alignment and provides comprehensive data for crystal structure, texture, and isotopic composition analysis. This approach opens new possibilities for advanced applications in nuclear engineering, archaeology, and materials science.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Event-to-Video Conversion for Overhead Object Detection

Collecting overhead imagery using an event camera is desirable due to the energy efficiency of the image sensor compared to standard cameras. However, event cameras complicate downstream image processing, especially for complex tasks such as object detection. In this paper, we investigate the viability of event streams for overhead object detection. We demonstrate that across a number of standard modeling approaches, there is a significant gap in performance between dense event representations and corresponding RGB frames. We establish that this gap is, in part, due to a lack of overlap between the event representations and the pre-training data that the object detectors were initially trained on through a number of experiments. Then, apply an off-the-shelf event-to-video conversion tool that converts event streams into gray-scale video to close this gap. We demonstrate that this approach results in a large performance increase, outperforming even event-specific object detection techniques on our overhead target task. These results suggest that better aligning event representations with existing large pre-trained models may result in greater short-term performance gains compared to end-to-end event-specific architectural improvements.

machine learning (ML), computer vision, Neuromorph↗
DOE OSTI2025

Large field-of-view event-mode camera for high-precision epithermal neutron resonance imaging

A large-area event-mode camera system coupled with a 6 LiF-ZnS:Ag scintillator is applied for neutron resonance imaging (NRI) on the energy-resolved neutron imaging (ERNI) flight path, also known as Flight Path 5 (FP5), at the Los Alamos Neutron Science Center (LANSCE). This novel neutron imaging system, featuring a 120 x 120 mm 2 field of view, efficiently captures resonance information across the entire image in a single acquisition, significantly reducing beam time requirements compared to conventional energy-resolved neutron imaging systems. High-quality neutron radiographs with enhanced spatial resolution are achieved through the reconstruction of neutron events based on observations of individual photons emitted from the scintillator. The system demonstrates reduced background through neutron/gamma discrimination capabilities while maintaining sharpness across a large fields of view. In the measurements presented here, a spatial resolution of approximately 340 μm was achieved using center-of-gravity photon cluster centroiding. We demonstrate the system’s capability for quantitatively determining isotopic distributions in various thin samples, as well as automatically reconstructing complex scenes with overlapping resonances from diverse samples. These results are obtained using standard data analysis tools, despite the relatively slow 6 LiF-ZnS:Ag scintillator, which may not be optimal for absorption resonance detection. The capabilities demonstrated here offer a valuable, versatile, and cost-effective solution for high spatial and temporal resolution, large field-of-view energy-resolved neutron imaging, with potential applications across various scientific and industrial domains.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Scintillation event imaging with a single photon avalanche diode camera

Position and time measurements of scintillation events encode information about the radiation source. Single photon avalanche diode (SPAD) arrays offer multiple-megapixel spatial resolution and tens of picoseconds temporal resolution for detecting single photons. Current lensless designs for measuring scintillation events use sensors that are lower in spatial resolution. Camera-based designs use sensors that are lower in temporal resolution or readout rate and cannot image individual interactions. Here we propose to image scintillation events in a thick, monolithic scintillator using a high-resolution SPAD camera. We demonstrate that a commercial SPAD camera is able to gather sufficient signal to image individual scintillation events and observe 3D shifts in their spatial distribution. Simulations show that a SPAD camera can localize individual scintillation events in 3D. We report direct imaging of gamma-ray interactions in a scintillator with a SPAD camera. The proposed design may allow to measure complex signatures of individual particles interacting in the scintillator.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

A NICER View of the Massive Pulsar PSR J0740+6620 Informed by Radio Timing and XMM-Newton Spectroscopy

We report on Bayesian estimation of the radius, mass, and hot surface regions of the massive millisecond pulsar PSR J0740+6620, conditional on pulse-profile modeling of Neutron Star Interior Composition Explorer X-ray Timing Instrument event data. We condition on informative pulsar mass, distance, and orbital inclination priors derived from the joint North American Nanohertz Observatory for Gravitational Waves and Canadian Hydrogen Intensity Mapping Experiment/Pulsar wideband radio timing measurements of Fonseca et al. We use XMM-Newton European Photon Imaging Camera spectroscopic event data to inform our X-ray likelihood function. The prior support of the pulsar radius is truncated at 16 km to ensure coverage of current dense matter models. We assume conservative priors on instrument calibration uncertainty. We constrain the equatorial radius and mass of PSR J0740+6620 to be ${12.39}_{-0.98}^{+1.30}$ km and ${2.072}_{-0.066}^{+0.067}$ M ⊙ respectively, each reported as the posterior credible interval bounded by the 16% and 84% quantiles, conditional on surface hot regions that are non-overlapping spherical caps of fully ionized hydrogen atmosphere with uniform effective temperature; a posteriori, the temperature is ${\mathrm{log}}_{10}(T\,[{\rm{K}}])={5.99}_{-0.06}^{+0.05}$ for each hot region. All software for the X-ray modeling framework is open-source and all data, model, and sample information is publicly available, including analysis notebooks and model modules in the Python language. Furthermore, our marginal likelihood function of mass and equatorial radius is proportional to the marginal joint posterior density of those parameters (within the prior support) and can thus be computed from the posterior samples.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

A plano–convex thick-lens velocity map imaging apparatus for direct, high resolution 3D momentum measurements of photoelectrons with ion time-of-flight coincidence

Since their inception, velocity map imaging (VMI) techniques have received continued interest in their expansion from 2D to 3D momentum measurements through either reconstructive or direct methods. Recently, much work has been devoted to the latter of these by relating electron time-of-flight (TOF) to the third momentum component. The challenge is having a timing resolution sufficient to resolve the structure in the narrow (<10 ns) electron TOF spread. Here, we build upon the work in VMI lens design and 3D VMI measurement by using a plano–convex thick-lens (PCTL) VMI in conjunction with an event-driven camera (TPX3CAM) providing TOF information for high resolution 3D electron momentum measurements. We perform simulations to show that, with the addition of a mesh electrode to the thick-lens geometry, the resulting plano–convex electrostatic field extends the detectable electron cutoff energy range while retaining the high resolution. This design also extends the electron TOF range, allowing for a better momentum resolution along this axis. We experimentally demonstrate these capabilities by examining above-threshold ionization in xenon, where the apparatus is shown to collect electrons of energy up to ∼7 eV with a TOF spread of ∼30 ns, both of which are improved compared to a previous work by factors of ∼1.4 and ∼3.75, respectively. Finally, the PCTL-VMI is equipped with a coincident ion TOF spectrometer, which is shown to effectively extract unique 3D momentum distributions for different ionic species in a gas mixture. These techniques have the potential to lend themselves to more advanced measurements involving systems where the electron momentum distributions possess non-trivial symmetries.

Instruments & Instrumentation↗
DOE OSTI2022

Dictionary Learning with Accumulator Neurons

The Locally Competitive Algorithm (LCA) uses local competition between non-spiking leaky integrator neurons to infer sparse representations, allowing for potentially real-time execution on massively parallel neuromorphic architectures such as Intel's Loihi processor. Here, we focus on the problem of inferring sparse representations from streaming video using dictionaries of spatiotemporal features optimized in an unsupervised manner for sparse reconstruction. Non-spiking LCA has previously been used to achieve unsupervised learning of spatiotemporal dictionaries composed of convolutional kernels from raw, unlabeled video. We demonstrate how unsupervised dictionary learning with spiking LCA (\hbox{S-LCA}) can be efficiently implemented using accumulator neurons, which combine a conventional leaky-integrate-and-fire (\hbox{LIF}) spike generator with an additional state variable that is used to minimize the difference between the integrated input and the spiking output. We demonstrate dictionary learning across a wide range of dynamical regimes, from graded to intermittent spiking, for inferring sparse representations of both static images drawn from the CIFAR database as well as video frames captured from a DVS camera. On a classification task that requires identification of the suite from a deck of cards being rapidly flipped through as viewed by a DVS camera, we find essentially no degradation in performance as the LCA model used to infer sparse spatiotemporal representations migrates from graded to spiking. We conclude that accumulator neurons are likely to provide a powerful enabling component of future neuromorphic hardware for implementing online unsupervised learning of spatiotemporal dictionaries optimized for sparse reconstruction of streaming video from event based DVS cameras.

artificial intelligence↗
DOE OSTI2022

Assessment of the Imaging Properties of Plastic Scintillators at FP60R for Neutron Imaging Applications [Slides]

4mm thick Stilbene gives the brightest signal but at the cost of resolution. 1 and 2 cm BC412 gave the highest resolution images. The HI-LY scintillator is better suited for DD neutrons. Future work includes: measurements this summer using an event-mode imaging camera which promises sub-pixel resolution through center-of-mass techniques, opportunities for DD neutron tests during laser-driven z-pinch experiments at UNR, and assess scatter within scintillator.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2026

Two-Stage Wildlife Event Classification for Edge Deployment

Camera-based wildlife monitoring is often overwhelmed by non-target triggers and slowed by manual review or cloud-dependent inference, which can prevent timely intervention for high stakes human–wildlife conflicts. Our key contribution is a deployable, fully offline edge vision sensor that achieves near-real-time, highly accurate wildlife event classification by combining detector-based empty-image suppression with a lightweight classifier trained with a staged transfer-learning curriculum. Specifically, Stage 1 uses a pretrained You Only Look Once (YOLO)-family detector for permissive animal localization and empty-trigger suppression, and Stage 2 uses a lightweight EfficientNet-based binary classifier to confirm puma on detector crops and gate downstream actions. Our design is robust to low-quality nighttime monochrome imagery (motion blur, low contrast, illumination artifacts, and partial-body captures) and operates using commercially available components in connectivity-limited settings. In field deployments running since May 2025, end-to-end latency from camera trigger to action command is approximately 4 s. Ablation studies using a dataset of labeled wildlife images (pumas, not pumas) show that the two-stage approach substantially reduces false alarms in identifying pumas relative to a full-image classifier while maintaining high recall. On the held-out test set (N = 1434 events), the proposed two-stage cascade achieves precision 0.983, recall 0.975, F1 0.979, accuracy 0.986, and balanced accuracy 0.983, with only 8 false positives and 12 false negatives. The system can be easily adapted for other species, as demonstrated by rapid retraining of the second stage to classify ringtails. Downstream responses (e.g., notifications and optional audio/light outputs) provide flexible actuation capabilities that can be configured to support intervention.

58 GEOSCIENCES↗
DOE OSTI2022

Digital coded exposure formation of frames from event-based imagery

Abstract Event-driven neuromorphic imagers have a number of attractive properties including low-power consumption, high dynamic range, the ability to detect fast events, low memory consumption and low band-width requirements. One of the biggest challenges with using event-driven imagery is that the field of event data processing is still embryonic. In contrast, decades worth of effort have been invested in the analysis of frame-based imagery. Hybrid approaches for applying established frame-based analysis techniques to event-driven imagery have been studied since event-driven imagers came into existence. However, the process for forming frames from event-driven imagery has not been studied in detail. This work presents a principled digital coded exposure approach for forming frames from event-driven imagery that is inspired by the physics exploited in a conventional camera featuring a shutter. The technique described in this work provides a fundamental tool for understanding the temporal information content that contributes to the formation of a frame from event-driven imagery data. Event-driven imagery allows for the application of arbitrary virtual digital shutter functions to form the final frame on a pixel-by-pixel basis. The proposed approach allows for the careful control of the spatio-temporal information that is captured in the frame. Furthermore, unlike a conventional physical camera, event-driven imagery can be formed into any variety of possible frames in post-processing after the data is captured. Furthermore, unlike a conventional physical camera, coded-exposure virtual shutter functions can assume arbitrary values including positive, negative, real, and complex values. The coded exposure approach also enables the ability to perform applications of industrial interest such as digital stroboscopy without any additional hardware. The ability to form frames from event-driven imagery in a principled manner opens up new possibilities in the ability to use conventional frame-based image processing techniques on event-driven imagery.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Use of vision and sound to classify feller-buncher operational state

Productivity measures in logging involve simultaneous recognition and classification of event occurrence and timing, and the volume of stems being handled. In full-tree felling systems these measurements are difficult to implement in an autonomous manner because of the unfavorable working environment and the abundance of confounding extraneous events. This paper proposed a vision method that used a lowcost camera to recognize feller-buncher operational events including tree cutting and piling. It used a fine K-nearest neighbors (fKNN) algorithm as the final classifier based on both audio and video features derived from short video segments as inputs. The classifier’s calibration accuracy exceeds 94%. The trained model was tested on videos recorded under various conditions. The overall accurate rates for short segments were greater than 89%. Comparisons were made between the human- and algorithm derived event detection rates, events’ durations, and inter-event timing using continuously recorded videos taken during feller operation. Video results between the fKNN model and manual observation were similar. Statistical comparison using the Kolmogorov–Smirnov test to evaluate measured parameters’ distributions (manual versus automated event duration and inter-event timing) did not show significant differences with the lowest P-value among all Kolmogorov–Smirnov tests equal to 0.12. Here the result indicated the feasibility and potential of using the method for the automatic time study of drive-to-tree feller bunchers.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Utilizing Time Reversal Ultrasonics to Detect the Removal of Nuclear Materials from Geological Repositories (FY26 Mid-Year)

Detecting unauthorized nuclear material removal from storage environments, such as geological repositories, is a critical safeguards task essential to ensuring the integrity and non-diversion of nuclear materials. However, this process is fraught with significant technical challenges. Storage configurations often involve tightly packed nuclear material containers or obstructed environments, making detection of removal events exceedingly difficult. Optical surveillance cameras, which are commonly used for monitoring, suffer from substantial limitations, including restricted coverage, reliance on line-of-sight measurements, and vulnerability to environmental conditions in certain storage scenarios. As the global inventory of monitored nuclear materials increases and storage configurations become more complex— such as deep geological repositories, inaccessible storage vaults, and tightly packed containers—there is an urgent need for innovative detection technologies that can reliably identify unauthorized diversion events in these challenging environments. The challenge of detecting nuclear material removal in complex storage environments is both significant and urgent. Preventing unauthorized access, diversion, or tampering with nuclear materials is a cornerstone of global nuclear safeguards and nonproliferation efforts. Current detection methods are increasingly inadequate as storage configurations become more intricate and inaccessible. The limitations of existing technologies—such as their inability to detect changes behind obstructions, reliance on costly and labor-intensive processes, and vulnerability to environmental conditions—pose risks to the effectiveness of safeguards systems. Addressing this challenge is critical to maintaining international trust in nuclear safeguards frameworks and ensuring compliance with nonproliferation agreements. Our project builds on the proven concept of TRU technology that can address this unmet need. TRU has demonstrated exceptional spatial sensitivity and change detection capabilities in complex non-line-ofsight environments, making it uniquely suited for detecting unauthorized nuclear material removal in challenging storage configurations. Unlike optical methods, TRU is not limited by line-of-sight constraints or environmental conditions, enabling reliable detection of subtle alterations even behind obstructions. By leveraging TRU’s ability to identify removal or tampering events, we aim to develop a robust detection system that enhances safeguards in geological repositories, storage vaults, and other complex environments.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2026

Rapid neutron and gamma-ray source localization using machine learning

Rapid localization of radiation sources is critical for applications including nuclear emergency response, safeguards, and security. However, conventional imaging systems such as neutron scatter cameras and Compton cameras depend on rare coincidence events, which often result in long acquisition times. In this work, we address the challenge of rapid source localization by developing a machine learning approach to predict the direction of a single radiation source using only count rates from an array of neutron and gamma-ray detectors. The proposed model is a fully connected neural network (FCNN) trained using Monte Carlo simulation data from a 252 Cf source. The model hyperparameters are optimized with a small set of routine 252 Cf measurements. We benchmarked the performance of the trained and optimized machine learning model using additional 252 Cf , 137 Cs , and PuBe measurements under laboratory conditions with varying source-detector configurations. For these measurements, the machine learning model achieved a mean localization error smaller than 30° with 3 x 10 3 system counts, corresponding to 8 s measurement time for the imaging system used in this work. In this low-statistics regime, the method outperformed traditional scatter-based imaging by more than 75% in localization accuracy for the evaluated measurement configurations. These results demonstrate that a machine learning-based approach can significantly reduce the time required for accurate single-source localization, providing a robust and computationally efficient alternative to traditional imaging systems in time-critical nuclear security and emergency response scenarios.

Gamma-ray imaging↗
DOE OSTI2022

In vitro and in vivo NIR fluorescence lifetime imaging with a time-gated SPAD camera

Near-infrared (NIR) fluorescence lifetime imaging (FLI) provides a unique contrast mechanism to monitor biological parameters and molecular events in vivo . Single-photon avalanche diode (SPAD) cameras have been recently demonstrated in FLI microscopy (FLIM) applications, but their suitability for in vivo macroscopic FLI (MFLI) in deep tissues remains to be demonstrated. Herein, we report in vivo NIR MFLI measurement with SwissSPAD2, a large time-gated SPAD camera. We first benchmark its performance in well-controlled in vitro experiments, ranging from monitoring environmental effects on fluorescence lifetime, to quantifying Förster resonant energy transfer (FRET) between dyes. Next, we use it for in vivo studies of target-drug engagement in live and intact tumor xenografts using FRET. Information obtained with SwissSPAD2 was successfully compared to that obtained with a gated intensified charge-coupled device (ICCD) camera, using two different approaches. Our results demonstrate that SPAD cameras offer a powerful technology for in vivo preclinical applications in the NIR window.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Data for "In vitro and in vivo NIR Fluorescence Lifetime Imaging with a time-gated SPAD camera"

Near-infrared (NIR) fluorescence lifetime imaging (FLI) provides a unique contrast mechanism to monitor biological parameters and molecular events in vivo. Single-photon avalanche diode (SPAD) cameras have been recently demonstrated in FLI microscopy (FLIM) applications, but their suitability for in vivo macroscopic FLI (MFLI) in deep tissues remains to be demonstrated. Herein, we report in vivo NIR MFLI measurement with SwissSPAD2, a large time-gated SPAD camera. We first benchmark its performance in well-controlled in vitro experiments, ranging from monitoring environmental effects on fluorescence lifetime, to quantifying Förster resonant energy transfer (FRET) between dyes. Next, we use it for in vivo studies of target-drug engagement in live and intact tumor xenografts using FRET. Information obtained with SwissSPAD2 was successfully compared to that obtained with a gated intensified charge-coupled device (ICCD) camera, using two different approaches. Our results demonstrate that SPAD cameras offer a powerful technology for in vivo preclinical applications in the NIR window.

2DG↗
DOE OSTI2022

High speed two-dimensional event detection and imaging using an analog interface and a massively parallel processor

A quantitative pulse count (event detection) algorithm with linearity to high count rates is accomplished by combining a high-speed, high frame rate camera with simple logic code run on a massively parallel processor such as a GPU or a FPGA. The parallel processor elements examine frames from the camera pixel by pixel to find and tag events or count pulses. The tagged events are combined to form a combined quantitative event image.

Waugh, Justin↗