Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “camera”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Solid state streak camera prototype performance testing and future upgrades

Streak Cameras are an essential diagnostic tool used in shock physics and high energy density physics experiments. Such experiments require well calibrated temporally resolving diagnostics for studying events that occur on the nanosecond to microsecond time scales. The Nevada National Security Site (NNSS) and Sandia National Laboratories (SNL) have built a 42-channel solid state streak camera (SSSC) prototype as a proof of concept for use as a streak camera replacement. This work is part of an ongoing project to develop the technology to a level competitive with analog streak cameras. This manuscript discusses the device concept, results from electronic and laser testing, and recent improvements to increase the device’s dynamic range.

Plasma diagnostics - interferometry, spectroscopy ↗

Intensified Tpx3Cam, a fast data-driven optical camera with nanosecond timing resolution for single photon detection in quantum applications

Here we describe a fast data-driven optical camera, Tpx3Cam, with nanosecond scale timing resolution and 80 Mpixel/sec throughput. After the addition of intensifier, the camera is single photon sensitive with quantum efficiency determined primarily by the intensifier photocathode. The single photon performance of the camera was characterized with results on the gain, timing resolution and afterpulsing reported here. The intensified camera was successfully used for measurements in a variety of applications including quantum applications. As an example of such application, which requires simultaneous detection of multiple photons, we describe registration of photon pairs from the spontaneous parametric down-conversion source in a spectrometer. We measured the photon wavelength and timing with respective precisions of 0.15 nm and 3 ns, and also demonstrated that the two photons are anti-correlated in energy.

79 ASTRONOMY AND ASTROPHYSICS↗

Characterization of a SiPM-based monolithic neutron scatter camera using dark counts

The Single Volume Scatter Camera (SVSC) Collaboration aims to develop portable neutron imaging systems for a variety of applications in nuclear non-proliferation. Conventional double-scatter neutron imagers are composed of several separate detector volumes organized in at least two planes. A neutron must scatter in two of these detector volumes for its initial trajectory to be reconstructed. As such, these systems typically have a large footprint and poor geometric efficiency. We report on the design and characterization of a prototype monolithic neutron scatter camera that is intended to significantly improve upon the geometrical shortcomings of conventional neutron cameras. The detector consists of a 50 mm×56 mm× 60 mm monolithic block of EJ-204 plastic scintillator instrumented on two faces with arrays of 64 Hamamatsu S13360-6075PE silicon photomultipliers (SiPMs). The electronic crosstalk is limited to < 5% between adjacent channels and < 0.1% between all other channel pairs. SiPMs introduce a significantly elevated dark count rate over PMTs, as well as correlated noise from after-pulsing and optical crosstalk. In this article, we characterize the dark count rate and optical crosstalk and present a modified event reconstruction likelihood function that accounts for them. We find that the average dark count rate per SiPM is 4.3 MHz with a standard deviation of 1.5 MHz among devices. The analysis method we employ to measure internal optical crosstalk also naturally yields the mean and width of the single-electron pulse height. Here, we calculate separate contributions to the width of the single-electron pulse-height from electronic noise and avalanche fluctuations. We demonstrate a timing resolution for a single-photon pulse to be (128 ± 4) ps. Finally, coincidence analysis is employed to measure external (pixel-to-pixel) optical crosstalk. We present a map of the average external crosstalk probability between 2×4 groups of SiPMs, as well as the in-situ timing characteristics extracted from the coincidence analysis. Further work is needed to characterize the performance of the camera at reconstructing single- and double-site interactions, as well as image reconstruction.

47 OTHER INSTRUMENTATION↗

Performance of the Tachyon Time-of-Flight PET Camera

We have constructed and characterized a time-of-flight Positron Emission Tomography (TOF PET) camera called the Tachyon. The Tachyon is a single-ring Lutetium Oxyorthosilicate (LSO) based camera designed to obtain significantly better timing resolution than the ~ 550 ps found in present commercial TOF cameras, in order to quantify the benefit of improved TOF resolution for clinically relevant tasks. The Tachyon's detector module is optimized for timing by coupling the 6.15 ×25 mm 2 side of 6.15 ×6.15 ×25 mm 3 LSO scintillator crystals onto a 1-inch diameter Hamamatsu R-9800 PMT with a super-bialkali photocathode. We characterized the camera according to the NEMA NU 2-2012 standard, measuring the energy resolution, timing resolution, spatial resolution, noise equivalent count rates and sensitivity. The Tachyon achieved a coincidence timing resolution of 314 ps +/- 20 ps FWHM over all crystal-crystal combinations. Experiments were performed with the NEMA body phantom to assess the imaging performance improvement over non-TOF PET. We find that the results show that at a matched contrast, incorporating 314 ps TOF reduces the standard deviation of the contrast by a factor of about 2.3.

47 OTHER INSTRUMENTATION↗

SU-F-BRA-16: Development of a Radiation Monitoring Device Using a Low-Cost CCD Camera Following Radionuclide Therapy

Purpose: It is now commonplace to handle treatments of hyperthyroidism using iodine-131 as an outpatient procedure due to lower costs and less stringent federal regulations. The Nuclear Regulatory Commission has currently updated release guidelines for these procedures, but there is still a large uncertainty in the dose to the public. Current guidelines to minimize dose to the public require patients to remain isolated after treatment. The purpose of this study was to use a low-cost common device, such as a cell phone, to estimate exposure emitted from a patient to the general public. Methods: Measurements were performed using an Apple iPhone 3GS and a Cs-137 irradiator. The charge-coupled device (CCD) camera on the phone was irradiated to exposure rates ranging from 0.1 mR/hr to 100 mR/hr and 30-sec videos were taken during irradiation with the camera lens covered by electrical tape. Interactions were detected as white pixels on a black background in each video. Both single threshold (ST) and colony counting (CC) methods were performed using MATLAB®. Calibration curves were determined by comparing the total pixel intensity output from each method to the known exposure rate. Results: The calibration curve showed a linear relationship above 5 mR/hr for both analysis techniques. The number of events counted per unit exposure rate within the linear region was 19.5 ± 0.7 events/mR and 8.9 ± 0.4 events/mR for the ST and CC methods respectively. Conclusion: Two algorithms were developed and show a linear relationship between photons detected by a CCD camera and low exposure rates, in the range of 5 mR/hr to 100-mR/hr. Future work aims to refine this model by investigating the dose-rate and energy dependencies of the camera response. This algorithm allows for quantitative monitoring of exposure from patients treated with iodine-131 using a simple device outside of the hospital.

60 APPLIED LIFE SCIENCES↗

Real-Time Multi-Vehicle Multi-Camera Tracking with Graph-Based Tracklet Features

An essential application in intelligent transportation systems is multi-target multi-camera tracking (MTMCT), where the target’s activity is tracked from different cameras. Although the tracking-by-detection scheme is the primary paradigm in MTMCT, the object association information from the video frames is lost. This is mainly because the multi-camera multi-object matching uses the information from the video frames separately. To solve this problem and leverage this association information, we propose an MTMCT framework, where features are built in the form of a graph and a graph similarity algorithm is used to match multi-camera objects. In this paper, we focus on the real-time scenario, where only the past images are used to match an object. Our method achieves an IDF1 score (the ratio of the number of correctly identified objects to the number of ground truth and average objects) of 0.75 with a rate of 14 frames per second (fps).

Engineering↗

Advancing 3D surface imaging: single-axis structured light illumination plenoptic camera with machine learning integration

Structured light illumination (SLI) is a configurable 3D surface imaging modality that can function largely independently of surface texture. At the same time, machine learning (ML) approaches are providing new ways to capture relevant information from SLI patterns, avoiding the need to develop advanced computer vision algorithms. By projecting an optical pattern onto a surface and measuring the apparent distortion of that pattern, one can determine surface topography from a single image. Common realizations of SLI 3D imaging use off-axis SLI to allow for parallax-based determination of depth; however, in constrained geometries, the ability to make single-axis measurements can be of major benefit. While plenoptic imaging (PI) cameras have long been developed for the purpose of single-axis 3D imaging, they are generally reliant on the surface texture of the measured object, thus making them unreliable in certain experimental conditions. Therefore, we present a single-axis 3D SLI plenoptic camera, which combines the single-axis benefits of PI technology while using coaxial SLI to maintain indifference to surface conditions. We also present a study of the camera capabilities paired with the development of several algorithms, including traditional feature tracking methods as well as ML methods, which are found to enhance resolution and range. We report depth sensitivity down to 0.2% $\frac{dz}{z_0}$. The single-axis SLI 3D plenoptic camera demonstrates potential applicability for in-situ topographical measurements under a wide range of conditions including, but not limited to, objects without trackable surface texture, high temperatures, and constrained geometry environments.

Imaging systems↗

In vitro and in vivo NIR fluorescence lifetime imaging with a time-gated SPAD camera

Near-infrared (NIR) fluorescence lifetime imaging (FLI) provides a unique contrast mechanism to monitor biological parameters and molecular events in vivo . Single-photon avalanche diode (SPAD) cameras have been recently demonstrated in FLI microscopy (FLIM) applications, but their suitability for in vivo macroscopic FLI (MFLI) in deep tissues remains to be demonstrated. Herein, we report in vivo NIR MFLI measurement with SwissSPAD2, a large time-gated SPAD camera. We first benchmark its performance in well-controlled in vitro experiments, ranging from monitoring environmental effects on fluorescence lifetime, to quantifying Förster resonant energy transfer (FRET) between dyes. Next, we use it for in vivo studies of target-drug engagement in live and intact tumor xenografts using FRET. Information obtained with SwissSPAD2 was successfully compared to that obtained with a gated intensified charge-coupled device (ICCD) camera, using two different approaches. Our results demonstrate that SPAD cameras offer a powerful technology for in vivo preclinical applications in the NIR window.

47 OTHER INSTRUMENTATION↗

Greenness indices from digital cameras predict the timing and seasonal dynamics of canopy-scale photosynthesis

The proliferation of digital cameras co-located with eddy covariance instrumentation provides new opportunities to better understand the relationship between canopy phenology and the seasonality of canopy photosynthesis. In this paper we analyze the abilities and limitations of canopy color metrics measured by digital repeat photography to track seasonal canopy development and photosynthesis, determine phenological transition dates, and estimate intra-annual and interannual variability in canopy photosynthesis. Here, we used 59 site-years of camera imagery and net ecosystem exchange measurements from 17 towers spanning three plant functional types (deciduous broadleaf forest, evergreen needleleaf forest, and grassland/crops) to derive color indices and estimate gross primary productivity (GPP). GPP was strongly correlated with greenness derived from camera imagery in all three plant functional types. Specifically, the beginning of the photosynthetic period in deciduous broadleaf forest and grassland/crops and the end of the photosynthetic period in grassland/crops were both correlated with changes in greenness; changes in redness were correlated with the end of the photosynthetic period in deciduous broadleaf forest. However, it was not possible to accurately identify the beginning or ending of the photosynthetic period using camera greenness in evergreen needleleaf forest. At deciduous broadleaf sites, anomalies in integrated greenness and total GPP were significantly correlated up to 60 days after the mean onset date for the start of spring. More generally, results from this work demonstrate that digital repeat photography can be used to quantify both the duration of the photosynthetically active period as well as total GPP in deciduous broadleaf forest and grassland/crops, but that new and different approaches are required before comparable results can be achieved in evergreen needleleaf forest.

54 ENVIRONMENTAL SCIENCES↗

Retrieving Point Cloud of Cloud Points (PCCP) Value-Added Product from Stereo Cameras

In this report, we refer to a pair of cameras that capture synchronized pictures with overlapping fields of view (FOV) as a stereo pair. Each stereo pair independently performs a stereo reconstruction of cloud points. Currently, there are three U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility stereo pairs (six cameras in total) positioned around the Southern Great Plains (SGP) observatory’s Central Facility (CF; Romps and Oktem 2017). Time-synchronized pictures from the two cameras in a stereo pair can be paired together to obtain a three-dimensional (3D) reconstruction of feature points by triangulation. This document explains how we use ARM stereo cameras and stereophotogrammetric principles to generate the Point Cloud of Cloud Points (PCCP) Value-Added Product (VAP). The PCCP VAP is essentially a set of 3D positions representing the locations of cloud features in the sky. Thousands of cloud features can be reconstructed instantly in each stereo pair's FOV, which covers an area of tens of square kilometers. Cloud base and cloud top heights can be extracted from the PCCP product.

42 ENGINEERING↗

Processing and Archiving Camera Data Effectively for Operando Neutron Measurement of Metal Additive Manufacturing

As the name suggests, The Operando Neutron Measurement of Metal Additive Manufacturing project conducted by ORNL’s Manufacturing Demonstration Facility (MDF) is experimenting with advanced additive metal manufacturing techniques while analyzing the process using the Spallation Neutron Source’s (SNS) beamline. As part of this experiment, the MDF is seeking to employ 2 XIMEA visible light cameras and a single infrared camera to analyze and correct manufacturing in real-time. The MDF requires a solution for capturing the high-resolution data feed from the cameras with compression while preserving enough detail for their software to detect and correct errors in real time. Our solution was to develop a Robot Operating System (ROS) driver to feed the camera data into ROS. From ROS, the feed is compressed and temporarily stored locally to a stripped 4 NVMe SSD RAID array. Post-experiment, the data is transitioned to long-term storage for archival purposes.

36 MATERIALS SCIENCE↗

Estimating vehicle fuel economy from overhead camera imagery and application for traffic control

In this work, we explore the ability to estimate vehicle fuel consumption using imagery from overhead fisheye lens cameras deployed as traffic sensors. We utilize this information to simulate vision-based control of a traffic intersection, with a goal of improving fuel economy with minimal impact to mobility. We introduce the ORNL Overhead Vehicle Dataset (OOVD), consisting of a data set of paired, labeled vehicle images from a ground-based camera and an overhead fisheye lens traffic camera. The data set includes segmentation masks based on Gaussian mixture models for vehicle detection. We show the dataset utility through three applications: the estimate of fuel consumption based on segmentation bounding boxes, vehicle discrimination for those vehicles with largest bounding boxes, and a fine-grained classification on a limited number of vehicle makes and models using a pre-trained set of convolutional neural network models. We compare these results with estimates based on a large open-source data set based on web-scraped imagery. Finally, we show the utility of the approach using reinforcement learning in a traffic simulator using the open source Simulation of Urban Mobility (SUMO) package. Our results show the feasibility of the approach for controlling traffic lights for better fuel efficiency based solely on visual vehicle estimates from commercial, fisheye lens cameras.

Karnowski, Thomas↗

Vegetation Warming Experiment: Landscape-scale digital camera imagery for vegetation phenology, Utqiagvik (Barrow), Alaska, 2019

Images captured using a StarDot NetCam SC phenocamera looking east from the top of the Barrow Environmental Observatory (BEO) Sled Shed, Utqiagvik, Alaska. The camera was installed to remotely monitor plant phenology and operation of the Brookhaven National Laboratory (BNL) TEST group's ZPW (Zero Power Warming) chambers during the growing season of 2019. Images were captured from early spring (4 April) through to mid fall (30 October). Snowmelt, vegetation growth and senescence, and snow accumulation were captured. Images were uploaded to the BNL FTP server every hour, then from 2019-06-27 to 2019-10-02 images were recorded every 10 minutes, then at hourly intervals until the end of data collection on 2019-10-30. Files were renamed with the date and time of the image. jpg images have been compressed in *.tar.gz format (5.6 GB). Closer fields of view (northeasterly) were also captured using 4 Wingscapes TimelapseCam cameras mounted on a mast on the sled shed. These cameras were operated from 2019-06-23 to 2019-09-25, with images recorded every 30 minutes from 9:00 to 16:30 Alaska daylight time (AKDT, UTC-8). Individual jpg images have been compressed in zip format for each camera and also presented as mp4 timelapse movies.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

Digital camera imagery for vegetation phenology, Seward Peninsula, Alaska, 2019-2021

Time lapse camera images from Kougarok mile marker (MM) 64 and Teller MM 27 NGEE-Arctic field sites on the Seward Peninsula, Alaska, captured from July 2019 to August 2021. Thirty three Wingscape Timelapse Pro cameras were deployed targeting patches of low and tall shrubs (including Alnus sp. and Salix sp.) and general vegetation and landscape views. Images from were recorded at hourly intervals from 11 AM to 2 PM, continuously for 25 months and capture vegetation phenology, snow accumulation and snow melt events. This data package includes images (*.jpg), organized by site and camera ID, and metadata with details of the cameras used, number of images recorded, start and end dates, GPS locations and example fields of view. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

Data for "In vitro and in vivo NIR Fluorescence Lifetime Imaging with a time-gated SPAD camera"

Near-infrared (NIR) fluorescence lifetime imaging (FLI) provides a unique contrast mechanism to monitor biological parameters and molecular events in vivo. Single-photon avalanche diode (SPAD) cameras have been recently demonstrated in FLI microscopy (FLIM) applications, but their suitability for in vivo macroscopic FLI (MFLI) in deep tissues remains to be demonstrated. Herein, we report in vivo NIR MFLI measurement with SwissSPAD2, a large time-gated SPAD camera. We first benchmark its performance in well-controlled in vitro experiments, ranging from monitoring environmental effects on fluorescence lifetime, to quantifying Förster resonant energy transfer (FRET) between dyes. Next, we use it for in vivo studies of target-drug engagement in live and intact tumor xenografts using FRET. Information obtained with SwissSPAD2 was successfully compared to that obtained with a gated intensified charge-coupled device (ICCD) camera, using two different approaches. Our results demonstrate that SPAD cameras offer a powerful technology for in vivo preclinical applications in the NIR window.

2DG↗

Initial Demonstration of 9-MHz Framing Camera Rates on the FAST UV Drive Laser Pulse Trains

We report the configuration of a Hamamatsu C5680 streak camera as a framing camera to record transverse spatial information of green-component laser micropulses at 3- and 9-MHz rates for the first time. The latter is near the time scale of the ~7.5-MHz revolution frequency of the Integrable Optics Test Accelerator (IOTA) ring and its expected synchroton radiation source temporal structure. The 2-D images are recorded with a Gig-E readout CCD camera. We also report a first proof of principle with an OTR source using the linac streak camera in a semi-framing mode.

43 PARTICLE ACCELERATORS↗

Light Field Cameras Offer Surveillance a New Dimension

Light field cameras, sometimes called “plenoptic cameras,” are used for a form of computational photography that captures information about the intensity and direction light rays are traveling in a scene. Researchers at Oak Ridge National Laboratory evaluated commercial off-the-shelf light field camera systems from Raytrix and Lytro. This paper describes how light field cameras work, discusses the author’s experience with the systems, proposes potential benefits they may offer for safeguards applications, and identifies limitations that would have to be addressed.

Garner, James R.↗

Integrating Overhead Camera Imagery with Reinforcement Learning to Improve Fuel Economy Through Adaptive Traffic Control

Overhead cameras have been deployed for some time as a sensor for traffic control, with many advantages over conventional inductive loop sensors in terms of robustness, ease of installation, and simplicity with respect to maintenance. We explore the utility of such imagery (in particular, fisheye lens cameras) for intelligent traffic control in real-time using reinforcement learning, with a goal of improving fuel economy for the overall intersection and grid of intersections. We summarize our initial work in data collection and approach to ascertain the ability to visually sense vehicular fuel consumption using real-world data. We then describe our deep reinforcement learning topology to test adaptive control informed by the camera capabilities. Next, we tested the proof-of-concept through a variety of simulation scenarios using the Simulation of Urban Mobility (SUMO) traffic simulator, which included different estimates on vehicle classifications, different traffic distributions, and different traffic densities. Six different control policies were tested ranging from simple timing, to heuristic visual-based methods, to actual policies learned via the reinforcement learning approach. Our results demonstrate the feasibility of the approach for controlling traffic lights for better fuel efficiency based on visual vehicle estimates from commercial, fisheye lens cameras.

Karnowski, Thomas↗