Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “CAMERAS (CAMERAS)”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Use of a 360-Degree Underwater Camera to Characterize Artificial Reef and Fish Aggregating Effects around Marine Energy Devices

Marine energy devices must be attached to the seafloor by their foundations, pilings, or anchors, and will have other parts in the water column like the devices themselves, mooring lines, and power export cables running along the seafloor. The installation and presence of these artificial structures will create physical changes that can disrupt or create new habitats, and potentially alter the behavior of mobile organisms such as fish around a device by attracting them to these new artificial reefs and fish aggregating devices. In this study, we tested a new approach for monitoring fish activity around a marine energy device anchor: a 360-degree underwater camera to keep the target (a wave energy converter’s anchor) in the field of view of the camera. The camera was deployed in three configurations (hand-held, tripod, video lander) at sites with different hydrodynamics and underwater visibilities. The video lander was the best configuration: very stable, versatile, and easy to handle. The 360-degree field of view enabled observing and counting fishes, which were more abundant at dusk than dawn or noon, around the anchor. Despite remaining challenges, 360-degree cameras are useful tools for monitoring animal interactions with marine energy devices.

360-degree camera↗

Enhancing Camera Calibration for Traffic Surveillance with an Integrated Approach of Genetic Algorithm and Particle Swarm Optimization

Recent advancements in sensor technologies, coupled with signal processing and machine learning, have enabled real-time traffic control systems to effectively adapt to changing traffic conditions. Cameras, as sensors, offer a cost-effective means to determine the number, location, type, and speed of vehicles, aiding decision-making at traffic intersections. However, the effective use of cameras for traffic surveillance requires proper calibration. This paper proposes a new optimization-based method for camera calibration. In this approach, initial calibration parameters are established using the Direct Linear Transformation (DLT) method. Then, optimization algorithms are applied to further refine the calibration parameters for the correction of nonlinear lens distortions. A significant enhancement in the optimization process is achieved through the integration of the Genetic Algorithm (GA) and Particle Swarm Optimization (PSO) into a combined Integrated GA and PSO (IGAPSO) technique. The effectiveness of this method is demonstrated through the calibration of eleven roadside cameras at three different intersections. The experimental results show that when compared to the baseline DLT method, the vehicle localization error is reduced by 22.30% with GA, 22.31% with PSO, and 25.51% with IGAPSO.

47 OTHER INSTRUMENTATION↗

Thermal Vacuum Testing of a Modified COTS Camera for Lunar Environments

The primary objective of this study was to simulate lunar thermal environments to qualify a modified Commercial-Off-The-Shelf (COTS) camera for potential flight applications. A comprehensive testing regimen was developed, including both vacuum and thermal vacuum testing. The tests subjected the camera to temperatures corresponding to expected extrema, and thermal performance was recorded throughout the process. The testing demonstrated that both the camera and its thermal protection systems were able to maintain operational functionality under most of the simulated conditions. The results of the testing indicate that the implemented thermal protection system is effective for the expected lunar environments. Despite the decrease in operational time in comparison with terrestrial usage, the camera's overall performance supports its suitability for use in both flight and lunar missions.

Thermal↗

Using Machine Learning to Track Objects Across Cameras

Video surveillance is one of the most important technologies used by the International Atomic Energy Agency in international safeguards. At large, complicated facilities, multiple surveillance cameras are deployed to monitor the transfer of safeguards-relevant objects across the site. During inspections, all surveillance videos are reviewed to ensure the objects are not manipulated or diverted during transfer, a laborious, time-consuming task. This work describes using deep machine learning algorithms to track objects automatically across multiple cameras, greatly improving the efficiency of the review process. The fundamental problem in this object tracking task across multiple cameras is how to associate the same object, which may show extreme intra-class variations, such as viewpoints, occlusions, and various scales, in different and even non-overlapped cameras. Object re-identification (Re-ID) in nuclear facility video surveillance is even more challenging than classic person or vehicle Re-ID problems because different instances in the same category may display an identical appearance. One observation from nuclear facility surveillance videos is that all objects must be carted (e.g., via forklift) to move. Therefore, the spatial context information of an object, which provides the feature from the carrier, is critical for the object Re-ID task. This work proposes a two-stream convolutional neural networks model that takes features of objects and their surrounding regions into account. Moreover, the custom videos usually are gleaned from different scenes from the training data, which may have extreme variations in illumination changes and/or cluttered backgrounds. Directly applying the trained model to custom videos will dramatically decrease the performance. To tackle this problem, an advanced domain adaptation technique is proposed to mitigate the gap between the data taken from different scenes. The proposed framework will track objects of interest across a nuclear complex. The resulting tracks can be used in further analyses, such as event/activity recognition, anomaly detection, etc.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Sub-millimeter resolution SiPM-based neutron anger camera

Thermal and cold neutron beamlines require detector systems that have a high neutron efficiency, large active area, and good spatial resolution. One type of detector that has been implemented at beamlines at the Spallation Neutron Source (SNS) is a scintillator-based Anger camera that utilizes photomultiplier tubes (PMTs) as photodetectors. In this work, we present a new Anger camera design that replaces PMTs with silicon photomultipliers (SiPMs). This new design offers better resolution, less distortion, and more compactness than the previous cameras. A camera with active area of ~100 cm 2 was shown to have a spatial resolution better than 0.5 mm. Additionally, the use of SiPMs allows for use in strong magnetic fields, opening the possibility of additional experimental capabilities. In conclusion, prototype has been built that demonstrates vacuum-compatibility, as required for a proposed beamline for the Second Target Station at SNS.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Imaging pyrometry for most color cameras using a triple pass filter

A simple combination of the Planck blackbody emission law, optical filters, and digital image processing is demonstrated to enable most commercial color cameras (still and video) to be used as an imaging pyrometer for flames and explosions. The hardware and data processing described take advantage of the color filter array (CFA) that is deposited on the surface of the light sensor array present in most digital color cameras. In this work, a triple-pass optical filter incorporated into the camera lens allows light in three 10-nm wide bandpass regions to reach the CFA/light sensor array. These bandpass regions are centered over the maxima in the blue, green, and red transmission regions of the CFA, minimizing the spectral overlap of these regions normally present. A computer algorithm is used to retrieve the blue, green, and red image matrices from camera memory and correct for remaining spectral overlap. A second algorithm calibrates the corrected intensities to a gray body emitter of known temperature, producing a color intensity correction factor for the camera/filter system. The Wien approximation to the Planck blackbody emission law is used to construct temperature images from the three color (blue, green, red) matrices. A short pass filter set eliminates light of wavelengths longer than 750 nm, providing reasonable accuracy (±10%) for temperatures between 1200 and 6000 K. The effectiveness of this system is demonstrated by measuring the temperature of several systems for which the temperature is known.

47 OTHER INSTRUMENTATION↗

Multi-camera imaging to characterize jet and liner uniformity on the Plasma Liner Experiment (PLX)

At Plasma Liner Experiment, a set of 36 coaxial plasma guns are deployed quasi-uniformly over a 9 ft diameter spherical chamber and are used to form a high-Z spherically compressive plasma liner. Simulations indicate that for the concept to ultimately achieve optimal target density and temperature, a high degree of timing uniformity is required between all guns. Therefore, to aid in quantifying and correcting gun-to-gun nonuniformities, a key diagnostic will consist of up to six fisheye-view CCD cameras positioned inside the main chamber such that each has all plasma guns within its view. The individual cameras can be triggered at different times to determine each plasma jet’s muzzle velocity and structure for different operating conditions. This camera array is currently under development, and the implementation needs and challenges for this camera array are discussed here. Additionally, we detail the analysis methodology for determining jet-to-jet uniformity deviations and how we can correct them, thereby improving overall liner uniformity.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A Monte Carlo technique to model performance of streak camera-based time-resolving x-ray spectrometers

A Monte Carlo technique has been developed to simulate the expected signal and the statistical noise of x-ray spectrometers that use streak cameras to achieve the time resolution required for ultrafast diagnostics of laser-generated plasmas. The technique accounts for statistics from both the photons incident on the streak camera’s photocathode and the electrons emitted by the photocathode travelling through the camera’s electron optics to the sensor. We use the technique to optimize the design of a spectrometer, which deduces the temporal history of electron temperature of the hotspot in an inertial confinement fusion implosion from its hard x-ray continuum emission spectra. The technique is general enough to be applied to any instrument using an x-ray streak camera.

Stoupin, S. (ORCID:0000000226225270)↗

The fast camera (Fastcam) imaging diagnostic systems on the DIII-D tokamak

Two camera systems are installed on the DIII-D tokamak at the toroidal positions of 90° (90° system) and 225° (225° system), respectively. The cameras have two types of relay optics, namely, a coherent optical fiber bundle and a periscope system. The periscope system provides absolute intensity calibration stability while sacrificing resolution (10 lp/mm), while the fiber system provides high resolution (16 lp/mm) while sacrificing calibration stability. The periscope is available only for the 90° system. The optics of the 225° system were designed for view stability, repeatability, and easy maintenance. The cameras are located inside optimized neutron, x ray and magnetic shielding in order to reduce electronics damage, reboots, and magnetic and neutron interference, increasing the overall system reliability. An automated filter wheel, providing remote filter change, allows for remote wavelength selection. A software suite automates camera acquisition and data storage, allowing for remote operation and reduced operator involvement. System metadata is used to streamline the data analysis workflow, particularly for intensity calibration. Here, the spatial calibration uses multiple observable wall features, resulting in a reconstruction accuracy ≤2 cm.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Solid state streak camera prototype performance testing and future upgrades

Streak Cameras are an essential diagnostic tool used in shock physics and high energy density physics experiments. Such experiments require well calibrated temporally resolving diagnostics for studying events that occur on the nanosecond to microsecond time scales. The Nevada National Security Site (NNSS) and Sandia National Laboratories (SNL) have built a 42-channel solid state streak camera (SSSC) prototype as a proof of concept for use as a streak camera replacement. This work is part of an ongoing project to develop the technology to a level competitive with analog streak cameras. This manuscript discusses the device concept, results from electronic and laser testing, and recent improvements to increase the device’s dynamic range.

Plasma diagnostics - interferometry, spectroscopy ↗

Intensified Tpx3Cam, a fast data-driven optical camera with nanosecond timing resolution for single photon detection in quantum applications

Here we describe a fast data-driven optical camera, Tpx3Cam, with nanosecond scale timing resolution and 80 Mpixel/sec throughput. After the addition of intensifier, the camera is single photon sensitive with quantum efficiency determined primarily by the intensifier photocathode. The single photon performance of the camera was characterized with results on the gain, timing resolution and afterpulsing reported here. The intensified camera was successfully used for measurements in a variety of applications including quantum applications. As an example of such application, which requires simultaneous detection of multiple photons, we describe registration of photon pairs from the spontaneous parametric down-conversion source in a spectrometer. We measured the photon wavelength and timing with respective precisions of 0.15 nm and 3 ns, and also demonstrated that the two photons are anti-correlated in energy.

79 ASTRONOMY AND ASTROPHYSICS↗

Characterization of a SiPM-based monolithic neutron scatter camera using dark counts

The Single Volume Scatter Camera (SVSC) Collaboration aims to develop portable neutron imaging systems for a variety of applications in nuclear non-proliferation. Conventional double-scatter neutron imagers are composed of several separate detector volumes organized in at least two planes. A neutron must scatter in two of these detector volumes for its initial trajectory to be reconstructed. As such, these systems typically have a large footprint and poor geometric efficiency. We report on the design and characterization of a prototype monolithic neutron scatter camera that is intended to significantly improve upon the geometrical shortcomings of conventional neutron cameras. The detector consists of a 50 mm×56 mm× 60 mm monolithic block of EJ-204 plastic scintillator instrumented on two faces with arrays of 64 Hamamatsu S13360-6075PE silicon photomultipliers (SiPMs). The electronic crosstalk is limited to < 5% between adjacent channels and < 0.1% between all other channel pairs. SiPMs introduce a significantly elevated dark count rate over PMTs, as well as correlated noise from after-pulsing and optical crosstalk. In this article, we characterize the dark count rate and optical crosstalk and present a modified event reconstruction likelihood function that accounts for them. We find that the average dark count rate per SiPM is 4.3 MHz with a standard deviation of 1.5 MHz among devices. The analysis method we employ to measure internal optical crosstalk also naturally yields the mean and width of the single-electron pulse height. Here, we calculate separate contributions to the width of the single-electron pulse-height from electronic noise and avalanche fluctuations. We demonstrate a timing resolution for a single-photon pulse to be (128 ± 4) ps. Finally, coincidence analysis is employed to measure external (pixel-to-pixel) optical crosstalk. We present a map of the average external crosstalk probability between 2×4 groups of SiPMs, as well as the in-situ timing characteristics extracted from the coincidence analysis. Further work is needed to characterize the performance of the camera at reconstructing single- and double-site interactions, as well as image reconstruction.

47 OTHER INSTRUMENTATION↗

Real-Time Multi-Vehicle Multi-Camera Tracking with Graph-Based Tracklet Features

An essential application in intelligent transportation systems is multi-target multi-camera tracking (MTMCT), where the target’s activity is tracked from different cameras. Although the tracking-by-detection scheme is the primary paradigm in MTMCT, the object association information from the video frames is lost. This is mainly because the multi-camera multi-object matching uses the information from the video frames separately. To solve this problem and leverage this association information, we propose an MTMCT framework, where features are built in the form of a graph and a graph similarity algorithm is used to match multi-camera objects. In this paper, we focus on the real-time scenario, where only the past images are used to match an object. Our method achieves an IDF1 score (the ratio of the number of correctly identified objects to the number of ground truth and average objects) of 0.75 with a rate of 14 frames per second (fps).

Engineering↗

Advancing 3D surface imaging: single-axis structured light illumination plenoptic camera with machine learning integration

Structured light illumination (SLI) is a configurable 3D surface imaging modality that can function largely independently of surface texture. At the same time, machine learning (ML) approaches are providing new ways to capture relevant information from SLI patterns, avoiding the need to develop advanced computer vision algorithms. By projecting an optical pattern onto a surface and measuring the apparent distortion of that pattern, one can determine surface topography from a single image. Common realizations of SLI 3D imaging use off-axis SLI to allow for parallax-based determination of depth; however, in constrained geometries, the ability to make single-axis measurements can be of major benefit. While plenoptic imaging (PI) cameras have long been developed for the purpose of single-axis 3D imaging, they are generally reliant on the surface texture of the measured object, thus making them unreliable in certain experimental conditions. Therefore, we present a single-axis 3D SLI plenoptic camera, which combines the single-axis benefits of PI technology while using coaxial SLI to maintain indifference to surface conditions. We also present a study of the camera capabilities paired with the development of several algorithms, including traditional feature tracking methods as well as ML methods, which are found to enhance resolution and range. We report depth sensitivity down to 0.2% $\frac{dz}{z_0}$. The single-axis SLI 3D plenoptic camera demonstrates potential applicability for in-situ topographical measurements under a wide range of conditions including, but not limited to, objects without trackable surface texture, high temperatures, and constrained geometry environments.

Imaging systems↗

In vitro and in vivo NIR fluorescence lifetime imaging with a time-gated SPAD camera

Near-infrared (NIR) fluorescence lifetime imaging (FLI) provides a unique contrast mechanism to monitor biological parameters and molecular events in vivo . Single-photon avalanche diode (SPAD) cameras have been recently demonstrated in FLI microscopy (FLIM) applications, but their suitability for in vivo macroscopic FLI (MFLI) in deep tissues remains to be demonstrated. Herein, we report in vivo NIR MFLI measurement with SwissSPAD2, a large time-gated SPAD camera. We first benchmark its performance in well-controlled in vitro experiments, ranging from monitoring environmental effects on fluorescence lifetime, to quantifying Förster resonant energy transfer (FRET) between dyes. Next, we use it for in vivo studies of target-drug engagement in live and intact tumor xenografts using FRET. Information obtained with SwissSPAD2 was successfully compared to that obtained with a gated intensified charge-coupled device (ICCD) camera, using two different approaches. Our results demonstrate that SPAD cameras offer a powerful technology for in vivo preclinical applications in the NIR window.

47 OTHER INSTRUMENTATION↗

Retrieving Point Cloud of Cloud Points (PCCP) Value-Added Product from Stereo Cameras

In this report, we refer to a pair of cameras that capture synchronized pictures with overlapping fields of view (FOV) as a stereo pair. Each stereo pair independently performs a stereo reconstruction of cloud points. Currently, there are three U.S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility stereo pairs (six cameras in total) positioned around the Southern Great Plains (SGP) observatory’s Central Facility (CF; Romps and Oktem 2017). Time-synchronized pictures from the two cameras in a stereo pair can be paired together to obtain a three-dimensional (3D) reconstruction of feature points by triangulation. This document explains how we use ARM stereo cameras and stereophotogrammetric principles to generate the Point Cloud of Cloud Points (PCCP) Value-Added Product (VAP). The PCCP VAP is essentially a set of 3D positions representing the locations of cloud features in the sky. Thousands of cloud features can be reconstructed instantly in each stereo pair's FOV, which covers an area of tens of square kilometers. Cloud base and cloud top heights can be extracted from the PCCP product.

42 ENGINEERING↗

Processing and Archiving Camera Data Effectively for Operando Neutron Measurement of Metal Additive Manufacturing

As the name suggests, The Operando Neutron Measurement of Metal Additive Manufacturing project conducted by ORNL’s Manufacturing Demonstration Facility (MDF) is experimenting with advanced additive metal manufacturing techniques while analyzing the process using the Spallation Neutron Source’s (SNS) beamline. As part of this experiment, the MDF is seeking to employ 2 XIMEA visible light cameras and a single infrared camera to analyze and correct manufacturing in real-time. The MDF requires a solution for capturing the high-resolution data feed from the cameras with compression while preserving enough detail for their software to detect and correct errors in real time. Our solution was to develop a Robot Operating System (ROS) driver to feed the camera data into ROS. From ROS, the feed is compressed and temporarily stored locally to a stripped 4 NVMe SSD RAID array. Post-experiment, the data is transitioned to long-term storage for archival purposes.

36 MATERIALS SCIENCE↗

Estimating vehicle fuel economy from overhead camera imagery and application for traffic control

In this work, we explore the ability to estimate vehicle fuel consumption using imagery from overhead fisheye lens cameras deployed as traffic sensors. We utilize this information to simulate vision-based control of a traffic intersection, with a goal of improving fuel economy with minimal impact to mobility. We introduce the ORNL Overhead Vehicle Dataset (OOVD), consisting of a data set of paired, labeled vehicle images from a ground-based camera and an overhead fisheye lens traffic camera. The data set includes segmentation masks based on Gaussian mixture models for vehicle detection. We show the dataset utility through three applications: the estimate of fuel consumption based on segmentation bounding boxes, vehicle discrimination for those vehicles with largest bounding boxes, and a fine-grained classification on a limited number of vehicle makes and models using a pre-trained set of convolutional neural network models. We compare these results with estimates based on a large open-source data set based on web-scraped imagery. Finally, we show the utility of the approach using reinforcement learning in a traffic simulator using the open source Simulation of Urban Mobility (SUMO) package. Our results show the feasibility of the approach for controlling traffic lights for better fuel efficiency based solely on visual vehicle estimates from commercial, fisheye lens cameras.

Karnowski, Thomas↗