Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “camera”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

PiCAM: A Raspberry Pi-based open-source, low-power camera system for monitoring plant phenology in Arctic environments

Time-lapse cameras have been widely used as a tool to monitor the timing of seasonal vegetation growth. These simple, relatively inexpensive systems can provide high-frequency observations of leaf development and demography which are critical data sets needed to characterize plant phenology from species to landscapes. This is important for understanding how plants are responding to global changes, as well as for validating satellite-derived phenology products. However, in remote regions including the high-latitude Arctic, deploying time-lapse cameras could be challenging. The remoteness and lack of widespread power and telecommunications infrastructure limit options for the installation, maintenance and retrieval of data and equipment, and make it difficult for cameras to survive in extreme weather (e.g. long cold winters). To improve our understanding of Arctic phenology, new technologies are required to address these challenges. Here, we present a novel, low-power, compact, lightweight time-lapse camera system, called power-interval camera automation module (PiCAM). The PiCAM was designed with explicit consideration to simplify deployment (i.e. without a need for external power supplies) of camera systems and to address the challenges of camera survival in harsh Arctic environments. In this paper, we describe the design, setup and technical details of the PiCAM and provide a roadmap for how to build and operate these systems. As proof of concept, we deployed 26 PiCAMs at three low-Arctic tundra sites on the Seward Peninsula, Alaska in early August 2021 for characterizing Arctic plant phenology. Of the 26 PiCAMs, 70% remained active at the point of our revisit in late July 2022 despite the extreme winter temperatures they experienced (< –30°C, heavy snow cover). We extracted key plant phenology metrics from the PiCAMs and captured strong differences across key Arctic plant species. We showed that the PiCAM has the potential to be widely used for monitoring plant phenology across the broader Arctic region, addressing the need for ground-based understanding of Arctic phenological diversity to develop knowledge of plant response to climate change and to validate remote sensing products.

54 ENVIRONMENTAL SCIENCES↗

To image, or not to image: class-specific diffractive cameras with all-optical erasure of undesired objects

Abstract Privacy protection is a growing concern in the digital era, with machine vision techniques widely used throughout public and private settings. Existing methods address this growing problem by, e.g., encrypting camera images or obscuring/blurring the imaged information through digital algorithms. Here, we demonstrate a camera design that performs class-specific imaging of target objects with instantaneous all-optical erasure of other classes of objects. This diffractive camera consists of transmissive surfaces structured using deep learning to perform selective imaging of target classes of objects positioned at its input field-of-view. After their fabrication, the thin diffractive layers collectively perform optical mode filtering to accurately form images of the objects that belong to a target data class or group of classes, while instantaneously erasing objects of the other data classes at the output field-of-view. Using the same framework, we also demonstrate the design of class-specific permutation and class-specific linear transformation cameras, where the objects of a target data class are pixel-wise permuted or linearly transformed following an arbitrarily selected transformation matrix for all-optical class-specific encryption, while the other classes of objects are irreversibly erased from the output image. The success of class-specific diffractive cameras was experimentally demonstrated using terahertz (THz) waves and 3D-printed diffractive layers that selectively imaged only one class of the MNIST handwritten digit dataset, all-optically erasing the other handwritten digits. This diffractive camera design can be scaled to different parts of the electromagnetic spectrum, including, e.g., the visible and infrared wavelengths, to provide transformative opportunities for privacy-preserving digital cameras and task-specific data-efficient imaging.

47 OTHER INSTRUMENTATION↗

Multi-Angle Snowflake Camera Instrument Handbook

The Multi-Angle Snowflake Camera (MASC) takes 9- to 37-micron resolution stereographic photographs of free-falling hydrometers from three angles, while simultaneously measuring their fall speed. Information about hydrometeor size, shape orientation, and aspect ratio is derived from MASC photographs. The instrument consists of three commercial cameras separated by angles of 36º. Each camera field of view is aligned to have a common single focus point about 10 cm distant from the cameras. Two near-infrared emitter pairs are aligned with the camera’s field of view within a 10-angular ring and detect hydrometeor passage, with the lower emitters configured to trigger the MASC cameras. The sensitive IR motion sensors are designed to filter out slow variations in ambient light. Fall speed is derived from successive triggers along the fall path. The camera exposure times are extremely short, in the range of 1/25,000th of a second, enabling the MASC to capture snowflake sizes ranging from 30 micrometers to 3 cm.

47 OTHER INSTRUMENTATION↗

Characterization of Cameras for the COSMO K-coronagraph

Digital image sensors are ubiquitous in astronomical instrumentation and it is well known that they suffer from issues that must be corrected for data to be scientifically useful. I present discussion on errors resulting from digitization and characterization of nonlinearity and ADC errors of the PhotonFocus MV-D1024E cameras selected for the K-coronagraph of the Coronal Solar Magnetism Observatory. I derive an analytic expression for quantization errors. The MV-D1024E camera has adequate bit depth for which quantization error is not an issue. I show that this is not the case for all cameras, particularly those with deep wells and low read noise. The impact of nonlinearity and ADC errors on science observations of the K-coronagraph is analyzed using a simplified telescope model. Errors caused by the camera ADCs result in systematic errors in the measurement of the polarimetric signal of several times 10{sup −9} B {sub ⊙}, which is about an order of magnitude above the desired sensitivity. I demonstrate a method for post-facto data correction using a lookup table and derive parameters from camera characterization measurements that were made with a lab setup. Nonlinearity is traditionally addressed with a global correction. I show through analysis of calibration data that for the MV-D1024E this correction leaves residual systematic errors after dark and gain correction of up to 1% of the signal. I demonstrate that a pixel-wise correction of nonlinearity reduces the errors to below 0.1%. These corrections are necessary for the K-coronagraph data products to meet the science requirements. They have been implemented in the instrument data acquisition system and data reduction pipeline. While no other instruments besides the K-coronagraph or cameras besides the MV-D1024E are discussed here, the results are illustrative for all instruments and cameras.

79 ASTRONOMY AND ASTROPHYSICS↗

Sky camera geometric calibration using solar observations

A camera model and associated automated calibration procedure for stationary daytime sky imaging cameras is presented. The specific modeling and calibration needs are motivated by remotely deployed cameras used to forecast solar power production where cameras point skyward and use 180° fisheye lenses. Sun position in the sky and on the image plane provides a simple and automated approach to calibration; special equipment or calibration patterns are not required. Sun position in the sky is modeled using a solar position algorithm (requiring latitude, longitude, altitude and time as inputs). Sun position on the image plane is detected using a simple image processing algorithm. The performance evaluation focuses on the calibration of a camera employing a fisheye lens with an equisolid angle projection, but the camera model is general enough to treat most fixed focal length, central, dioptric camera systems with a photo objective lens. Calibration errors scale with the noise level of the sun position measurement in the image plane, but the calibration is robust across a large range of noise in the sun position. In conclusion, calibration performance on clear days ranged from 0.94 to 1.24 pixels root mean square error.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of Low-cost, Full HD, CMOS Cameras for Use in the Calcine Retrieval Project - 19530

This paper describes results from radiation testing conducted on low-cost, commercial off-the-shelf, full high-definition (HD) resolution (1920 x 1080 p), complementary metal-oxide-semiconductor (CMOS) camera sensors. The purpose of the testing was to evaluate the sensors' suitability for use in the Calcine Retrieval Project by determining their image quality and life expectancy while operating in an ionizing radiation field of 20.0 Gy/h. The two camera sensors tested were the Axis FA1105 and Axis FA1125. These commercial camera sensors were designed for retail security surveillance and have no radiation-hardened (rad-hard) components. In addition to radiation testing, the sensors' field-of-view, resolution, and low-light image quality were tested at several target distances to ensure they meet project requirements. Testing was divided into two phases. During Phase 1, four FA1105 sensors and four FA1125 sensors were tested simultaneously without any shielding in radiation fields of 25.5 Gy/h and 49.3 Gy/h. In Phase 2, three FA1105 and five FA1125 sensors were shielded by 22.2 mm of lead and tested simultaneously in radiation fields of 26.8 Gy/h, 52.3 Gy/h, 143.0 Gy/h, 200.7 Gy/h, 404.6 Gy/h, and 2,317.5 Gy/h. Dose rate values were established using film dosimetry readings. Apertures in the shielding allowed for a 40-degree field of view while shielding all parts of the sensor except for directly in front of the CMOS sensor array. All testing was conducted at the Idaho Accelerator Center in Pocatello, Idaho, using a 450 keV X-ray generator. Sensor images were automatically captured at regular intervals throughout the testing for qualitative evaluation by the test team. Film dosimetry was placed near the sensors to record actual dose totals. The 450 keV setting generates X-ray radiation with an energy level close to the primary gamma energy level produced by the Cesium-137 isotope in the calcine, which is 662 keV. Results from Phase 1 indicate the sensors failed at an average cumulative dose of 226.3 Gy. For a given 20.0 Gy/h field this results in a mean time to failure (MTTF) of 11.3 hours. Recorded images from all sensors showed minimal image degradation due to radiation-induced noise. When the sensors finally failed, the failure mode was an abrupt loss of video. The image went black suggesting some other component in the sensor head besides the CMOS sensor array was responsible for the failure. During a portion of Phase 1 testing, a commercial, rad-hard camera was irradiated in the 25.5 Gy/h field along with the eight Axis FA series sensors. Image quality from the FA series sensors significantly outperformed the image quality of the rad-hard camera in radiation-induced noise tolerance, image resolution, and dynamic range. During Phase 2 testing, all sensors produced excellent images in radiation fields as high as 404.6 Gy/h. One FA1125 sensor was tested at the highest dose rate of 2,317.5 Gy/h. At this dose rate, the image was color shifted towards red and contained a significant amount radiation-induced noise. The sensor did not fail and was producing usable imagery after one hour, at which time the test was ended due to allotted beam-time at the test facility. Eighteen hours after X-rays were shut off, the sensor image returned to normal color and all eight sensors continued to operate without any visible, permanent image degradation. For Phase 2 testing, it was not possible to establish a MTTF since none of the shielded sensors failed during the allotted test time. However, given the highest cumulative dose of 4,142.1 Gy received by a shielded FA1125 sensor, a minimum life expectancy of 207 hours (8.6 days) is predicted while operating in a 20.0 Gy/h field. Test results indicate the radiation tolerance of the FA series sensor's CMOS array, along with the small form factor, full HD image quality, wide dynamic range, and Ethernet standard makes it suitable for short-term use in monitoring and visually documenting waste remediation efforts for the Calcine Retrieval Project at the INL. The sensor's low-cost of about $140 US, compared to commercial rad-hard cameras costing between $5,000 and $7,000 US each, allow them to be used as an affordable, disposable resource for many short-duration, radioactive waste remediation efforts where decontamination of an expensive, commercial rad-hard camera is undesirable or not possible. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Performance comparison of state-of-the-art high-speed video cameras for scientific applications

Time-resolved visualization of fast processes using high-speed digital video-cameras has been widely used in most fields of scientific research for over a decade. In many applications, high-speed imaging is used not only to record the time history of a phenomenon but also to quantify it, hence requiring dependable equipment. Important aspects of two-dimensional imaging instrumentation used to qualitatively or quantitatively assess fast-moving scenes include sensitivity, linearity, as well as signal-to-noise ratio (SNR). Under certain circumstances, the weaknesses of commercially available high-speed cameras, i.e., sensitivity, linearity, image lag, etc., render the experiment complicated and uncertain. Our study evaluated two advanced CMOS-based, continuous-recording, high-speed cameras available at the moment of writing. In this work, various parameters, potentially important toward accurate time-resolved measurements and photonic quantification, have been measured under controlled conditions on the bench, using scientific instrumentation. Testing procedures to measure sensitivity, linearity, SNR, shutter accuracy, and image lag are proposed and detailed. The results of the tests, comparing the two high-speed cameras under study, are also presented and discussed. Results show that, with careful implementation and understanding of their performance and limitations, these high-speed cameras are reasonable alternatives to scientific CCD cameras, while also delivering time-resolved imaging data.

42 ENGINEERING↗

EGS Collab Experiment 1: 4850L Downhole Camera Surveys During Injection

This package includes data and footage from two rounds of downhole camera surveys performed at the Sanford Underground Research Facility (SURF) on the 4850 level. The exercise was performed once on 25 May 2018 and once on 21 December 2018. On May 25th, the first round was done during fluid injection at the 164-ft stimulation zone in the injection well (E1-I). On December 21st, the second round was carried out during fluid injection at the 142-ft stimulation zone. Prior to the injections, downhole instrumentation was removed from the production well (E1-P) to allow room for the downhole camera system. The water within E1-P was then lifted out by the application of air pressure and the downhole camera system was conveyed into the production well. Finally, the water was injected into E1-I and the camera was used to scan for jetting points, or fluid entry, in E1-P. There is a survey description in this package that further describes the procedure of the survey and the overall results. Additionally, there is a detailed analysis of the surveys in the form of a PowerPoint, which includes animations/visualizations from the camera footage, presents interpretations in detail, and provides some general conclusions. Three animations, along with the two video segments that show the jetting into E1-P, are also provided. The video footage was collected using a GeoVISION Dual-Scan Micro Video Camera, the specs of which are also included in this package as a resource.

15 GEOTHERMAL ENERGY↗

Improving the accessibility and transferability of machine learning algorithms for identification of animals in camera trap images: MLWIC2

Motion-activated wildlife cameras (or “camera traps”) are frequently used to remotely and noninvasively observe animals. The vast number of images collected from camera trap projects has prompted some biologists to employ machine learning algorithms to automatically recognize species in these images, or at least filter-out images that do not contain animals. These approaches are often limited by model transferability, as a model trained to recognize species from one location might not work as well for the same species in different locations. Furthermore, these methods often require advanced computational skills, making them inaccessible to many biologists. We used 3 million camera trap images from 18 studies in 10 states across the United States of America to train two deep neural networks, one that recognizes 58 species, the “species model,” and one that determines if an image is empty or if it contains an animal, the “empty-animal model.” Our species model and empty-animal model had accuracies of 96.8% and 97.3%, respectively. Furthermore, the models performed well on some out-of-sample datasets, as the species model had 91% accuracy on species from Canada (accuracy range 36%–91% across all out-of-sample datasets) and the empty-animal model achieved an accuracy of 91%–94% on out-of-sample datasets from different continents. Our software addresses some of the limitations of using machine learning to classify images from camera traps. By including many species from several locations, our species model is potentially applicable to many camera trap studies in North America. We also found that our empty-animal model can facilitate removal of images without animals globally. We provide the trained models in an R package (MLWIC2: Machine Learning for Wildlife Image Classification in R), which contains Shiny Applications that allow scientists with minimal programming experience to use trained models and train new models in six neural network architectures with varying depths.

59 BASIC BIOLOGICAL SCIENCES↗

Installation of a fast framing visible camera on KSTAR

Visible camera technologies have made remarkable progress in recent years, and the fast camera has proven itself to be a capable imaging diagnostic in studies of specific fusion plasma issues such as the start-up physics, plasma wall interactions, edge-localized modes, and disruptions. For the purpose of favorable visible imaging, a fast framing camera has recently been installed on the Korea Superconducting Tokamak Advanced Research (KSTAR) device. The camera uses a complementary metal-oxide semiconductor detector with a maximum resolution of 1280x1024 at 1000 frames/s (fps) and a minimum resolution of 1280x16 at 64 kfps. A 2-m-long viewport having a novel optical rail system was installed on a tangential port to view the tokamak interior. The system is fully controlled from the main control room and protected by a shutter from deposits. To verify that the camera electronics are safe from the high magnetic field and its rapid time variation, possible influences are considered theoretically and experimentally. In this work, we present the design and installation of the fast camera system on the KSTAR device with discussions on the field variation effect issues.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Conceptual design of a neutron camera for MAST Upgrade

This paper presents two different conceptual designs of neutron cameras for Mega Ampere Spherical Tokamak (MAST) Upgrade. The first one consists of two horizontal cameras, one equatorial and one vertically down-shifted by 65 cm. The second design, viewing the plasma in a poloidal section, also consists of two cameras, one radial and the other one with a diagonal view. Design parameters for the different cameras were selected on the basis of neutron transport calculations and on a set of target measurement requirements taking into account the predicted neutron emissivities in the different MAST Upgrade operating scenarios. Based on a comparison of the cameras’ profile resolving power, the horizontal cameras are suggested as the best option.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Development of a pixelated GSO gamma camera system with tungsten parallel hole collimator for single photon imaging

Purpose: In small animal imaging using a single photon emitting radionuclide, a high resolution gamma camera is required. Recently, position sensitive photomultiplier tubes (PSPMTs) with high quantum efficiency have been developed. By combining these with nonhygroscopic scintillators with a relatively low light output, a high resolution gamma camera can become useful for low energy gamma photons. Therefore, the authors developed a gamma camera by combining a pixelated Ce-doped Gd{sub 2}SiO{sub 5} (GSO) block with a high quantum efficiency PSPMT. Methods: GSO was selected for the scintillator, because it is not hygroscopic and does not contain any natural radioactivity. An array of 1.9 mm x 1.9 mm x 7 mm individual GSO crystal elements was constructed. These GSOs were combined with a 0.1-mm thick reflector to form a 22 x 22 matrix and optically coupled to a high quantum efficiency PSPMT (H8500C-100 MOD8). The GSO gamma camera was encased in a tungsten gamma-ray shield with tungsten pixelated parallel hole collimator, and the basic performance was measured for Co-57 gamma photons (122 keV). Results: In a two-dimensional position histogram, all pixels were clearly resolved. The energy resolution was {approx}15% FWHM. With the 20-mm thick tungsten pixelated collimator, the spatial resolution was 4.4-mm FWHM 40 mm from the collimator surface, and the sensitivity was {approx}0.05%. Phantom and small animal images were successfully obtained with our developed gamma camera. Conclusions: These results confirmed that the developed pixelated GSO gamma camera has potential as an effective instrument for low energy gamma photon imaging.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Quantitatively accurate activity measurements with a dedicated cardiac SPECT camera: Physical phantom experiments

Purpose: Recently, there has been increased interest in dedicated cardiac single photon emission computed tomography (SPECT) scanners with pinhole collimation and improved detector technology due to their improved count sensitivity and resolution over traditional parallel-hole cameras. With traditional cameras, energy-based approaches are often used in the clinic for scatter compensation because they are fast and easily implemented. Some of the cardiac cameras use cadmium-zinc-telluride (CZT) detectors which can complicate the use of energy-based scatter correction (SC) due to the low-energy tail—an increased number of unscattered photons detected with reduced energy. Modified energy-based scatter correction methods can be implemented, but their level of accuracy is unclear. In this study, the authors validated by physical phantom experiments the quantitative accuracy and reproducibility of easily implemented correction techniques applied to {sup 99m}Tc myocardial imaging with a CZT-detector-based gamma camera with multiple heads, each with a single-pinhole collimator. Methods: Activity in the cardiac compartment of an Anthropomorphic Torso phantom (Data Spectrum Corporation) was measured through 15 {sup 99m}Tc-SPECT acquisitions. The ratio of activity concentrations in organ compartments resembled a clinical {sup 99m}Tc-sestamibi scan and was kept consistent across all experiments (1.2:1 heart to liver and 1.5:1 heart to lung). Two background activity levels were considered: no activity (cold) and an activity concentration 1/10th of the heart (hot). A plastic “lesion” was placed inside of the septal wall of the myocardial insert to simulate the presence of a region without tracer uptake and contrast in this lesion was calculated for all images. The true net activity in each compartment was measured with a dose calibrator (CRC-25R, Capintec, Inc.). A 10 min SPECT image was acquired using a dedicated cardiac camera with CZT detectors (Discovery NM530c, GE Healthcare), followed by a CT scan for attenuation correction (AC). For each experiment, separate images were created including reconstruction with no corrections (NC), with AC, with attenuation and dual-energy window (DEW) scatter correction (ACSC), with attenuation and partial volume correction (PVC) applied (ACPVC), and with attenuation, scatter, and PVC applied (ACSCPVC). The DEW SC method used was modified to account for the presence of the low-energy tail. Results: T-tests showed that the mean error in absolute activity measurement was reduced significantly for AC and ACSC compared to NC for both (hot and cold) datasets (p < 0.001) and that ACSC, ACPVC, and ACSCPVC show significant reductions in mean differences compared to AC (p ≤ 0.001) without increasing the uncertainty (p > 0.4). The effect of SC and PVC was significant in reducing errors over AC in both datasets (p < 0.001 and p < 0.01, respectively), resulting in a mean error of 5% ± 4%. Conclusions: Quantitative measurements of cardiac {sup 99m}Tc activity are achievable using attenuation and scatter corrections, with the authors’ dedicated cardiac SPECT camera. Partial volume corrections offer improvements in measurement accuracy in AC images and ACSC images with elevated background activity; however, these improvements are not significant in ACSC images with low background activity.

61 RADIATION PROTECTION AND DOSIMETRY↗

SU-F-J-206: Systematic Evaluation of the Minimum Detectable Shift Using a Range- Finding Camera

Purpose: The robotic table used for patient alignment in proton therapy is calibrated only at commissioning under well-defined conditions and table shifts may vary over time and with differing conditions. The purpose of this study is to systematically investigate minimum detectable shifts using a time-of-flight (TOF) range-finding camera for table position feedback. Methods: A TOF camera was used to acquire one hundred 424 × 512 range images from a flat surface before and after known shifts. Range was assigned by averaging central regions of the image across multiple images. Depth resolution was determined by evaluating the difference between the actual shift of the surface and the measured shift. Depth resolution was evaluated for number of images averaged, area of sensor over which depth was averaged, distance from camera to surface, central versus peripheral image regions, and angle of surface relative to camera. Results: For one to one thousand images with a shift of one millimeter the range in error was 0.852 ± 0.27 mm to 0.004 ± 0.01 mm (95% C.I.). For varying regions of the camera sensor the range in error was 0.02 ± 0.05 mm to 0.47 ± 0.04 mm. The following results are for 10 image averages. For areas ranging from one pixel to 9 × 9 pixels the range in error was 0.15 ± 0.09 to 0.29 ± 0.15 mm (1σ). For distances ranging from two to four meters the range in error was 0.15 ± 0.09 to 0.28 ± 0.15 mm. For an angle of incidence between thirty degrees and ninety degrees the average range in error was 0.11 ± 0.08 to 0.17 ± 0.09 mm. Conclusion: It is feasible to use a TOF camera for measuring shifts in flat surfaces under clinically relevant conditions with submillimeter precision.

60 APPLIED LIFE SCIENCES↗

Ultra-high-precision alignment of the elastomerically mounted elements of the science camera lenses for the Mars Science Laboratory (MSL) rover

Cameras built for space exploration are required to meet stringent environmental conditions, such as thermal and dynamic loads for both the optics (camera lens) and imaging electronics. On a multitude of spaceborne imaging instruments, optical elements are supported in their mounts via an elastomeric bonding approach using a room temperature vulcanizing silicone as the bonding agent. Employing this integration method, we achieved element-to-element alignment, measured as the total indicated runout, using a high-precision contact probe to be on the order of half a wavelength of He-Ne laser light, or 0.3 {mu}m, on the Malin Space Science Systems lenses for the Mars Science Laboratory (MSL) cameras. This is a higher precision than the current industry state-of-the-art, and it was achieved for the very challenging small diameter lens elements. This paper describes the design philosophy, implementation, and integration method that resulted in achieving this level of precision for interelement alignment. The results are based on actual measurements that were made during the process of building the MSL rover's science camera lenses, namely Mastcams, the Mars Hand Lens Imager, and the Mars Descent Imager. The optical designs of these cameras lenses are described in detail in [Opt. Eng.48, 103002 (2009)10.1117/1.3251343], while further information on the four science cameras can be found at http://www.msss.com.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

A Cooperative Control Algorithm for Camera Based Observational Systems

Over the last several years, there has been considerable growth in camera based observation systems for a variety of safety, scientific, and recreational applications. In order to improve the effectiveness of these systems, we frequently desire the ability to increase the number of observed objects, but solving this problem is not as simple as adding more cameras. Quite often, there are economic or physical restrictions that prevent us from adding additional cameras to the system. As a result, we require methods that coordinate the tracking of objects between multiple cameras in an optimal way. In order to accomplish this goal, we present a new cooperative control algorithm for a camera based observational system. Specifically, we present a receding horizon control where we model the underlying optimal control problem as a mixed integer linear program. The benefit of this design is that we can coordinate the actions between each camera while simultaneously respecting its kinematics. In addition, we further improve the quality of our solution by coupling our algorithm with a Kalman filter. Through this integration, we not only add a predictive component to our control, but we use the uncertainty estimates provided by the filter to encourage the system to periodically observe any outliers in the observed area. This combined approach allows us to intelligently observe the entire region of interest in an effective and thorough manner.

99 GENERAL AND MISCELLANEOUS↗

Multi-target camera tracking, hand-off and display LDRD 158819 final report

Modern security control rooms gather video and sensor feeds from tens to hundreds of cameras. Advanced camera analytics can detect motion from individual video streams and convert unexpected motion into alarms, but the interpretation of these alarms depends heavily upon human operators. Unfortunately, these operators can be overwhelmed when a large number of events happen simultaneously, or lulled into complacency due to frequent false alarms. This LDRD project has focused on improving video surveillance-based security systems by changing the fundamental focus from the cameras to the targets being tracked. If properly integrated, more cameras shouldn't lead to more alarms, more monitors, more operators, and increased response latency but instead should lead to better information and more rapid response times. For the course of the LDRD we have been developing algorithms that take live video imagery from multiple video cameras, identifies individual moving targets from the background imagery, and then displays the results in a single 3D interactive video. In this document we summarize the work in developing this multi-camera, multi-target system, including lessons learned, tools developed, technologies explored, and a description of current capability.

47 OTHER INSTRUMENTATION↗

Multi-Target Camera Tracking, Hand-off and Display LDRD 158819 Final Report

Modern security control rooms gather video and sensor feeds from tens to hundreds of cameras. Advanced camera analytics can detect motion from individual video streams and convert unexpected motion into alarms, but the interpretation of these alarms depends heavily upon human operators. Unfortunately, these operators can be overwhelmed when a large number of events happen simultaneously, or lulled into complacency due to frequent false alarms. This LDRD project has focused on improving video surveillance-based security systems by changing the fundamental focus from the cameras to the targets being tracked. If properly integrated, more cameras shouldn’t lead to more alarms, more monitors, more operators, and increased response latency but instead should lead to better information and more rapid response times. For the course of the LDRD we have been developing algorithms that take live video imagery from multiple video cameras, identify individual moving targets from the background imagery, and then display the results in a single 3D interactive video. In this document we summarize the work in developing this multi-camera, multi-target system, including lessons learned, tools developed, technologies explored, and a description of current capability.

47 OTHER INSTRUMENTATION↗