Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Video camera”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Monitoring installation of partially occluded subassemblies in modular construction factories using BIM, ray tracing, and computer vision

Modular and offsite construction methods are being increasingly adopted due to the advantages they offer in terms of project completion time, quality, and energy-efficiency. Despite these advantages, the current state of monitoring systems in modular construction factories highly relies on labor-intensive, subjective, and error-prone observational methods. A large body of research has aimed to automate the monitoring process using an array of sensors, such as IMUs and RFIDs, during the past two decades. Recently, computer vision-based methods have gained increasing interest as a non-intrusive technology to monitor the process inside modular construction factories. However, partial occlusion challenges have impeded their practical application on a large scale. This challenge is specifically important for monitoring the installation of subassemblies since they can obstruct the view of the monitoring camera, especially those that enable long-term monitoring like closed-circuit television (CCTV) fixed-view surveillance cameras. Here, this paper aims to address this challenge by proposing a novel computer vision-based method to monitor the installation of new subassemblies inside modular factories in highly occluded scenes. The proposed methodology identifies the subassemblies in the CCTV video footage using computer vision, analyzes the occlusions using BIM and ray casting techniques, and estimates the progress of assembly by comparing the BIM model with the detected subassemblies in the video. The proposed methodology was successfully validated on surveillance videos captured from a volumetric modular construction factory in the U.S., achieving 93% accuracy in identifying the installation of subassemblies. The results from this research show that the integration of BIM and computer vision is a promising method for monitoring the installation processes inside modular factories under severe occlusion.

97 MATHEMATICS AND COMPUTING↗

Remote Sensing Low Signal-to-Noise-Ratio Target Detection Enhancement

In real-time remote sensing application, frames of data are continuously flowing into the processing system. The capability of detecting objects of interest and tracking them as they move is crucial to many critical surveillance and monitoring missions. Detecting small objects using remote sensors is an ongoing, challenging problem. Since object(s) are located far away from the sensor, the target’s Signal-to-Noise-Ratio (SNR) is low. The Limit of Detection (LOD) for remote sensors is bounded by what is observable on each image frame. In this paper, we present a new method, a “Multi-frame Moving Object Detection System (MMODS)”, to detect small, low SNR objects that are beyond what a human can observe in a single video frame. This is demonstrated by using simulated data where our technology-detected objects are as small as one pixel with a targeted SNR, close to 1:1. We also demonstrate a similar improvement using live data collected with a remote camera. The MMODS technology fills a major technology gap in remote sensing surveillance applications for small target detection. Our method does not require prior knowledge about the environment, pre-labeled targets, or training data to effectively detect and track slow- and fast-moving targets, regardless of the size or the distance.

47 OTHER INSTRUMENTATION↗

Low power and privacy preserving sensor platform for occupancy detection

A low-cost, low-power, stand-alone sensor platform having a visible-range camera sensor, a thermopile array, a microphone, a motion sensor, and a microprocessor that is configured to perform occupancy detection and counting while preserving the privacy of occupants. The platform is programmed to extract shape/texture from images in spatial domain; motion from video in time domain; and audio features in frequency domain. Embedded binarized neural networks are used for efficient object of interest detection. The platform is also programmed with advanced fusion algorithms for multiple sensor modalities addressing dependent sensor observations. The platform may be deployed for (i) residential use in detecting occupants for autonomously controlling building systems, such as HVAC and lighting systems, to provide energy savings, (ii) security and surveillance, such as to detect loitering and surveil places of interest, (iii) analyzing customer behavior and flows, (iv) identifying high performing stores by retailers.

Velipasalar, Senem↗

Quantitative investigation of sooting dynamics in droplet combustion using an automated image analysis algorithm

This paper reports an image analysis approach using a newly-developed open-source program to extract quantitative measurements of soot volume fraction (SVF) from digital video images of burning n-heptane droplets. The automated program developed in this work can analyze images of fixed and untethered droplets to quantify sooting dynamics. The images analyzed in the program were taken from experiments carried out in the Multi-user Droplet Combustion Apparatus (MDCA) onboard the International Space Station (ISS). In these experiments, video imaging of burning droplets was obtained using backlighting by a laser diode with a wavelength of 653 nm. Here, the light was collimated before it passed through the droplet and soot-containing region, after which the light was then attenuated and projected onto the camera’s sensors. This technique facilitates the measurements of SVF based on the principles of the full field light extinction method (FFLEM). The measurements provide quantitative data that reveal the sooting dynamics of liquid fuels during droplet combustion processes. The analyses of a soot-attenuating image (ISS n-heptane, untethered droplet) at an instant during the burning show that the SVF distribution has a peak at the soot shell location. It then decreases due to soot oxidation when the location is further away from the burning droplet. Regarding temporal effects on the maximum SVF (SVF max ), results show that SVF max first increases after the burning is initiated until a peak value is reached, after which SVF max decreases. The SVF max values identified in this study for n-heptane are quantitatively consistent with previously reported values for fiber-supported droplets and are reached relatively early in the burning history. n-Heptane images are also analyzed to show the effects of initial droplet sizes on the maximum soot volume fraction. Results show that SVF max decreases with increasing initial droplet size, which is consistent with visual observations of less soot formed and dimmer flame brightness as Do increases.

42 ENGINEERING↗

Vehicle Tracking with Crop-based Detection

End-to-end production of vehicle tracking data from video in real-time and with high accuracy remains a challenging problem due to the computational cost of object detection on each frame. In this work we present Tracking with Crop-based Detection, a method for speeding object tracking in constrained contexts (with stable cameras and relatively-predictable object motion) such as vehicle traffic monitoring. We leverage this context to provide a strong prior for object locations, which we use to 1.) boost detection speed by detecting objects only in regions corresponding to object priors on most frames and 2.) inform the selection of the detector output for each object. We evaluate Crop-based Detection as an extension to the KIOU object tracker (Crop-KIOU) on the UA-DETRAC dataset. The proposed tracker outperforms all other reported algorithms in terms of PR-MOTA, PR-MOTP, and mostly tracked objects on the UA-DETRAC benchmark, establishing a new state-of-the-art. Relative to tracking by detection with KIOU, Crop-KIOU achieves a 26% higher frame-rate and increases accuracy. Furthermore, Tracking with Crop-based Detection can be combined with frame skipping; we show a 149% increase in framerate relative to KIOU with no decrease in accuracy using this combination of methods.

Gloudemans, Derek↗

Vehicular Re-Identification from Uncontrolled Multiple Views

Vehicle re-identification (re-ID) across disparate sensing modalities remains a fundamental challenge for transportation research. In this work, we introduce a deep multi-view vehicle re-ID framework that leverages Siamese networks to compare pairs of vehicle images and produce matching scores, enabling robust association across drastically different viewpoints such as those from UAVs, surveillance cameras, and ground sensors. The model exploits convolutional neural networks to learn features that remain discriminative under changes in angle, distance, and illumination, supporting more generalizable re-ID performance. As part of this effort, we also developed an automated pipeline to synchronize roadside and UAV video streams, producing a multi-perspective dataset that complements preexisting real collections and a synthetic dataset generated in this study. Together, these contributions advance the capability to re-identify vehicles across wide viewing baselines; establish a foundation for scalable, reproducible research in vehicle re-ID; and open pathways for future applications, such as inferring routine behaviors, movement patterns, and daily habits of the individual associated with the vehicle.

convolutional neural networks↗

Truck Platooning Performance with ADAS and Onboard Camera Data Describing Traffic Interactions

This project was part of the Characterizing Behaviors and Capabilities for Emerging Connected and Automated Vehicle Technologies, Sensors, and Connectivity project. The National Laboratory of the Rockies partnered with Cummins Inc. to collect data from Class 8 tractor trailer combinations in platoon (cooperative adaptive cruise control) operations on public roads in southern Indiana. Data collected include J1939 CAN bus, radar, intervehicle position, and video data. The video data could not be shared in the raw form, so they were processed to extract information on the other vehicles on the road, their relative positions, and intrusion events. This information was then columnized for modeling use and further enhanced by appending road information including road type, speed limit, altitude, and grade. The test route included free-flowing traffic, highway interchanges, and construction zones, as well as low-, medium-, and high-grade sections. Individual test conditions varied by day, with advanced driver-assistance system (ADAS) features engaged or disengaged and different combined vehicle masses tested in addition to uncontrolled variables such as weather and traffic interactions.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Toward an AI-Powered Software Pipeline for Real-Time Tracking and Analysis of Wildfire and Smoke

Real-time tracking of wildfires and smoke is crucial for effective response, minimizing damage, protecting lives, and efficiently managing resources during fire emergencies. We develop a web-based AI-powered pipeline that detects wildfires in aerial video and estimates deployment-relevant behavior metrics, including cumulative burned area, burned-area growth rate, fire spread direction, and smoke dispersion. The system combines a YOLO-based detector with YCbCr-based fire segmentation, HSV-based smoke segmentation, Farneback optical flow, and centroid-based spatiotemporal tracking. Using ground sampling distance (GSD), pixel-level fire masks are converted to physical burned-area measurements by correlating fire pixel counts with camera altitude and tilt angle. We benchmark YOLO variants and non-YOLO baselines (GoogLeNet, CNN, DBN, Autoencoder, U-Net, and AlexNet) on the IEEE FLAME dataset and a newly created aerial frame dataset, Wildfire-DB. Cross-dataset evaluation uses a strict threshold-transfer protocol: decision thresholds are selected on FLAME validation and transferred unchanged to Wildfire-DB to quantify generalization under domain shift. YOLOv6 achieves the strongest cross-dataset frame-level fire detection on Wildfire-DB (ROC-AUC 0.8200, PR-AUC 0.8044, and transferred-threshold F1 0.7596). For tracking-oriented deployment requiring oriented localization, YOLO11-OBB provides the most reliable cross-dataset behavior among OBB-capable models while remaining computationally feasible. To analyze the feasibility of UAV deployment, we further measure inference efficiency using synchronized GPU and CPU power logs on a fixed workload of 1569 frames. YOLO-family models process the video in 5.73–12.47 seconds with net energy of 1247.28–1775.39 J, substantially lower latency and energy than heavier classification and reconstruction baselines. Overall, model optimality depends on operational objectives: YOLOv6 is best for cross-dataset detection robustness, whereas YOL...

Color segmentation↗

Obstacle Detection for Drones Using Machine Learning

Using machine learning, drones are able to detect obstacles in real time utilizing only a camera. Obstacle detection is done with a depth estimation model. The model produces an estimate of the distance of all the objects within the drones line of sight. From this estimate we can then detect if we are close to an obstacle. The method has been applied to a variety of real world videos and achieves 92% accuracy.

47 OTHER INSTRUMENTATION↗

Blast Effects on Buildings (Final Report)

Lawrence Livermore National Laboratory (LLNL) has conservatively reduced the explosive safety standards suggested by the Small Quantities in Research Laboratories (SQRL) program testing by 60%. For this reason, further research into the detailed effects of small amounts of explosives in typically constructed rooms is needed in order to improve their factor of safety. The team was tasked with designing an experiment to investigate the effect of different variables on drywall under explosive blasts. In order to meet this objective, the team conducted a comprehensive literature review to gain an understanding of industry-standard construction practices and review previous tests conducted by the Army corp of engineers. Since the team used PBXN-5 rather than C4, as in SQRL, an initial shot was conducted to compare damage levels. From those results and the physical constraints of the testing chamber, the team redesigned multiple single-panel drywall frames to capture the entirety of the incurred damage. Proposed designs were narrowed down using a decision matrix. From the study of previous tests and literature review, variables were chosen that the team hypothesized to have an impact on drywall strength. The variables that were tested were chosen from the results of that work and specific variables the sponsor was interested in, and they were paint, humidity/moisture content, and explosive positioning relative to the studs. Detailed plans were made for each variable according to what conditions the team wanted to investigate. For humidity, this involved testing low, ambient, and high conditions by treating the panels in a chamber. Preliminary shots were performed to test the structural integrity of the frame and streamline the test diagnostics which involved a high-speed camera placed behind the drywall, outside of the chamber, and a pressure probe placed behind the drywall, inside the chamber. Once the instrumentation, diagnostics, and frame design were finalized, a quantitative damage criteria matrix was created to categorize the results of the main shot series. In conjunction with evidence from the high-speed video, the achieved damage levels indicate that high moisture content drywall is better able to withstand explosive blasts. Larger stud damage and lower drywall damage occurred when the explosive was located directly in front of a stud. Paint had no noticeable impact on strength. Ultimately, the team conducted a total of 17 tests, leaving the door open for future in-depth research into the impact of humidity.

36 MATERIALS SCIENCE↗

Extraction of Vibration Data with Imaging

To date, the primary sensing technology used to measure the vibration response has been accelerometers and strain gages mounted directly to the structure and using either wired or, more recently, wireless telemetry. Cost issues with these sensors and the associated data acquisition systems typically limit the numbers that are deployed on in situ structures. Although there are a few structures with larger sensing counts that in some cases exceed over 1000 sensors, more typical numbers range from ten to one hundred sensors resulting in low spatial resolution when they are applied to physically large systems. When one considers that nuclear power plant structures usually have complex geometries, material properties, connectivity and boundary conditions, it is clear these current approaches to vibration measurements can only provide limited information about a system’s dynamics response characteristics. As an alternative, many non-contact measurement technologies have emerged, including point wise measurement methods such as Global Positioning System (GPS), microwave interferometry, and laser Doppler vibrometry (LDV), as well as simultaneous full-field measurement methods such as electronic speckle pattern interferometry, holography interferometry, and muon tomography, some of which can provide high spatial resolution measurements. Among these methods, digital video imaging techniques have emerged as a feasible solution for full-field vibration measurements that provide significantly more detailed dynamic response information because every pixel becomes a measurement point. Furthermore, recent advances in image processing and computer vision algorithms have been successfully used to process video data for experimental and operational modal analysis. Such full-field measurements have the potential to significantly improve many current structural assessment procedures including system identification (modal parameter estimation), structural health monitoring, load reconstruction, model validation, and model updating. Furthermore, more recent full-field imaging techniques can be accomplished with relatively low-cost, commercially-available off-the-shelf cameras. However, these measurement procedures have other limitations that must be considered such as the ability to only measure visibly accessible points on a structure and a more limited dynamic range and bandwidth than can be achieved with accelerometers or strain gages.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

lumicap v0.1

Automated HDR luminance imaging system designed for daylighting research and building science. It controls a fisheye-lens camera to capture time-lapse bracket sequences, merges them into calibrated HDR images, and runs a full post-processing pipeline — all unattended. Features: - Scheduled LDR bracket capture via gphoto2 - HDR merging with vignetting, ND filter, and fisheye projection corrections - Illuminance and luminance meter integration (Konica Minolta T-10A, LS-100/150) - Daylight glare probability (DGP) and solar position computation - Automated false-color rendering, JPEG thumbnails, and daily time-lapse video - CSV data logging per timestep Uses: - Long-term monitoring of daylight conditions in buildings - Glare analysis for occupant comfort research - Solar irradiance and sky luminance studies Advantages: - End-to-end automation — capture, calibration, analysis, and archiving run without manual intervention - Built on the proven Radiance toolchain, ensuring photometrically accurate HDR output - Hardware-agnostic meter support via serial auto-detection - Lightweight — no GUI overhead, deployable on a headless Raspberry Pi or similar embedded system

Wang, Taoning [Lawrence Berkeley National Laborato↗

From Data to Insights: A Covariate Analysis of the IARPA BRIAR Dataset for Multimodal Biometric Recognition Algorithms at Altitude and Range

This paper examines covariate effects on fused whole body biometrics performance in the IARPA BRIAR dataset, specifically focusing on UAV platforms, elevated positions, and distances up to 1000 meters. The dataset includes outdoor videos compared with indoor images and controlled gait recordings. Normalized raw fusion scores relate directly to predicted false accept rates (FAR), offering an intuitive means for interpreting model results. A linear model is developed to predict biometric algorithm scores, analyzing their performance to identify the most influential covariates on accuracy at altitude and range. Weather factors like temperature, wind speed, solar loading, and turbulence are also investigated in this analysis. The study found that resolution and camera distance best predicted accuracy and findings can guide future research and development efforts in long-range/elevated/UAV biometrics and support the creation of more reliable and robust systems for national security and other critical domains.

Bolme, David↗

Characterization of Orography-Influenced Riming and Secondary Ice Production and Their Effects on Precipitation Rates Using Radar Polarimetry and Doppler Spectra (CORSIPP-SAIL)

The Characterization of Orography-Influenced Riming and Secondary Ice Production and Their Effects on Precipitation Rates Using Radar Polarimetry and Doppler Spectra (CORSIPP) project was conducted to help improve the understanding of precipitation formation in orographically influenced terrain. Special focus is put on the two processes of riming and secondary ice production and their external drivers. Two instruments, a polarimetric W-band simultaneous transmission simultaneous reception (STSR) Doppler cloud radar manufactured by Radiometer Physics GmbH (RPG, instrument type RPG-FMCW-94-DP), from now on named LIMRAD94, and the video in situ snowfall sensor (VISSS), were deployed at the U. S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility’s Surface Atmosphere Integrated Field Laboratory (SAIL) site in Gothic, Colorado between November 2022 and June 2023 during the second SAIL winter. Note that the exact dates of data availability differ between the instruments. Both instruments arrived at Gothic on November 2, 2022, 09:20 local time. VISSS, described by Maahn et al., is equipped with two camera systems with telecentric lenses. The two cameras are at a 90° angle to each other. This configuration allows for size-independent measurements by capturing images of hydrometeors from two sides at a high frame rate of 250 Hz. With a minimum detection size of 200 μm, VISSS provides valuable insights into particle size, number, shape, complexity, and fall velocity. The VISSS was deployed on the grassland next to the ARM facility with the amazing help of the ARM employees on site. The setup started on November 2, 2022, and was finished on November 5, 2022, without major problems. VISSS measurements were started on November 6, 2022. LIMRAD94 was installed on a scaffolding platform near Orehouse (Gothic) on November 9, 2022, with the great help of RMBL staff. LIMRAD94 was mounted on a cold temperature scanner prototype. After a short test of the setup on November 9, 2022, the digital control of the scanner elevation stopped working for (at that time) unknown reasons. All attempts to resolve the problem failed. This malfunction made it impossible to operate LIMRAD94 in scanning mode. The scanner was then manually moved to zenith pointing mode and between November 10 and November 15, 2022, vertical observations for polarimetric calibration were performed. On November 15, 2022, after the polarimetric calibration was applied, the scanner was manually moved to 40° elevation with azimuthal view towards the Ka-band ARM Zenith Radar (KAZR) and measurements were continued at constant elevation. Investigation of the scanner malfunction on February 6, 2023, by Benn Schmatz revealed a disengagement between the cogwheel of the elevation motor and the cogwheel moving the scanner in elevation. This mechanical issue was temporarily solved by re-engaging the cogwheels. This made the scanner operational again for about four weeks, until mechanical force disengaged the cogwheels again on March 15, 2023. This repeated scanner failure remained undetected for about three weeks until April 8, 2023; during this time the scanner was stuck at 72° elevation. However, the radar software continued to produce data files falsely indicating that the scanner was still operational. After the scanner failure was noticed, scanning was stopped again, and we returned to constant elevation measurements. On May 15, 2023, the cogwheels of the elevation motor were secured with additional screws sent by the manufacturer. At some point in May, the cogwheels of the azimuth motor were also disengaged by mechanical force, which still allowed for range height indicator (RHI) but no plan position indicator (PPI) scans in the last weeks of the campaign. The azimuth motor was repaired in Germany after the end of the campaign. Throughout the campaign, RMBL and ARM staff kept the radar and the VISSS free of snow.

54 ENVIRONMENTAL SCIENCES↗

Quantifying Operational Drivers of Multimodal Biometric Verification in Aerial Surveillance

Multimodal biometric verification is increasingly applied across operational contexts ranging from close-range security cameras and building-mounted surveillance to long-range ground sensors and unmanned aerial system (UAS) imagery. Variations in acquisition conditions—such as image resolution, viewing geometry, and motion artifacts—pose significant challenges for cross-domain algorithmic generalization. This study evaluates two independent multimodal biometric verification systems developed under the Intelligence Advanced Research Projects Activity (IARPA) Biometric Recognition and Identification at Altitude and Range (BRIAR) program, comparing performance on close-range and aerial datasets. Close-range video served as a baseline to quantify the decline in verification performance on aerial footage. The dataset included six UAS platforms, spanning small quadcopters at 10m altitude to medium-sized fixed-wing aircraft at 360m. Mixed-effects logistic regression identified image resolution (head and body pixel counts), head height, sensor characteristics, and algorithm selection as primary determinants of verification success, whereas demographic attributes and mission gait were not significant predictors. Activity type and collection site influenced performance in close-range data but had negligible impact on UAS imagery. These results clarify modality-specific strengths and limitations and highlight opportunities to enhance cross-domain biometric verification.

Peluso, Alina [ORNL] (ORCID:0000000328950406)↗

The Sensor Dilemma in Intelligent Transportation Systems

Intelligent Transportation Systems (ITS) are at the forefront in advancing the way we interact and perceive with the transportation network. This revolution is fueled by the significant advancement in sensor perception technologies such as Radar, LiDAR and Video Imaging which are the most popular modalities for ITS. Real-time perception data from these sensors allows intelligent infrastructure side decision making to improve the energy, efficiency and safety at traffic intersections. As traffic departments across the United States are transitioning from traditional loop detectors / emulators and embracing newer technologies, they are often left with a dilemma in choosing a sensor technology for infrastructure-based perception which is reliable, inexpensive, easy to setup and has robust performance in varying weather conditions. However, choosing a sensor which checks all boxes is not straightforward as every sensor type has unique benefits and drawbacks. Radar is excellent at detecting long range vehicles and weather resistance but lacks high resolution. LiDAR is expensive and weather-sensitive, while cameras provide rich visual data at a low cost but are constrained by lighting and visibility. This study examines Radar, LiDAR and camera sensors capabilities to ascertain whether any of these qualifies as the "best" sensor for ITS perception. Through this evaluation, we hope to draw attention to the necessity of National Renewable Energy Laboratory's (NREL) Infrastructure Perception and Control (IPC) framework which presents a multi-sensor track data fusion engine to assimilate multiple data streams in order to provide robust and reliable perception. While no single sensor can meet all the demands of ITS, a hybrid approach combining multiple sensor modalities like Radar, LiDAR and cameras, offers the most robust solution for enhancing the safety and efficiency in intelligent transportation systems.

33 ADVANCED PROPULSION SYSTEMS↗

Microcam: A Low Power and Privacy Preserving Multi-modal Platform for Occupancy Detection (Final Report)

Heating, ventilation, and air conditioning (HVAC) consumes a significant portion of the energy used in buildings. Much of this is wasted energy, used when buildings are either not occupied at all, or occupied well under their maximum design conditions. This project has focused on residential occupancy detection to autonomously control HVAC systems and save energy. Limitations of existing occupancy sensors include one or more of the following: (i) they employ sensors or algorithms that are not able to detect stationary occupants; (ii) they cannot classify the source of the motion (such as a pet); (iii) depending on the camera resolution and employed algorithms, they do not allow for embedded or onboard computation, and require external or cloud-based processing; (iv) many algorithms developed for camera-based systems are sensitive to lighting changes, and thus prone to missed detections or false alarms; (v) Most existing systems depend on adjustment of settings for different scenarios, complicating self-commissioning; (vi) they cannot provide high enough accuracy; (vii) they are costly; (viii) they are not battery-powered, thus limiting ease of use and installation. In this project, Syracuse University and its partner SRI have developed a low-cost, high accuracy, standalone residential occupancy sensing platform, referred to as the MicroCam, to address all of the aforementioned challenges. MicroCam can operate on typical alkaline batteries without relying on the “cloud” or external computing resources, and consists of low-power, Artificial Intelligence (AI)-based, IoT platforms. Each platform has multi-modal sensors and can process motion, audio and video data, and send binary occupancy result to a lead platform. All sensor data is processed locally on platforms, and the only transmitted data is the binary occupancy state. In addition, preliminary work has been done on images wherein occupants are not discernable. Thus, MicroCam is a standalone solution preserving privacy of the occupants.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗