SEARCH · Engineering Papers

Results for “Videos”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

All sources NASA NTRS DOE OSTI

DOE OSTI2022

3DBFSVBF (3D BatFinder Smart Video BioFilter and Multi-class BatFinder Smart Video BioFilter) [SWR-22-88]

Bats are notoriously difficult to study, therefore, identifying specific behavioral trends and the precise environmental conditions at the time of collision requires a monitoring solution that can reliably collect relevant data. To date, thermal infrared video surveillance has been extensively applied to study bats and has proven to be a powerful yet cumbersome tool. Current analytical approaches are time consuming because data processing data has not been fully automated. In the past, steps have been taken to record avian and bat activity in conjunction with complicated image processing techniques that separate species from other moving objects within the field of view (i.e. clouds and portions of the wind turbine). Once the videos are collected, the post-processing does not allow real time monitoring and identification, leading to a delay in both studying the behavior of these species and determining the effectiveness of any impact reduction strategy being studied. Moreover, object identification capability is lacking, thus limiting the usefulness of video data. To resolve these issues, we are using open source 3D computer vision and machine learning techniques allowing for automatic detection of objects in real-time with the ability to correlate these objects with environmental variables and recording the flight paths of each object. The machine learning has been trained on 3D data and allows for automated real-time data collection, identification and tracking, thereby eliminating the need for long and tedious post-analysis processing of the videos. This machine learning model is an added feature to the previous BatFinder Smart Video BioFilter and increases the accuracy of that systems classification by increasing the accuracy of identifying bats (90% accuracy) and insects (69% accuracy) to a 97% accuracy. There are two object classifier machine learning models, Binary and multi-classification. Binary object classifier labeled BatFinder_Smart_Video_BioFilter.h5 distinguishes between biological objects and non-biological objects. The main goal of this object classifier is to ignore the turbine blades while detecting biological object flying withing the rotor swept area of the turbine. Non-biological objects have a probability of 0 and biological objects have a probability of 1. Multi-classifier labeled Multiclass_BatFinder_Smart_Video_BioFilter.h5 distinguishes between bats, birds, insects and non-biological.

Yarbrough, John↗

DOE OSTI2025

Videos, photos, and AI-derived grain size data associated with “High-throughput AI Video Surveys Enable Reproducible Multiscale Sediment Size Mapping, with Implications for Hydrobiogeochemical Parameterization”

NOTE: The manuscript associated with this data package is currently in review. The data may be revised based on reviewer feedback. Upon manuscript acceptance, this data package will be updated with the final dataset and additional metadata. This data package is associated with the manuscript “High-throughput AI Video Surveys Enable Reproducible Multiscale Sediment Size Mapping, with Implications for Hydrobiogeochemical Parameterization” under review. This data package includes five data types: 1) raw photos and videos from drone survey and walking smartphone surveys; 2) images derived from raw videos; 3) manual labeling of reference scales; 4) metadata for all images and photo resolution derived from artificial intelligence (AI) models or manual labels, 5) grain size data obtained from AI models for all photos, 6) metadata and grain size data after quality control, 7) summaries of sample efficiency for all data, and 8) computational fluid dynamics (CFD) data used to support hydro-biogeochemical (HBGC) parameter estimation. Such data is used to 1) demonstrate significant improvements in accuracy, efficiency, and quality control for grain size data collection with the help of AI models, 2) study the spatial heterogeneity of grain size and observation reproducibility based on tens of thousands of data points generated by the AI models, and 3) evaluate the impacts of grain size heterogeneity on key HBGC parameters across sediment-to-reach and hourly-to-yearly scales. In particular, the data package contains 116 folders and 179696 files. The files include 41 videos in .mov format, 64047 photos in .jpg format, 13541 video-derived photos in .png format, 12747 segmentation mask data in .tif format, 12747 segmentation data in .json format, 24771 .csv files that with metadata and grain size for each individual photo as well as water depth and velocity data from CFD and observation, 51791 .txt files of raw AI predicted labels, and 11 flight record data in .srt format. The summary for all metadata and grain size statistics information is included in “Scales_V3_NG.csv” and “Statistics_V3_NG.csv”. The summary for data that pass data quality control (QC) level 0-2 is included in “QCStatistics_V3_NG.csv”. The QC level 0 represents photos whose photo resolution is positive, excluding photos that miss reference scale. The QC level 1 means reference scale circularity uncertainty is less than 5% for smartphone images while representing photo resolution is larger than 0.44 mm/pixel for drone images. The QC level 2 means excluding photos whose grain number is less than 100, a minimum number of grains recommended by classic literature. The summary for each video’s name, length, frame rates, survey area, grain number, survey efficiency, etc. can be found in “QCSummary_V3_NG.csv”. The summary for site name, GPS coordinates, and number of images at each site can be found in “SitesSummary_V3_*.csv” files. Overall computational efficiency summary is reported in Table 4 of accompanying manuscript. Additionally, the nitrate concentration data used in this work was downloaded from an existing dataset published on ESS-DIVE (Boat-Dragged Sensor Hanford Reach.csv; Conner A. et al., 2020). We thank the United States Forest Service, Washington Department of Fish and Wildlife, Washington Department of Natural Resources, Cowiche Canyon Conservatory, Port of Benton, and the Confederated Tribes and Bands of the Yakama Nation for access to field locations where the data were collected. We also thank the Yakama Nation Tribal Council and Yakama Nation Fisheries for working with us to facilitate data collection and optimization of data usage according to their values and worldview.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

BFSVBF (BatFinder Smart Video BioFilter) [SWR-22-87] and Multi-class BatFinder Smart Video BioFilter Keras

Bats are notoriously difficult to study, therefore, identifying specific behavioral trends and the precise environmental conditions at the time of collision requires a monitoring solution that can reliably collect relevant data. To date, thermal infrared video surveillance has been extensively applied to study bats and has proven to be a powerful yet cumbersome tool. Current analytical approaches are time consuming because data processing data has not been fully automated. In the past, steps have been taken to record avian and bat activity in conjunction with complicated image processing techniques that separate species from other moving objects within the field of view (i.e. clouds and portions of the wind turbine). Once the videos are collected, the post-processing does not allow real time monitoring and identification, leading to a delay in both studying the behavior of these species and determining the effectiveness of any impact reduction strategy being studied. Moreover, object identification capability is lacking, thus limiting the usefulness of video data. To resolve these issues, we are using open source computer vision and machine learning techniques allowing for automatic detection of objects in real-time with the ability to correlate these objects with environmental variables and recording the flight paths of each object. The code has gone through five rounds of development with images used to train the models. This advancement allows for automated real-time data collection, identification, and tracking, thereby eliminating the need for long and tedious post-analysis processing of the videos. We will discuss the two open source and publicly available machine learning models developed within this scope of this work: 1) a binary model with a 97.5% accuracy in identifying the difference between an object and an empty scene, including wind turbine and clouds; and 2) a multiple classification model with the capability of identifying the type of object detected: bats (90% accuracy), birds (83% accuracy), insects (69% accuracy) and non-biological (99% accuracy).

Yarbrough, John↗

DOE OSTI2024

Increased accuracy and signal-to-noise ratio through recent improvements in infra-red video bolometer fabrication and calibration

The infra-red video bolometer (IRVB) is a diagnostic equipped with an infra-red camera that measures the total radiated power in thousands of lines of sight within a large field of view. Recently validated in MAST-U [Fderici et al., Rev. Sci. Instrum. 94, 033502 (2023)], it offers a high spatial resolution map of the radiated power in the divertor region, where large gradients are expected. The IRVB’s sensing element comprises a thin layer of high Z absorbing material, typically platinum, usually coated with carbon to reduce reflections [Peterson et al., Rev. Sci. Instrum. 79, 10E301 (2008)].Here, the possibility of using a relatively inert material such as titanium, is explored that can be produced in layers up to 1 μm compared to 2.5 μm for Pt and then coat it with Pt of the desired thickness (0.3 μm per side here) and carbon. This leads to a higher temperature signal (about 3 times) and better spatial resolution (about 4 times), resulting in higher accuracy in the measured power [Peterson et al., Rev. Sci. Instrum. 79, 10E301 (2008)]. This assembly is also expected to improve foil uniformity, as the Pt layer is obtained via deposition rather than mechanical processes [Mukai et al., Rev. Sci. Instrum. 87, 2014 (2016)].Given its multi-material composition, measuring the thermal properties of the foil assembly is vital. Various methods using a calibrated laser as a heat source have been developed, analyzing the temperature profile shape [Sano et al., Plasma and Fusion Res. 7, 2405039 (2012)] and [Mukai et al., Rev. Sci. Instrum. 89, 10E114 (2018)] or fitting the calculated laser power for different intensities and frequencies [Fderici et al., Rev. Sci. Instrum. 94, 033502 (2023)]. Here, a simpler approach is presented, which relies on analyzing the separate components of the foil heat equation for a single laser exposure in a given area. This can then be iterated over the entire foil to capture local deviations.

Magnetic Fusion Energy↗

DOE OSTI2023

Longwave infrared (6.6–11.4 µm) dual-comb spectroscopy with 240,000 comb-mode-resolved data points at video rate

Using sub-3-cycle pulses from mode-locked Cr:ZnS lasers at λ ≈ 2.4 µm as a driving source, we performed high-resolution dual-frequency-comb spectroscopy in the longwave infrared (LWIR) range. A duo of highly coherent broadband (6.6–11.4 µm) frequency combs were produced via intrapulse difference frequency generation in zinc germanium phosphide (ZGP) crystals. Fast (up to 0.1 s per spectrum) acquisition of 240,000 comb-mode-resolved data points, spaced by 80 MHz and referenced to a Rb clock, was demonstrated, resulting in metrology grade molecular spectra of N 2 O (nitrous oxide) and CH 3 OH (methane). The key to high-speed massive spectral data acquisition was low intensity and phase noise of the LWIR combs and high (7.5%) downconversion efficiency, resulting in a LWIR power of 300 mW for each comb.

Vasilyev, Sergey (ORCID:0000000225203547)↗

DOE OSTI2022

Overview and How-to Tutorial Videos for Using NEWTS Data

Overview and How-to Tutorial Videos for Using NEWTS Data Video 1: Overview of NEWTS Database Video 2: How-to tutorial for EPA Flue Gas Desulfurization (FGD) Effluent NEWTS dataset Video 3: How-to tutorial for USGS Produced Waters NEWTS dataset Video 4: How-to tutorial for EPA Ash NEWTS dataset Video 5: How-to tutorial for Quillinan, et al 2018 DOE Geothermal Technology Office REE dataset Video 6: Tutorial video on navigating the NEWTS Dashboard, with an overview of NEWTS and navigating between the NEWTS Dashboard and Datasets (https://netl-doe.maps.arcgis.com/apps/dashboards/a5fa4192f7c6478dab3d6180d9c30b84) Video 7: Additional tutorial video on navigating the NEWTS Dashboard and investigating specific data points in the Dashboard and Datasets Video 8: Re-record of recent webinar giving an overview of the NEWTS Database and Dashboard, including interacting with the NEWTS Dashboard, locating specific data points, and finding the relevant streams in the NEWTS Database and datasets on EDX. Includes overview of the datasets, case studies, and steps for taking stream data from the database and modeling stream data in OLI Studio and Geochemist's Workbench. Note: Video 3 tutorial is also applicable to the USGS Brackish Water NEWTS dataset.

Aqueous Chemistry↗

DOE OSTI2020

Video Summarization Using Deep Action Recognition Features and Robust Principal Components Analysis

In an instance where desired pre-defined actions, behaviors, or other categories are known a priori, various video classification and recognition models can be trained to discover those classifications and their location within the video. Absent that information, one might still be tasked with identifying interesting portions within a video, a process which—if done manually—is onerous and time-consuming as it requires manual inspection of the video itself. Recognizing high-level interesting segments within a whole video has been a general area of interest due to the ubiquity of video data. However the size of the data makes storage, retrieval, and inspection of large collections of videos cumbersome. This problem motivates the task of generating shortened clips highlighting the primary content of a video, relieving the burden of having to watch the entire video. This paper presents an unsupervised method of creating shortened clips of videos, enabling the rapid review of the most interesting content within a video. Our method uses features extracted from pre-trained action recognition models as input to online moving window robust principal component analysis to generate summaries. The procedure is tested on a publicly available video summarization dataset and demonstrates comparable performance to state-of-the-art in an un-augmented setting while requiring no training.

Claborne, Daniel M.↗

DOE OSTI2022

Electronic device and method for compressing video data

A computer-implemented method for compressing video data comprises receiving a sequence of video data values, each video data value being a digital value from a successive one of a plurality of pixels that form a video sensor, the sequence of video data values resulting from successive frames of video captured by the video sensor; extracting the video data values for each pixel in turn to create a plurality of pixel data streams, each pixel data stream including the video data value for each frame of captured video for the pixel; and applying data compression to each pixel data stream to create compressed data for each pixel data stream.

Tohlen, Michael Aaron↗

DOE OSTI2023

Electronic device and method for compressing video data

Tohlen, Michael Aaron↗

DOE OSTI2021

Predicting Nugget Size of Resistance Spot Welds Using Infrared Thermal Videos With Image Segmentation and Convolutional Neural Network

Resistance spot welding (RSW) is a widely adopted joining technique in automotive industry. Recent advancement in sensing technology makes it possible to collect thermal videos of the weld nugget during RSW using an infrared (IR) camera. The effective and timely analysis of such thermal videos has the potential of enabling in situ nondestructive evaluation (NDE) of the weld nugget by predicting nugget thickness and diameter. Deep learning (DL) has demonstrated to be effective in analyzing imaging data in many applications. However, the thermal videos in RSW present unique data-level challenges that compromise the effectiveness of most pre-trained DL models. We propose a novel image segmentation method for handling the RSW thermal videos to improve the prediction performance of DL models in RSW. The proposed method transforms raw thermal videos into spatial-temporal instances in four steps: video-wise normalization, removal of uninformative images, watershed segmentation, and spatial-temporal instance construction. The extracted spatial-temporal instances serve as the input data for training a DL-based NDE model. The proposed method is able to extract high-quality data with spatial-temporal correlations in the thermal videos, while being robust to the impact of unknown surface emissivity. Overall, our case studies demonstrate that the proposed method achieves better prediction of nugget thickness and diameter than predicting without the transformation.

42 ENGINEERING↗

DOE OSTI2021

Triton Field Trials Changes in Habitat 360-degree Underwater Videos

This dataset contains the underwater 360-degree video files recorded with a Boxfish 360 camera in La Jolla, CA, near a gravity base anchor of the CalWave xWave wave energy converter in December 2021 over three days, at dawn, noon, and dusk. It was generated to test the ability of using this type of camera mounted on an aluminum frame as a video lander to monitor the artificial reef effect of marine energy devices and associated seafloor structures. The Boxfish 360 is made of 3 cameras each recording its own set of videos. The videos are MOV files that can be viewed individually with any video reader but need to be stitched together to create the 360-degree footage. This dataset contains all the raw video files collected at dawn, noon and dusk on 11/30/2021, 12/01/2021 and 12/02/2021, for about 1h each time. This dataset is associated with the journal manuscript below (linked in resources): Hemery, L.G.; Mackereth, K.F.; Gunn, C.M.; Pablo, E.B. Use of a 360-Degree Underwater Camera to Characterize Artificial Reef and Fish Aggregating Effects around Marine Energy Devices. J. Mar. Sci. Eng. 2022, 10, 555. https://doi.org/10.3390/jmse10050555

16 TIDAL AND WAVE POWER↗

DOE OSTI2020

Sparse and Random Sampling Techniques for High-Resolution, Full-Field, BSS-Based Structural Dynamics Identification from Video

Video-based techniques for identification of structural dynamics have the advantage that they are very inexpensive to deploy compared to conventional accelerometer or strain gauge techniques. When structural dynamics from video is accomplished using full-field, high-resolution analysis techniques utilizing algorithms on the pixel time series such as principal components analysis and solutions to blind source separation the added benefit of high-resolution, full-field modal identification is achieved. An important property of video of vibrating structures is that it is particularly sparse. Typically video of vibrating structures has a dimensionality consisting of many thousands or even millions of pixels and hundreds to thousands of frames. However the motion of the vibrating structure can be described using only a few mode shapes and their associated time series. As a result, emerging techniques for sparse and random sampling such as compressive sensing should be applicable to performing modal identification on video. This work presents how full-field, high-resolution, structural dynamics identification frameworks can be coupled with compressive sampling. The techniques described in this work are demonstrated to be able to recover mode shapes from experimental video of vibrating structures when 70% to 90% of the frames from a video captured in the conventional manner are removed.

47 OTHER INSTRUMENTATION↗

DOE OSTI2021

FPV Video Adaptation for UAV Collision Avoidance

First person view (FPV) technology for unmanned aerial vehicles (UAVs) provides an immersive experience for pilots and enables various personal and commercial applications such as aerial photography, drone racing, search and rescue operations, agricultural surveillance, and structural inspection. While real time video streaming from a UAV and vision-based collision avoidance strategies have been studied in literature as separate topics, in this paper we tackle collision avoidance in FPV scenarios, taking into account network delays and real time video parameters. We present a theoretical model for obstacle collisions that considers the current communication channel conditions, the real time video parameters, and the UAV's position relative to the closest obstacle. A video adaptation algorithm is then designed, using this metric, to tune the FPV video resolution, number of re-transmission attempts, and the modulation scheme to maximize the probability of avoiding collisions. This algorithm also takes into account specific latency constraints of the application. This video algorithm was evaluated in various scenarios and its ability to respond to both distances to the obstacle as well as the communication channel conditions was demonstrated. It was found that, for the considered scenarios, the performance of the proposed adaptive algorithm was, on an average, 58.63% higher than the closest non-adaptive one in terms of maximizing the probability of avoiding collision. Such collision avoidance strategies could be used to make UAV FPV applications safer and more reliable.

47 OTHER INSTRUMENTATION↗

DOE OSTI2024

Spatialyze: A Geospatial Video Analytics System with Spatial-Aware Optimizations

Videos that are shot using commodity hardware such as phones and surveillance cameras record various metadata such as time and location. We encounter suchgeospatial videoson a daily basis and such videos have been growing in volume significantly. Yet, we do not have data management systems that allow users to interact with such data effectively. In this paper, we describe Spatialyze, a new framework for end-to-end querying of geospatial videos. Spatialyze comes with a domain-specific language where users can construct geospatial video analytic workflows using a 3-step, declarative,build-filter-observeparadigm. Internally, Spatialyze leverages the declarative nature of such workflows, the temporal-spatial metadata stored with videos, and physical behavior of real-world objects to optimize the execution of workflows. Our results using real-world videos and workflows show that Spatialyze can reduce execution time by up to 5.3×, while maintaining up to 97.1% accuracy compared to unoptimized execution.

Computer Science↗

DOE OSTI2025

House Advantage or House of Cards? Stacking the Deck for Data Videos Leads to Null Results: Preprint

Videos are becoming a ubiquitous means of sharing information on social media platforms. In response, data videos - short clips combining visualization with dynamic storytelling, audio descriptions, and spatial referencing - have gained popularity for communicating data. These affordances suggest that data videos might communicate data patterns, trends, and concepts more effectively than static visualizations, enhancing comprehension. However, existing research has not systematically tested this claim. To address this gap, we conducted three controlled studies to measure comprehension differences between data videos and static visualizations. Despite leveraging visual cues and audio explanations, no data video led to significantly better comprehension than an analogous static visualization. Our results suggest data videos are not categorically better and that future research should examine the tradeoffs between their engagement benefits and costs.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

Measured air quality impacts after teaching parents about cooking ventilation with a video: a pilot study

BackgroundCooking-related emissions contribute to air pollutants in the home and may influence children’s health outcomes.ObjectiveIn this pilot study, we investigate the effects of a cooking ventilation intervention in homes with gas stoves, including a video-based educational intervention and range hood replacement (when needed) in children’s homes.MethodsThis was a pilot (n = 14), before-after trial (clinicaltrials.gov #NCT04464720) in homes in the San Francisco Bay Area that had a school-aged child, a gas stove, and either a venting range hood or over-the-range microwave/hood. Cooking events, ventilation use, and indoor air pollution were measured in homes for 2–4 weeks, and children completed respiratory assessments. Midway, families received this intervention: (1) education about the hazards of cooking-related pollutants and benefits of both switching to back burners and using the range hood whenever cooking and (2) ensuring the range hood met airflow and sound performance standards. The educational intervention was delivered via a video developed in conjunction with local youth.ResultsWe found substantially increased use of back burners and slight increases in range hood use during cooking after intervening. Even though there was no change in cooking frequency or duration, these behavior changes resulted in decreases in nitrogen dioxide (NO2), including significant decreases in the total integrated concentration of NO2 over all cooking events from 1230 ppb*min (IQR 336, 7861) to 756 (IQR 84.0, 4210; p < 0.05) and NO2 collected on samplers over the entire pre- and post-intervention intervals from 10.4 ppb (IQR 3.5, 47.5) to 9.4 (IQR 3.0, 36.1; p < 0.005). There were smaller changes in PM2.5, and no changes were seen in respiratory outcomes.ImpactThis pilot before-after trial evaluated the use of a four-minute educational video to improve cooking ventilation in homes with gas stoves and one or more school-aged children. Participant behavior changed after watching the video, and there were decreases in indoor air pollutant concentrations in the home, some of which were significant. This brief video is now publicly available in English and Spanish (wspehsu.ucsf.edu/projects/indoor-air-quality), and this provides suggestive evidence of the utility of this simple intervention, which could be particularly beneficial for households that have children with asthma.

Holm, Stephanie M↗

DOE OSTI2023

Cycle-by-cycle Delay Estimation at Signalized Intersections by using Machine Learning and Simulated Video Detection Data

Accurate estimation of delay is crucial for efficient traffic signal operations. Estimation of delay in the real-time manner using traditional loop detectors requires advanced detectors (in addition to stop-bar detection). In cases when this detection layout is not in place, delay estimates are approximated with a lower accuracy. Video detection is one of the most frequently deployed detection systems at signalized intersections in recent years. In most cases video detection operates in the same way as traditional inductive loops. However, when coupled with computer vision algorithms, video detection systems could be used to retrieve additional information (e.g., vehicular arrivals and departures) that cannot be taken out from the conventional systems (e.g., long stop-bar loop detectors). Although present for several decades, video detection data were not frequently examined for delay estimation purposes. In this study, we proposed a novel delay estimation model which can be developed with only data from stop-bar video detectors. Relevant data were collected from a simulation model of 11 signalized intersections at downtown Chattanooga, TN and processed to create needed inputs for model development. With the use of multigene genetic programming the authors developed a delay model that outperforms accuracy of multi regression model. Furthermore, authors evaluated the developed model by comparison with the other benchmark delay models, such as HCM and approach delay model. It was found that the developed MGGP delay model outperforms benchmark models for a wide range of traffic and signal operation conditions.

Erdagi, Ismet Goksad↗

DOE OSTI2023

Video frame prediction of microbial growth with a recurrent neural network

The recent explosion of interest and advances in machine learning technologies has opened the door to new analytical capabilities in microbiology. Using experimental data such as images or videos, machine learning, in particular deep learning with neural networks, can be harnessed to provide insights and predictions for microbial populations. This paper presents such an application in which a Recurrent Neural Network (RNN) was used to perform prediction of microbial growth for a population of two Pseudomonas aeruginosa mutants. The RNN was trained on videos that were acquired previously using fluorescence microscopy and microfluidics. Of the 20 frames that make up each video, 10 were used as inputs to the network which outputs a prediction for the next 10 frames of the video. The accuracy of the network was evaluated by comparing the predicted frames to the original frames, as well as population curves and the number and size of individual colonies extracted from these frames. Overall, the growth predictions are found to be accurate in metrics such as image comparison, colony size, and total population. Yet, limitations exist due to the scarcity of available and comparable data in the literature, indicating a need for more studies. Both the successes and challenges of our approach are discussed.

59 BASIC BIOLOGICAL SCIENCES↗