Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Videos”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Use of vision and sound to classify feller-buncher operational state

Productivity measures in logging involve simultaneous recognition and classification of event occurrence and timing, and the volume of stems being handled. In full-tree felling systems these measurements are difficult to implement in an autonomous manner because of the unfavorable working environment and the abundance of confounding extraneous events. This paper proposed a vision method that used a lowcost camera to recognize feller-buncher operational events including tree cutting and piling. It used a fine K-nearest neighbors (fKNN) algorithm as the final classifier based on both audio and video features derived from short video segments as inputs. The classifier’s calibration accuracy exceeds 94%. The trained model was tested on videos recorded under various conditions. The overall accurate rates for short segments were greater than 89%. Comparisons were made between the human- and algorithm derived event detection rates, events’ durations, and inter-event timing using continuously recorded videos taken during feller operation. Video results between the fKNN model and manual observation were similar. Statistical comparison using the Kolmogorov–Smirnov test to evaluate measured parameters’ distributions (manual versus automated event duration and inter-event timing) did not show significant differences with the lowest P-value among all Kolmogorov–Smirnov tests equal to 0.12. Here the result indicated the feasibility and potential of using the method for the automatic time study of drive-to-tree feller bunchers.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

So you think you can track?

This work introduces a multi-camera tracking dataset consisting of 234 hours of video data recorded concurrently from 234 overlapping HD cameras covering a 4.2 mile stretch of 8-10 lane interstate highway near Nashville, TN. Video is recorded in cooperation with Tennessee State Department of Transportation and its policies. The video is recorded during a period of high traffic density with 500+ objects typically visible within the scene and typical object longevities of 3-15 minutes. GPS trajectories from 270 vehicle passes through the scene are manually corrected in the video data to provide a set of ground-truth trajectories for recall-oriented tracking metrics, and object detections are provided for each camera in the scene (159 million total before cross-camera fusion). Initial benchmarking of tracking-by-detection algorithms is performed against the GPS trajectories, and a best HOTA of only 9.5% is obtained (best recall 75.9% at IOU 0.1, 47.9 average IDs per ground truth object), indicating the benchmarked trackers do not perform sufficiently well at the long temporal and spatial durations required for traffic scene understanding. Video data, scene information, and vehicle trajectories are made publicly available at i24motion.org.

42 ENGINEERING↗
DOE OSTI2025

Development and Validation of Smart Building Technology Modules for Academic and Professional Education (Final Technical Report)

Smart building technologies can improve building energy efficiency and resilience, reduce carbon emissions, and provide load flexibility to the grid. However, in both college curricula and building professionals’ continuing education, there is a lack of systematic instruction on smart building technologies. Slipstream, partnering with Texas A&M University (TAMU), the Society of Building Science Educators (SBSE), and the National Institute of Building Sciences (NIBS), developed a semester-long smart building curriculum for college students and 16 training videos for building professionals and the general public. The education and training cover the drivers and benefits of smart building technologies, key building energy systems, the latest sensor technologies and IoT devices, and focus on topics related to smart building controls (i.e., energy management information systems, smart building control platforms, cybersecurity, grid-interactive-efficient buildings [GEBs], smart building control methods, and occupant-centric control). The smart building curriculum for college students was taught at TAMU in the Spring semester of 2024 as part of the validation process. Student feedback was collected and summarized in a validation report by TAMU. The curriculum material was also reviewed by SBSE faculty who are interested in teaching smart building technology-related courses. Suggestions on revisions and better adoption of the materials by other faculty across the architectural, engineering, and construction (AEC) domains were compiled in a distinct validation report by SBSE. The SBSE validation report was used to create structured subsets of the curriculum material for adoption at different levels in different sub-disciplines. These subsets are categorized and offered on the SBSE website (https://www.sbse.org/courses/Smart-Building-Technologies). The 16 training videos for building professionals and the general public were previewed by 17 industry experts, and feedback and suggested changes were incorporated into the final version of these videos. The videos are organized into a smart building technology training course and published on the Whole Building Design Guide website (https://www.wbdg.org/ce/doe/bto/sbtt), which is hosted by the National Institute of Building Sciences (NIBS). Project team members created marketing materials to promote the awareness of these free, publicly available education and training resources. Outreach and marketing activities included creating short promotional videos, building project webpages, making project announcements on social media, conducting an email campaign, and directly reaching out to faculties and building professionals. This report describes the project approach, provides outlines of the training materials, along with links to resources, and identifies lessons learned in creating the content. We also suggest ways to scale the instruction of smart building concepts to empower the workforce to accelerate the adoption of smart building technologies in the real world.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2020

Panel Session 4 and 15: Japan Fukushima Daiichi D and D Update and Technological Challenges at Japan Fukushima Daiichi D and D and Update on Nuclear Overview and Development in Japan - Nuclear Fuel Cycle

Sessions 4 and 15 represent a two-part panel series that discusses progress and challenges associated with cleanup at Fukushima. Severe limitations on availability of original panelists from Japan due to strict restrictions put in place to alleviate the spread of coronavirus necessitated changes to both panels. The result was a significantly modified panel for Session 04 (shown above) and the elimination of all panelists for Session 15. The 4 and 15 Panel Sessions provide an overview of activities related to both the progress and challenges of cleanup and decommissioning of the Fukushima Daiichi Nuclear Power Station (NPS) in Japan. Five panelists discussed perspectives of the cleanup following a Tokyo Electric Power Company (TEPCO) video showing the progress on site since the devastating Great East Earthquake and tsunami that caused the explosions at three of the six reactors on the site. Three of the five panelists discussed on-going work being performed for the effort, while the other two provided expert perspectives of on strategic efforts at the site. The panel was attended by over 80 technologists and policy makers spanning the globe and was opened by Dr. Monica Regalbuto of Idaho National Laboratory and a short video provided by TEPCO. The video described changes at the site that spanned the cleanup efforts from stabilizing water intrusion into the contaminated reactor buildings to construction of new administrative facilities. The video explained the processes underway to retrieve spent fuel rods and challenges in retrieval of the compromised fuel debris. The video highlighted working condition improvements that included establishment of rest housing and a small convenience store on the site, and the rollback of protective equipment around the site due to decreases contamination. Panelists with presentations: Revision of 'the Mid-and-Long-Term Road-map towards the Decommissioning of TEPCO's Fukushima Daiichi Nuclear Power Station' (Paul Dickman); Sharing UK experience at Fukushima Daiichi (Adrian Simper); SRNL Japan (Andrew Fellinger); ABLE's Initiative to Dismantle the Exhaust Stack (Daniel Walter); JAEA R and D in Fukushima (Tokio Fukahori); TEPCO - Overview and Update of the Fukushima Decommissioning Process (Monica Regalbuto); Toshiba's Involvement in the Decommissioning of the Fukushima Daiichi Nuclear Power Plant (Yasuhiro Yuguchi); Remote Dismantling of the Exhaust Stack At Fukushima Dai-ichi NPS (Takashi Okutsu)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2022

CAS Operator Training Simulator

SAND2022-1525 O The Central Alarm System (CAS) training simulator is a standalone application that will work on any Alarm Control and Display (AC&D) System. Designed to be used by an instructor in a classroom environment, this software plays back scenario alarms and videos usually exported out of Scribe3D or any software that can produce scenario-based videos. Users can select from an array of different scenarios to play. The alarms are sent to an AC&D controller and the videos are sent to a Video Management Server (VMS). Both alarms and associated videos displayed by the intended AC&D system. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Le, Tam↗
DOE OSTI2022

Metal fuel relocation experiments with pressure injection

A pool-type sodium-cooled fast reactor (SFR) using metal fuels has a number of inherent safety features that can support benign consequences for design basis accidents (DBAs). Even in postulated severe accident conditions, the core is designed to remain under sub-critical condition in a passive coolable geometry. In case of the postulated severe accidents in SFRs, fuel relocation in the core region along the coolant channel is an important negative reactivity feedback factor that lowers the reactor power level and consequently eliminates the possibility of recriticality. Therefore, understanding the relocation behavior of fuels and the coolability of the relocated fuels in the postulated severe accident is one of the most important factors in the safety assessment of SFRs. In the present study, the relocation behavior of the metal fuel in a pin bundle geometry was investigated by injecting the metal fuels into the coolant channels with pressure. The first metal fuel relocation with pressure injection (RPI-1) experiment showed that many of the metal fuels levitated to upper plenum. In case of RPI-2 experiment, the Real Time X-ray Video System (RTXVS) was constructed and used to obtain a real time X-ray video of the experiment. This real time X-ray video clearly showed the relocation behavior of the pressure injected metallic uranium in the sodium coolant channel. Through this video, it was confirmed that part of the fuel was dispersed downward and part of the fuel was dispersed upward, and the relocation behavior of the injected fuel proceeded simultaneously in the downward and upward directions. So, it can be concluded that in case of pressure injection of the metallic fuel, there is a possibility that the metallic fuel can be quickly removed from the core region, resulting in a negative reactivity feedback effect.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

Critical analysis of velocimetry methods for particulate flows from synthetic data

Particle tracking methods that extract high-fidelity particle velocity data from high speed video of particle laden flows is a common experimental technique applied to chemical processes. These measurements are used to better understand the motion of particles and fluids in complex systems and create data against which computational models are validated. However, the methods, codes, and experimental setups all have limitations. It is imperative that practitioners verify the methods and their implementation as well as understand the limitations of experimental setups. This work focuses on quantifying the visible depth of field in a high particle concentration fluidized bed. Following a precedent set by the particle imaging velocimetry community, a particle velocity field is manufactured using a computational fluid dynamics and discrete element method simulation. Photo realistic high-speed videos are rendered based on the simulated data using the three-dimensional creation software Blender. Particle velocities are extracted from the synthetic high-speed videos using three variants of Particle Tracking Velocimetry and Optical Flow Velocimetry methodologies. Here, the tracked results are then compared to the known solution, quantifying the error associated with the assumed visible depth. The results indicate that at depth of one particle diameter, all three particle tracking codes give accurate measurements, largely within 5%. However, the error increases when the full bed video measurements are compared to the known solution at one particle diameter, i.e., mimicking a validation study. Finally, for some statistics the constant depth assumption only increases the error slightly, for others significantly.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Dictionary Learning with Accumulator Neurons

The Locally Competitive Algorithm (LCA) uses local competition between non-spiking leaky integrator neurons to infer sparse representations, allowing for potentially real-time execution on massively parallel neuromorphic architectures such as Intel's Loihi processor. Here, we focus on the problem of inferring sparse representations from streaming video using dictionaries of spatiotemporal features optimized in an unsupervised manner for sparse reconstruction. Non-spiking LCA has previously been used to achieve unsupervised learning of spatiotemporal dictionaries composed of convolutional kernels from raw, unlabeled video. We demonstrate how unsupervised dictionary learning with spiking LCA (\hbox{S-LCA}) can be efficiently implemented using accumulator neurons, which combine a conventional leaky-integrate-and-fire (\hbox{LIF}) spike generator with an additional state variable that is used to minimize the difference between the integrated input and the spiking output. We demonstrate dictionary learning across a wide range of dynamical regimes, from graded to intermittent spiking, for inferring sparse representations of both static images drawn from the CIFAR database as well as video frames captured from a DVS camera. On a classification task that requires identification of the suite from a deck of cards being rapidly flipped through as viewed by a DVS camera, we find essentially no degradation in performance as the LCA model used to infer sparse spatiotemporal representations migrates from graded to spiking. We conclude that accumulator neurons are likely to provide a powerful enabling component of future neuromorphic hardware for implementing online unsupervised learning of spatiotemporal dictionaries optimized for sparse reconstruction of streaming video from event based DVS cameras.

artificial intelligence↗
DOE OSTI2021

Passive method to measure strength of turbulence

Disclosed is a method to passively measure and calculate the strength of turbulence via the index of refraction structure constant Cn2 from video imagery gathered by an imaging device, such as a video camera. Processing may occur with any type computing device utilizing a processor executing machine executable code stored on memory. This method significantly simplifies instrumentation requirements, reduces cost, and provides rapid data output. This method combines an angle of arrival methodology, which provides scale factors, with a new spatial/temporal frequency domain method. As part of the development process, video imagery from high speed cameras was collected and analyzed. The data was decimated to video rates such that statistics could be computed and used to confirm that this passive method accurately characterizes the atmospheric turbulence. Cn2 accuracy from this method compared well with scintillometer data through two full orders of magnitude and more capability is expected beyond this verification.

O'Neill, Mary Morabito↗
DOE OSTI2020

Autonomous Selective Parts-Based Tracking

Object tracking from videos is still a challenging task due to various changes throughout a video sequence including occlusions, motion blur, scale and other deformation changes. In this paper, we propose a selective parts-based approach, using correlation filters, that makes choices based on a consensus of the parts and global tracking. Moreover, we further enhance our parts-based approach by introducing a segmentation-assisted parts initialization. In addition, we present a genetic algorithm-based method to autonomously select various parameters of the tracking algorithm, as opposed to the common practice of manually tuning those parameters. In contrast to existing part-based methods, the proposed method does not dilute accurate tracking by averaging results over multiple parts at every frame. Instead, we take a selective approach based on the relative weight of the responses across parts. Moreover, we only make location corrections when a part diverges, and rely on these location corrections to maintain an accurate appearance model. In the case of occlusions, which are among the main reasons for using a parts-based approach, our proposed approach consistently achieves the best performance. It is due to the ability to handle occlusion and not dilute decisions with incorrect parts, that our proposed approach enables state-of-the-art performance. The approach we propose was evaluated on videos from three different challenging benchmark datasets. Our approach has resulted in better overall precision and success rates for three different base tracking approaches.

42 ENGINEERING↗
DOE OSTI2023

CholecTriplet2021: A benchmark challenge for surgical action triplet recognition

Context-aware decision support in the operating room can foster surgical safety and efficiency by leveraging real-time feedback from surgical workflow analysis. Most existing works recognize surgical activities at a coarse-grained level, such as phases, steps or events, leaving out fine-grained interaction details about the surgical activity; yet those are needed for more helpful AI assistance in the operating room. Recognizing surgical actions as triplets of ‹ instrument, verb, target › combination delivers more comprehensive details about the activities taking place in surgical videos. This paper presents CholecTriplet2021: an endoscopic vision challenge organized at MICCAI 2021 for the recognition of surgical action triplets in laparoscopic videos. Here, the challenge granted private access to the large-scale CholecT50 dataset, which is annotated with action triplet information. In this paper, we present the challenge setup and the assessment of the state-of-the-art deep learning methods proposed by the participants during the challenge. Here, a total of 4 baseline methods from the challenge organizers and 19 new deep learning algorithms from the competing teams are presented to recognize surgical action triplets directly from surgical videos, achieving mean average precision (mAP) ranging from 4.2% to 38.1%. This study also analyzes the significance of the results obtained by the presented approaches, performs a thorough methodological comparison between them, in-depth result analysis, and proposes a novel ensemble method for enhanced recognition. Our analysis shows that surgical workflow analysis is not yet solved, and also highlights interesting directions for future research on fine-grained surgical activity recognition which is of utmost importance for the development of AI in surgery.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Monitoring installation of partially occluded subassemblies in modular construction factories using BIM, ray tracing, and computer vision

Modular and offsite construction methods are being increasingly adopted due to the advantages they offer in terms of project completion time, quality, and energy-efficiency. Despite these advantages, the current state of monitoring systems in modular construction factories highly relies on labor-intensive, subjective, and error-prone observational methods. A large body of research has aimed to automate the monitoring process using an array of sensors, such as IMUs and RFIDs, during the past two decades. Recently, computer vision-based methods have gained increasing interest as a non-intrusive technology to monitor the process inside modular construction factories. However, partial occlusion challenges have impeded their practical application on a large scale. This challenge is specifically important for monitoring the installation of subassemblies since they can obstruct the view of the monitoring camera, especially those that enable long-term monitoring like closed-circuit television (CCTV) fixed-view surveillance cameras. Here, this paper aims to address this challenge by proposing a novel computer vision-based method to monitor the installation of new subassemblies inside modular factories in highly occluded scenes. The proposed methodology identifies the subassemblies in the CCTV video footage using computer vision, analyzes the occlusions using BIM and ray casting techniques, and estimates the progress of assembly by comparing the BIM model with the detected subassemblies in the video. The proposed methodology was successfully validated on surveillance videos captured from a volumetric modular construction factory in the U.S., achieving 93% accuracy in identifying the installation of subassemblies. The results from this research show that the integration of BIM and computer vision is a promising method for monitoring the installation processes inside modular factories under severe occlusion.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Autonomous nondestructive evaluation of resistance spot welded joints

The application of non-destructive evaluation approaches has attracted strong interests in modern automotive industries. Here, we present an autonomous deep-computing framework to analyze raw videos from infrared systems and to predict weld nugget shape and size with unprecedented accuracy and speed. In a comprehensive training and testing experiment with 90 videos (seven sets of welding material stack-ups), a new method was developed to assemble sufficient datasets for neural network training. Our framework successfully predicts all the nugget shapes with F1 scores that range from 0.84 to 0.92. The total training time on Nvidia DGX station takes less than 10 min for each set of welding material stack-up. The real inference time of an individual dataset (with 30 video frames) takes about 0.005 s. The procedure and methods developed in the study can be applied to other image-based weld property prediction, as well as other manufacturing processes. Furthermore, our well-trained neural networks take limited memory resources (2.3 MB) and are suitable for embedded microprocessors for in-situ welding quality control as edge computing within an intelligent welding framework.

42 ENGINEERING↗
DOE OSTI2021

Fast wide-field upconversion luminescence lifetime thermometry enabled by single-shot compressed ultrahigh-speed imaging

Photoluminescence lifetime imaging of upconverting nanoparticles is increasingly featured in recent progress in optical thermometry. Despite remarkable advances in photoluminescent temperature indicators, existing optical instruments lack the ability of wide-field photoluminescence lifetime imaging in real time, thus falling short in dynamic temperature mapping. Here, we report video-rate upconversion temperature sensing in wide field using single-shot photoluminescence lifetime imaging thermometry (SPLIT). Developed from a compressed-sensing ultrahigh-speed imaging paradigm, SPLIT first records wide-field luminescence intensity decay compressively in two views in a single exposure. Then, an algorithm, built upon the plug-and-play alternating direction method of multipliers, is used to reconstruct the video, from which the extracted lifetime distribution is converted to a temperature map. Using the core/shell NaGdF 4 :Er 3+ ,Yb 3+ /NaGdF 4 upconverting nanoparticles as the lifetime-based temperature indicators, we apply SPLIT in longitudinal wide-field temperature monitoring beneath a thin scattering medium. SPLIT also enables video-rate temperature mapping of a moving biological sample at single-cell resolution.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Evaluation of Saccadic Component Measure on Smooth Pursuit Tests

ABSTRACT Introduction Despite the advancement of eye-tracking technology for smooth pursuit (SP) eye movement evaluation, qualitative observation offers much information that is not captured by computers; hence, both objective and qualitative information should be utilized to evaluate SP. This study examined the consistency among our clinicians when evaluating SP using normal (N), grossly normal (GN), mildly abnormal (MA), and abnormal (AB) as classifications. We then evaluated the effect of combining GN and MA into a single subclinical (SUBC) category. We also evaluated the computerized percent saccade (PS) metric by determining its sensitivity and specificity in classifying SP. Materials and Methods Retrospective horizontal and vertical SP test videos and numerical data for 70 participants were obtained from the Neuro Kinetics Neuro-Otologic Test Center and de-identified. From this, eye-tracking videos, time plots of eye-tracking positional data, and tables of SP eye-tracking performance data were generated for 0.1, 0.3, and 0.5 Hz in both horizontal and vertical planes, totaling 6 tests per subject. Three clinicians rated each subject’s SP performance as N, GN, MA, or AB for a total of 6 ratings (3 frequencies, horizontal and vertical). This process was repeated using N, SUBC, and AB as rating categories. Clinicians also provided an overall SP rating for each plane as follows: AB if the results were abnormal for 2 or more frequencies tested. Alternatively, if fewer than 2 frequencies presented with a rating of AB, then an overall rating of MA, GN, or N was determined at the respective clinician’s discretion. Results When the 3 clinicians were tasked with classifying SP videos using 4 clinical categories, fair overall agreement was demonstrated. However, when MA and GN categories were combined into an SUBC category, the overall agreement for the 3 clinicians improved slightly for both horizontal SP (HSP) and vertical SP (VSP). This pattern of agreement did not differ considerably when comparing HSP versus VSP, and good consistency and reliability was observed across clinicians. Again, inter-rater consistency was smaller for VSP versus HSP despite the reduction in clinical categories. Cut-off values were generated for the PS metric and demonstrated good specificity and sensitivity when they were exceeded for 2 or more frequencies in a particular plane when evaluating a subject’s SP test. Conclusions

General & Internal Medicine↗
DOE OSTI2023

Detection efficiency of adult Pacific lamprey passage counts at Leaburg Dam and upstream distribution in the McKenzie River (Oregon, USA)

Abstract Adult Pacific lamprey ( Entosphenus tridentatus ) were counted using consistent methodology since 2005 with a video monitoring system as they passed Leaburg Dam (McKenzie River, Oregon, USA) en route to upstream spawning areas. In this study we evaluated the detection efficiency of the video system and upstream distribution of Pacific lamprey using the video counts of lamprey passage (herein, “dam counts”), passive integrated transponder (PIT) tags, and radio telemetry. In 2019–2020 we collected, tagged and tracked 32 adult lamprey (4 from the McKenzie River and 28 that were translocated from Willamette Falls). All fish were tagged and released into the tailrace of Leaburg Dam in June 2019. Oregon Department of Fish and Wildlife employees and volunteers from the local community conducted mobile radiotracking above and below the dam in drift boats (114 mainstem river kilometers) and on foot (several tributaries). The estimated detection efficiency for dam counts was 92% (95% confidence interval: 67%–99%). Fifty percent (16 of 32) of the tagged lamprey passed the dam, including 13 of 28 that were translocated. Thirty‐seven percent (6 of 16) of lamprey that passed Leaburg Dam were detected in a restored reach of the South Fork McKenzie, 32.6 river kilometers upstream of the dam.

Romer, Jeremy D.↗
DOE OSTI2024

Software For Automated Leak Detection Using Infrared Camera

This code can read in videos or images in either a batch or real-time format. Videos are broken up into frames, and the frames are processed using an optical flow algorithm to decipher movement between adjacent frames. This adherent movement is ran through a convolutional neural network that automatically classifies the contents of the video. Additional content inside the code aids with noisy images and removal of nuisance movement.

Walker, CodyM. [Idaho National Laboratory (INL), I↗