Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Video”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Vehicle Tracking with Crop-based Detection

End-to-end production of vehicle tracking data from video in real-time and with high accuracy remains a challenging problem due to the computational cost of object detection on each frame. In this work we present Tracking with Crop-based Detection, a method for speeding object tracking in constrained contexts (with stable cameras and relatively-predictable object motion) such as vehicle traffic monitoring. We leverage this context to provide a strong prior for object locations, which we use to 1.) boost detection speed by detecting objects only in regions corresponding to object priors on most frames and 2.) inform the selection of the detector output for each object. We evaluate Crop-based Detection as an extension to the KIOU object tracker (Crop-KIOU) on the UA-DETRAC dataset. The proposed tracker outperforms all other reported algorithms in terms of PR-MOTA, PR-MOTP, and mostly tracked objects on the UA-DETRAC benchmark, establishing a new state-of-the-art. Relative to tracking by detection with KIOU, Crop-KIOU achieves a 26% higher frame-rate and increases accuracy. Furthermore, Tracking with Crop-based Detection can be combined with frame skipping; we show a 149% increase in framerate relative to KIOU with no decrease in accuracy using this combination of methods.

Gloudemans, Derek↗
DOE OSTI2024

From Data to Insights: A Covariate Analysis of the IARPA BRIAR Dataset for Multimodal Biometric Recognition Algorithms at Altitude and Range

This paper examines covariate effects on fused whole body biometrics performance in the IARPA BRIAR dataset, specifically focusing on UAV platforms, elevated positions, and distances up to 1000 meters. The dataset includes outdoor videos compared with indoor images and controlled gait recordings. Normalized raw fusion scores relate directly to predicted false accept rates (FAR), offering an intuitive means for interpreting model results. A linear model is developed to predict biometric algorithm scores, analyzing their performance to identify the most influential covariates on accuracy at altitude and range. Weather factors like temperature, wind speed, solar loading, and turbulence are also investigated in this analysis. The study found that resolution and camera distance best predicted accuracy and findings can guide future research and development efforts in long-range/elevated/UAV biometrics and support the creation of more reliable and robust systems for national security and other critical domains.

Bolme, David↗
DOE OSTI2025

A Multichannel Silicon Package for Large-Scale Skipper-CCD Experiments

The next generation of experiments for light-dark-matter and neutrino searches based on skipper charge-coupled devices (skipper-CCDs) introduces new challenges for the sensor packaging and readout architecture. Scaling the active mass while simultaneously reducing the experimental backgrounds in orders of magnitude requires a novel high-density silicon-based package that must be massively produced and tested. In this work, we present a silicon multichip module design capable of hosting up to 16 skipper-CCDs, along with the fabrication process for the first prototypes. We thoroughly tested and characterized the assembled prototypes to build an empirical model for the video output signal of skipper-CCDs integrated into the silicon package. We then used this model in simulations to optimize the fabrication process and achieve the robust performance required for the full-scale array, which we validated through a new round of prototype fabrication. We outline the specifications selected for the ongoing production of 1500 silicon wafers that will ultimately add up to a 10-kg skipper-CCD array with 24000 readout channels.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

AWB-GCN: A Graph Convolutional Network Accelerator with Runtime Workload Rebalancing

The recent development of deep learning has been mostly focusing on Euclidean data, such as images, videos, audios, etc. However, most real-world information and relation are often expressed as graphs. To efficiently learn from graph data, graph convolutional networks (GCNs) emerge as a promising approach, showing advantages in several practical applications such as social network analysis, knowledge discovery, 3D modeling, motion capturing, etc. Real-world graphs are usually extremely large and imbalanced, posting significant performance demand and design challenges on the hardware dedicated for GCN inference. In this paper, we propose an architecture design called UW-GCN to accelerate graph convolutional network inference. To tackle the major performance bottleneck from workload imbalance, we propose dynamic neighborhood stealing and remote chunk shuffling techniques, relying on hardware flexibility to achieve hardware auto-tuning under negligible area or delay overhead. Specifically, UW-GCN is able to smartly profile the sparse graph pattern while continuously adjusting the workload distribution via routing reconfiguration among parallel processing elements (PEs). The ideal configuration is then reused in the remaining iterations. To the best of our knowledge, this is the first accelerator design particularly for GCN and the first work relying on hardware auto-tuning, which is normally based on software, to achieve near-optimal workload balance in processing sparse structures.

Geng, Tong↗
DOE OSTI2023

Minimizing Ground Risk in Cellular-Connected Drone Corridors With mmWave Links

Unmanned Aircraft Systems (UASs) have been receiving significant interest and support from academia, industry, and regulatory bodies over the past decade due to their various use cases. To safely integrate UAS operations into the national airspace, particularly overpopulated regions, the risk posed to ground users, buildings, and vehicles due to unmanned aerial vehicle (UAV) flight should be minimized. This risk can be represented by a numerical metric, which we refer to in this article as the “ground risk.” Many UAS applications also depend on the presence of a reliable wireless communication link between the UAV and a control station for the transmission of UAV position, surveillance video, UAV payload commands, and other mission-related data. Such wireless communication requirements also need to be considered in the design of UAS operations. In this article, we consider both these aspects and study the design of nonintersecting trajectories for UAS operations to minimize ground risk, subject to constraints on the wireless signal strength and geometry of the trajectory, specified in terms of: 1) an enclosing cylinder within which the trajectory must lie and 2) an integrated angular change along the UAV's trajectory. The performance of a computationally expensive optimal algorithm is compared with that of a computationally faster heuristic approach within the dense urban environment of Manhattan, NY, USA. Performance evaluation using ray-tracing simulations shows that the heuristic approach performs close to the optimal algorithm at a reduced computation cost. In conclusion, this research can be utilized to make UAS operations safe and reliable and accelerate their adoption.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2021

Correlations Between Panoramic Imagery and Gamma-Ray Background in an Urban Area

When searching for radiological sources in an urban area, a vehicle-borne detector system will often measure complex, varying backgrounds primarily from natural gamma-ray sources. Much work has been focused on developing spectral algorithms that retain sensitivity and minimize the false-positive rate even in the presence of such spectral and temporal variability. However, information about the environment surrounding the detector system might also provide useful clues about the expected background, which if incorporated into an algorithm, could improve performance. Recent work has focused on extensive measuring and modeling of urban areas with the goal of understanding how these complex backgrounds arise. This work presents an analysis of panoramic video images and gamma-ray background data collected in Oakland, California, by the radiological multisensor analysis platform (RadMAP) vehicle. Features were extracted from the panoramic images by semantically labeling the images and then convolving the labeled regions with the detector response. A linear model was used to relate the image-derived features to gamma-ray spectral features obtained using nonnegative matrix factorization (NMF) under different regularizations. Here we find some gamma-ray background features correlate strongly with image-derived features that measure the response-adjusted solid angle subtended by sky and buildings, and we discuss the implications for the development of future, contextually aware detection algorithms.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

Scalable Hybrid Learning Techniques for Scientific Data Compression

Data compression is becoming critical for storing scientific data because many scientific applications need to store large amounts of data and post process this data for scientific discovery. Unlike image and video compression algorithms that limit errors to primary data (PD), scientists require compression techniques that accurately preserve derived quantities of interest (QoIs). Here, this article presents a physics-informed compression technique implemented as an end-to-end, scalable, GPU-based pipeline for data compression that addresses this requirement. Our hybrid compression technique combines machine learning techniques and standard compression methods. Specifically, we combine an autoencoder, an error-bounded lossy compressor to provide guarantees on raw data error, and a constraint satisfaction post-processing step to preserve the QoIs within a minimal error (generally less than floating point error). The effectiveness of the data compression pipeline is demonstrated by compressing nuclear fusion simulation data generated by a large-scale fusion code, XGC, which produces hundreds of terabytes of data in a single day. Our approach works within the ADIOS framework and results in compression by a factor of more than 150 while requiring only a few percent of the computational resources necessary for generating the data, making the overall approach highly effective for practical scenarios.

ITER↗
DOE OSTI2021

Real-Time Omnidirectional Stereo Rendering: Generating 360° Surround-View Panoramic Images for Comfortable Immersive Viewing

Surround-view panoramic images and videos have become a popular form of media for interactive viewing on mobile devices and virtual reality headsets. Viewing such media provides a sense of immersion by allowing users to control their view direction and experience an entire environment. When using a virtual reality headset, the level of immersion can be improved by leveraging stereoscopic capabilities. Stereoscopic images are generated in pairs, one for the left eye and one for the right eye, and result in providing an important depth cue for the human visual system. For computer generated imagery, rendering proper stereo pairs is well known for a fixed view. However, it is much more difficult to create omnidirectional stereo pairs for a surround-view projection that work well when looking in any direction. One major drawback of traditional omnidirectional stereo images is that they suffer from binocular misalignment in the peripheral vision as a user's view direction approaches the zenith / nadir (north / south pole) of the projection sphere. This paper presents a real-time geometry-based approach for omnidirectional stereo rendering that fits into the standard rendering pipeline. Our approach includes tunable parameters that enable pole merging - a reduction in the stereo effect near the poles that can minimize binocular misalignment. Results from a user study indicate that pole merging reduces visual fatigue and discomfort associated with binocular misalignment without inhibiting depth perception.

360° panorama↗
DOE OSTI2023

Observing fish interactions with marine energy turbines using acoustic cameras

Abstract Marine current energy converters such as tidal and riverine turbines have the potential to provide reliable, clean power. The risk of collision of fishes with marine energy turbines is not yet well understood, in part due to the challenges associated with observing fish at turbine sites. Turbidity and light availability can limit the effectiveness of optical sensors like video cameras, motivating the use of acoustic cameras for this task. However, challenges persist in collecting and interpreting data acquired from acoustic cameras. Given the limited number of turbine deployments to date, it is prudent to draw on the application of acoustic cameras to monitor fish in other scenarios. This article synthesizes their use for other fisheries applications to inform best practices and set realistic expectations for the results of acoustic camera monitoring at turbine sites. We discuss six key tasks performed with acoustic cameras: detecting objects, identifying objects as fish, counting fish, measuring fish, classifying fish taxonomically and analysing fish behavior. Specific challenges to monitoring fish at turbine sites are discussed. This article is intended to serve as a reference for researchers, regulators and marine energy developers on effective use of acoustic cameras to monitor fish at turbine sites. The studies detailed in this article provide evidence that, in some scenarios, acoustic cameras can be used to inform the risk of fish collision with marine energy turbines but doing so requires careful study design and data processing.

Cotter, Emma↗
DOE OSTI2022

Correction and calibration of atmospheric impact observations in GOES GLM data

The Earth's atmosphere is impacted daily by both meteoroids and artificial objects. Calibrated observations of the emitted light at sufficiently high sampling rates can enable or improve the estimation of impactor attributes such as size, cohesion, trajectory, and composition, but are difficult to obtain owing to the unpredictability, brevity, and high dynamic (brightness) range of impacts. Ground-based camera systems have successfully monitored small regions of the atmosphere at video frame rates and with limited radiometric capabilities, but most impacts occur over the 70% of the Earth's surface covered by water and are therefore missed by these networks. The Geostationary Lightning Mapper (GLM) instruments aboard Geostationary Operational Environmental Satellites 16 and 17 provide near-hemispherical coverage at 500 frames per second. These data have been shown to contain the signatures of many independently confirmed impacts, often from both viewing angles simultaneously, and constitute an observational resource that is currently unparalleled in the public domain. NASA's Asteroid Threat Assessment Project has implemented an automated impact detection pipeline that processes data from GLM daily. Given a detected impact, the GLM data contain a wealth of information for use in quantitative follow-up analyses. However, impact events differ from lightning in ways that violate key assumptions built into GLM's design. The result is that GLM's onboard processing introduces errors into pixel observations of impact events and the calibrated energies near the periphery of the detector may be substantially overestimated. We present methods for mitigating these and other issues to produce a data product more suitable for impact analyses than the existing GLM lightning product.

58 GEOSCIENCES↗
DOE OSTI2022

A Combined Computer Vision and Deep Learning Approach for Rapid Drone-Based Optical Characterization of Parabolic Troughs

Optical accuracy is a primary driver of parabolic trough concentrating solar power (CSP) plant performance, but can be damaged by wind loads, gravity, error during installation, and regular plant operation. Collecting and analyzing optical measurements over an entire operating parabolic trough plant is difficult, given the large scale of typical installations. Distant Observer, a software tool developed at the National Renewable Energy Laboratory, uses images of the absorber tube reflected in the collector mirror to measure both surface slope in the parabolic mirror and offset of the absorber tube from the ideal focal point. This technology has been adapted for fast data collection using low-cost commercial drones, but until recently still required substantial human labor to process large amounts of data. A new method leveraging advanced deep learning and computer vision tools can drastically reduce the time required to process images. This new method addresses the primary analysis bottleneck, identifying featureless, reflective mirror corner points to a high degree of accuracy. Recent work has shown promising results using computer vision methods. The combined deep learning and computer vision approach presented here proved highly effective and has the potential to further automate data collection and analysis, making the tool more robust. The method presented in this paper automatically identified 74.3% of mirror corners within 2 pixels of their manually marked counterparts and 91.9% within 3 pixels. This level of accuracy is sufficient for practical Distant Observer analysis within a target uncertainty. A commercial drone collected video of over 100 parabolic trough modules at an operating CSP plant to demonstrate the deep learning and computer vision method's usefulness in processing large amounts of data. These troughs were successfully analyzed using Distant Observer, paired with the new deep learning and computer vision algorithm, and can provide plant operators and trough designers with valuable insight about plant performance, operating strategies, and plant-wide optical error trends.

computer vision↗
DOE OSTI2024

Resources, Training, and Education Under the Heliostat Consortium: Industry Gap Analysis and Building a Resource Database

Concentrating solar power is not a widely deployed or known technology area, and the heliostat workforce community in the United States is currently small, with knowledge and expertise not widely available. The resource, training, and education (RTE) topic within the Heliostat Consortium (HelioCon) was established to address this. RTE encompasses resources, practices, and programs to ensure that (1) newcomers to the heliostat development community have an adequate knowledge base and training to conduct R&D efforts, (2) outsiders to the field are provided with resources and opportunities to join the workforce, and (3) the workforce community is a productive, healthy, and fulfilling environment for all workers. In the first year of the project, a roadmap study was conducted, in which the major gaps in RTE were identified by consulting experts in the industry, with the top gap being the lack of public accessibility to concentrating solar-thermal power (CSP) knowledge. Here, to address this, the HelioCon team has been developing a centralized web-based resource database, containing a reference library, educational videos, lists of components suppliers and software/metrology tools, a power tower plant database, and information on existing standards/guidelines.

14 SOLAR ENERGY↗
DOE OSTI2026

Uncertainty quantification of fireball features extracted from nuclear test films using computer vision

Films from the US’s historic nuclear testing era comprise the only extensive collection of imagery depicting high-yield detonations. These films offer unique insights into the characteristics of flows occurring on scales that are difficult to replicate experimentally, and they are a valuable source of data for the validation of models used to describe nuclear detonations. In recent work, we implemented modern computer vision and machine learning techniques to extract features of the fireball following nuclear detonation. With a training dataset of fireball films, we fine-tuned a You Only Look Once 11 (YOLO11) model to detect and track the fireball. Applied to a video, the outer bounding box produced in each frame by YOLO11 is used as an input prompt to Meta’s Segment Anything Model 2 (SAM2), which is shown to accurately predict the boundary of the fireball over time with high resolution. These state-of-the-art computer vision foundation models exhibit impressive visual accuracy in their results but lack an output of values that robustly quantify uncertainty in scientific applications. In this paper, we develop procedures for uncertainty quantification of extracted fireball features. We outline the application of a parallel attention mechanism to calculate uncertainty ranges that complement and better pose model validation data. This higher quality fireball validation data may serve to improve prognostic models describing nuclear detonations in support of nuclear forensic and emergency response activities.

Khristy, Joel [ORNL] (ORCID:0000000209963060)↗
DOE OSTI2026

YOLO11 to SAM2 pipeline for feature extraction from nuclear test films

The response to the effects of nuclear detonations is supported by models that describe the evolution of the nuclear fireball and cloud and the associated transport of active debris. Validation of those descriptions relies on data from the nuclear test operations. Video records of those events offer a rich source of information that was exploited to a limited extent in historic analyses. Computer vision and machine learning techniques are powerful tools that can be used to increase the number of measurements that can be obtained from those films. In this work, we apply computer vision techniques to automatically track the temporal evolution of the nuclear fireball. In particular, we apply You Only Look Once 11 (YOLO11) and Segment Anything Model 2 (SAM2) in combination with minimal human intervention to digitized versions of the original nuclear test films. As part of the proposed workflow, the YOLO11 model is applied to films to determine bounding boxes for the fireball within each frame. These are then used as inputs to SAM2, which uses image segmentation to determine the fireball boundaries and their temporal evolution. We assess the accuracy of our approach by using it to determine the energy released during the Trinity nuclear test and comparing the results with previous analyses based on manual measurements.

Van Exel, Kimberly [ORNL] (ORCID:0009000877463894)↗
DOE OSTI2024

Protorheology

We all instinctively poke, bounce, scoop, and observe materials to understand rheological properties quickly. Yet, these observations are rarely analyzed quantitatively. To address this, here we introduce the paradigm of protorheology: approximate quantitative inference from simple observations. Several case studies demonstrate how protorheology is an inclusive entry to rheology for a broad range of practitioners and strengthens the confidence and interpretation of accurate laboratory measurements. We survey a range of creative tests according to which rheological phenomenon is revealed. Some new working equations are derived, and all working equations are summarized for convenient reference and comparison across different methods. Finally, this establishes a framework to enable increased use of photos, videos, and quantitative inference and to support the increasing interest in digital image analysis, inverse methods, and high-throughput characterization being applied to rheological properties.

42 ENGINEERING↗
DOE OSTI2022

Real-space observation of fluctuating antiferromagnetic domains

Magnetic domains play a fundamental role in physics of magnetism and its technological applications. Dynamics of antiferromagnetic domains is poorly understood, although antiferromagnets are expected to be extensively used in future electronic devices wherein it determines the stability and operational speed. Dynamics of antiferromagnets also features prominently in the studies of topological quantum matter. Real-space imaging of fluctuating antiferromagnetic domains is therefore highly desired but has never been demonstrated. We use coherent x-ray diffraction to obtain videos of fluctuating micrometer-scale antiferromagnetic domains in Ni 2 MnTeO 6 on time scales from 10 -1 to 10 3 s. In the collinear phase, thermally activated domain wall motion is observed in the vicinity of the Néel temperature. Unexpectedly, the fluctuations persist through the full range of the higher-temperature helical phase. These observations illustrate the high potential significance of the dynamic domain imaging in phase transition studies and in magnetic device research.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗