Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Sensor fusion”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

The Sensor Dilemma in Intelligent Transportation Systems

Intelligent Transportation Systems (ITS) are at the forefront in advancing the way we interact and perceive with the transportation network. This revolution is fueled by the significant advancement in sensor perception technologies such as Radar, LiDAR and Video Imaging which are the most popular modalities for ITS. Real-time perception data from these sensors allows intelligent infrastructure side decision making to improve the energy, efficiency and safety at traffic intersections. As traffic departments across the United States are transitioning from traditional loop detectors / emulators and embracing newer technologies, they are often left with a dilemma in choosing a sensor technology for infrastructure-based perception which is reliable, inexpensive, easy to setup and has robust performance in varying weather conditions. However, choosing a sensor which checks all boxes is not straightforward as every sensor type has unique benefits and drawbacks. Radar is excellent at detecting long range vehicles and weather resistance but lacks high resolution. LiDAR is expensive and weather-sensitive, while cameras provide rich visual data at a low cost but are constrained by lighting and visibility. This study examines Radar, LiDAR and camera sensors capabilities to ascertain whether any of these qualifies as the "best" sensor for ITS perception. Through this evaluation, we hope to draw attention to the necessity of National Renewable Energy Laboratory's (NREL) Infrastructure Perception and Control (IPC) framework which presents a multi-sensor track data fusion engine to assimilate multiple data streams in order to provide robust and reliable perception. While no single sensor can meet all the demands of ITS, a hybrid approach combining multiple sensor modalities like Radar, LiDAR and cameras, offers the most robust solution for enhancing the safety and efficiency in intelligent transportation systems.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2024

Spatiotemporal Automatic Calibration of Infrastructure Lidar, Radar, and Camera with a Global Navigation Satellite System: Preprint

Robust and accurate perception is important for modern intelligent transportation systems (ITS), which use sensors of various modalities for data fusion to create a digital twin of an intersection. Sensor calibration is an important process that creates a unified coordinate frame for the sensor output data so that it can be used for data fusion. Classical approaches for sensor calibration are time-consuming, require an overlapping field of view for feature matching, and are not feasible for ITS application as they cause disruptions in the flow of traffic. In this paper, we present a spatiotemporal automatic calibration approach to calibrate multiple infrastructure lidar, radar, and cameras installed at a traffic intersection. The approach uses global navigation satellite system (GNSS) positioning information shared by connected vehicles, and when the vehicle is detected by the sensor, we match the sensor detections with the GNSS coordinates. The proposed algorithm is evaluated with a real-world dataset utilizing detections from two radars, cameras, and lidars with a test vehicle instrumented with a post-processing kinematic (PPK)-corrected GNSS driving past the sensors installed at a four-way traffic intersection. The experimental results show that the proposed automatic calibration approach can achieve the transformation with a root mean squared error of less than 0.5 for radar and lidar and less than 2 for camera detections. The ability to rapidly calibrate sensors not only benefits initial installations, but can also be used for system health monitoring, while utilizing available connected vehicle data to test the real-time sensor fidelity and operational status.

ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2021

Studying drought-induced forest mortality using high spatiotemporal resolution evapotranspiration data from thermal satellite imaging

Drought can have pervasive and wide-spread impacts to forest health, as evidenced in several severe events occurring over the recent decades. Extensive forest die-off due to drought can impair the ecological functioning of forests, impacting habitat, water yield and quality from forested lands, and altering forest fire dynamics and intensity. Satellite remote sensing provides an effective means for detecting and monitoring spatial patterns of forest mortality over large areas, exploiting free and open long-term image archives available at a range in spatial and temporal resolutions. While remotely sensed surface reflectances and vegetation indices have been widely used to study optical response of forest canopies to drought events, retrievals of evapotranspiration (ET) derived from thermal satellite imagery – particularly at resolutions approaching crown scale - can provide insights into cumulative tree stresses that can incite disease and trigger mortality. In this study, we applied a multi-sensor satellite data fusion approach to estimate daily 30-m resolution ET and an associated Evaporative Stress Index (ESI) to study drought-induced mortality in a temperate forest at the Missouri Ozark AmeriFlux (MOFLUX) site, located in the central United States. The study covered the period from 2010 to 2014, including an exceptional drought year of 2012. Modeled ET agreed well with eddy flux measurements from the MOFLUX tower, with average monthly relative errors of 15%. Plot-scale ESI, describing temporal anomalies in the ratio of actual-to-reference ET, was used as an index of relative forest health to investigate relationships between forest mortality and drought severity. ESI showed good agreement with observed predawn leaf water potential, especially during the drought year. Furthermore, plot-scale ESI was also correlated with the subsequent year's tree mortality, suggesting the importance of considering the forest health condition prior to drought when studying drought-induced forest impacts. This study demonstrates the utility of multi-year ET remote sensing data at the stand or plot scale as an indicator of forest health and as a predictor of future mortality due to drought.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Review of In Situ Sensing for Directed Energy Deposition for Industrial Part Quality Assessment

As the use additive manufacturing (AM) processes continues to grow in critical industries, improved quality assurance methods are becoming increasingly sought after for qualification and certification of AM components. Traditional nondestructive evaluation of printed components is often unable to supply the required confidence in print quality to justify qualification and certification, but the layer-by-layer nature of AM provides unprecedented opportunities for in situ quality inspection. This document summarizes recent developments in process monitoring research specifically related to Directed Energy Deposition (DED). Particular attention is given to three aspects of the highlighted manuscripts: (1) the type of sensors used, (2) features extracted from each sensor modality, and (3) analysis of extracted features for AM quality assessment. Based on the review of the state-of-the-art, several observations have been made. First, none of the reviewed works have applied their trained models to real part geometries, with many of the works relying on single track experiments, thin-walled structures, and cubes. Similarly, there have not been any works demonstrating model generalizability, i.e., a model trained on data from one build allows for fruitful analysis of data from another build. Many works used machine learning techniques to distinguish different process regimes (i.e., normal, keyholing, lack-of-fusion), but very few papers have investigated stochastic variation in an already “optimized” process. Sensor fusion approaches are also limited in the DED sensing literature, but the few works that have employed such techniques have demonstrated the benefits. Finally, registration of in situ data to the build coordinate system is of paramount importance to producing industrially relevant in situ monitoring systems. Data registration allows direct correlations between process anomalies detected in the process monitoring data to localized departures in part quality, but such techniques are generally lacking in the current literature.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Quench detection using Hall sensors in high-temperature superconducting CORC ® -based cable-in-conduit-conductors for fusion applications

Advanced magnet systems for fusion applications would greatly benefit from the use of high-temperature superconductors (HTS). These materials allow fusion magnets to operate at higher magnetic fields, allowing for more compact fusion machines, and allow for operation at elevated temperatures, enabling demountable coils that provide access for maintenance of the fusion reactor. Quench detection remains a major challenge in the protection of HTS magnets that are vulnerable to localized conductor burnout due to their low quench propagation velocities. One of the methods explored is the use of Hall sensors that are incorporated in or near the magnet terminations that can detect local field variations that occur as a result of current redistribution within the conductor to bypass a hotspot within the magnet winding. This method is potentially well suited for Cable in Conduit Conductors, such as those made from Conductor on Round Core (CORC) cables, in which sub-cables containing HTS tapes are connected to the terminations at a low resistance. Here, to demonstrate the technique, a CORC ® triplet consisting of three sub-cables, rated for 4 kA operation at 77 K, was manufactured and Hall sensors were used to measure local field variations next to the terminations due to current redistribution between the cables. The Hall response was compared to voltages that developed over the cables and terminations as a local hotspot was applied to different cables in the triplet. It was found that the Hall sensors were faster and more sensitive than voltage contact measurements and were able to reliably detect current redistribution of only a few amperes caused by a hotspot, well before the triplet exceeded its critical current. The method also allowed the detection of heater-induced hotspots during high ramp rates of 2 kA s<:sup>–1 relevant for fusion applications. Hall sensors have a distinct benefit of being less sensitive to inductive pickup of AC interference compared to voltage contact measurements that make quench detection through voltage measurements in magnets especially challenging. The method can also be used for diagnostic measurements of current redistribution caused by other sources such as inhomogeneous current injection from faulty joints, or localized conductor damage. The Hall sensors are likely capable of detecting the onset of a quench that may occur a far distance away from the sensor location, presenting a breakthrough in HTS quench detection that potentially removes one of the remaining barriers to reliable operation of large HTS magnet systems.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2025

Demonstrating Advanced Sensors for In-Situ Monitoring Towards Qualification of Nuclear Relevant Components

The U.S. Department of Energy’s Office of Nuclear Energy Advanced Materials and Manufacturing Technologies (AMMT) program is pursuing qualification of laser powder bed fusion (LPBF) components for nuclear applications. A major focus of this effort is the use of in situ process monitoring and machine learning–based tools to establish real-time quality assurance. The primary objective of this report is to identify and evaluate the most relevant in situ sensor systems for LPBF, and to document the deployment of these systems across platforms critical to the AMMT program. This work demonstrates how in situ monitoring can detect process anomalies, track geometry-dependent flaws, and identify limiting combinations of processing parameters—particularly those related to energy density and complex geometries (e.g., overhanging structures). To support this goal, a diverse suite of sensor modalities was evaluated across LPBF platforms, including visible and near-infrared (NIR) imaging, fringe projection profilometry, long-wavelength infrared (LWIR) thermography, and high-speed photodiode/pyrometry systems. These sensor streams were integrated with Peregrine, a machine-agnostic software platform that, among other capabilities, can generate real-time process anomaly classification. This report documents sensor deployments on multiple AMMT flagship platforms, including the Concept Laser M2 and Renishaw AM400/AM250 systems. Calibration builds with complex, flaw-prone geometries such as unsupported overhangs, stepped features, and thin walls, were used to evaluate how well Peregrine and its associated sensors could detect process anomalies and other instabilities under varied energy densities. It will be shown how Peregrine reliably identifies common process anomalies such as recoater streaking, superelevation, etc., and can be used in post-build analysis for anomaly spatial distributions throughout the build height to better understand the impact of geometry and processing parameter choice on the build. This work demonstrates measurable progress toward the vision that components can be born-qualified by establishing a real-time monitoring framework, identifying limiting process conditions, and laying the foundation for sensor fusion–enabled prediction pipelines that are scalable across platforms and applicable to nuclear-relevant components.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Low power and privacy preserving sensor platform for occupancy detection

A low-cost, low-power, stand-alone sensor platform having a visible-range camera sensor, a thermopile array, a microphone, a motion sensor, and a microprocessor that is configured to perform occupancy detection and counting while preserving the privacy of occupants. The platform is programmed to extract shape/texture from images in spatial domain; motion from video in time domain; and audio features in frequency domain. Embedded binarized neural networks are used for efficient object of interest detection. The platform is also programmed with advanced fusion algorithms for multiple sensor modalities addressing dependent sensor observations. The platform may be deployed for (i) residential use in detecting occupants for autonomously controlling building systems, such as HVAC and lighting systems, to provide energy savings, (ii) security and surveillance, such as to detect loitering and surveil places of interest, (iii) analyzing customer behavior and flows, (iv) identifying high performing stores by retailers.

Velipasalar, Senem↗
DOE OSTI2021

Fusion-based occupancy sensing for building systems

Sensing and control apparatus for a building HVAC system includes interior and boundary sensors, such as cameras and thermal sensors, generating sensor signals conveying occupancy-related features for an area. A controller uses the sensor signals to produce an occupancy estimate and to generate equipment-control signals to cause the HVAC system to supply conditioned air to the area based on the occupancy estimate. The controller includes fusion systems collectively generating the occupancy estimate by corresponding fusion calculations, the fusion systems producing a boundary occupancy-count change based on sensor signals from the boundary sensors, an interior occupancy count based on sensor signals from the interior sensors, and the overall occupancy estimate. Fusion may be of one or multiple types including cross-modality fusion across different sensor types, within-modality fusion across different instances of same-type sensors, and cross-algorithm fusion using different algorithms for the same sensor(s).

Konrad, Janusz L.↗
DOE OSTI2022

Skyfall: Signal Fusion from a Smartphone Falling from the Stratosphere

A smartphone plummeted from a stratospheric height of 36 km, providing a near-real-time record of its rapid descent and ground impact. An app recorded and streamed useful internal multi-sensor data at high sample rates. Signal fusion with external and internal sensor systems permitted a more detailed reconstruction of the Skyfall chronology, including its descent speed, rotation rate, and impact deceleration. Our results reinforce the potential of smartphones as an agile and versatile geophysical data collection system for environmental and disaster monitoring IoT applications. We discuss mobile environmental sensing capabilities and present a flexible data model to record and stream signals of interest. The Skyfall case study can be used as a guide to smartphone signal processing methods that are transportable to other hardware platforms and operating systems.

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

In-situ sensor monitoring of multi-class gas porosity formation in laser powder bed fusion using convolutional neural network

In-situ monitoring of defect formation remains a significant challenge in the laser powder bed fusion (LPBF) process. Recent advances have enabled real-time defect detection with machine learning and in-situ sensing technologies; however, most studies focus on binary classification of keyhole pores, limiting nuanced multi-class pore differentiation and formation mechanisms. This work introduces a multi-class pore detection framework (no pore, small pores < 15 µm, and large pores > 15 µm) by leveraging photodiode sensor data alongside high-fidelity synchrotron X-ray imaging. The 15 µm threshold is selected to distinguish between two fundamentally different defect mechanisms, following the physical size-mechanism boundary established by prior high-resolution synchrotron X-ray characterization of Al6061 LPBF. Distinguishing these classes is critical because large keyhole pores are structurally detrimental, whereas small gas pores are often benign, requiring different process control strategies. Thermal emission monitoring data collected simultaneously with high-speed X-ray imaging at the Stanford Synchrotron Radiation Lightsource (SSRL), are correlated with subsurface melt pool dynamics to establish ground truth. Continuous Wavelet Transform (CWT) with optimized parameters converts the photodiode time-series signals into time–frequency images, facilitating feature extraction. Convolutional Neural Networks (CNN) are then applied for real-time multi-class pore classification in an average inference time of 1 ms per signal window. It achieves 79% accuracy and an Area Under the Receiver Operating Characteristic curve (AUC ROC) score of 0.89 with five-fold cross-validation. The results demonstrate that coupling CWT-based feature engineering with CNN architecture enables reliable multi-class pore detection in Al6061 builds using affordable in-situ sensors. This approach advances scalable and affordable quality assurance in additive manufacturing by moving beyond binary defect detection toward more nuanced classification of porosity mechanisms with in-situ sensors and machine learning.

Laser powder bed fusion, Multi-class pores, In-sit↗
DOE OSTI2020

Sensor Drift Estimation for Reactor Systems by Fusing Multiple Sensor Measurements

A nuclear power plant is instrumented with a variety of sensors that monitor its variables to estimate the state and initiate safety actions, if needed. We address the problem of estimating drifts or errors in sensor measurements due to factors such as calibration changes. We propose an information fusion method that uses measurements from other sensors to generate an estimate of a sensor measurement, and its difference from an actual measurement provides an error estimate. We present two fusers based on the ensemble of trees and support vector machine that are trained using sensor measurements collected at an emulated test loop of a pressurized water reactor under no-drift conditions. We present error estimates for a differential pressure sensor of the heat exchanger of the primary coolant system, under twenty controlled scenarios using the test loop. Both positive and negative errors are captured by both methods in scenarios involving calibration drifts, blocking, air gap and electromagnetic interference. The root mean square errors of estimated drifts are typically within 2% percent of the maximum.

Rao, Nageswara↗
DOE OSTI2020

Detecting Low-level Radiation Sources Using Border Monitoring Gamma Sensors

We consider a problem of detecting a low-level radiation source using a network of Gamma spectral sensors placed on the periphery of a monitored region. We propose a computationally light-weight, correlation-based method which is primarily intended for systems with limited computing capacity. Sensor measurements are combined at the fusion by first generating decisions at each time step and then taking their majority vote within a time widow. At each time step, decisions are generated using two strategies: (i) SUM method based on a threshold decision on a correlation statistic derived from measurements from all sensors, and (ii) OR method based on logical-OR of threshold decisions based on correlations statistics of individual sensor measurements. We derive analytical performance bounds for false alarm rates of SUM and OR methods, and show that their performance is enhanced by the temporal smoothing of majority vote within a time window. Using measurements from a test campaign, we generate a border monitoring scenario with twelve 2"x2" NaI Gamma sensors deployed on the periphery of 42m x 42m outdoor region. A Cs-137 source is moved in a straight-line across this region, starting several meters outside and finally moving away from it. We illustrate the performance of both correlation-based detection methods, and compare their performances with each other and with a particle filter method. Overall, under small false-alarm conditions, the OR fusion is found to produce better detection performance.

Sen, Satyabrata↗
DOE OSTI2022

Fiber-Optic Bolometer and Calorimeter Arrays for Magnetically Confined Plasmas

Bolometers measure the plasma radiation and provide essential diagnostic information both for safe, sustainable operation of magnetic-confinement fusion (MCF) devices and for study of the relevant physics. The fusion community has been replying on resistive bolometers for plasma radiation measurement. However, their performance is greatly compromised by the strong electromagnetic interference present in MCF devices. Previously, we have demonstrated a fiber-optic bolometer that has the promise to overcome the challenges related to the strong EMI in the MCF environment. In this project, we study the performance of the fiber-optic bolometer in a simulated MCF environment and improved the sensitivity through a novel sensor design. Part of the work reported here was performed between 09/01-12/31/2017 when the PI was with University of Nebraska-Lincoln under the same project but with a different award number (DE-SC0018273).

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Spectral sensor error analysis for measuring x-ray radiation drive using the DANTE diagnostic toward inertial confinement fusion experiments

DANTE is a diagnostic used to measure the x-radiation drive produced by heating a high-Z cavity (“hohlraum”) with high-powered laser beams. It records the spectrally and temporally resolved radiation flux at x-ray energies between 50 eV and 20 keV. Each sensor configuration on DANTE is composed of filters, mirrors, and x-ray diodes to define 18 different x-ray channels whose output is voltage as a function of time. The absolute flux is then determined from the photometric calibration of the sensor configuration and a spectral reconstructing algorithm. The reconstruction of the spectra vs time from the measured voltages and known response of each channel has presented challenges. Here we demonstrate a novel approach here for quantifying the error on the determined flux based on the channel sensor configuration and most commonly used reconstruction algorithm. In general, we find that the integrated spectral flux from a hohlraum can robustly be reconstructed (within ~14%) using a traditional unfold approach with as few as ten channels due to the underlying assumption of a largely Planckian spectral intensity distribution.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Localized keyhole pore prediction during laser powder bed fusion via multimodal process monitoring and X-ray radiography

Systematic fault detection and control during laser powder bed fusion (L-PBF) has been a long-standing objective for system manufacturers and researchers in the additive manufacturing (AM) industry. This manuscript investigates a data fusion approach for detection of keyhole porosity formation during laser irradiation of Ti-6Al-4V substrates by concurrent recording of thermally induced optical emission measured using both off-axis and coaxial photodiode sensors, and acoustic emission. Subsurface defect formation was monitored via high-speed synchrotron X-ray imaging at 20,000 frames per second, enabling temporal registration of keyhole pore formation events to the monitoring signals at a resolution of 50 µs. We developed data fusion machine learning (ML) models for localized prediction of keyhole pore formation at various time scales ranging from 0.5 ms to 2 ms. The signal segments were featurized using two independent approaches: (1) power spectral density (PSD) and (2) highly comparative time series analysis (HCTSA) framework. The extracted features from different sensor modalities were fused together to construct a multimodal feature space and sequential feature selection was used to determine the most informative features for training the ML models. The predictive performance was evaluated for three classifying algorithms: Support Vector Machine (SVM), K-Nearest Neighbor (KNN), and Gaussian Naive Bayes (GNB). As a result, pore formation events were predicted with up to 0.95 F1-score, 1.0 recall and 0.94 accuracy. The most heavily weighted features indicate that model performance is chiefly governed by the acoustic monitoring signal, with a secondary contribution from the optical emission sensors.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Completion design improvement using a deep convolutional network

Maximizing stimulated natural and hydraulic fracture network is one of the primary hydraulic fracturing concerns for economic production from a horizontal shale gas well. Geomechanical facies and preexisting fractures in each stage are identified based on similarities in formation characteristics to optimize the locations of perforation clusters. This often requires analyzing large volumes of drilling, Logging While Drilling (LWD) and Measurement While Drilling (MWD) data. In this paper, we develop a methodology that calculates the mechanical specific energy (MSE) using real-time drill string acceleration signals directly from its definition. High resolution vibration signals have been collected using a tri-axial accerlometer, which was an auxiliary tool included in acoustic borehole imager. This technique provides a cost-efficient solution for engineered completion design. Furthermore, we adopt deep Convolutional Neural Network (CNN) with signal processing to build a data pipeline that effectively extracts patterns from dynamic acceleration signals for rock lateral MSE classification. First, we apply discrete wavelet transform and Short-Time Fourier Transform (STFT) for signal denoising and pattern recognition. Then we construct an image dataset using multi-scale image fusion at pixel level from 3 sensor channels, including axial, lateral acceleration spectrograms and zero-padded revolutions per minute (RPM). The resulted RGB image dataset includes 4,000 images of 5 MSE ranges with various rock strength conditions. Our results demonstrate that the proposed deep learning model can achieve more than 90% classification accuracy. The deep learning results, as a reference source, were applied in selected Marcellus Shale Energy and Environmental Lab (MSEEL) wells engineered completion located in the Marcellus shale gas site.

03 NATURAL GAS↗