Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Sensor fusion”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Sub-millisecond keyhole pore detection in laser powder bed fusion using sound and light sensors and machine learning

Laser powder bed fusion is a mainstream additive manufacturing technology widely used to manufacture complex parts in prominent sectors, including aerospace, biomedical, and automotive industries. However, during the printing process, the presence of an unstable vapor depression can lead to a type of defect called keyhole porosity, which is detrimental to the part quality. In this study, we developed an effective approach to locally detect the generation of keyhole pores during the printing process by leveraging machine learning and a suite of optical and acoustic sensors. Simultaneous synchrotron x-ray imaging allows the direct visualization of pore generation events inside the sample, offering high-fidelity ground truth. A neural network model adopting SqueezeNet architecture using single-sensor data was developed to evaluate the fidelity of each sensor for capturing keyhole pore generation events. Our comparative study shows that the near infrared images gave the highest prediction accuracy, followed by 100 kHz and 20 kHz microphones, and the photodiode sensitive to processing laser wavelength had the lowest accuracy. Using a single sensor, over 90% prediction accuracy can be achieved with a temporal resolution as short as 0.1 ms. A data fusion scheme was also developed with features extracted using SqueezeNet neural network architecture and classification using different machine learning algorithms. Our work demonstrates the correlation between the characteristic optical and acoustic emissions and the keyhole oscillation behavior, and thereby provides strong physics support for the machine learning approach.

36 MATERIALS SCIENCE↗
NASA NTRS1992

A data fusion algorithm for multi-sensor microburst hazard assessment

A recursive model-based data fusion algorithm for multi-sensor microburst hazard assessment is described. An analytical microburst model is used to approximate the actual windfield, and a set of 'best' model parameters are estimated from measured winds. The winds corresponding to the best parameter set can then be used to compute alerting factors such as microburst position, extent, and intensity. The estimation algorithm is based on an iterated extended Kalman filter which uses the microburst model parameters as state variables. Microburst state dynamic and process noise parameters are chosen based on measured microburst statistics. The estimation method is applied to data from a time-varying computational simulation of a historical microburst event to demonstrate its capabilities and limitations. Selection of filter parameters and initial conditions is discussed. Computational requirements and datalink bandwidth considerations are also addressed.

Wanke, Craig R.↗
NASA NTRS1994

A data fusion algorithm for multi-sensor microburst hazard assessment

A recursive model-based data fusion algorithm for multi-sensor microburst hazard assessment is described. An analytical microburst model is used to approximate the actual windfield, and a set of 'best' model parameters are estimated from measured winds. The winds corresponding to the best parameter set can then be used to compute alerting factors such as microburst position, extent, and intensity. The estimation algorithm is based on an iterated extended Kalman filter which uses the microburst model parameters as state variables. Microburst state dynamic and process noise parameters are chosen based on measured microburst statistics. The estimation method is applied to data from a time-varying computational simulation of a historical microburst event to demonstrate its capabilities and limitations. Selection of filter parameters and initial conditions is discussed. Computational requirements and datalink bandwidth considerations are also addressed.

Wanke, Craig R.↗
DOE OSTI2023

Seeing the Disturbed Forest for the Trees: Remote Sensing Is Underutilized to Quantify Critical Zone Response to Unprecedented Disturbance

Understanding the severity and extent of near surface critical zone (CZ) disturbances and their ecosystem response is a pressing concern in the face of increasing human and natural disturbances. Predicting disturbance severity and recovery in a changing climate requires comprehensive understanding of ecosystem feedbacks among vegetation and the surrounding environment, including climate, hydrology, geomorphology, and biogeochemistry. Field surveys and satellite remote sensing have limited ability to effectively capture the spatial and temporal variability of disturbance and CZ properties. Technological advances in remote sensing using new sensors and new platforms have improved observations of changes in vegetation canopy structure and productivity; however, integrating measures of forest disturbance from various sensing platforms is complex. By connecting the potential for remote sensing technologies to observe different CZ disturbance vectors, we show that lower severity disturbance and slower vegetation recovery are more difficult to quantify. Case studies in montane forests from the western United States highlight new opportunities, including evaluating post-disturbance forest recovery at multiple scales, shedding light on understory vegetation regrowth, detecting specific physiological responses, and refining ecohydrological modeling. Learning from regional CZ disturbance case studies, we propose future directions to synthesize fragmented findings with (a) new data analysis using new or existing sensors, (b) data fusion across multiple sensors and platforms, (c) increasing the value of ground-based observations, (d) disturbance modeling, and (e) synthesis to improve understanding of disturbance.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1999

The Distribution of Titanium in Lunar Soils on the Basis of Sensor and In Situ Data Fusion

A variety of remote-sensing measurements have been used to map the distribution of elements on the Moon as a means of providing constraints on the processes from which its crust and major terranes originated. Discussed here is Ti, which is incorporated into refractory minerals such as ilmenite during the latter stages of differentiation, and is thus a most useful element for understanding mare basalt petrogenesis. One of the earliest Ti maps showed Ti variations in nearside maria on the basis of groundbased spectral reflectance measurements. A map of Ti derived from gamma-ray measurements on Apollo 15 and 16 was produced at about the same time, and was improved upon considerably by Davis and coworkers, who effectively removed sources of spurious variation from Fe and Al or REE (e.g., Th) interference, and calibrated Ti on the bases of landing-site soil averages. In recent years, spectral reflectance measurements from Clementine have been used by Lucey and coworkers to produce global Ti distribution maps as well. As we indicated previously, the Lucey and Davis maps agree to first order. Meanwhile, we are using the concept of sensor data fusion to combine measurements from the AGR (Apollo gamma-ray) and CSR (Clementine Spectral Reflectance) techniques with ground truth from lunar soils to utilize the differences between the two maps to understand the distribution of Ti within lunar soil components, as we have done with Fe. This technique should be verified and applied on Lunar Prospector gamma-ray measurements of Ti, as the calibrated data become available within the next couple of years. Lunar Ti is found principally in the mineral ilmenite, and is associated with certain components of lunar soil: crystalline Ilmenite mineral fragments and high Ti-bearing glass. All data indicate that Ti is associated with maria and mafic minerals. In AGR and CSR datasets, Ti is highest on the nearside and in the maria, particularly in southern Serenitatis/northern Tranquillitatis and northwestern Procellarum. Unlike CSR-derived values, AGR Ti values show modest increase (up to 0.7%) on the northern farside. Both techniques show a primarily unimodal distribution with a shoulder in the high Ti direction and a primary mode at approximately 0.2% (0.15% for CSR and 0.25% for AGR data), but the AGR Ti data have more structure in the shoulder, including an apparent minor mode at 1.2% Ti, representing non-highland areas. Recalibrating the two datasets on the basis of matching the peaks and range on the histograms would not account for this additional structure in the AGR data. Low Ti areas, which occur predominantly on the farside, are not represented well in the lunar sample collection, although several meteorites thought to be of lunar highland origin show Ti abundances averaging about 0.2%. (Error bars on AGR Ti values are about 0.5%.) Gamma-ray measurements reflect intrinsic Ti surface composition, regardless of the physical or chemical state of Ti. Lucey and coworkers have attempted to produce an equivalent bulk Ti map by normalizing the spectral feature at 415 nm to remove the effects of physical variations from soil to soil. The normalization is based on laboratory measurements of available samples, primarily nearside maria, and is undoubtedly optimized for the proportions in which Ti- components are found in these soils. In particular, mare soils tend to have a much higher proportion of opaque mineral grains, which appears to be well correlated with Ti abundance. The relationship between Ti abundance and proportion of Ti-bearing glass (weighted for Ti abundance) is not as direct. Also shows the relationship between landing site soil average, AGR, and CSR Ti abundances (with CSR filtered to match resolution and field of view of AGR data). AGR Ti values show the best agreement with Ti soil averages, CSR Ti values being somewhat higher in high-Ti soils, and lower in low-Ti soils. These results would tend to support the argument that the technique for deriving Ti from the CSR measurements is optimized for one of the primary Ti-bearing components, most likely opaque mineral grains, and is thus over-compensating and reporting higher Ti values in mare areas, and underreporting Ti in highland areas with much lower proportions of opaque mineral grains. More information is contained in original.

Clark, P. E.↗
NASA NTRS1993

Image fusion

The topics covered include the following: a system overview of the basic components of a system designed to improve the ability of a pilot to fly through low-visibility conditions such as fog; the role of visual sciences; fusion issues; sensor characterization; sources of information; image processing; and image fusion.

Pavel, M.↗
DOE OSTI2022

Data Fusion via Neural Network Entropy Minimization for Target Detection and Multi-Sensor Event Classification

Broadly applicable solutions to multimodal and multisensory fusion problems across domains remain a challenge because effective solutions often require substantive domain knowledge and engineering. The chief questions that arise for data fusion are in when to share information from different data sources, and how to accomplish the integration of information. The solutions explored in this work remain agnostic to input representation and terminal decision fusion approaches by sharing information through the learning objective as a compound objective function. The objective function this work uses assumes a one-to-one learning paradigm within a one-to-many domain which allows the assumption that consistency can be enforced across the one-to-many dimension. The domains and tasks we explore in this work include multi-sensor fusion for seismic event location and multimodal hyperspectral target discrimination. We find that our domain- informed consistency objectives are challenging to implement in stable and successful learning because of intersections between inherent data complexity and practical parameter optimization. While multimodal hyperspectral target discrimination was not enhanced across a range of different experiments by the fusion strategies put forward in this work, seismic event location benefited substantially, but only for label-limited scenarios.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
NASA NTRS1987

Orbital navigation, docking and obstacle avoidance as a form of three dimensional model-based image understanding

Range imagery from a laser scanner can be used to provide sufficient information for docking and obstacle avoidance procedures to be performed automatically. Three dimensional model-based computer vision algorithms in development can perform these tasks even with targets which may not be cooperative (that is, objects without special targets or markers to provide unambiguous location points). Roll, pitch and yaw of the vehicle can be taken into account as image scanning takes place, so that these can be corrected when the image is converted from egocentric to world coordinates. Other attributes of the sensor, such as the registered reflectence and texture channels, provide additional data sources for algorithm robustness. Temporal fusion of sensor immages can take place in the work coordinate domain, allowing for the building of complex maps in three dimensional space.

Beyer, J.↗
NASA NTRS2002

Multi-Image Registration for an Enhanced Vision System

An Enhanced Vision System (EVS) utilizing multi-sensor image fusion is currently under development at the NASA Langley Research Center. The EVS will provide enhanced images of the flight environment to assist pilots in poor visibility conditions. Multi-spectral images obtained from a short wave infrared (SWIR), a long wave infrared (LWIR), and a color visible band CCD camera, are enhanced and fused using the Retinex algorithm. The images from the different sensors do not have a uniform data structure: the three sensors not only operate at different wavelengths, but they also have different spatial resolutions, optical fields of view (FOV), and bore-sighting inaccuracies. Thus, in order to perform image fusion, the images must first be co-registered. Image registration is the task of aligning images taken at different times, from different sensors, or from different viewpoints, so that all corresponding points in the images match. In this paper, we present two methods for registering multiple multi-spectral images. The first method performs registration using sensor specifications to match the FOVs and resolutions directly through image resampling. In the second method, registration is obtained through geometric correction based on a spatial transformation defined by user selected control points and regression analysis.

Hines, Glenn↗
NASA NTRS1993

Proceedings of the Augmented VIsual Display (AVID) Research Workshop

The papers, abstracts, and presentations were presented at a three day workshop focused on sensor modeling and simulation, and image enhancement, processing, and fusion. The technical sessions emphasized how sensor technology can be used to create visual imagery adequate for aircraft control and operations. Participants from industry, government, and academic laboratories contributed to panels on Sensor Systems, Sensor Modeling, Sensor Fusion, Image Processing (Computer and Human Vision), and Image Evaluation and Metrics.

Kaiser, Mary K.↗
NASA NTRS1989

Finite solid representation of robot manipulation in three-dimensional geometric reasoning

Intelligence robotic system design involves sensor allocation and sensor data fusion. In the field of geometric reasoning, a fast and effective representation method is needed to determine the physical dimensions of the manipulator as well as the motion environment in sufficient detail. Due to the capability of current sensor technology, the integrity of the sensor information is location dependent and point-wise, line-wise and plane-wise in nature. In order to maneuver the robot by reasoning the environment, there is a minimum requirement of prior information for integrating the allocated sensor feedback. Some new theoretical developments of how to associate the number and the locations of the sensors with three-dimensional geometry of the robot and the motion environment is presented. The related collision avoidance problem (CAP) will be addressed as well.

Chen, Alexander Y. K.↗
NASA NTRS2009

The Radio Frequency Health Node Wireless Sensor System

The Radio Frequency Health Node (RFHN) wireless sensor system differs from other wireless sensor systems in ways originally intended to enhance utility as an instrumentation system for a spacecraft. The RFHN can also be adapted to use in terrestrial applications in which there are requirements for operational flexibility and integrability into higher-level instrumentation and data acquisition systems. As shown in the figure, the heart of the system is the RFHN, which is a unit that passes commands and data between (1) one or more commercially available wireless sensor units (optionally, also including wired sensor units) and (2) command and data interfaces with a local control computer that may be part of the spacecraft or other engineering system in which the wireless sensor system is installed. In turn, the local control computer can be in radio or wire communication with a remote control computer that may be part of a higher-level system. The remote control computer, acting via the local control computer and the RFHN, cannot only monitor readout data from the sensor units but can also remotely configure (program or reprogram) the RFHN and the sensor units during operation. In a spacecraft application, the RFHN and the sensor units can also be configured more nearly directly, prior to launch, via a serial interface that includes an umbilical cable between the spacecraft and ground support equipment. In either case, the RFHN wireless sensor system has the flexibility to be configured, as required, with different numbers and types of sensors for different applications. The RFHN can be used to effect realtime transfer of data from, and commands to, the wireless sensor units. It can also store data for later retrieval by an external computer. The RFHN communicates with the wireless sensor units via a radio transceiver module. The modular design of the RFHN makes it possible to add radio transceiver modules as needed to accommodate additional sets of wireless sensor units. The RFHN includes a core module that performs generic computer functions, including management of power and input, output, processing, and storage of data. In a typical application, the processing capabilities in the RFHN are utilized to perform preprocessing, trending, and fusion of sensor data. The core module also serves as the unit through which the remote control computer configures the sensor units and the rest of the RFHN.

Valencia, J. Emilio↗
DOE OSTI2025

Fusion of Experiments and Simulations for Real-Time Identification of Pipeline Defects

In this study, we explored fusion of experiments and simulations for real time identification of pipeline defects across physical and non-physical domains. The challenges associated to data processing were addressed and a combined classification models was presented via CNN models. In addition, regression model based on XGBOOST is built to determine the defect location and defect dimension from data-driven features of guided wave signals captured by SMS fiber optic sensor.

deep learning↗
DOE OSTI2025

Fusion of Experiments and Simulations for Real-Time Identification of Pipeline Defects

In this study, we explored fusion of experiments and simulations for real time identification of pipeline defects across physical and non-physical domains. The challenges associated to data processing were addressed and a combined classification models was presented via CNN models. In addition, regression model based on XGBOOST is built to determine the defect location and defect dimension from data-driven features of guided wave signals captured by SMS fiber optic sensor.

deep learning↗
DOE OSTI2021

Mediated Electrochemical Probing: A Systems-Level Tool for Redox Biology

Biology uses well-known redox mechanisms for energy harvesting (e.g., respiration), biosynthesis, and immune defense (e.g., oxidative burst), and now we know biology uses redox for systems-level communication. Currently, we have limited abilities to “eavesdrop” on this redox modality, which can be contrasted with our abilities to observe and actuate biology through its more familiar ionic electrical modality. In this Perspective, we argue that the coupling of electrochemistry with diffusible mediators (electron shuttles) provides a unique opportunity to access the redox communication modality through its electrical features. Here, we highlight previous studies showing that mediated electrochemical probing (MEP) can “communicate” with biology to acquire information and even to actuate specific biological responses (i.e., targeted gene expression). We suggest that MEP may reveal an extent of redox-based communication that has remained underappreciated in nature and that MEP could provide new technological approaches for redox biology, bioelectronics, clinical care, and environmental sciences.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗