Results for “Sensor fusion” — Page 3

NASA NTRS1991

Sensor fusion techniques for predicting thunderstorm evolution using lightning and radar networks

A pattern recognition scheme that is used to generate initial seeds or 'first guess' fields for clustering the discrete lightning discharges into storm cells is presented. The clustering process is critically dependent on the prior accuracy of the lightning location estimates. The generation of subsequent storm life-cycle time series (for extrapolation forecasting) also relies on the cluster analysis procedure assigning the correct number of lightning discharges (objects) to the proper storms (groups). The advantages and limitations of different clustering strategies for storm identification and tracking are examined. Storm identification with lightning data alone is compared to storm identification with radar alone, and some synergies for sensor fusion are explored.

Goodman, Steven J.↗

NASA NTRS1992

Advanced data visualization and sensor fusion: Conversion of techniques from medical imaging to Earth science

Hughes Aircraft Company and the University of Chicago propose to transfer existing medical imaging registration algorithms to the area of multi-sensor data fusion. The University of Chicago's algorithms have been successfully demonstrated to provide pixel by pixel comparison capability for medical sensors with different characteristics. The research will attempt to fuse GOES, AVHRR, and SSM/I sensor data which will benefit a wide range of researchers. The algorithms will utilize data visualization and algorithm development tools created by Hughes in its EOSDIS prototyping. This will maximize the work on the fusion algorithms since support software (e.g. input/output routines) will already exist. The research will produce a portable software library with documentation for use by other researchers.

Savage, Richard C.↗

NASA NTRS1993

Advanced data visualization and sensor fusion: Conversion of techniques from medical imaging to Earth science

Hughes Aircraft Company and the University of Chicago propose to transfer existing medical imaging registration algorithms to the area of multi-sensor data fusion. The University of Chicago's algorithms have been successfully demonstrated to provide pixel by pixel comparison capability for medical sensors with different characteristics. The research will attempt to fuse GOES (Geostationary Operational Environmental Satellite), AVHRR (Advanced Very High Resolution Radiometer), and SSM/I (Special Sensor Microwave Imager) sensor data which will benefit a wide range of researchers. The algorithms will utilize data visualization and algorithm development tools created by Hughes in its EOSDIS (Earth Observation SystemData/Information System) prototyping. This will maximize the work on the fusion algorithms since support software (e.g. input/output routines) will already exist. The research will produce a portable software library with documentation for use by other researchers.

Savage, Richard C.↗

NASA NTRS1991

Method and apparatus for sensor fusion

Method and apparatus for fusion of data from optical and radar sensors by error minimization procedure is presented. The method was applied to the problem of shape reconstruction of an unknown surface at a distance. The method involves deriving an incomplete surface model from an optical sensor. The unknown characteristics of the surface are represented by some parameter. The correct value of the parameter is computed by iteratively generating theoretical predictions of the radar cross sections (RCS) of the surface, comparing the predicted and the observed values for the RCS, and improving the surface model from results of the comparison. Theoretical RCS may be computed from the surface model in several ways. One RCS prediction technique is the method of moments. The method of moments can be applied to an unknown surface only if some shape information is available from an independent source. The optical image provides the independent information.

Krishen, Kumar↗

NASA NTRS1991

Sensor fusion for synthetic vision

Display methodologies are explored for fusing images gathered by millimeter wave sensors with images rendered from an on-board terrain data base to facilitate visually guided flight and ground operations in low visibility conditions. An approach to fusion based on multiresolution image representation and processing is described which facilitates fusion of images differing in resolution within and between images. To investigate possible fusion methods, a workstation-based simulation environment is being developed.

Pavel, M.↗

NASA NTRS1989

Knowledge-based imaging-sensor fusion system

An imaging system which applies knowledge-based technology to supervise and control both sensor hardware and computation in the imaging system is described. It includes the development of an imaging system breadboard which brings together into one system work that we and others have pursued for LaRC for several years. The goal is to combine Digital Signal Processing (DSP) with Knowledge-Based Processing and also include Neural Net processing. The system is considered a smart camera. Imagine that there is a microgravity experiment on-board Space Station Freedom with a high frame rate, high resolution camera. All the data cannot possibly be acquired from a laboratory on Earth. In fact, only a small fraction of the data will be received. Again, imagine being responsible for some experiments on Mars with the Mars Rover: the data rate is a few kilobits per second for data from several sensors and instruments. Would it not be preferable to have a smart system which would have some human knowledge and yet follow some instructions and attempt to make the best use of the limited bandwidth for transmission. The system concept, current status of the breadboard system and some recent experiments at the Mars-like Amboy Lava Fields in California are discussed.

Westrom, George↗

DOE OSTI2022

Multimodal sensor fusion framework for residential building occupancy detection

For several years now, smart building energy systems have been a research area of intensive activity. In light of the increasing need for sustainable buildings and energy systems, this trend motivates an increasing need for a solution to reduce carbon dioxide emissions and improve energy efficiency. This work proposes a high-performing and transferable occupancy detection framework that combines sensor data from different data modalities, including time series environmental data (temperature, humidity, and illuminance), image data, and acoustic energy data using ensemble method. To draw out the best prediction performance in each modality, the proposed framework was developed, including various models that were designed to learn the occupancy patterns reflected in the physical data streams. To tackle the time series environmental data, we designed two variants of an occupancy detection spatiotemporal pattern network (Occ-STPN) that performs both feature level and decision level fusion, respectively. We also propose a new metric; the fading memory mean square error (FMMSE), that provides a fair evaluation and penalization of delayed occupancy predictions. Multiple open-sourced datasets, including the Electricity Consumption and Occupancy and the University of California, Irvine's (UCI) building occupancy detection dataset, along with our own real data collected from six different houses, were used to validate the algorithms' performance. The experimental results presented herein break down the performance for each sensing modality, and a detailed analysis of the performance is also discussed.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2024

Comparing Sensor Fusion and Multimodal Chemometric Models for Monitoring U(VI) in Complex Environments Representative of Irradiated Nuclear Fuel

Optical sensors and chemometric models were leveraged for the quantification of uranium(VI) (0–100 μg mL –1 ), europium (0–150 μg mL –1 ), samarium (0–250 μg mL –1 ), praseodymium (0–350 μg mL –1 ), neodymium (0–1000 μg mL –1 ), and HNO 3 (2–4 M) with varying corrosion product (iron, nickel, and chromium) levels using laser fluorescence, Raman scattering, and ultraviolet–visible–near-infrared absorption spectra. In this paper, an efficient approach to developing and evaluating tens of thousands of partial least-squares regression (PLSR) models, built from fused optical spectra or multimodal acquisitions, is discussed. Each PLSR model was optimized with unique preprocessing combinations, and features were selected using genetic algorithm filters. The 7-factor D-optimal design training set contained just 55 samples to minimize the number of samples. The performance of PLSR models was evaluated by using an automated latent variable selection script. PLS1 regression models tailored to each species outperformed a global PLS2 model. PLS1 models built using fused spectra data and a multimodal (i.e., analyzed separately) approach yielded similar information, resulting in percent root-mean-square error of prediction values of 0.9–5.7% for the seven factors. Further, the optical techniques and data processing strategies established in this study allow for the direct analysis of numerous species without measuring luminescence lifetimes or relying on a standard addition approach, making it optimal for near-real-time, in situ measurements. Nuclear reactor modeling helped bound training set conditions and identified elemental ratios of lanthanide fission products to characterize the burnup of irradiated nuclear fuel. Leveraging fluorescence, spectrophotometry, experimental design, and chemometrics can enable the remote quantification and characterization of complex systems with numerous species, monitor system performance, help identify the source of materials, and enable rapid high-throughput experiments in a variety of industrial processes and fundamental studies.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

NASA NTRS1989

Microwave and camera sensor fusion for the shape extraction of metallic 3D space objects

The vacuum of space presents special problems for optical image sensors. Metallic objects in this environment can produce intense specular reflections and deep shadows. By combining the polarized RCS with an incomplete camera image, it has become possible to better determine the shape of some simple three-dimensional objects. The radar data are used in an iterative procedure that generates successive approximations to the target shape by minimizing the error between computed scattering cross-sections and the observed radar returns. Favorable results have been obtained for simulations and experiments reconstructing plates, ellipsoids, and arbitrary surfaces.

Shaw, Scott W.↗

NASA NTRS2024

Distributed Sensor Fusion of Ground and Air Nodes Using Vision and Radar Modalities for Tracking Multirotor Small Uncrewed Air Systems and Birds

High-density airspace operations with multiple aircraft type and potentially noncooperative aircraft require distributed sensor detection and tracking systems to monitor airspace for safe, autonomous flight operations for advanced air mobility, urban air mobility, and high density small uncrewed air systems (SUAS) flight concepts. This work collected data using a distributed radar and camera sensor framework during the NASA Advanced Air Mobility High Density Vertiplex project SUAS flight operation. Node locations include on an onboard SUAS, affixed to the Landing and Impact Research Facility with approximate 200ft elevation, on a tripod on first-floor roof with an approximate elevation of 20 ft, and on a tripod on a concrete pad that is approximately 4 ft above sea level. Each node includes camera, radar, and GPS.

Beyond Visual Line of Sight↗

NASA NTRS1989

Neural network implementations of data association algorithms for sensor fusion

The paper is concerned with locating a time varying set of entities in a fixed field when the entities are sensed at discrete time instances. At a given time instant a collection of bivariate Gaussian sensor reports is produced, and these reports estimate the location of a subset of the entities present in the field. A database of reports is maintained, which ideally should contain one report for each entity sensed. Whenever a collection of sensor reports is received, the database must be updated to reflect the new information. This updating requires association processing between the database reports and the new sensor reports to determine which pairs of sensor and database reports correspond to the same entity. Algorithms for performing this association processing are presented. Neural network implementation of the algorithms, along with simulation results comparing the approaches are provided.

Brown, Donald E.↗

NASA NTRS1996

Inertial head-tracker sensor fusion by a complementary separate-bias Kalman filter

Current virtual environment and teleoperator applications are hampered by the need for an accurate, quick responding head-tracking system with a large working volume. Gyroscopic orientation sensors can overcome problems with jitter, latency, interference, line-of-sight obscurations, and limited range, but suffer from slow drift. Gravimetric inclinometers can detect attitude without drifting, but are slow and sensitive to transverse accelerations. This paper describes the design of a Kalman filter to integrate the data from these two types of sensors in order to achieve the excellent dynamic response of an inertial system without drift, and without the acceleration sensitivity of inclinometers.

Foxlin, Eric↗

DOE OSTI2020

Multi-sensor fusion for robust autonomous flight in indoor and outdoor environments with a rotorcraft micro-aerial vehicle (MAV)

The subject matter described herein includes a modular and extensible approach to integrate noisy measurements from multiple heterogeneous sensors that yield either absolute or relative observations at different and varying time intervals, and to provide smooth and globally consistent estimates of position in real time for autonomous flight. We describe the development of the algorithms and software architecture for a new 1.9 kg MAV platform equipped with an IMU, laser scanner, stereo cameras, pressure altimeter, magnetometer, and a GPS receiver, in which the state estimation and control are performed onboard on an Intel NUC 3rd generation i3 processor. We illustrate the robustness of our framework in large-scale, indoor-outdoor autonomous aerial navigation experiments involving traversals of over 440 meters at average speeds of 1.5 m/s with winds around 10 mph while entering and exiting buildings.

42 ENGINEERING↗

NASA NTRS1996

Inertial Head-Tracker Sensor Fusion by a Complementary Separate-Bias Kalman Filter

Current virtual environment and teleoperator applications are hampered by the need for an accurate, quick-responding head-tracking system with a large working volume. Gyroscopic orientation sensors can overcome problems with jitter, latency, interference, line-of-sight obscurations, and limited range, but suffer from slow drift. Gravimetric inclinometers can detect attitude without drifting, but are slow and sensitive to transverse accelerations. This paper describes the design of a Kalman filter to integrate the data from these two types of sensors in order to achieve the excellent dynamic response of an inertial system without drift, and without the acceleration sensitivity of inclinometers.

Foxlin, Eric↗

NASA NTRS1990

A sensor fusion field experiment in forest ecosystem dynamics

The background of the Forest Ecosystem Dynamics field campaign is presented, a progress report on the analysis of the collected data and related modeling activities is provided, and plans for future experiments at different points in the phenological cycle are outlined. The ecological overview of the study site is presented, and attention is focused on forest stands, needles, and atmospheric measurements. Sensor deployment and thermal and microwave observations are discussed, along with two examples of the optical radiation measurements obtained during the experiment in support of radiative transfer modeling. Future activities pertaining to an archival system, synthetic aperture radar, carbon acquisition modeling, and upcoming field experiments are considered.

Smith, James A.↗

NASA NTRSDate not supplied

A Green’s Function Sensor Fusion Approach for Evaluating Spacecraft Entry Heating From on-Board Thermal Instrumentation

During atmospheric entry, distributed thermal measurements are critical to enable the evaluation of heat loads on spacecraft thermal protection systems (TPS). In recent space exploration missions, Schmidt-Boelter-type heat flux gauges have been integrated into the TPS alongside conventional temperature measurement instrumentation to measure total (convective and radiative) and radiative heat transfer rates1,2. While direct heat flux sensors (HFS) are able to provide valuable information detailing the thermal loads experienced by spacecraft, the interpretation of these measurements in unsteady, convective environments requires a correction factor to account for local heating augmentations at the cold wall HFS surface2,3. Current efforts to estimate cold wall correction factors, and thus recover the hot wall TPS heat flux, rely on time-marching computational fluid dynamics (CFD) simulations2. Simulation-based methods are susceptible to large uncertainties, however, as they require estimations of vehicle trajectory, gas kinetics, wall catalysis models, and other flight conditions as input parameters2,4. Furthermore, CFD simulations are computationally expensive and cannot efficiently survey all possible entry scenarios, exacerbating the uncertainty of reconstructed hot wall heat flux values. These drawbacks motivate the development of alternative hot wall heat flux reconstruction methods that are not reliant on CFD-based correction factors.

Kenneth McAfee↗

NASA NTRSDate not supplied

A Green’s Function Sensor Fusion Approach for Evaluating Spacecraft Entry Heating From on-Board Thermal Instrumentation

During atmospheric entry, distributed thermal measurements are critical to enable the evaluation of heat loads on spacecraft thermal protection systems (TPS). In recent space exploration missions, Schmidt-Boelter-type heat flux gauges have been integrated into the TPS alongside conventional temperature measurement instrumentation to measure total (convective and radiative) and radiative heat transfer rates1,2. While direct heat flux sensors (HFS) are able to provide valuable information detailing the thermal loads experienced by spacecraft, the interpretation of these measurements in unsteady, convective environments requires a correction factor to account for local heating augmentations at the cold wall HFS surface2,3. Current efforts to estimate cold wall correction factors, and thus recover the hot wall TPS heat flux, rely on time-marching computational fluid dynamics (CFD) simulations2. Simulation-based methods are susceptible to large uncertainties, however, as they require estimations of vehicle trajectory, gas kinetics, wall catalysis models, and other flight conditions as input parameters2,4. Furthermore, CFD simulations are computationally expensive and cannot efficiently survey all possible entry scenarios, exacerbating the uncertainty of reconstructed hot wall heat flux values. These drawbacks motivate the development of alternative hot wall heat flux reconstruction methods that are not reliant on CFD-based correction factors.

Kenneth McAfee↗

NASA NTRSDate not supplied

A Green’s Function Sensor Fusion Approach for Evaluating Spacecraft Entry Heating From on-Board Thermal Instrumentation

During atmospheric entry, distributed thermal measurements are critical to enable the evaluation of heat loads on spacecraft thermal protection systems (TPS). In recent space exploration missions, Schmidt-Boelter-type heat flux gauges have been integrated into the TPS alongside conventional temperature measurement instrumentation to measure total (convective and radiative) and radiative heat transfer rates1,2. While direct heat flux sensors (HFS) are able to provide valuable information detailing the thermal loads experienced by spacecraft, the interpretation of these measurements in unsteady, convective environments requires a correction factor to account for local heating augmentations at the cold wall HFS surface2,3. Current efforts to estimate cold wall correction factors, and thus recover the hot wall TPS heat flux, rely on time-marching computational fluid dynamics (CFD) simulations2. Simulation-based methods are susceptible to large uncertainties, however, as they require estimations of vehicle trajectory, gas kinetics, wall catalysis models, and other flight conditions as input parameters2,4. Furthermore, CFD simulations are computationally expensive and cannot efficiently survey all possible entry scenarios, exacerbating the uncertainty of reconstructed hot wall heat flux values. These drawbacks motivate the development of alternative hot wall heat flux reconstruction methods that are not reliant on CFD-based correction factors.

Kenneth McAfee↗