Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “multi-sensor data fusion”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Safe Operations at Roadway Junctions: Intelligent Roadway Infrastructure as Functional Interlocking

Automated vehicle (AV) technology is quickly maturing, and the corresponding infrastructure systems that evaluate traffic and communicate to vehicles requires sophisticated sensing and perception technologies, referred to as intelligent roadway infrastructure (IRI), to complement emerging AV capabilities. IRI provides signals to vehicles, indicating right-of-way for vehicles and communicating to approaching AVs that no other vehicle is failing to yield. This capability, denoted as safety-affirmative signaling, provides a green light or a green arrow as appropriate and affirms through communication links to connected vehicles when it is safe to proceed. About 36% of collisions occur at intersections, with most occurring upon left turns (22.2%) or crossing over (12.6%), and only a small percentage (1.2%) while turning right at an intersection. Of all intersection crashes about half (52.5%) of those vehicles were traveling through a signalized intersection 2. Safety-affirmative signaling would guarantee safety of AV fleet vehicles, by providing the interlocking principle, a term from automated train control that only allows progression through a railway intersection after affirming no opportunity for a crash exists. IRI through safety-affirmative signaling would bring performance and safety to complex roadway intersections where AV transit fleet service is most needed, as well as safety benefits to traditional, non-automated vehicles and vulnerable road users. The implementation of IRI has functional, programmatic, and technical challenges. Research work performed at the National Renewable Energy Laboratory (NREL) in an integrative approach encapsulating these themes, and termed infrastructure perception and control (IPC) is motivated by improved performance (travel time), improved safety (reduced collisions), and improved energy efficiency (less fuel burned and minimized production of greenhouse gases). IPC is intended not only for roadway and intersection applications but also in extension to inform complementary buildings and grid systems to enable better co-management, as vehicles and their charging needs become increasingly integrated into the built environment. The NREL IPC project presents an open-source framework, architecture, and supporting technology to implement IRI, addressing critical issues such as fusion of data, reliability, standardization of data interfaces, and confidence of detection. The framework is informed by previous experience in U.S. Department of Defense research technology, specifically in the use of radar to detect, identify, and track aerial threats. These principles combined with multi-sensor fusion provides for a complete digital twin with known and measurable confidence and accuracy from which safety-affirmative signaling can be developed and deployed.

ADVANCED PROPULSION SYSTEMS,MATHEMATICS AND COMPUT↗
DOE OSTI2022

Erratum to: Data Fusion to Support Integrated Nuclear Detonation Detection [Slides]

The original document (LA-UR-22-29547) contained minor equation errors that approximate correct equations that couple the multi-sensor, serial system detector thresholds for a seismic Rayleigh wave detector and an acoustic energy detector. Those errors appeared on slides 62-67. This erratum associates the following slides with the erroneous slides. The numbers of the erroneous slides are marked at the upper right in small text in orange. A result of those errors over-predict the performance of the two-sensor serial network, that is, the former document provides an optimistic estimate of system performance.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS2006

Real-time Enhancement, Registration, and Fusion for a Multi-Sensor Enhanced Vision System

Over the last few years NASA Langley Research Center (LaRC) has been developing an Enhanced Vision System (EVS) to aid pilots while flying in poor visibility conditions. The EVS captures imagery using two infrared video cameras. The cameras are placed in an enclosure that is mounted and flown forward-looking underneath the NASA LaRC ARIES 757 aircraft. The data streams from the cameras are processed in real-time and displayed on monitors on-board the aircraft. With proper processing the camera system can provide better-than- human-observed imagery particularly during poor visibility conditions. However, to obtain this goal requires several different stages of processing including enhancement, registration, and fusion, and specialized processing hardware for real-time performance. We are using a real-time implementation of the Retinex algorithm for image enhancement, affine transformations for registration, and weighted sums to perform fusion. All of the algorithms are executed on a single TI DM642 digital signal processor (DSP) clocked at 720 MHz. The image processing components were added to the EVS system, tested, and demonstrated during flight tests in August and September of 2005. In this paper we briefly discuss the EVS image processing hardware and algorithms. We then discuss implementation issues and show examples of the results obtained during flight tests. Keywords: enhanced vision system, image enhancement, retinex, digital signal processing, sensor fusion

Hines, Glenn D.↗
NASA NTRS2005

Multi-Sensor Fusion and Enhancement for Object Detection

This was a quick &week effort to investigate the ability to detect changes along the flight path of an unmanned airborne vehicle (UAV) over time. Video was acquired by the UAV during several passes over the same terrain. Concurrently, GPS data and UAV attitude data were also acquired. The purpose of the research was to use information from all of these sources to detect if any change had occurred in the terrain encompassed by the flight path.

Rahman, Zia-Ur↗
NASA NTRS2024

PACE Technical Report Series, Volume 12: The PACE Level 1C data format

NASA's Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) mission will make global ocean color and atmospheric measurements to provide extended data records of ocean ecology and global biogeochemistry, along with polarimetric measurements for advanced observations of aerosols, clouds and the ocean. PACE will contain three instruments: the primary Ocean Color Instrument (OCI), and two multi-angle polarimeters (MAPs). The latter instruments are contributed under a ‘Do-No-Harm’ (to the rest of the PACE mission) principle, and the PACE Science Data Processing System (SDPS) is only required to produce Level-1b (geolocated radiances with calibration applied) data without performance requirements. However, there is a strong desire to produce data in a format that merges the disparate spatial resolutions, viewing geometry and sampling nature of the three instruments. Our terminology for this format is Level 1c (L1C). This format will be an input to Level 2 algorithms produced from standalone MAP instrument observations, or from algorithms employing multi-sensor fusion. Creating the L1C format has several components. This includes choice of projection method, the means by which multi-angle views are properly incorporated into that projection (‘aggregation’) the means to represent wavelength and light polarization state, the selection of data to be included within the L1C file, and the handling of ancillary data either required for L1C file generation or needed in that format for L2 processing.

PACE↗
NASA NTRS2011

Global Assimilation of Multi-Sensor Snow Observations for Improved Characterization of Snow Processes

Snow conditions on the land surface are recognized to be key components of the global hydrological cycle as they play a critical role in the determination of local and regional climate. In many mid-latitude and high-latitude regions, the seasonal water storage and associated spring snowmelt dominate the local hydrology. The contribution to the runoff and moisture conditions from snow is vital in supporting agriculture and in determining water resources management practices. Consequently, accurate characterization of snow properties becomes important for both end-use applications and weather and climate research. Recently a joint effort between the u.S. Air Force and NASA has enabled a blended, multi-sensor snow product known as the AFWA NASA Snow Algorithm (ANSA). This global snow dataset has been generated by utilizing the Earth Observation System (EOS) Moderate Resolution Imaging Spectroradiometer (MODIS) and Advanced Microwave Scanning Radiometer for EOS (AMSR-E) datasets. ANSA product includes estimates of snow cover extent, snow water equivalent (SWE) and SWE-derived snow depth fields. The MODIS-based products enable snow cover mappings under cloud-free conditions whereas the passive microwave data from AMSR-E provides measurements under cloudy conditions. These remotely-sensed snow observations are further augmented with the information from ground-based snow measurements through data fusion techniques. The resulting ANSA products are employed in the NASA Land Information System (LIS) data assimilation framework, which provides a comprehensive environment for integrating community land surface models, ground and satellite-based observations, and ensemble-based data assimilation tools. LIS incorporates the multisensor ANSA snow retrievals with the land surface model estimates to generate spatially and temporally continuous estimates of snow states, through data assimilation. A suite of experiments to assimilate ANSA snow cover, SWE and snow depth estimates with different land surface models in LIS are conducted and the resulting estimates of snow conditions are evaluated against a number of in-situ observational datasets, over several regions of the world. These evaluations are used to compare and contrast the advantages and disadvantages of these multi-sensor snow observations.

Kumar, Sujay↗
NASA NTRS2022

Local Scale (3-M) Soil Moisture Mapping Using SMAP and Planet Superdove

A capability for mapping meter-level resolution soil moisture with frequent temporal sampling over large regions is essential for quantifying local-scale environmental heterogeneity and eco-hydrologic behavior. However, available surface soil moisture (SSM) products generally involve much coarser grain sizes ranging from 30 m to several 10s of kilometers. Hence a new method is proposed to estimate 3-m resolution SSM using a combination of multi-sensor fusion, machine- learning (ML) and Cumulative Distribution Function (CDF) matching approaches. This method established favorable SSM correspondence between 3-m pixels and overlying 9-km grid cells from overlapping Planet SuperDove (PSD) observations and NASA Soil Moisture Active-Passive (SMAP) mission products. The resulting 3-m SSM predictions showed improved accuracy by reducing ab- solute bias and RMSE by ~0.01 cm3/cm3 over the original SMAP data in relation to in-situ soil moisture measurements for the Australian Yanco region, while preserving the high sampling frequency (1-3 day global revisit) and sensitivity to surface wetness (R 0.865) from SMAP. Heterogeneous soil moisture distributions varying with vegetation biomass gradients and irrigation regimes were generally captured within a selected study area. Further algorithm refinement and implementation for regional applications will allow for improvement in water resources management, precision agriculture, and disaster forecasts and responses.

soil moisture↗
NASA NTRS2004

Registration and Fusion of Multiple Source Remotely Sensed Image Data

Earth and Space Science often involve the comparison, fusion, and integration of multiple types of remotely sensed data at various temporal, radiometric, and spatial resolutions. Results of this integration may be utilized for global change analysis, global coverage of an area at multiple resolutions, map updating or validation of new instruments, as well as integration of data provided by multiple instruments carried on multiple platforms, e.g. in spacecraft constellations or fleets of planetary rovers. Our focus is on developing methods to perform fast, accurate and automatic image registration and fusion. General methods for automatic image registration are being reviewed and evaluated. Various choices for feature extraction, feature matching and similarity measurements are being compared, including wavelet-based algorithms, mutual information and statistically robust techniques. Our work also involves studies related to image fusion and investigates dimension reduction and co-kriging for application-dependent fusion. All methods are being tested using several multi-sensor datasets, acquired at EOS Core Sites, and including multiple sensors such as IKONOS, Landsat-7/ETM+, EO1/ALI and Hyperion, MODIS, and SeaWIFS instruments. Issues related to the coregistration of data from the same platform (i.e., AIRS and MODIS from Aqua) or from several platforms of the A-train (i.e., MLS, HIRDLS, OMI from Aura with AIRS and MODIS from Terra and Aqua) will also be considered.

LeMoigne, Jacqueline↗
DOE OSTI2024

Science Area 1: Standard Award: Model-Data Fusion to Examine Multiscale Dynamical Controls on Snow Cover and Critical Zone Moisture Inputs (Final Report)

In many mountain watersheds of the world, seasonal snowpacks play an important role as natural reservoirs of water. Seasonal snowpacks accumulate water during cold, wet winter months that subsequently melts. Downstream communities depend on water from melting seasonal snowpacks to support agricultural, industrial, and municipal water needs. Rapidly melting snowpacks can also present a flooding hazard, particularly if snowpacks melt at rates faster than anticipated and where adequate reservoir capacity is unavailable to buffer river flows associated with melt. The spatial and temporal dynamics of snow accumulation and melt also play an important role in supporting upland ecosystems in mountain landscapes. Snowmelt provides soil moisture that enable terrestrial ecosystem productivity and exert control on soil microorganisms that play important roles in global carbon cycles. Climate warming is gradually decreasing the amount of precipitation in mountain watersheds arriving as snow, presenting potentially profound disruptions to mountain ecosystems, as well as downstream delivery of water. The overarching goal of this project was to understand how interactions between the near-surface atmosphere and surface topography control the input, accumulation, retention, and release of water from mountain snowpacks. Over a 5-year period, this project pursued an approach combining high-resolution regional climate modeling, satellite and airborne remote sensing data, and ground-based observations to develop and analyze benchmark datasets to address overarching science questions and hypotheses. Key products include a continuous, long-term, high spatiotemporal resolution (1 km/1 hr) dataset characterizing key climate variables in the Upper Colorado River Basin. The dataset included historical estimates of precipitation, temperature, humidity, solar and longwave radiation, and wind speeds. Additionally, the project developed a 20+ year long, 30 m spatial, daily temporal multi-sensor dataset characterizing snow presence/absence in the East/Taylor River watersheds in the Central Rocky Mountains of Colorado. The project supported training of 1 postdoctoral scholar, 1 Ph.D. student, and 1 M.S. student.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Forest aboveground biomass estimation through integration of sentinel-2 and PALSAR-2 time series: assessing models trained on GEDI and field inventory benchmarks

Accurate and spatially explicit forest Aboveground Biomass (AGB) mapping through remote sensing is critical for quantifying terrestrial carbon stocks and informing effective forest management strategies. However, AGB estimation in dense forests with complex terrain remains challenging due to satellite sensor signal saturation problem (saturation issue occurs in high biomass forests), structural complexity, and limited ground truth for calibration. This study presents a novel framework that integrates multi-temporal Sentinel-2 optical imagery, ALOS PALSAR-2 Synthetic Aperture Radar (SAR) data, and topographic variables with explainable Machine Learning to map AGB across mountainous forests within subtropical and temperate oceanic climate zones of Mexico. We evaluate the effects of temporal granularity and sensor synergy by comparing multiple temporal inputs and sensor configurations (Sentinel-2, PALSAR-2, and their fusion), and assess model performance using two reference datasets: NASA GEDI LiDAR-derived biomass and Mexico’s National Forest and Soil Inventory (INFyS). Our results showed that models trained on INFyS consistently outperformed those trained on GEDI, highlighting limitations in GEDI’s reliability in biomass estimates within this study region. Furthermore, the integration of Sentinel-2 and PALSAR-2 provided improved predictions compared to single-sensor models, particularly when combined with temporally explicit yearly statistics. The best-performing model, which was trained on INFyS data, and considered both Sentinel-2 and PALSAR-2 yearly statistics, as well as topographic variables, achieved an R2 of 0.64, RMSE of 51.10 Mg/ha, and relative RMSE (rRMSE) of 58.69%. Explainable ML analysis identified Sentinel-2 spectral indices and topographic features as key predictors, while PALSAR-2 metrics provided complementary information, partially mitigating saturation effects in high-biomass areas. Specifically, integrating both sensors substantially improved AGB estimation in high biomass forest (≥200 Mg/ha), yielding 98% gains over optical-only model, with resulting estimates exceeding GEDI L4B by 29% and ESA-CCI-BIOMASS by 174%. Terrain-stratified analysis indicated close agreement with GEDI in low-slope areas, with increasing divergence as slope steepness increased, while estimates remained consistently higher than ESA-CCI-BIOMASS across all slope classes. The proposed approach advances multi-sensor fusion and temporal feature engineering for AGB mapping using open-access satellite datasets, providing a scalable and reproducible framework for annual biomass monitoring in topographically complex mountainous forests. The resulting 25 m resolution biomass product has the potential to provide spatially detailed information for forest monitoring and may support applications in carbon accounting and forest management.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Automatic Calibration and Health Monitoring of Infrastructure Sensors

Smart transportation infrastructure relies on networks of heterogeneous sensors - cameras, radars, and lidars - continuously monitoring traffic conditions. However, executing the initial spatial calibration of multiple sensors and the subsequent health monitoring presents significant operational challenges. Environmental factors, mechanical vibrations, and gradual drift cause spatial misalignment, degrading fusion performance and tracking accuracy. Traditional calibration approaches require manual intervention with specialized targets or survey equipment, resulting in service interruptions and high maintenance costs. This work presents an automated framework for initial calibration and continuous health monitoring without human intervention or service disruption. Our approach addresses two critical problems: (1) detecting when sensors become miscalibrated during operation, and (2) automatically re-establishing spatial alignment using only operational traffic data. The health monitoring component analyzes measurement innovations - differences between sensor observations and predicted object states - to detect systematic biases indicative of calibration drift. By computing bias magnitude, directional consistency, and rejection rates, the system identifies miscalibrations as small as 0.5 meters. Unlike traditional methods requiring known calibration targets, our diagnostic operates continuously on live traffic observations, enabling early detection before fusion quality degrades. The automatic recalibration algorithm leverages overlapping sensor fields-of-view and temporal correlation of vehicle observations. Using graph-based optimization, the system automatically discovers which sensor pairs observe common regions, estimates pairwise spatial transformations using RANSAC-based robust estimation, and jointly optimizes all sensor poses through bundle adjustment. The framework handles practical deployment challenges, including different sensor sampling rates (1-10 Hz), varying installation positions, unknown orientations, and limited overlap regions (>10%). When approximate sensor positions are available from installation surveys (+/-1m accuracy), the algorithm additionally estimates sensor orientations, refining both position and rotation to sub-meter and sub-degree accuracy. We validate the framework on multi-hour traffic datasets from six heterogeneous sensors with sampling rates ranging from 1 Hz to 10 Hz. Results demonstrate successful calibration even with sparse overlap (<20%) and automatic detection of miscalibrations exceeding 0.8 meters. This work enables a "deploy-and-forget" sensor infrastructure that maintains calibration autonomously, reducing maintenance costs while improving tracking accuracy. The techniques generalize beyond transportation to any multi-sensor monitoring application requiring robust spatial alignment, including smart cities, industrial monitoring, and surveillance systems.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS1993

Atmospheric electricity/meteorology analysis

This activity focuses on Lightning Imaging Sensor (LIS)/Lightning Mapper Sensor (LMS) algorithm development and applied research. Specifically we are exploring the relationships between (1) global and regional lightning activity and rainfall, and (2) storm electrical development, physics, and the role of the environment. U.S. composite radar-rainfall maps and ground strike lightning maps are used to understand lightning-rainfall relationships at the regional scale. These observations are then compared to SSM/I brightness temperatures to simulate LIS/TRMM multi-sensor algorithm data sets. These data sets are supplied to the WETNET project archive. WSR88-D (NEXRAD) data are also used as it becomes available. The results of this study allow us to examine the information content from lightning imaging sensors in low-earth and geostationary orbits. Analysis of tropical and U.S. data sets continues. A neural network/sensor fusion algorithm is being refined for objectively associating lightning and rainfall with their parent storm systems. Total lightning data from interferometers are being used in conjunction with data from the national lightning network. A 6-year lightning/rainfall climatology has been assembled for LIS sampling studies.

Goodman, Steven J.↗
NASA NTRS1992

Geographic information system for fusion and analysis of high-resolution remote sensing and ground truth data

We seek to combine high-resolution remotely sensed data with models and ground truth measurements, in the context of a Geographical Information System, integrated with specialized image processing software. We will use this integrated system to analyze the data from two Case Studies, one at a bore Al forest site, the other a tropical forest site. We will assess the information content of the different components of the data, determine the optimum data combinations to study biogeophysical changes in the forest, assess the best way to visualize the results, and validate the models for the forest response to different radar wavelengths/polarizations. During the 1990's, unprecedented amounts of high-resolution images from space of the Earth's surface will become available to the applications scientist from the LANDSAT/TM series, European and Japanese ERS-1 satellites, RADARSAT and SIR-C missions. When the Earth Observation Systems (EOS) program is operational, the amount of data available for a particular site can only increase. The interdisciplinary scientist, seeking to use data from various sensors to study his site of interest, may be faced with massive difficulties in manipulating such large data sets, assessing their information content, determining the optimum combinations of data to study a particular parameter, visualizing his results and validating his model of the surface. The techniques to deal with these problems are also needed to support the analysis of data from NASA's current program of Multi-sensor Airborne Campaigns, which will also generate large volumes of data. In the Case Studies outlined in this proposal, we will have somewhat unique data sets. For the Bonanza Creek Experimental Forest (Case I) calibrated DC-8 SAR data and extensive ground truth measurement are already at our disposal. The data set shows documented evidence to temporal change. The Belize Forest Experiment (Case II) will produce calibrated DC-8 SAR and AVIRIS data, together with extensive measurements on the tropical rain forest itself. The extreme range of these sites, one an Arctic forest, the other a tropical rain forest, has been deliberately chosen to find common problems which can lead to generalized observations and unique problems with data which raise issues for the EOS System.

Freeman, Anthony↗
NASA NTRS1993

Geographic information system for fusion and analysis of high-resolution remote sensing and ground data

We seek to combine high-resolution remotely sensed data with models and ground truth measurements, in the context of a Geographical Information System (GIS), integrated with specialized image processing software. We will use this integrated system to analyze the data from two Case Studies, one at a boreal forest site, the other a tropical forest site. We will assess the information content of the different components of the data, determine the optimum data combinations to study biogeophysical changes in the forest, assess the best way to visualize the results, and validate the models for the forest response to different radar wavelengths/polarizations. During the 1990's, unprecedented amounts of high-resolution images from space of the Earth's surface will become available to the applications scientist from the LANDSAT/TM series, European and Japanese ERS-1 satellites, RADARSAT and SIR-C missions. When the Earth Observation Systems (EOS) program is operational, the amount of data available for a particular site can only increase. The interdisciplinary scientist, seeking to use data from various sensors to study his site of interest, may be faced with massive difficulties in manipulating such large data sets, assessing their information content, determining the optimum combinations of data to study a particular parameter, visualizing his results and validating his model of the surface. The techniques to deal with these problems are also needed to support the analysis of data from NASA's current program of Multi-sensor Airborne Campaigns, which will also generate large volumes of data. In the Case Studies outlined in this proposal, we will have somewhat unique data sets. For the Bonanza Creek Experimental Forest (Case 1) calibrated DC-8 SAR (Synthetic Aperture Radar) data and extensive ground truth measurement are already at our disposal. The data set shows documented evidence to temporal change. The Belize Forest Experiment (Case 2) will produce calibrated DC-8 SAR and AVIRIS data, together with extensive measurements on the tropical rain forest itself. The extreme range of these sites, one an Arctic forest, the other a tropical rain forest, has been deliberately chosen to find common problems which can lead to generalized observations and unique problems with data which raise issues for the EOS System.

Freeman, Anthony↗
NASA NTRS2002

Multi-Image Registration for an Enhanced Vision System

An Enhanced Vision System (EVS) utilizing multi-sensor image fusion is currently under development at the NASA Langley Research Center. The EVS will provide enhanced images of the flight environment to assist pilots in poor visibility conditions. Multi-spectral images obtained from a short wave infrared (SWIR), a long wave infrared (LWIR), and a color visible band CCD camera, are enhanced and fused using the Retinex algorithm. The images from the different sensors do not have a uniform data structure: the three sensors not only operate at different wavelengths, but they also have different spatial resolutions, optical fields of view (FOV), and bore-sighting inaccuracies. Thus, in order to perform image fusion, the images must first be co-registered. Image registration is the task of aligning images taken at different times, from different sensors, or from different viewpoints, so that all corresponding points in the images match. In this paper, we present two methods for registering multiple multi-spectral images. The first method performs registration using sensor specifications to match the FOVs and resolutions directly through image resampling. In the second method, registration is obtained through geometric correction based on a spatial transformation defined by user selected control points and regression analysis.

Hines, Glenn↗
NASA NTRS2008

Multi-sensor Testing for Automated Rendezvous and Docking

During the past two years, many sensors have been tested in an open-loop fashion in the Marshall Space Flight Center (MSFC) Flight Robotics Laboratory (FRL) to both determine their suitability for use in Automated Rendezvous and Docking (AR&D) systems and to ensure the test facility is prepared for future multi-sensor testing. The primary focus of this work was in support of the CEV AR&D system, because the AR&D sensor technology area was identified as one of the top risks in the program. In 2006, four different sensors were tested individually or in a pair in the MSFC FRL. In 2007, four sensors, two each of two different types, were tested simultaneously. In each set of tests, the target was moved through a series of pre-planned trajectories while the sensor tracked it. In addition, a laser tracker "truth" sensor also measured the target motion. The tests demonstrated the functionality of testing four sensors simultaneously as well as the capabilities (both good and bad) of all of the different sensors tested. This paper outlines the test setup and conditions, briefly describes the facility, summarizes the earlier results of the individual sensor tests, and describes in some detail the results of the four-sensor testing. Post-test analysis includes data fusion by minimum variance estimation and sequential Kalman filtering. This Sensor Technology Project work was funded by NASA's Exploration Technology Development Program.

Howard, Richard T.↗
NASA NTRS2015

Earth Science Data Fusion with Event Building Approach

Objectives of the NASA Information And Data System (NAIADS) project are to develop a prototype of a conceptually new middleware framework to modernize and significantly improve efficiency of the Earth Science data fusion, big data processing and analytics. The key components of the NAIADS include: Service Oriented Architecture (SOA) multi-lingual framework, multi-sensor coincident data Predictor, fast into-memory data Staging, multi-sensor data-Event Builder, complete data-Event streaming (a work flow with minimized IO), on-line data processing control and analytics services. The NAIADS project is leveraging CLARA framework, developed in Jefferson Lab, and integrated with the ZeroMQ messaging library. The science services are prototyped and incorporated into the system. Merging the SCIAMACHY Level-1 observations and MODIS/Terra Level-2 (Clouds and Aerosols) data products, and ECMWF re- analysis will be used for NAIADS demonstration and performance tests in compute Cloud and Cluster environments.

Lukashin, C.↗
NASA NTRSDate not supplied

Adaptive Multi-Sensor Localization Information Fusion for Autonomous Urban Air Mobility Operations

An adaptive method is developed to iteratively fuse the information provided by multiple sensors to enable autonomous urban air mobility type operations. First, noisy and bias corrupted IMU readings are processed as soon as they arrive using kinematic equations represented in the vehicle's body frame. To correct the systems drift resulting from the integration, an information content measure is introduced to decide on the environment. For the cluttered environment the information provided by environmental sensors is counted as reliable and the drift correction as accurate. For the open space, the GPS data is counted as reliable, and the drift correction is done based on the GPS readings. The measurement noise effects are minimize using Iterated Extended Kalman Filter framework. The algorithm is implemented in the in-house developed FlightDeckz simulation environment using an IMU model, simulated video recorded from a camera mounted on the vehicle (for the purpose of this study, outside scenery was generated with XPlane), which flies in an urban environment, and GPS data generated from the environment's digital map.

Onboard Perception↗