Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Sensor fusion”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Data Fusion for Urban Air Quality Assessment & Forecasting

This presentation provides an overview for our funded project with NASA's Health and Air Quality Applied Sciences Program. The project will expand an existing air quality data fusion tool implemented in Google Earth Engine (GEE) by our project team members at Sonoma Technology, Inc. (STI), a private air quality data company. We will expand the capabilities of this tool using new methods developed by the NASA GMAO which will give it the capability of providing sub-city scale resolution and hourly frequency estimates and forecasts of three key air quality indicators: surface-level particulate matter (PM2.5), nitrogen dioxide (NO2), and ozone (O3). We will combine a variety of Earth Observations including satellite data, global air quality forecasts, and local data from regulatory-grade monitors and/or low cost sensors. We will implement the new data fusion capabilities into the existing GEE tool in consultation with our end-users to best address their needs for sub-city scale air quality estimates and forecasts.

K Emma Knowland↗

Gaussian Mixture Models for Temporal Depth Fusion

Sensing the 3D environment of a moving robot is essential for collision avoidance. Most 3D sensors produce dense depth maps, which are subject to imperfections due to various environmental factors. Temporal fusion of depth maps is crucial to overcome those. Temporal fusion is traditionally done in 3D space with voxel data structures, but it can be approached by temporal fusion in image space, with potential benefits in reduced memory and computational cost for applications like reactive collision avoidance for micro air vehicles. In this paper, we present an efficient Gaussian Mixture Models based depth map fusion approach, introducing an online update scheme for dense representations. The environment is modeled from an ego-centric point of view, where each pixel is represented by a mixture of Gaussian inverse-depth models. Consecutive frames are related to each other by transformations obtained from visual odometry. This approach achieves better accuracy than alternative image space depth map fusion techniques at lower computational cost.

Matthies, Larry↗

Autonomous Propulsion System Technology Being Developed to Optimize Engine Performance Throughout the Lifecycle

The goal of the Autonomous Propulsion System Technology (APST) project is to reduce pilot workload under both normal and anomalous conditions. Ongoing work under APST develops and leverages technologies that provide autonomous engine monitoring, diagnosing, and controller adaptation functions, resulting in an integrated suite of algorithms that maintain the propulsion system's performance and safety throughout its life. Engine-to-engine performance variation occurs among new engines because of manufacturing tolerances and assembly practices. As an engine wears, the performance changes as operability limits are reached. In addition to these normal phenomena, other unanticipated events such as sensor failures, bird ingestion, or component faults may occur, affecting pilot workload as well as compromising safety. APST will adapt the controller as necessary to achieve optimal performance for a normal aging engine, and the safety net of APST algorithms will examine and interpret data from a variety of onboard sources to detect, isolate, and if possible, accommodate faults. Situations that cannot be accommodated within the faulted engine itself will be referred to a higher level vehicle management system. This system will have the authority to redistribute the faulted engine's functionality among other engines, or to replan the mission based on this new engine health information. Work is currently underway in the areas of adaptive control to compensate for engine degradation due to aging, data fusion for diagnostics and prognostics of specific sensor and component faults, and foreign object ingestion detection. In addition, a framework is being defined for integrating all the components of APST into a unified system. A multivariable, adaptive, multimode control algorithm has been developed that accommodates degradation-induced thrust disturbances during throttle transients. The baseline controller of the engine model currently being investigated has multiple control modes that are selected according to some performance or operational criteria. As the engine degrades, parameters shift from their nominal values. Thus, when a new control mode is swapped in, a variable that is being brought under control might have an excessive initial error. The new adaptive algorithm adjusts the controller gains on the basis of the level of degradation to minimize the disruptive influence of the large error on other variables and to recover the desired thrust response.

Litt, Jonathan S.↗

A two-stage optical fusion framework for wildfire severity mapping across the conterminous United States

Accurate wildfire severity mapping (WSM) is essential for post-fire recovery planning, erosion risk assessment, ecosystem monitoring, and disaster risk reduction. Although Landsat and Sentinel optical imagery have been widely used for burn severity assessment, the added value of fusing multiple optical sensors has not been sufficiently quantified across diverse fire events, particularly since the launch of Landsat-9. This study evaluates whether multisensor optical fusion improves wildfire severity mapping relative to single-sensor baselines using Sentinel-2, Landsat-8, and Landsat-9 imagery across 40 wildfire events in the conterminous United States. We tested a two-stage fusion framework that combines feature-level fusion with pixel-level dimensionality reduction. First, feature-level fused datasets were created through early fusion by combining standardized post-fire bands from each sensor into a single predictor stack. Both raw reflectance bands and pairwise spectral transforms were retained to capture within- and cross-sensor spectral interactions. Second, Linear Discriminant Analysis was applied to both single-sensor and fused datasets to produce comparable low-dimensional feature spaces. Six machine-learning classifiers were then used to benchmark model performance with repeated spatially buffered train–test splits. Results show that Landsat-9 was the strongest single-sensor baseline. Among the fusion strategies, Sentinel-2 + Landsat-9 produced the most consistent improvement and reduced performance variability. Landscape-condition analysis further showed that this fusion was most beneficial in shrubland-dominated and high-terrain fires, where it achieved the highest overall mean accuracy and the fewest failures. In contrast, its benefits were less reliable in evergreen forests, mixed vegetation, and low- to moderate-elevation terrain. In operational settings, the Sentinel-2 + Landsat-9 configuration offers a practical solution for post-fire recovery planning, erosion-risk assessment, watershed management, and ecological monitoring when field observations are available and timely satellite-based information is needed.

Landsat↗

Texture development in magnetostrictive Fe-Ga alloys processed by laser powder bed fusion

Iron-gallium (Fe-Ga, Galfenol) alloys are promising magnetostrictive materials for actuators, sensors, and energy harvesting, but their performance is highly sensitive to microstructure and texture. Additive manufacturing by laser powder bed fusion (LPBF) offers a pathway to engineer texture and integrate functional materials into complex geometries. Here, we fabricate Fe-Ga alloys (Fe 82.2 Ga 17.8 ) by LPBF of gas-atomized powders and systematically optimize laser power and scan speed to maximize density and control texture. Nearly full-density parts (up to 99.6 %) are achieved within a narrow processing window. Electron backscatter diffraction (EBSD) reveals a strong <100> fiber texture aligned with the build direction and columnar grains up to 1 mm long. Magnetostriction measurements show saturation magnetostriction of 190 ppm in the build direction. Correlating texture data with macroscopic magnetostriction, we estimate intrinsic magnetostriction constants (λ 100 = 228 ppm, λ 111 = 12 ppm), closely matching single crystal-derived values. These results demonstrate the critical interplay between processing, texture, and functional performance in additively manufactured Fe-Ga alloys and establish LPBF as a viable route for high-performance magnetostrictive materials.

Additive manufacturing↗

Advanced communications, tracking, robotic vision technology for space applications

Recent advancements in the areas of tracking, communications, and robotics vision sensors being pursued within NASA, as applicable to space programs, are presented. Optical and laser-based communications and tracking systems and applications to space programs are discussed. Communication systems for multiple access, broadband, high data rate, and efficient operations are given. Current efforts at 20/30 GHz and millimeter wave bands are summarized. The use of optical data processing in control system applications for rendezvous and docking is presented. Robotics vision, based on television, laser, and microwave sensors for space applications, is discussed. The fusion of these technologies for remote control, station keeping, tracking, inspection, and satellite repair is detailed.

Krishen, Kumar↗

Multi-frequency SAR, SSM/I and AVHRR derived geophysical information of the marginal ice zone

A description is given of the fusion of synthetic aperture radar (SAR), special sensor microwave imager (SSM/I), and NOAA Advanced Very High Resolution Radiometer (AVHRR) data to study arctic processes. These data were collected during the SIZEX/CEAREX experiments that occurred in the Greenland Sea in March of 1989. Detailed comparisons between the SAR, AVHRR, and SSM/I indicated: (1) The ice edge position was in agreement to within 25 km, (2) The SSM/I SAR total ice concentration compared favorably, however, the SSM/I significantly underpredicted the multiyear fraction, (3) Combining high resolution SAR with SSM/I can potentially map open water and new ice features in the marginal ice zone (MIZ) which cannot be mapped by the single sensors, and (4) The combination of all three sensors provides accurate ice information as well as sea surface temperature and wind speeds.

Shuchman, R. A.↗

Sensor Arrays for Aerospace Vehicles

Advances in highly scalable sensors, wireless networks, distributed computing and data fusion algorithms enable significant improvements in high-level information-centric state determination for adaptable and autonomous aerospace vehicles. The objective is to increase insight into structural response of space vehicles and insight into the aerodynamics of new aircraft.

Alena, Richard↗

A System to Provide Real-Time Collaborative Situational Awareness by Web Enabling a Distributed Sensor Network

In this paper, we describe the architecture of both the PATS and SAP systems and how these two systems interoperate with each other forming a unified capability for deploying intelligence in hostile environments with the objective of providing actionable situational awareness of individuals. The SAP system works in concert with the UICDS information sharing middleware to provide data fusion from multiple sources. UICDS can then publish the sensor data using the OGC's Web Mapping Service, Web Feature Service, and Sensor Observation Service standards. The system described in the paper is able to integrate a spatially distributed sensor system, operating without the benefit of the Web infrastructure, with a remote monitoring and control system that is equipped to take advantage of SWE.

Visualization↗

Ground to Air Testing of a Fused Optical-Radar Aircraft Detection and Tracking System

Onboard detection and tracking capability are integral to the sensing component in collision avoidance systems needed to safely operate autonomous urban air taxis and small Unmanned Aircraft Systems. Ground-based validation of detection and tracking systems is an important milestone towards the end goal of real-time collision avoidance using onboard sensors and algorithms. In this work, we evaluate three Extended Kalman Filter(EKF)based fusion trackers with radar and vision detection inputs, and compare them with baseline trackers for each sensor type. Performance is assessed using field collected data of ground to air test flights with the sensors co-located on a stable platform with an instrumented multirotor acting as the intruder performing a waypoint pattern at a distance of1.1km to 0.3km to simulate a head-on collision geometry. Fusing an image-based morphological detector with a radar detector using an EKF covered 74% of the ground truth position updates logged by the flight controller on the multirotor within 50 meters after accounting for alignment offsets while covering 15% more ground truth updates relative to radar only. Removing timestamps when the intruder aircraft is occluded by trees and only considering timestamps where the radar has an update, the EKF image-based morphological detector combined with the radar detector covered 90% of the of the ground truth position updates within 50metersand 97% within 100 meters.

Chester V Dolph↗

Sensor Web Technology Challenges and Advancements for the Earth Science Decadal Survey Era

This paper examines the Earth science decadal survey era and the role ESTO developed sensor web technologies can contribute to the scientific observations. This includes hardware and software technology advances for in-situ and in-space measurements. Also discussed are emerging areas of importance such as the potential of small satellites for sensor web based observations as well as advances in data fusion critical to the science and societal benefits of future missions, and the challenges ahead.

sensor web↗

AC compensation of 3D magnetic diagnostic signals in DIII-D and National Spherical Torus Experiment-Upgrade (NSTX-U) for real-time application

A time domain algorithm has been developed to remove the vacuum pickup generated by both coil current (DC) and induced vessel current (AC) in real time from three dimensional (3D) magnetic diagnostic signals in the National Spherical Torus Experiment-Upgrade (NSTX-U) and DIII-D tokamaks. The possibility of detecting 3D plasma perturbations in real time is essential in modern and future tokamaks to avoid and control MHD instabilities. The presence of vacuum field pickup, due to toroidally asymmetric (3D) coils or to misalignment between sensors and axisymmetric (2D) coils, pollutes the measured plasma 3D field, making the detection of the magnetic field produced by the plasma challenging. Although the DC coupling between coils and sensors can be easily calculated and removed, the AC part is more difficult. Here, an algorithm based on a layered low-pass filter approach for the AC compensation and its application for DIII-D and NSTX-U data is presented, showing that this method reduces the vacuum pickup to the noise level. Comparison of plasma response measurements with and without vacuum compensation shows that accurate mode locking detection and plasma response identification require precise AC and DC compensations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Reactor Power Level Estimation by Fusing Multi-Modal Sensor Measurements

Estimates of the power level of a nuclear reactor based on measurements from an independent monitoring sensor system can help in the compliance verification of its declared operations. We present a three-level fusion method to estimate the power level of a nuclear reactor using features derived from infrared, electromagnetic, and acoustic sensor measurements collected in proximity to the reactor. Based on a simplified analytical model of the secondary coolant system of the reactor, we identify partial regression functions of the power level in terms of the temperature difference between inlet and outlet of coolant pipes, and the activity levels of four fans and four pumps, which are estimated as features from the sensor measurements. The power level estimator employs a combination of aggregate and complementary fusion steps at three levels to incorporate the multi-modal features in a structure that reflects the secondary cooling system and its partial regression functions. Using the measurements from a test campaign at an operational reactor, we show that this estimator achieves 3.47% or lower root mean square error under 5-fold cross validation. More generally, these results illustrate a progressive reduction in estimation error as additional modalities are appropriately incorporated, and that the fuser outperforms single modality features and their sub-combinations.

Rao, Nageswara↗

Longevity evaluation of SiC based alpha voltaic batteries with surface alpha sources

The alpha emitting actinide 241 Am is electrodeposited on the surface of the Pt electrode of in-house fabricated SiC Schottky diodes. With 17 nCi 241 Am directly coated on the top of a device, the 2-pi geometry yields a high energy (5.486 MeV) and a long-term irradiation accumulating to a high fluence (1.6 × 10 9 alpha particles’ infusion/month). The forward, reverse I/V, and dark current, are periodically measured to monitor key characteristics of device durability for any sign of degradation over time. The direct deposition of actinides on the surface of the device also enables the evaluation of radiation damage through alpha particles’ energy spectroscopic performance, which shows a clear spectrum degradation that can be reversed by optical excitation of the device prior to spectrum acquisition. As an analytical aide, the device performance is also simulated by Allpix 2 . Lastly, this study provides an insight into the durability of 4H-SiC as an energy converter option for alpha-voltaic batteries and the survivability in the other harsh environment found in nuclear fuel cycle, high energy physics, fission, fusion, and space exploration where rad-hard sensors are required.

Americium↗

Radiation-Hardened GaN HEMT and Cell Design, Modeling, and Fabrication for Nuclear Instrumentation Applications

Recent advances in nuclear power generation technologies show great promise for efficient, safe generation of carbon-free power in the near future. Consequently, many new generation reactor designs are being pursued by government and industry groups, including both fission- and fusion-based technologies. Radiation- and temperature-tolerant sensor technology continues to advance, yet development of the electronics/instrumentation technologies suitable for these environments have fallen behind. Industry has adequately addressed harsh environment electronics needs for low earth orbit satellites, but the much more extreme conditions associated with electronics placed near or in a reactor core remain unaddressed. This project investigates the use of gallium nitride (GaN) circuit technology to address the unique needs for sensor interface electronics and communications in reactor environments. This report provides a summary of the first year’s project activities related to developing and optimizing devices and circuits for this GaN high electronic mobility transistor (HEMT) process. Activities reported include multiple analog and digital circuit designs simulated using custom Verilog-A models generated from measured GaN devices fabricated in the target process. Digital circuit designs included fundamental logic circuits such as an inverter, NAND, NOR, AND and OR gates, as well as a 5-stage ring oscillator. Each design was simulated using an open-source SPICE simulator, and an integrated circuit layout was produced of each design for use in future fabrication. Analog circuit designs focused on the fundamental building blocks to be used to construct sensor interface and communications circuits. These included current mirrors, matched differential pairs, and a Gilbert cell mixer design, each with an associated integrated circuit layout. Layout tools used for these designs included two open-source packages—KLayout and Magic—which were customized for specific use with the OSU GaN process layers. Design rules and preliminary device extraction capabilities were built for the Magic tool to enable device extraction and subsequent netlist generation for SPICE simulation. Finally, future research directions for year two are summarized. When the year-two directions are implemented, the project will be in position to advance the state of the art in electronics for near- or in-reactor sensor interfacing and communications.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Methods and decision making on a Mars rover for identification of fossils

A system for automated fusion and interpretation of image data from multiple sensors, including multispectral data from an imaging spectrometer is being developed. Classical artificial intelligence techniques and artificial neural networks are employed to make real time decision based on current input and known scientific goals. Emphasis is placed on identifying minerals which could indicate past life activity or an environment supportive of life. Multispectral data can be used for geological analysis because different minerals have characteristic spectral reflectance in the visible and near infrared range. Classification of each spectrum into a broad class, based on overall spectral shape and locations of absorption bands is possible in real time using artificial neural networks. The goal of the system is twofold: multisensor and multispectral data must be interpreted in real time so that potentially interesting sites can be flagged and investigated in more detail while the rover is near those sites; and the sensed data must be reduced to the most compact form possible without loss of crucial information. Autonomous decision making will allow a rover to achieve maximum scientific benefit from a mission. Both a classical rule based approach and a decision neural network for making real time choices are being considered. Neural nets may work well for adaptive decision making. A neural net can be trained to work in two steps. First, the actual input state is mapped to the closest of a number of memorized states. After weighing the importance of various input parameters, the net produces an output decision based on the matched memory state. Real time, autonomous image data analysis and decision making capabilities are required for achieving maximum scientific benefit from a rover mission. The system under development will enhance the chances of identifying fossils or environments capable of supporting life on Mars

Eberlein, Susan↗

Towards an Open, Distributed Software Architecture for UxS Operations

To address the growing need to evaluate, test, and certify an ever expanding ecosystem of UxS platforms in preparation of cultural integration, NASA Langley Research Center's Autonomy Incubator (AI) has taken on the challenge of developing a software framework in which UxS platforms developed by third parties can be integrated into a single system which provides evaluation and testing, mission planning and operation, and out-of-the-box autonomy and data fusion capabilities. This software framework, named AEON (Autonomous Entity Operations Network), has two main goals. The first goal is the development of a cross-platform, extensible, onboard software system that provides autonomy at the mission execution and course-planning level, a highly configurable data fusion framework sensitive to the platform's available sensor hardware, and plug-and-play compatibility with a wide array of computer systems, sensors, software, and controls hardware. The second goal is the development of a ground control system that acts as a test-bed for integration of the proposed heterogeneous fleet, and allows for complex mission planning, tracking, and debugging capabilities. The ground control system should also be highly extensible and allow plug-and-play interoperability with third party software systems. In order to achieve these goals, this paper proposes an open, distributed software architecture which utilizes at its core the Data Distribution Service (DDS) standards, established by the Object Management Group (OMG), for inter-process communication and data flow. The design decisions proposed herein leverage the advantages of existing robotics software architectures and the DDS standards to develop software that is scalable, high-performance, fault tolerant, modular, and readily interoperable with external platforms and software.

Cross, Charles D.↗

Development of an Information Fusion System for Engine Diagnostics and Health Management

Aircraft gas-turbine engine data are available from a variety of sources including on-board sensor measurements, maintenance histories, and component models. An ultimate goal of Propulsion Health Management (PHM) is to maximize the amount of meaningful information that can be extracted from disparate data sources to obtain comprehensive diagnostic and prognostic knowledge regarding the health of the engine. Data Fusion is the integration of data or information from multiple sources, to achieve improved accuracy and more specific inferences than can be obtained from the use of a single sensor alone. The basic tenet underlying the data/information fusion concept is to leverage all available information to enhance diagnostic visibility, increase diagnostic reliability and reduce the number of diagnostic false alarms. This paper describes a basic PHM Data Fusion architecture being developed in alignment with the NASA C17 Propulsion Health Management (PHM) Flight Test program. The challenge of how to maximize the meaningful information extracted from disparate data sources to obtain enhanced diagnostic and prognostic information regarding the health and condition of the engine is the primary goal of this endeavor. To address this challenge, NASA Glenn Research Center (GRC), NASA Dryden Flight Research Center (DFRC) and Pratt & Whitney (P&W) have formed a team with several small innovative technology companies to plan and conduct a research project in the area of data fusion as applied to PHM. Methodologies being developed and evaluated have been drawn from a wide range of areas including artificial intelligence, pattern recognition, statistical estimation, and fuzzy logic. This paper will provide a broad overview of this work, discuss some of the methodologies employed and give some illustrative examples.

Volponi, Allan J.↗