Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Sensor fusion”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Advances in sapphire optical fiber sensors

We describe the development and testing of two sapphire fiber sensor designs intended for use in high temperature environments. The first is a birefringence-balanced polarimetric sapphire fiber sensor. In this sensor, two single crystal sapphire rods, acting as the birefringence sensing element, are connected to each other in such a way that the slow axis of the first rod is aligned along with the fast axis of the second rod, and the fast axis of the first rod is along the slow axis of the second rod. This sensor has been demonstrated for measurement of temperature up to 1500 C. The second is a sapphire-fiber-based intrinsic interferometric sensor. In this sensor, a length of uncoated, unclad, structural-graded multimode sapphire fiber is fusion spliced to a singlemode silica fiber to form a Fabry-Perot cavity. The reflections from the silica-to-sapphire fiber splice and the free endface of the sapphire fiber give rise to the interfering fringe output. This sensor has been demonstrated for the measurement of temperature above 1510 C, and a resolution of 0.1 C has been obtained.

Wang, Anbo↗

Smart Networked Elements in Support of ISHM

At the core of ISHM is the ability to extract information and knowledge from raw data. Conventional data acquisition systems sample and convert physical measurements to engineering units, which higher-level systems use to derive health and information about processes and systems. Although health management is essential at the top level, there are considerable advantages to implementing health-related functions at the sensor level. The distribution of processing to lower levels reduces bandwidth requirements, enhances data fusion, and improves the resolution for detection and isolation of failures in a system, subsystem, component, or process. The Smart Networked Element (SNE) has been developed to implement intelligent functions and algorithms at the sensor level in support of ISHM.

Oostdyk, Rebecca↗

Registration and Fusion of Multiple Source Remotely Sensed Image Data

Earth and Space Science often involve the comparison, fusion, and integration of multiple types of remotely sensed data at various temporal, radiometric, and spatial resolutions. Results of this integration may be utilized for global change analysis, global coverage of an area at multiple resolutions, map updating or validation of new instruments, as well as integration of data provided by multiple instruments carried on multiple platforms, e.g. in spacecraft constellations or fleets of planetary rovers. Our focus is on developing methods to perform fast, accurate and automatic image registration and fusion. General methods for automatic image registration are being reviewed and evaluated. Various choices for feature extraction, feature matching and similarity measurements are being compared, including wavelet-based algorithms, mutual information and statistically robust techniques. Our work also involves studies related to image fusion and investigates dimension reduction and co-kriging for application-dependent fusion. All methods are being tested using several multi-sensor datasets, acquired at EOS Core Sites, and including multiple sensors such as IKONOS, Landsat-7/ETM+, EO1/ALI and Hyperion, MODIS, and SeaWIFS instruments. Issues related to the coregistration of data from the same platform (i.e., AIRS and MODIS from Aqua) or from several platforms of the A-train (i.e., MLS, HIRDLS, OMI from Aura with AIRS and MODIS from Terra and Aqua) will also be considered.

LeMoigne, Jacqueline↗

Sensor data validation and reconstruction. Phase 1: System architecture study

The sensor validation and data reconstruction task reviewed relevant literature and selected applicable validation and reconstruction techniques for further study; analyzed the selected techniques and emphasized those which could be used for both validation and reconstruction; analyzed Space Shuttle Main Engine (SSME) hot fire test data to determine statistical and physical relationships between various parameters; developed statistical and empirical correlations between parameters to perform validation and reconstruction tasks, using a computer aided engineering (CAE) package; and conceptually designed an expert system based knowledge fusion tool, which allows the user to relate diverse types of information when validating sensor data. The host hardware for the system is intended to be a Sun SPARCstation, but could be any RISC workstation with a UNIX operating system and a windowing/graphics system such as Motif or Dataviews. The information fusion tool is intended to be developed using the NEXPERT Object expert system shell, and the C programming language.

Source record↗

Distributed Visual Sensing and Fusion for Advanced Air Mobility

Surveillance solutions for Advanced and Urban Air Mobility frameworks are a key factor to enable safe operations of highly automated aircraft in the civil airspace. To design solutions suitable for all types of aircraft, non-cooperative sensors can be used, though many challenges arise when the small dimensions of the vehicles and their proximity to the ground during low-altitude missions are considered. A distributed sensing concept can be efficiently applied to address these challenges by exploiting multiple sensors within a surveillance network. This paper proposes a strategy to fuse the information collected by three ground-fixed cameras within a network of multiple distributed sensors and is tested with during experimental flight tests. The solution exploits standalone tracking estimates of each camera within a fusion center that performs triangulation and three-dimensional tracking. This approach is tested in a scenario involving two small UAVs flying at low altitude. The paper deals with the challenges of associating the two objects from independent and unrelated tracks to achieve robust triangulation, which produces meter-level mean errors with respect to GNSS-based ground truth.

Federica Vitiello↗

Recent Advances in Registration, Integration and Fusion of Remotely Sensed Data: Redundant Representations and Frames

In recent years, sophisticated mathematical techniques have been successfully applied to the field of remote sensing to produce significant advances in applications such as registration, integration and fusion of remotely sensed data. Registration, integration and fusion of multiple source imagery are the most important issues when dealing with Earth Science remote sensing data where information from multiple sensors, exhibiting various resolutions, must be integrated. Issues ranging from different sensor geometries, different spectral responses, differing illumination conditions, different seasons, and various amounts of noise need to be dealt with when designing an image registration, integration or fusion method. This tutorial will first define the problems and challenges associated with these applications and then will review some mathematical techniques that have been successfully utilized to solve them. In particular, we will cover topics on geometric multiscale representations, redundant representations and fusion frames, graph operators, diffusion wavelets, as well as spatial-spectral and operator-based data fusion. All the algorithms will be illustrated using remotely sensed data, with an emphasis on current and operational instruments.

Fusion↗

A scale space feature based registration technique for fusion of satellite imagery

Feature based registration is one of the most reliable methods to register multi-sensor images (both active and passive imagery) since features are often more reliable than intensity or radiometric values. The only situation where a feature based approach will fail is when the scene is completely homogenous or densely textural in which case a combination of feature and intensity based methods may yield better results. In this paper, we present some preliminary results of testing our scale space feature based registration technique, a modified version of feature based method developed earlier for classification of multi-sensor imagery. The proposed approach removes the sensitivity in parameter selection experienced in the earlier version as explained later.

Raghavan, Srini↗

Integration of active and passive sensors for obstacle avoidance

The automatic obstacle-avoidance guidance problem is studied under the operational constraints imposed by the rotorcraft nap-of-the-earth (NOE) environment. The problem is discussed for two different circumstances. The first assumes that a full range map is available, irrespective of the type of sensor being used. Two approaches are proposed to extend a two-dimensional obstacle-avoidance concept presented by Cheng (1988). The situation where only a sparse range map is available from a passive sensor is also treated. An integrated approach that augments the passive sensor with an active one is discussed, along with the problem of data fusion and how it is affected by the characteristics of NOE flight.

Cheng, Victor H. L.↗

Interactive and cooperative sensing and control for advanced teleoperation

This paper presents the paradigm of interactive and cooperative sensing and control as a fundamental mechanism of integrating and fusing the strengths of man and machine for advanced teleoperation. The interactive and cooperative sensing and control is considered as an extended and generalized form of traded and shared control. The emphasis of interactive and cooperative sensing and control is given to the distribution of mutually nonexclusive subtasks to man and machine, the interactive invocation of subtasks under the man/machine symbiotic relationship, and the fusion of information and decisionmaking between man and machine according to their confidence measures. The proposed interactive and cooperative sensing and control system is composed of such major functional blocks as the logical sensor system, the sensor-based local autonomy, the virtual environment formation, and the cooperative decision-making between man and machine. The Sensing-Knowledge-Command (SKC) fusion network is proposed as a fundamental architecture for implementing cooperative and interactive sensing and control. Simulation results are shown.

Lee, Sukhan↗

Evolution of an Intelligent Information Fusion System

Consideration is given to the hardware and software needed to manage the enormous amount and complexity of data that the next generation of space-borne sensors will provide. An anthology is presented illustrating the evolution of artificial intelligence, science data processing, and management from the 1960s to the near future. Problems and limitations of technologies, data structures, data standards, and conceptual thinking are addressed. The development of an end-to-end Intelligent Information Fusion System that embodies knowledge of the user's domain-specific goals is proposed.

Campbell, William J.↗

Design Methods and Practices for Fault Prevention and Management in Spacecraft

Integrated Systems Health Management (ISHM) is intended to become a critical capability for all space, lunar and planetary exploration vehicles and systems at NASA. Monitoring and managing the health state of diverse components, subsystems, and systems is a difficult task that will become more challenging when implemented for long-term, evolving deployments. A key technical challenge will be to ensure that the ISHM technologies are reliable, effective, and low cost, resulting in turn in safe, reliable, and affordable missions. To ensure safety and reliability, ISHM functionality, decisions and knowledge have to be incorporated into the product lifecycle as early as possible, and ISHM must be considered as an essential element of models developed and used in various stages during system design. During early stage design, many decisions and tasks are still open, including sensor and measurement point selection, modeling and model-checking, diagnosis, signature and data fusion schemes, presenting the best opportunity to catch and prevent potential failures and anomalies in a cost-effective way. Using appropriate formal methods during early design, the design teams can systematically explore risks without committing to design decisions too early. However, the nature of ISHM knowledge and data is detailed, relying on high-fidelity, detailed models, whereas the earlier stages of the product lifecycle utilize low-fidelity, high-level models of systems and their functionality. We currently lack the tools and processes necessary for integrating ISHM into the vehicle system/subsystem design. As a result, most existing ISHM-like technologies are retrofits that were done after the system design was completed. It is very expensive, and sometimes futile, to retrofit a system health management capability into existing systems. Last-minute retrofits result in unreliable systems, ineffective solutions, and excessive costs (e.g., Space Shuttle TPS monitoring which was considered only after 110 flights and the Columbia disaster). High false alarm or false negative rates due to substandard implementations hurt the credibility of the ISHM discipline. This paper presents an overview of the current state of ISHM design,and a review of formal design methods to make recommendations about possible approaches to enable the ISHM capabilities to be designed-in at the system-level, from the very beginning of the vehicle design process.

Tumer, Irem Y.↗

An Overview of Inter-comparison Methodologies for Terra and Aqua MODIS Calibration

With increasing efforts on data fusion and long-term climate data records (CDR) using observations made by multiple sensors, on the same or different platforms, their cross-calibration and validation work has become more and more important. The uncertainties of the climate models and data records depend not only on the calibration quality of individual sensors but also on their calibration consistency. This paper provides an overview of methodologies used by the MODIS Characterization Support Team (MCST) at NASA GSFC for the inter-comparison studies of Terra and Aqua MODIS on-orbit calibration. Each MODIS was built with a set of onboard calibrators (OBC) that include a blackbody (BB), a solar diffuser (SD), and a solar diffuser stability monitor (SDSM). The BB is primarily used for the thermal emissive bands (TEB) calibration and the SD/SDSM system for the reflective solar bands (RSB) calibration. Although the-instrument design and calibration approach are nearly identical for both Terra and Aqua MODIS and they all went through an extensive and similar pre-launch calibration and characterization process, still their on-orbit calibration consistency needs to be carefully examined and validated as many science products have been generated from observations made by both instruments. Methodologies discussed in this paper include inter-comparison studies using the Moon, a third sensor, and ground targets. Our results show that Terra and Aqua reflective solar bands and thermal emissive bands have been calibrated consistently with excellent long-term stabilities. For the 11 and 12 micrometers sea surface temperature (SST) bands, the calibration difference of Terra and Aqua MODIS is less than 0.2K.

Xiong, X.↗

Dynamics of the Molten Contact Line

The purpose of this program is to develop a basic understanding of how a molten material front spreads over a solid that is below its melting point, arrests, and freezes. Our hope is that the work will contribute toward a scientific knowledge base for certain new applications involving molten droplet deposition, including the "printing" of arbitrary three-dimensional objects by precise deposition of individual molten microdrops that solidify after impact. Little information is available at this time on the capillarity-driven motion and arrest of molten contact line regions. Schiaffino and Sonin investigated the arrest of the contact line of a molten microcrystalline wax spreading over a subcooled solid "target" of the same material. They found that contact line arrest takes place at an apparent liquid contact angle that depends primarily on the Stefan number S=c(T(sub f) -T(sub t)/L based on the temperature difference between the fusion point and the target temperature, and proposed that contact line arrest occurs when the liquid's dynamic contact angle approaches the angle of attack of the solidification front just behind the contact line. They also showed, however, that the conventional continuum equations and boundary conditions have no meaningful solution for this angle. The solidification front angle is determined by the heat flux just behind the contact line, and the heat flux is singular at that point. By comparing experiments with numerical computations, Schiaffino and Sonin estimated that the conventional solidification model must break down within a distance of order 0.1 - 1 microns of the contact line. The physical mechanism for this breakdown is as yet undetermined, and no first-principles theory exists for the contact angle at arrest. Schiaffino and Sonin also presented a framework for understanding how to moderate Weber number molten droplet deposition in terms of similarity laws and experimentation. The study is based on experiments with three molten materials- molten wax on solid wax, water on ice, and mercury on frozen mercury- which between them span a considerable range of the deposition/solidification similarity parameters. Correlations are obtained for the spreading velocity, spreading time scales, the spreading factor (i.e. ratio of deposited drop's final footprint radius and the drop's initial radius), post-spreading liquid oscillation amplitudes and time scales, and bulk solidification time scales. Duthaler carried out an experimental and theoretical investigation of the relationship between the liquid's apparent contact angle and the Capillary number Ca=mu U/sigma based on contact line speed, for molten materials spreading over subcooled solids. This relationship is required for modeling of melt spreading. We have adapted Voinov's methodology to the molten contact line and formulated a theoretical model for the Ca vs. contact angle relationship, based Schiaffino and Sonin#s (1997a,b) wedge-like solidification front model. With the solidification front angle taken from Schiaffino and Sonin, the model is in good agreement with the experimental results for Ca vs. contact angle. Duthaler also extended the experimental investigation of droplet deposition and contact line freezing to more materials, including solder on glass, solder on solder, water on ice, and molten microcrystalline wax on wax. The latter also included tests on inclined targets. Deposition tests have also been done with molten octacosane (C28H58) on various targets. An important objective of our program has been the development of micron-scale sensors for measuring the transient temperature at a point on the substrate surface as a molten contact line moves over it. The expectation is that this temperature history will yield a better understanding of the thermal process in the contact line region. The sensors are of the thermistor type, either 2.5 microns or 1.5 microns square, microfabricated with silicon-based technology on either pure silicon or amorphous silicon dioxide chips. Each chip has 32 sensors distributed on its surface in arrays. The time response is better than 10 ms. At the time of writing, sensor calibration is in progress. Results on thermal transients during contact line passage will be discussed at the conference. While we expect that the data will provide information on the near-contact-line heat transfer process, we also foresee possible problems. First, the spatial resolution of the sensors may be insufficient to resolve the near-contact-line region. Second, the sensors protrude about 0.5 microns above the substrate surface, and may affect the contact line motion. Third, a sensor's temperature history depends on both the heat flux distribution into it from the fusion front and the thermal properties of the substrate below it and the solidified melt between it and the fusion front. The heat flux distribution in the contact line region must therefore be unfolded from computations of the overall system's transient thermal response.

Sonin, Ain A.↗

Probabilistic #D data fusion for multiresolution surface generation

In this paper we present an algorithm for adaptive resolution integration of 3D data collected from multiple distributed sensors. The input to the algorithm is a set of 3D surface points and associated sensor models. Using a probabilistic rule, a surface probability function is generated that represents the probability that a particular volume of space contains the surface. The surface probability function is represented using an octree data structure; regions of space with samples of large conariance are stored at a coarser level than regions of space containing samples with smaller covariance. The algorithm outputs an adaptive resolution surface generated by connecting points that lie on the ridge of surface probability with triangles scaled to match the local discretization of space given by the algorithm, we present results from 3D data generated by scanning lidar and structure from motion.

3D data fusion multiresolution surface generation ↗

In-Situ Process Monitoring, Synchronization, and Mapping Laser Powder Bed Fusion Builds of Ti6Al4V

The use of in-situ process monitoring is of interest to lower the cost of inspection for the qualification of laser powder bed fusion (LPBF) parts. Precise monitoring of the LPBF-AM build process constitutes a multi-scale and multi-discipline task. There are several significant challenges to the in-situ approach: the synchronization of sensor signals to process steps, the physical interpretation and classification of sensor signals, managing very large datasets, and comparing the inputs with the observed monitoring signals. At NASA Langley Research Center, a configurable architecture additive testbed has been developed to monitor the build process with synchronized sensors. The philosophy and method adopted for the synchronization of the cameras with laser power & position Ti-6Al-4V LPBF are described. The synchronized in-situ monitoring signals are compared with ex-situ nondestructive inspection and optical microscopy observations. Such comparisons permit a better understanding of how the sequential process actions of LPBF-AM can affect build quality.

Laser Powder Bed Fusion↗

Monitoring System for Storm Readiness and Recovery of Test Facilities: Integrated System Health Management (ISHM) Approach

Severe weather events are likely occurrences on the Mississippi Gulf Coast. It is important to rapidly diagnose and mitigate the effects of storms on Stennis Space Center's rocket engine test complex to avoid delays to critical test article programs, reduce costs, and maintain safety. An Integrated Systems Health Management (ISHM) approach and technologies are employed to integrate environmental (weather) monitoring, structural modeling, and the suite of available facility instrumentation to provide information for readiness before storms, rapid initial damage assessment to guide mitigation planning, and then support on-going assurance as repairs are effected and finally support recertification. The system is denominated Katrina Storm Monitoring System (KStorMS). Integrated Systems Health Management (ISHM) describes a comprehensive set of capabilities that provide insight into the behavior the health of a system. Knowing the status of a system allows decision makers to effectively plan and execute their mission. For example, early insight into component degradation and impending failures provides more time to develop work around strategies and more effectively plan for maintenance. Failures of system elements generally occur over time. Information extracted from sensor data, combined with system-wide knowledge bases and methods for information extraction and fusion, inference, and decision making, can be used to detect incipient failures. If failures do occur, it is critical to detect and isolate them, and suggest an appropriate course of action. ISHM enables determining the condition (health) of every element in a complex system-of-systems or SoS (detect anomalies, diagnose causes, predict future anomalies), and provide data, information, and knowledge (DIaK) to control systems for safe and effective operation. ISHM capability is achieved by using a wide range of technologies that enable anomaly detection, diagnostics, prognostics, and advise for control: (1) anomaly detection algorithms and strategies, (2) fusion of DIaK for anomaly detection (model-based, numerical, statistical, empirical, expert-based, qualitative, etc.), (3) diagnostics/prognostics strategies and methods, (4) user interface, (5) advanced control strategies, (6) integration architectures/frameworks, (7) embedding of intelligence. Many of these technologies are mature, and they are being used in the KStorMS. The paper will describe the design, implementation, and operation of the KStorMS; and discuss further evolution to support other needs such as condition-based maintenance (CBM).

Figueroa, Fernando↗

Issues in Data Fusion for Satellite Aerosol Measurements for Applications with GIOVANNI System at NASA GES DISC

We look at issues, barriers and approaches for Data Fusion of satellite aerosol data as available from the GES DISC GIOVANNI Web Service. Daily Global Maps of AOT from a single satellite sensor alone contain gaps that arise due to various sources (sun glint regions, clouds, orbital swath gaps at low latitudes, bright underlying surfaces etc.). The goal is to develop a fast, accurate and efficient method to improve the spatial coverage of the Daily AOT data to facilitate comparisons with Global Models. Data Fusion may be supplemented by Optimal Interpolation (OI) as needed.

Gopalan, Arun↗

Powder Bed Fusion Laser Beam Metals Additive Manufacturing: Process Monitoring Approaches for Qualification and Certification

The use of in-situ process monitoring is of interest to lower the cost of inspection for the qualification of powder bed fusion laser beam metal (PBF-LB/M) additively manufactured (AM) parts. Precise monitoring of the PBF-LB/M AM build process constitutes a multi-scale and multi-discipline task. There are several significant challenges to the in-situ approach: the synchronization of sensor signals to process steps; the physical interpretation and classification of sensor signals; managing very large datasets; and comparing the inputs with the observed monitoring signals. At NASA Langley Research Center, a configurable architecture additive testbed has been developed to monitor the build process with synchronized sensors. The philosophy and method adopted for the synchronization of the cameras with laser power and position throughout a complex PBF-LB/M AM build will be described. The synchronized in-situ monitoring signals are compared with ex-situ nondestructive inspection, x-ray computed tomography (XCT). Such comparisons permit a better understanding of how the sequential process actions of LPBF-AM can affect build quality. The multi-scale and complex process of printing additively manufactured (AM) parts can have unexpected, but predictable, build conditions that result in material microstructure variability. This presentation will describe an additive manufacturing model-based process metric (AM-PM) computational method that is a fully parallel reduced order modeling approach developed to evaluate the evolution of AM processes. This method couples the known sequence of the AM process with a physically informed nearest neighbors’ calculation to map the conditions of a part-scale build. The result is a map of the build that is derived directly from build files or in-situ process monitoring sensors. The methodology of the approach will be described and mapped to the porosity observed from XCT for a complex PBF-LB/M build. Such comparative results develop understanding of how the sequential process actions can affect the PBF-LB/M AM build quality and microstructure variability.

Laser Powder Bed Fusion↗