Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Sensor fusion”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Towards Qualification and Certification of Laser Powder Bed Fusion Ti-6Al-4V with In-Situ Process Monitoring and Automated Defect Detection

Qualification and certification of laser powder bed fusion (LPBF) parts are two challenges that must be answered to ensure suitability for critical applications. In-situ monitoring using high frame rate thermal and conventional optical imaging sensors is applied to the LPBF build process. Currently, the large volume of data from such sensors becomes untenable for manual inspection in production environments. This presentation serves to address this in-situ monitoring deficiency in two ways. First, a framework for managing data streams from LPBF process monitoring sensors is described. Second, two candidate image analysis techniques are presented: one is a set of heuristics that are easily interpretable, and the other is an uninterpretable convolutional neural network. These strategies are compared in terms of performance, computational expense, and speed. These methodologies represent platforms for connecting processing conditions to process modeling efforts aligned with the qualification and certification mission for LPBF Ti-6Al-4V components.

Qualification↗
NASA NTRS1993

Intelligent sensing and control for advanced teleoperation

A theoretical framework is presented for a 'sensing-knowledge command-fusion' paradigm of interactive and cooperative sensing and control in advanced teleoperators, which takes advantage of both current and projected robotic dexterousness and sensor-based autonomy capabilities. Attention is given to (1) a method for the achievement of a sensing-knowledge-command computational mechanism that implements the intended cooperative/interactive system, and (2) the system architecture and man/machine-interface protocols entailed by this implementation.

Lee, Sukhan↗
NASA NTRS2005

Meeting the Challenges of Exploration Systems: Health Management Technologies for Aerospace Systems With Emphasis on Propulsion

The constraints of future Exploration Missions will require unique Integrated System Health Management (ISHM) capabilities throughout the mission. An ambitious launch schedule, human-rating requirements, long quiescent periods, limited human access for repair or replacement, and long communication delays all require an ISHM system that can span distinct yet interdependent vehicle subsystems, anticipate failure states, provide autonomous remediation, and support the Exploration Mission from beginning to end. NASA Glenn Research Center has developed and applied health management system technologies to aerospace propulsion systems for almost two decades. Lessons learned from past activities help define the approach to proper ISHM development: sensor selection- identifies sensor sets required for accurate health assessment; data qualification and validation-ensures the integrity of measurement data from sensor to data system; fault detection and isolation-uses measurements in a component/subsystem context to detect faults and identify their point of origin; information fusion and diagnostic decision criteria-aligns data from similar and disparate sources in time and use that data to perform higher-level system diagnosis; and verification and validation-uses data, real or simulated, to provide variable exposure to the diagnostic system for faults that may only manifest themselves in actual implementation, as well as faults that are detectable via hardware testing. This presentation describes a framework for developing health management systems and highlights the health management research activities performed by the Controls and Dynamics Branch at the NASA Glenn Research Center. It illustrates how those activities contribute to the development of solutions for Integrated System Health Management.

Melcher, Kevin J.↗
NASA NTRS2008

Overview of the Smart Network Element Architecture and Recent Innovations

In industrial environments, system operators rely on the availability and accuracy of sensors to monitor processes and detect failures of components and/or processes. The sensors must be networked in such a way that their data is reported to a central human interface, where operators are tasked with making real-time decisions based on the state of the sensors and the components that are being monitored. Incorporating health management functions at this central location aids the operator by automating the decision-making process to suggest, and sometimes perform, the action required by current operating conditions. Integrated Systems Health Management (ISHM) aims to incorporate data from many sources, including real-time and historical data and user input, and extract information and knowledge from that data to diagnose failures and predict future failures of the system. By distributing health management processing to lower levels of the architecture, there is less bandwidth required for ISHM, enhanced data fusion, make systems and processes more robust, and improved resolution for the detection and isolation of failures in a system, subsystem, component, or process. The Smart Network Element (SNE) has been developed at NASA Kennedy Space Center to perform intelligent functions at sensors and actuators' level in support of ISHM.

Perotti, Jose M.↗
NASA NTRS2012

Achieving Accuracy Requirements for Forest Biomass Mapping: A Data Fusion Method for Estimating Forest Biomass and LiDAR Sampling Error with Spaceborne Data

The synergistic use of active and passive remote sensing (i.e., data fusion) demonstrates the ability of spaceborne light detection and ranging (LiDAR), synthetic aperture radar (SAR) and multispectral imagery for achieving the accuracy requirements of a global forest biomass mapping mission. This data fusion approach also provides a means to extend 3D information from discrete spaceborne LiDAR measurements of forest structure across scales much larger than that of the LiDAR footprint. For estimating biomass, these measurements mix a number of errors including those associated with LiDAR footprint sampling over regional - global extents. A general framework for mapping above ground live forest biomass (AGB) with a data fusion approach is presented and verified using data from NASA field campaigns near Howland, ME, USA, to assess AGB and LiDAR sampling errors across a regionally representative landscape. We combined SAR and Landsat-derived optical (passive optical) image data to identify forest patches, and used image and simulated spaceborne LiDAR data to compute AGB and estimate LiDAR sampling error for forest patches and 100m, 250m, 500m, and 1km grid cells. Forest patches were delineated with Landsat-derived data and airborne SAR imagery, and simulated spaceborne LiDAR (SSL) data were derived from orbit and cloud cover simulations and airborne data from NASA's Laser Vegetation Imaging Sensor (L VIS). At both the patch and grid scales, we evaluated differences in AGB estimation and sampling error from the combined use of LiDAR with both SAR and passive optical and with either SAR or passive optical alone. This data fusion approach demonstrates that incorporating forest patches into the AGB mapping framework can provide sub-grid forest information for coarser grid-level AGB reporting, and that combining simulated spaceborne LiDAR with SAR and passive optical data are most useful for estimating AGB when measurements from LiDAR are limited because they minimized forest AGB sampling errors by 15 - 38%. Furthermore, spaceborne global scale accuracy requirements were achieved. At least 80% of the grid cells at 100m, 250m, 500m, and 1km grid levels met AGB density accuracy requirements using a combination of passive optical and SAR along with machine learning methods to predict vegetation structure metrics for forested areas without LiDAR samples. Finally, using either passive optical or SAR, accuracy requirements were met at the 500m and 250m grid level, respectively.

Montesano, P. M.↗
NASA NTRS1991

Architecture of a large object-oriented database for remotely sensed data

Attention is given to the proposed Intelligent Information Fusion System (IIFS) within the framework of the Intelligent Data Management project at NASA-Goddard. IIFS is to use connectionist architectures to extract high-level attributes from incoming sensor images, and then send those characterizations and their associated ephemeris and ancillary image data to a large object-oriented database which will serve as the master catalog of sensor data. Important issues facing this project include the choice of rapid-access data structures (RADSs) for cataloging images by their high-level characterization, the implementation of efficient spatial data structures for cataloging images by their scene location, the automated population of such a database from a continuous stream of incoming ephemeris and ancillary data, and the translation and optimization of natural-language database queries so that RADSs are employed when appropriate.

Dorfman, Erik↗
NASA NTRS2005

E-Nose Vapor Identification Based on Dempster-Shafer Fusion of Multiple Classifiers

Electronic nose (e-nose) vapor identification is an efficient approach to monitor air contaminants in space stations and shuttles in order to ensure the health and safety of astronauts. Data preprocessing (measurement denoising and feature extraction) and pattern classification are important components of an e-nose system. In this paper, a wavelet-based denoising method is applied to filter the noisy sensor measurements. Transient-state features are then extracted from the denoised sensor measurements, and are used to train multiple classifiers such as multi-layer perceptions (MLP), support vector machines (SVM), k nearest neighbor (KNN), and Parzen classifier. The Dempster-Shafer (DS) technique is used at the end to fuse the results of the multiple classifiers to get the final classification. Experimental analysis based on real vapor data shows that the wavelet denoising method can remove both random noise and outliers successfully, and the classification rate can be improved by using classifier fusion.

Li, Winston↗
NASA NTRS2021

Melt Pool Imaging using a Configurable Architecture Additive Testbed System

This paper describes the inline (coaxial to laser) near infrared (NIR) camera sensor on the Configurable Architecture Additive Testbed (CAAT). The CAAT is an instrument that provides the capability to investigate laser based additive manufacturing (AM) processes and is configured for the metal powder bed fusion process. A low cost NIR camera is radiometrically calibrated to obtain coaxial, inline, imagery of laser generated melt pools. The camera capabilities, system optical path, and the uncertainty in the temperature measurement from NIR surface area scans on a bare titanium alloy plate are presented and discussed. The surface radiance measurements are compared to optical microscopy images of the melt pool width and depth. A metallic additive manufacturing process thermal model is developed in order to predict thermal distributions during laser scanning. The predicted thermal distributions by the model for different configurations are compared to the coaxial NIR measurements and discussed.

Additive manufacturing↗
NASA NTRS2020

Continuity of A Global, Satellite-Based Terrestrial Primary Productivity Dataset in the VIIRS Era Achieved With Model-Data Fusion

The NASA Terra and Aqua satellites have been successfully operating for over two decades and have far exceeded their original 5‐year design life. However, the era of NASA’s Earth Observing System (EOS) may be coming to a close as early as 2023. We conducted a comprehensive calibration and validation of the MODIS MOD17 product [1,2] and the potential for continuity of multi‐decadal ecosystem gross primary productivity (GPP) and annual net primary productivity (NPP), using data from the Visible Infrared Imaging Radiometer Suite (VIIRS) sensors aboard Suomi NPP and NOAA‐20. We combined an 18‐year record of eddy covariance flux tower measurements with hundreds of field measurements of NPP from the Oak Ridge National Laboratories Multi‐Biome collection to benchmark MODIS MOD17 Collection 6.1 (C61) and to develop the first terrestrial productivity estimates from VIIRS. Plant traits from the literature and the global TRY database [3,4] provide strong priors for identifying model parameters in a Bayesian model‐data fusion. As MODIS‐like observations are still needed for global environmental applications, the new VIIRS VNP17 product has the potential to extend these continuous estimates of global, terrestrial primary productivity beyond 2030.

K. Arthur Endsley↗
NASA NTRSDate not supplied

The Additive Manufacturing Moment Measure - A Parallel Computation Technique for Determining Build Variance in the Laser Powder Bed Fusion Process

Additive manufacturing (AM) has unique process attributes that facilitate the creation of optimized, complex, and unique parts for aerospace applications. However, the multi-scale and complicated building process for AM parts can cause unexpected build conditions that result in microstructural variability within the deposited material. The need for richer datasets and computational modeling capabilities to improve AM process reliability is a consequence of this microstructural variability. A computational approach, referred to as the Additive Manufacturing Moment Measure (AM3), addresses this need by leveraging the way AM processes fuse material in precise, incremental steps. During the layering sequence, each previous step contributes to the condition of the current step at the center of the heat source. The precise steps can be selected to systematically create a time-space point field with co-located machine input and in-situ sensor data. The sequential nature of the AM process, coupled with nearest neighbor calculations, allows for a fully parallel computation for part-scale build profile analysis. The AM3 concept introduced here enables part-scale assessment directly from build files and in-situ process monitoring sensors alike. The AM moment measures were calculated for build point fields and compared with co-located in-situ and ex-situ nondestructive evaluation and optical microscopy observations. These comparisons permit a better understanding of how the sequential process actions can affect the quality of a laser powder bed fusion (LPBF) build. Details of the AM3technique will be discussed and compared to measured LPBF part characteristics. The AM3 results indicate a strong potential to advance the qualification process for aerospace applications.

Additive Manufacturing↗
NASA NTRS1992

The fusion of information via fuzzy integration

Multisensor fusion is becoming increasingly important in intelligent computer vision systems. In this paper we present the generalized fuzzy integral with respect to an S-decomposable measure as a tool for fusing information from multiple sensors in an object recognition problem. Results from an experiment with automatic target recognition imagery are provided.

Keller, James M.↗
NASA NTRS1992

Interactive and cooperative sensing and control for advanced teleoperation

This paper presents the paradigm of interactive and cooperative sensing and control as a fundamental mechanism of integrating and fusing the strengths of man and machine for advanced teleoperation. The interactive and cooperative sensing and control is considered as an extended and generalized form of traded and shared control. The emphasis of interactive and cooperative sensing and control is given to the distribution of mutually nonexclusive subtasks to man and machine, the interactive invocation of subtasks under the man/machine symbiotic relationship, and the fusion of information and decision-making between man and machine according to their confidence measures. The proposed interactive and cooperative sensing and control system is composed of such major functional blocks as the logical sensor system, the sensor-based local autonomy, the virtual environment formation, and the cooperative decision-making between man and machine. A case study is performed to demonstrate the feasibility of implementing the fundamental theory and system architecture of interactive and cooperative sensing and control, proposed for the new generation of teleoperation.

Lee, Sukhan↗
NASA NTRS2005

Real-time Enhanced Vision System

Flying in poor visibility conditions, such as rain, snow, fog or haze, is inherently dangerous. However these conditions can occur at nearly any location, so inevitably pilots must successfully navigate through them. At NASA Langley Research Center (LaRC), under support of the Aviation Safety and Security Program Office and the Systems Engineering Directorate, we are developing an Enhanced Vision System (EVS) that combines image enhancement and synthetic vision elements to assist pilots flying through adverse weather conditions. This system uses a combination of forward-looking infrared and visible sensors for data acquisition. A core function of the system is to enhance and fuse the sensor data in order to increase the information content and quality of the captured imagery. These operations must be performed in real-time for the pilot to use while flying. For image enhancement, we are using the LaRC patented Retinex algorithm since it performs exceptionally well for improving low-contrast range imagery typically seen during poor visibility conditions. In general, real-time operation of the Retinex requires specialized hardware. To date, we have successfully implemented a single-sensor real-time version of the Retinex on several different Digital Signal Processor (DSP) platforms. In this paper we give an overview of the EVS and its performance requirements for real-time enhancement and fusion and we discuss our current real-time Retinex implementations on DSPs.

Hines, Glenn D.↗
NASA NTRS2012

Achieving Accuracy Requirements for Forest Biomass Mapping: A Spaceborne Data Fusion Method for Estimating Forest Biomass and Lidar Sampling Error

The synergistic use of active and passive remote sensing (i.e., data fusion) demonstrates the ability of spaceborne light detection and ranging (LiDAR), synthetic aperture radar (SAR) and multispectral imagery for achieving the accuracy requirements of a global forest biomass mapping mission (+/-20 Mg/ha or 20%, the greater of the two, for at least 80% of grid cells). A data fusion approach also provides a means to extend 3D information from discrete spaceborne LiDAR measurements of forest structure across scales much larger than that of the LiDAR footprint. For estimating biomass, these measurements mix a number of errors including those associated with LiDAR footprint sampling over regional-global extents. A general framework for mapping above ground live forest biomass density (AGB) with a data fusion approach is presented and verified using data from NASA field campaigns near Howland, ME, USA, to assess AGB and LiDAR sampling errors across a regionally representative landscape. We combined SAR and Landsat-derived optical (passive optical) image data to identify contiguous areas (>0.5 ha) that are relatively homogenous in remote sensing metrics (forest patches). We used this image-derived data with simulated spaceborne LiDAR derived from orbit and cloud cover simulations and airborne data from NASA's Laser Vegetation Imaging Sensor (LVIS) to compute AGB and estimate LiDAR sampling error for forest patches and 100 m, 250 m, 500 m, and 1 km grid cells. At both the patch and grid scales, we evaluated differences in AGB estimation and sampling error from the combined use of LiDAR with both SAR and passive optical and with either SAR or passive optical alone. First, this data fusion approach demonstrates that incorporating forest patches into the AGB mapping framework can provide sub-grid forest information for coarser grid-level AGB reporting. Second, a data fusion approach for estimating AGB using simulated spaceborne LiDAR with SAR and passive optical image combinations reduced forest AGB sampling errors 12%-38% from those where LiDAR is used with SAR or passive optical alone. In absolute terms, sampling errors were reduced from 14-40 Mg/ha to 11-28 Mg/ha across all grid scales and prediction methods, where minimum sampling errors were 11, 15, 18, and 22 Mg/ha for 1 km, 500 m, 250 m, and 100 m grid scales, respectively. Third, spaceborne global scale accuracy requirements were achieved whereby at least 80% of the grid cells at 100 m, 250 m, 500 m, and 1 km grid levels met AGB accuracy requirements using a combination of passive optical and SAR along with machine learning methods to predict vegetation structure metrics for forested areas without LiDAR samples. Finally, using either passive optical or SAR, accuracy requirements were met at the 500 m and 250 m grid level, respectively..

LiDAR↗
NASA NTRS1997

A Low-Power High-Speed Smart Sensor Design for Space Exploration Missions

A low-power high-speed smart sensor system based on a large format active pixel sensor (APS) integrated with a programmable neural processor for space exploration missions is presented. The concept of building an advanced smart sensing system is demonstrated by a system-level microchip design that is composed with an APS sensor, a programmable neural processor, and an embedded microprocessor in a SOI CMOS technology. This ultra-fast smart sensor system-on-a-chip design mimics what is inherent in biological vision systems. Moreover, it is programmable and capable of performing ultra-fast machine vision processing in all levels such as image acquisition, image fusion, image analysis, scene interpretation, and control functions. The system provides about one tera-operation-per-second computing power which is a two order-of-magnitude increase over that of state-of-the-art microcomputers. Its high performance is due to massively parallel computing structures, high data throughput rates, fast learning capabilities, and advanced VLSI system-on-a-chip implementation.

Fang, Wai-Chi↗
NASA NTRS2015

The Role of the NASA Global Hawk Link Module as an Information Nexus For Atmospheric Mapping Missions

The Link Module described in this paper was developed for the NASA Uninhabited Aerial System (UAS) Global Hawk Pacific Mission (GloPAC) Airborne Science Campaign; four flights of 30 hour duration, supporting the Aura Validation Experiment (AVE). It was used again during the Genesis and Rapid Intensification Processes (GRIP) experiment, a NASA Earth Science field experiment to better understand how tropical storms form and develop into major hurricanes. In these missions, the Link Module negotiated all communication over the high bandwidth Ku satellite link, archived all the science data from onboard experiments in a spatially enabled database, routed command and control of the instruments from the Global Hawk Operations Center, and re-transmitted select data sets directly to experimenters control and analysis systems. The availability of aggregated information from collections of sensors, and remote control capabilities, in real-time, is revolutionizing the way Airborne Science is being conducted. The Link Module NG now being flown in support of the NASA Earth Venture missions, the Hurricane and Severe Storm Sentinel (HS3) mission, and Airborne Tropical Tropopause Experiment (A TTREX) mission, has advanced data fusion technologies that are further advancing the Scientific productivity, flexibility and robustness of these systems. On-the-fly traffic shaping has been developed to allow the high definition video, used for critical flight control segments, to dynamically allocate variable bandwidth on demand. Historically, the Link Module evolved from the instrument and communication interface controller used by NASA's Pathfinder and Pathfinder plus solar powered UAS's in the late 1990' s. It later was expanded for use in the AIRDAS four channel scanner flown on the NASA Altus UAS, and then again to a module in the AMS twelve channel multispectral scanner flying on the NASA (Predator-b) Ikhana UAS. The current system is the answer to the challenges imposed by extremely long duration UASs, with on-board multi-instrument (>= 12) Sensor Webs.

Hurricanes↗
NASA NTRS2019

The Evolution and Extratropical Transition of Tropical Cyclones from a GPM, ISS LIS and GLM Perspective

Not much is known about the evolution of lightning within extra-tropical cyclones traversing the mid-latitudes, especially its oceans. To facilitate such studies we combine a recently constructed precipitation features (PF) database obtained from the Global Precipitation Measurement (GPM) mission constellation of satellites with lightning observations from the Geostationary Lightning Mapper (GLM) onboard GOES-16 and the Lightning Imaging Sensor (LIS) onboard the International Space Station (ISS). The goal of this study is to provide a new observationally-based view of the tropical to extra-tropical transition and its impact on lightning production. Such data fusion approaches, as presented here, will also be important in future satellite studies of convective precipitation.

Gatlin, Patrick↗
NASA NTRS2013

Comparative Study of Vibration Condition Indicators for Detecting Cracks in Spur Gears

This paper reports the results of an empirical study on the tooth breakage failure mode in spur gears. Of four dominant gear failure modes (breakage, wear, pitting, and scoring), tooth breakage is the most precipitous and often leads to catastrophic failures. The cracks were initiated using a fatigue tester and a custom-designed single-tooth bending fixture to simulate over-load conditions, instead of traditional notching using wire electrical discharge machining (EDM). The cracks were then propagated on a dynamometer. The ground truth of damage level during crack propagation was monitored with crack-propagation sensors. Ten crack propagations have been performed to compare the existing condition indicators (CIs) with respect to their: ability to detect a crack, ability to assess the damage, and sensitivity to sensor placement. Of more than thirty computed CIs, this paper compares five commonly used: raw RMS, FM0, NA4, raw kurtosis, and NP4. The performance of combined CIs was also investigated, using linear, logistic, and boosted regression trees based feature fusion.

Nanadic, Nenad↗