Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Sensor fusion”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRS1993

Sensor fusion for assured vision in space applications

By using emittance and reflectance radiation models, the effects of angle of observation, polarization, and spectral content are analyzed to characterize the geometrical and physical properties--reflectivity, emissivity, orientation, dielectric properties, and roughness--of a sensed surface. Based on this analysis, the use of microwave, infrared, and optical sensing is investigated to assure the perception of surfaces on a typical lunar outpost. Also, the concept of employing several sensors on a lunar outpost is explored. An approach for efficient hardware implementation of the fused sensor systems is discussed.

Collin, Marie-France↗
DOE OSTI2023

Scalable in situ non-destructive evaluation of additively manufactured components using process monitoring, sensor fusion, and machine learning

Laser Powder Bed Fusion (L-PBF) Additive Manufacturing (AM) is among the metal 3D printing technologies most broadly adopted by the manufacturing industry. However, the current industry qualification paradigm for critical-application L-PBF parts relies heavily on expensive non-destructive inspection techniques, which significantly limits the use-cases of L-PBF. In situ monitoring of the process promises a less expensive alternative to ex situ testing, but existing sensor technologies and data analysis techniques struggle to detect sub-surface flaws (e.g., porosity and cracking) on production-scale L-PBF printers. In this work, an in situ NDE (INDE) system was engineered to detect subsurface flaws detected in X-Ray Computed Tomography (XCT) directly from process monitoring data. A multilayer, multimodal data input allowed the INDE system to detect numerous subsurface flaws in the size range of 200–1000µm using a novel human-in-the-loop annotation procedure. Furthermore, a framework was established for generating probability-of-detection (POD) and probability-of-false-alarm (PFA) curves compliant with NDE standards by systematically comparing instances of detected subsurface flaws to post-build XCT data. Here, we also introduce for the first time in the AM in situ sensing literature the a 90/95 – the flaw size corresponding to a 90% detection rate on the lower 95% confidence interval of the POD curve. The INDE system successfully demonstrated POD capabilities commensurate with traditional NDE methods. Traditional ML performance metrics were also shown to be inadequate for assessing the ability of the INDE system’s flaw detection performance. It is the hope of the authors that future studies will adopt the POD and PFA approach outlined here to provide better insight into the utility of process monitoring for AM.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Internship Final Report on the unsupervised learning sensor fusion (ULSF) approach

This paper describes a summer internship project undertaken at Sandia National Labs (SNL), both current status and future work. The project was to explore various machine learning approaches for use on turbulent flow data. Specifically, unsupervised classification of turbulent flow data was explored. First, the usage of models in this field is discussed, and several issues in the common usage of the models are identified. Solutions to these issues are then proposed, in the form of a Bayesian filtering approach which probabilistically incorporates multiple sources of data to improve confidence in a result. Several types of sensors are suggested for this method, the incorporation of which range from semi-supervised learning approaches to fully unsupervised. These approaches are then tested on several turbulent flow cases.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Machine Learning Enabled Sensor Fusion for In-Situ Defect Detection in Laser Powder Bed Fusion

Laser Powder Bed Fusion (L-PBF) Additive Manufacturing (AM) is among the metal 3D printing technologies most broadly adopted by the manufacturing industry. The current industry qualification paradigm for critical-application L-PBF parts relies heavily on expensive non-destructive inspection techniques such as X-Ray Computed Tomography (XCT), which significantly limits the use-cases of L-PBF. In situ monitoring of the process promises a less expensive alternative to ex situ testing, but existing sensor technologies and data analysis techniques struggle to detect sub-surface flaws (e.g., porosity and cracking) on production-scale L-PBF printers. RTX Technologies Research Center (RTRC) has licensed ORNL’s Peregrine software package – a printer- and camera-agnostic data analytics tool designed specifically for detecting process anomalies using in situ data collected during powder bed printing. The goal of this project was to feed temporally rich, multi-modal sensor data, including visible light, integrated near infrared (NIR), and spatially mapped co-axial melt pool thermal emission data into Peregrine to enable detection of subsurface flaws. XCT data was used as ground truth training data to allow Peregrine’s deep learning algorithms to recognize anomalies in these complex data streams in both test artifacts and industrially relevant geometries. Completion of this program has seen the successful implementation of multi-modal, multi-layer sensor data footprints for training of machine learning models in Peregrine. Flaws detected in XCT data have been successfully detected directly from this in situ data footprint, and initial analyses of the in situ probability-of-detection has been conducted, showing performance levels commensurate with traditional non-destructive evaluation (NDE) methods. The in situ monitoring methodology was then applied to an industrially relevant component that was using post-build NDE, highlighting the utility of the proposed method for hard-to-inspect AM components. As a direct result of this program, two journal manuscripts [1], [2] have been published in Additive Manufacturing, with additional manuscripts planned following program completion.

36 MATERIALS SCIENCE↗
NASA NTRS2009

Wrap-Around Out-the-Window Sensor Fusion System

The Advanced Cockpit Evaluation System (ACES) includes communication, computing, and display subsystems, mounted in a van, that synthesize out-the-window views to approximate the views of the outside world as it would be seen from the cockpit of a crewed spacecraft, aircraft, or remote control of a ground vehicle or UAV (unmanned aerial vehicle). The system includes five flat-panel display units arranged approximately in a semicircle around an operator, like cockpit windows. The scene displayed on each panel represents the view through the corresponding cockpit window. Each display unit is driven by a personal computer equipped with a video-capture card that accepts live input from any of a variety of sensors (typically, visible and/or infrared video cameras). Software running in the computers blends the live video images with synthetic images that could be generated, for example, from heads-up-display outputs, waypoints, corridors, or from satellite photographs of the same geographic region. Data from a Global Positioning System receiver and an inertial navigation system aboard the remote vehicle are used by the ACES software to keep the synthetic and live views in registration. If the live image were to fail, the synthetic scenes could still be displayed to maintain situational awareness.

Fox, Jeffrey↗
DOE OSTI2023

Downhole Sensing and Event-Driven Sensor Fusion for Depth-of-Cut Based Autonomous Fault Response and Drilling Optimization

Achieving robust and efficient drilling is a critical part of reducing the cost of geothermal energy exploration and extraction. Drilling performance is often evaluated using one or more of three key metrics: depth of cut (DOC), rate of penetration (ROP), and mechanical specific energy (MSE). All three of these quantities are related to each other. DOC refers to the depth a bit penetrates into rock during drilling. This is an important quantity for estimating bit behavior. ROP is the simply the DOC multiplied by the rotational rate, and represents how quickly the drill bit is advancing through the ground. ROP is often the parameter used for drilling control and optimization. Finally, MSE provides insight into drilling efficiency and rock type. MSE calculations rely on ROP, drilling force, and drilling torque. Surface-based sensors at the top of the drill are often used to measure all these quantities. However, top-hole measurements can deviate substantially from the behavior at the bit due to lag, vibrations, and friction. Therefore, relying only on top-hole information can lead to suboptimal drilling control. In this work, we describe recent progress towards estimating ROP, DOC, and MSE using down-hole sensing. We assume down-hole measurements of torque, weight-on-bit (WOB). Our hypothesis is that these measurements can provide more rapid and accurate measures of drilling performance. We show how a multi-layer perceptron (MLP) machine learning algorithm can provide rapid and accurate performance when evaluated on experimental data taken from Sandia’s Hard Rock Drilling Facility. In addition, we implement our algorithms on an embedded system intended to emulate a bottom-hole-assembly for sensing and estimation. Our experimental results show that DOC can be estimated accurately and in real-time. These estimates when combined with measurements for rotary speed, torque, and force can provide improved estimates for ROP and MSE. These results have the potential to enable better drilling assessment, improved control, and extended component lifetimes.

15 GEOTHERMAL ENERGY↗
DOE OSTI2026

Deliberate Motion Analytics Applied to CUAS Sensor Fusion

The Advanced Reactor Safeguards and Security (ARSS) program in the Department of Energy’s Office of Nuclear Energy (DOE-NE) seeks to identify new technology solutions for safeguards and security challenges associated with domestic deployment of advanced nuclear reactors. Research in the ARSS program is investigating alternative physical protection system (PPS) approaches that leverage new detection technologies. This report shows test results from a new form of artificial intelligence (AI) that is called deliberate motion analytics (DMA) when used to spatially and temporally fuse active radar and passive radio frequency (RF) detection that significantly improves detection of uncrewed aircraft systems (UASs). DMA is designed to filter out false positive alarms yet provide highly reliable intrusion detection at nuclear power plants (NPPs) and advanced small modular reactor (ASMR) perimeters. This form of AI is considered to be an enabling technology for security of the future and supports the ARSS investigation of alternative PPSs.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
NASA NTRS1988

Sensor fusion of range and reflectance data for outdoor scene analysis

In recognizing objects in an outdoor scene, range and reflectance (or color) data provide complementary information. Results of experiments in recognizing outdoor scenes containing roads, trees, and cars are presented. The recognition program uses range and reflectance data obtained by a scanning laser range finder, as well as color data from a color TV camera. After segmentation of each image into primitive regions, models of objects are matched using various properties.

Kweon, In SO↗
NASA NTRS1987

Microwave and video sensor fusion for the shape extraction of 3D space objects

A new system for the fusion of optical image data and polarized radar scattering cross-sections is presented. By considering the scattering data in conjunction with image data, the problem of ambiguity can be reduced. Only a small part of the surface needs to be reconstructed from the radar cross-sections; the remaining portion is constrained by the optical image.

Shaw, Scott W.↗
NASA NTRS2005

Multi-Sensor Fusion and Enhancement for Object Detection

This was a quick &week effort to investigate the ability to detect changes along the flight path of an unmanned airborne vehicle (UAV) over time. Video was acquired by the UAV during several passes over the same terrain. Concurrently, GPS data and UAV attitude data were also acquired. The purpose of the research was to use information from all of these sources to detect if any change had occurred in the terrain encompassed by the flight path.

Rahman, Zia-Ur↗
NASA NTRS2013

GPS/INS Sensor Fusion Using GPS Wind up Model

A method of stabilizing an inertial navigation system (INS), includes the steps of: receiving data from an inertial navigation system; and receiving a finite number of carrier phase observables using at least one GPS receiver from a plurality of GPS satellites; calculating a phase wind up correction; correcting at least one of the finite number of carrier phase observables using the phase wind up correction; and calculating a corrected IMU attitude or velocity or position using the corrected at least one of the finite number of carrier phase observables; and performing a step selected from the steps consisting of recording, reporting, or providing the corrected IMU attitude or velocity or position to another process that uses the corrected IMU attitude or velocity or position. A GPS stabilized inertial navigation system apparatus is also described.

Williamson, Walton R.↗
DOE OSTI2023

System and method for adaptive object-oriented sensor fusion for environmental mapping

The present disclosure relates to a mapping system adapted for detecting objects in an environmental scene, by scanning an environmental scene with propagating energy, and receiving reflected energy back from objects present in the environmental scene, in a prioritized manner, for later use. The system may comprise an imaging subsystem which includes a detection and ranging subsystem for initially identifying primitive objects in the environmental scene. The imaging subsystem may also include an identification and mapping subsystem for prioritizing the primitive objects for further scanning and analysis, to ultimately identify one or more of the primitive objects as one or more abstract objects. An environmental model, updated in real time, is used to maintain a map of the primitive objects and the known abstract objects within the environmental scene, as new primitive objects and new abstract objects are obtained with repeated scans of the environmental scene.

Panas, Robert Matthew↗
DOE OSTI2023

Sensor Fusion-Based Vehicle Detection and Tracking Using a Single Camera and Radar at a Traffic Intersection

Recent advancements in sensor technologies, in conjunction with signal processing and machine learning, have enabled real-time traffic control systems to adapt to varying traffic conditions. This paper introduces a new sensor fusion approach that combines data from a single camera and radar to achieve cost-effective and efficient vehicle detection and tracking. Initially, vehicles are independently detected and classified using the camera and radar. Then, the constant-velocity model within a Kalman filter is employed to predict vehicle locations, while the Hungarian algorithm is used to associate these predictions with sensor measurements. Finally, vehicle tracking is accomplished by merging kinematic information from predictions and measurements through the Kalman filter. A case study conducted at an intersection demonstrates the effectiveness of the proposed sensor fusion method for traffic detection and tracking, including performance comparisons with individual sensors.

47 OTHER INSTRUMENTATION↗
NASA NTRS2018

A Survey of Methods for Computing Best Estimates of Endoatmospheric and Exoatmospheric Trajectories

Beginning with the mathematical prediction of planetary orbits in the early seventeenth century up through the most recent developments in sensor fusion methods, many techniques have emerged that can be employed on the problem of endo and exoatmospheric trajectory estimation. Although early methods were ad hoc, the twentieth century saw the emergence of many systematic approaches to estimation theory that produced a wealth of useful techniques. The broad genesis of estimation theory has resulted in an equally broad array of mathematical principles, methods and vocabulary. Among the fundamental ideas and methods that are briefly touched on are batch and sequential processing, smoothing, estimation, and prediction, sensor fusion, sensor fusion architectures, data association, Bayesian and non Bayesian filtering, the family of Kalman filters, models of the dynamics of the phases of a rocket's flight, and asynchronous, delayed, and asequent data. Along the way, a few trajectory estimation issues are addressed and much of the vocabulary is defined.

Bernard, William P.↗