Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Information fusion”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS1993

Enhanced image capture through fusion

Image fusion may be used to combine images from different sensors, such as IR and visible cameras, to obtain a single composite with extended information content. Fusion may also be used to combine multiple images from a given sensor to form a composite image in which information of interest is enhanced. We present a general method for performing image fusion and show that this method is effective for diverse fusion applications. We suggest that fusion may provide a powerful tool for enhanced image capture with broad utility in image processing and computer vision.

Burt, Peter J.↗
NASA NTRS2003

What is Your Cosmic Connection to the Elements?

This booklet provides information and classroom activities covering topics in astronomy, physics, and chemistry. Chemistry teachers will find information about the cosmic origin of the chemical elements. The astronomy topics include the big bang, life cycles of small and large stars, supernovae, and cosmic rays. Physics teachers will find information on fusion processes, and physical principles important in stellar evolution. While not meant to replace a textbook, the information provided here is meant to give the necessary background for the theme of :our cosmic connection to the elements." The activities can be used to re-enforce the material across a number of disciplines, using a variety of techniques, and to engage and excite students about the topic. Additional activities, and on-line versions of the activities published here, are available at http://imagine.gsfc.nasa.gov/docs/teachers/elements/.

Lochner, J.↗
DOE OSTI2025

A Representation Fusion Framework for Decoupling Diagnostic Information in Multimodal Learning

Modern medicine increasingly relies on multimodal data, ranging from clinical notes to imaging and genomics, to guide diagnosis and treatment. However, integrating these heterogeneous data sources in a principled and interpretable manner remains a major challenge. We present MODES (Multi-mOdal Disentangled Embedding Space), a representation fusion framework that explicitly separates shared and modality-specific factors of variation, offering a structured latent space for multimodal information that improves both prediction and interpretability. By leveraging pre-trained unimodal foundation models, MODES mitigates the dependency on extensive paired datasets, crucial in data-scarce clinical settings. We introduce a masking strategy that optimizes representation dimensionality by eliminating low-information dimensions, to achieve compact, information-rich representations. Our framework demonstrates superior performance in predicting diagnoses and phenotypes compared to unimodal and conventional fusion models. MODES also enables robust diagnostic inference in missing data scenarios, offering an opportunity toward interpretable and efficient multimodal diagnostics in personalized healthcare.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

A Gaussian process guide for signal regression in magnetic fusion

Extracting reliable information from diagnostic data in tokamaks is critical for understanding, analyzing, and controlling the behavior of fusion plasmas and validating models describing that behavior. Recent interest within the fusion community has focused on the use of principled statistical methods, such as Gaussian process regression (GPR), to attempt to develop sharper, more reliable, and more rigorous tools for examining the complex observed behavior in these systems. While GPR is an enormously powerful tool, there is also the danger of drawing fragile, or inconsistent conclusions from naive GPR fits that are not driven by principled treatments. Here we review the fundamental concepts underlying GPR in a way that may be useful for broad-ranging applications in fusion science. We also revisit how GPR is developed for profile fitting in tokamaks. We examine various extensions and targeted modifications applicable to experimental observations in the edge of the DIII-D tokamak. Finally, we discuss best practices for applying GPR to fusion data.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
NASA NTRS1993

Interactive and cooperative sensing and control for advanced teleoperation

This paper presents the paradigm of interactive and cooperative sensing and control as a fundamental mechanism of integrating and fusing the strengths of man and machine for advanced teleoperation. The interactive and cooperative sensing and control is considered as an extended and generalized form of traded and shared control. The emphasis of interactive and cooperative sensing and control is given to the distribution of mutually nonexclusive subtasks to man and machine, the interactive invocation of subtasks under the man/machine symbiotic relationship, and the fusion of information and decisionmaking between man and machine according to their confidence measures. The proposed interactive and cooperative sensing and control system is composed of such major functional blocks as the logical sensor system, the sensor-based local autonomy, the virtual environment formation, and the cooperative decision-making between man and machine. The Sensing-Knowledge-Command (SKC) fusion network is proposed as a fundamental architecture for implementing cooperative and interactive sensing and control. Simulation results are shown.

Lee, Sukhan↗
DOE OSTI2020

Interactions Between Microturbulence and Magnetohydrodynamic Instabilities in Magnetized Plasmas (Final Technical Report)

The overall goal of this project was to develop a better understanding between small-scale microturbulence and large-scale magnetohydrodynamic (MHD) instabilities, particularly magnetic islands and tearing modes, in fusion relevant magnetically confined plasmas. This project advanced understanding through numerical simulations of different model equations. Questions addressed included how the magnitudes, spatial structures, and scalings of turbulent forcings and drags impact island dynamics, as well as what the "region of influence" of a tearing mode on the turbulence dynamics. A key finding of the project is that the microturbulence (and associated transport) exhibits spatial asymmetries for sufficiently large islands. The results have improved our fundamental understanding of plasma dynamics, motivated new experimental investigations, and will help inform future fusion predictive modeling efforts.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Interactions Between Microturbulence and Magnetohydrodynamic Instabilities in Magnetized Plasmas (Final Technical Report)

This document details the work accomplished during the period 04/15/2012-01/31/2020 for the collaborative project “Interactions Between Microturbulence and Magnetohydrodynamic Instabilities in Magnetized Plasmas,” and serves as the final report on the University of California, San Diego part of this collaborative project for Department of Energy Office of Science - Fusion Energy Sciences Grant No. DE- SC0007783. This project focused on the development of analytic and computational tools, seeking to better understand the mutual interactions between small-scale temperature-gradient driven microturbulence and macroscopic magnetohydrodynamic (MHD) instabilities, particularly tearing modes, in magnetically confined plasmas relevant for the generation of fusion energy. This project advanced understanding through numerical simulations of different sets of model equations, corresponding to different microturbulence instabilities. Questions addressed included how the magnitudes, spatial structures, and scaling's of turbulent forcing's and drags impact magnetic island dynamics, as well as quantifying the “region of influence” of an island on the microturbulence dynamics. A key finding of the project is that the microturbulence fluctuations and associated cross-field particle and energy fluxes exhibit spatial asymmetries for sufficiently large islands. The results have improved our fundamental understanding of plasma dynamics, motivated new experimental investigations, and will help inform future fusion predictive modeling efforts.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Absolute Neutron Rate Measurement and Non-Thermal/Thermonuclear Fusion Differentiation

The goal of fusion energy is to produce significantly more energy from fusion reactions than is input into the device. One of the products of fusion reactions is neutrons, which, due to their lack of charge, provide a unique view into the parameters of the device. Lawrence Livermore National Laboratory (LLNL) in collaboration with the University of California, Berkeley (UCB) have designed, assembled, and fielded a robust and portable neutron detection system known as PANDA (Portable and Adaptable Neutron Diagnostics for ARPA-E). This detector suite consists of three LaBr activation detectors that are calibrated to give a total neutron yield on shot, and twenty-four scintillators coupled to photo-multiplier tubes (SPMT). The SPMTs can be configured to attain spatial, temporal and/or energy information from fusion neutrons. The system was designed to be portable and is compartmentalized so that individual components can be used at different fusion facilities. During the duration of this work, part of the system was installed at the FuZE facility, a part of Zap Energy. Another component was installed that the CESZAR facility at the University of California, San Diego (UCSD) to support experiments by Magneto-Inertial Fusion Technologies, Inc. (MIFTI). The diagnostics were successful at both locations and the LLNL/UCB team supported the data analysis by creating and running analysis scripts and Monte-Carlo calculations. At Zap Energy the diagnostics demonstrated that the fusion from the FuZE device is thermonuclear in nature, a result that resulted in an invited talk at the American Physical Society Division of Plasma Physics and an invited paper. Additionally, temporal and spatial data was taken using the SPMTs to understand the duration and length of fusion production. At UCSD the neutron yield from the diagnostics was used to show improvements to fusion yields on their gas puff Z-pinch when using a gas shell surrounding the fuel. The success in this diagnostic has led to continued work at both Zap Energy and MIFTI, as well as follow on funding and interest at other fusion energy companies.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Latent code-based fusion: A Volterra neural network approach

We propose a deep structure encoder using Volterra Neural Networks (VNNs) to seek a latent representation of multi-modal data whose features are jointly captured by a union of subspaces. The so-called self-representation embedding of the latent codes leads to a simplified fusion which is driven by a similarly constructed decoding. The Volterra Filter architecture achieved reduction in parameter complexity is primarily due to controlled non-linearities being introduced by the higher-order convolutions in lieu of generalized activation functions. Experimental results on two different datasets have shown a significant improvement in the clustering performance for VNNs auto-encoder over conventional Convolutional Neural Networks (CNNs) auto-encoder. In addition, we also show that the proposed approach demonstrates a much-improved sample complexity over CNN-based auto-encoder with a robust classification performance.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Machine Learning Methods for Connection RTT and Loss Rate Estimation Using MPI Measurements Under Random Losses

Scientific computations are expected to be increasingly distributed across wide-area networks, and Message Passing Interface (MPI) has been shown to scale to support their communications over long distances. Application-level measurements of MPI operations reflect the connection Round-Trip Time (RTT) and loss rate, and machine learning methods have been previously developed to estimate them under deterministic periodic losses. In this paper, we consider more complex, random losses with unform, Poisson and Gaussian distributions. We study five disparate machine leaning methods, with linear and non-linear, and smooth and non-smooth properties, to estimate RTT and loss rate over 10Gbps connections with 0-366ms RTT. The diversity and complexity of these estimators combined with the randomness of losses and TCP’s non-linear response together rule out the selection of a single best among them; instead, we fuse them to retain their design diversity. Overall, the results show that accurate estimates can be generated at low loss rates but become inaccurate at loss rates 10% and higher, thereby illustrating both their strengths and limitations.

Generalization Bounds↗
DOE OSTI2021

Sequential Bayesian inference of transition rates in the hidden Markov model for multi-state system degradation

The more easily available system performance data and advances in data analytics have provided us with opportunities to optimize maintenance programs for engineered systems, for example nuclear power plants. One key task in maintenance optimization is to obtain an accurate model for system degradation. Here, in this research, we propose a Bayesian method to address this problem. Noting that systems usually exhibit multiple states and that the actual state of a system usually is not directly observable, in the method we first model the system degradation process and the observation process based on a hidden Markov model. Then we develop a sequential Bayesian inference algorithm based on importance sampling and the forward algorithm to infer the posterior distributions of the transition rates in the hidden Markov model based on available observations. The proposed Bayesian method allows us to take advantage of evidence from multiple sources, and also allows us to perform Bayesian inference sequentially, without the need to use the entire history of observations every time new observations are collected. We demonstrate the proposed method using both synthetic data for a nuclear power plant feedwater pump and realistic data for a nuclear power plant chemistry analytical device.

42 ENGINEERING↗
DOE OSTI2024

Power generation forecasting for solar plants based on Dynamic Bayesian networks by fusing multi-source information

A Dynamic Bayesian network (DBN) model for solar power generation forecasting in solar plants is proposed in this paper. The key idea is to fuse sensor data, operational indicators, meteorological data, lagged output power information, and model errors for more accurate short-term (e.g., hours) and mid-term (e.g., days to weeks) power generation forecasting. The proposed DBN augments automated data-driven structure learning with expert knowledge encoding using continuous and categorical data given constraints to represent causal relationships within a solar inverter system. Additionally, an error compensation mechanism is proposed to capture temporal fluctuation. The effectiveness of the DBN on solar power generation forecasting was evaluated by rolling window analysis with one-year testing data collected from a local solar plant. The proposed DBN is compared with four state-of-art methods including support-vector regression (SVR), k-nearest neighbors (kNN), artificial neural network (ANN), and long short-term memory (LSTM) models. The result show that the proposed DBN achieves better accuracy in general, and it is not as data-hungry as some neural network-based models. The proposed DBN is also shown to have robust and consistent forecasting power with different forecasting horizons. The accuracy is 92% - 95% from one hour to one week ahead forecasting.

14 SOLAR ENERGY↗
DOE OSTI2022

Improvements on the Diagnostic Residual Gas Analyzer at Wendelstein 7-X

Exhaust gas analysis provides key information on fusion processes, divertor operation, and wall state in fusion experiments and future reactors. The diagnostic residual gas analyzer (DRGA) concept has been developed for ITER with a focus on fast helium and hydrogen isotope detection. The first operation of the prototype DRGA (P-DRGA) at the stellarator Wendelstein 7-X showed potential for improvement in terms of magnetic sensor shielding, data acquisition automation, and potential new additions to the cluster of sensors on the P-DRGA. More recently, a Monte Carlo simulation of the flow of the mixed gas species effluent from the pressure-reducing orifice, down to about 8-m sampling tube and into the analysis region of the sensors, has been found to generally agree with previous calculations and measurements but revealed potential back-streaming effects for light gases, with impact on detection limits both for the prototype and for the ITER DRGA currently in design. For the upcoming campaign of the prototype, an enhanced soft iron shield will safeguard the gauges against magnetic stray field influence. The newly introduced shielding has been tested for its effect on magnetic stray fields and found to reduce the inside residual field by about two orders of magnitude.

Schlisio, G↗
DOE OSTI2026

4D Multimodal Co-attention Fusion Network with Latent Contrastive Alignment for Alzheimer’s Diagnosis

Multimodal neuroimaging provides complementary structural and functional insights into both human brain organization and disease-related dynamics. Recent studies demonstrate enhanced diagnostic sensitivity for Alzheimer’s disease (AD) through synergistic integration of neuroimaging data (e.g., sMRI, fMRI) with tabular data (e.g., behavioral and cognitive tests). However, the intrinsic heterogeneity across modalities (e.g., 4D spatiotemporal fMRI dynamics vs. 3D anatomical sMRI structure) presents critical challenges for discriminative feature fusion, often leading to information loss or biased fusion. To bridge this gap, we propose M2M-AlignNet: a multimodal co-attention network with latent alignment for early AD diagnosis using sMRI and fMRI. At the core of our approach is a multi-patch-to-multi-patch (M2M) contrastive loss function that quantifies and reduces representational discrepancies via weighted patch correspondence, explicitly aligning fMRI components across brain regions with their sMRI structural substrates without one-to-one constraints. Additionally, we propose a latent-as-query co-attention module to autonomously discover fusion patterns, circumventing modality prioritization biases while minimizing feature redundancy. We conduct extensive experiments to confirm the effectiveness of our method and highlight the correspondence between fMRI and sMRI as AD biomarkers.

Wei, Yuxiang [Georgia Institute of Technology]↗
NASA NTRS1993

Multiscale Morphological Filtering for Analysis of Noisy and Complex Images

Images acquired with passive sensing techniques suffer from illumination variations and poor local contrasts that create major difficulties in interpretation and identification tasks. On the other hand, images acquired with active sensing techniques based on monochromatic illumination are degraded with speckle noise. Mathematical morphology offers elegant techniques to handle a wide range of image degradation problems. Unlike linear filters, morphological filters do not blur the edges and hence maintain higher image resolution. Their rich mathematical framework facilitates the design and analysis of these filters as well as their hardware implementation. Morphological filters are easier to implement and are more cost effective and efficient than several conventional linear filters. Morphological filters to remove speckle noise while maintaining high resolution and preserving thin image regions that are particularly vulnerable to speckle noise were developed and applied to SAR imagery. These filters used combination of linear (one-dimensional) structuring elements in different (typically four) orientations. Although this approach preserves more details than the simple morphological filters using two-dimensional structuring elements, the limited orientations of one-dimensional elements approximate the fine details of the region boundaries. A more robust filter designed recently overcomes the limitation of the fixed orientations. This filter uses a combination of concave and convex structuring elements. Morphological operators are also useful in extracting features from visible and infrared imagery. A multiresolution image pyramid obtained with successive filtering and a subsampling process aids in the removal of the illumination variations and enhances local contrasts. A morphology-based interpolation scheme was also introduced to reduce intensity discontinuities created in any morphological filtering task. The generality of morphological filtering techniques in extracting information from a wide variety of images obtained with active and passive sensing techniques is discussed. Such techniques are particularly useful in obtaining more information from fusion of complex images by different sensors such as SAR, visible, and infrared.

Kher, A.↗
NASA NTRS1992

Interactive and cooperative sensing and control for advanced teleoperation

This paper presents the paradigm of interactive and cooperative sensing and control as a fundamental mechanism of integrating and fusing the strengths of man and machine for advanced teleoperation. The interactive and cooperative sensing and control is considered as an extended and generalized form of traded and shared control. The emphasis of interactive and cooperative sensing and control is given to the distribution of mutually nonexclusive subtasks to man and machine, the interactive invocation of subtasks under the man/machine symbiotic relationship, and the fusion of information and decision-making between man and machine according to their confidence measures. The proposed interactive and cooperative sensing and control system is composed of such major functional blocks as the logical sensor system, the sensor-based local autonomy, the virtual environment formation, and the cooperative decision-making between man and machine. A case study is performed to demonstrate the feasibility of implementing the fundamental theory and system architecture of interactive and cooperative sensing and control, proposed for the new generation of teleoperation.

Lee, Sukhan↗
NASA NTRS2000

A Structured Light Sensor System for Tree Inventory

Tree Inventory is referred to measurement and estimation of marketable wood volume in a piece of land or forest for purposes such as investment or for loan applications. Exist techniques rely on trained surveyor conducting measurements manually using simple optical or mechanical devices, and hence are time consuming subjective and error prone. The advance of computer vision techniques makes it possible to conduct automatic measurements that are more efficient, objective and reliable. This paper describes 3D measurements of tree diameters using a uniquely designed ensemble of two line laser emitters rigidly mounted on a video camera. The proposed laser camera system relies on a fixed distance between two parallel laser planes and projections of laser lines to calculate tree diameters. Performance of the laser camera system is further enhanced by fusion of information induced from structured lighting and that contained in video images. Comparison will be made between the laser camera sensor system and a stereo vision system previously developed for measurements of tree diameters.

Chien, Chiun-Hong↗