Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Blind Source Separation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

A novel CMB component separation method: hierarchical generalized morphological component analysis

ABSTRACT We present a novel technique for cosmic microwave background (CMB) foreground subtraction based on the framework of blind source separation. Inspired by previous work incorporating local variation to generalized morphological component analysis (GMCA), we introduce hierarchical GMCA (HGMCA), a Bayesian hierarchical graphical model for source separation. We test our method on Nside = 256 simulated sky maps that include dust, synchrotron, free–free, and anomalous microwave emission, and show that HGMCA reduces foreground contamination by $25{{\ \rm per\ cent}}$ over GMCA in both the regions included and excluded by the Planck UT78 mask, decreases the error in the measurement of the CMB temperature power spectrum to the 0.02–0.03 per cent level at ℓ > 200 (and $\lt 0.26{{\ \rm per\ cent}}$ for all ℓ), and reduces correlation to all the foregrounds. We find equivalent or improved performance when compared to state-of-the-art internal linear combination type algorithms on these simulations, suggesting that HGMCA may be a competitive alternative to foreground separation techniques previously applied to observed CMB data. Additionally, we show that our performance does not suffer when we perturb model parameters or alter the CMB realization, which suggests that our algorithm generalizes well beyond our simplified simulations. Our results open a new avenue for constructing CMB maps through Bayesian hierarchical analysis.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

A survey of unsupervised learning methods for high-dimensional uncertainty quantification in black-box-type problems

Constructing surrogate models for uncertainty quantification (UQ) on complex partial differential equations (PDEs) having inherently high-dimensional O(10 n ), n ≥ 2, stochastic inputs (e.g., forcing terms, boundary conditions, initial conditions) poses tremendous challenges. The “curse of dimensionality” can be addressed with suitable unsupervised learning techniques used as a pre-processing tool to encode inputs onto lower-dimensional subspaces while retaining its structural information and meaningful properties. In this work, we review and investigate thirteen dimension reduction methods including linear and nonlinear, spectral, blind source separation, convex and non-convex methods and utilize the resulting embeddings to construct a mapping to quantities of interest via polynomial chaos expansions (PCE). Here, we refer to the general proposed approach as manifold PCE (m-PCE), where manifold corresponds to the latent space resulting from any of the studied dimension reduction methods. To investigate the capabilities and limitations of these methods we conduct numerical tests for three physics-based systems (treated as black-boxes) having high-dimensional stochastic inputs of varying complexity modeled as both Gaussian and non-Gaussian random fields to investigate the effect of the intrinsic dimensionality of input data. We demonstrate both the advantages and limitations of the unsupervised learning methods and we conclude that a suitable m-PCE model provides a cost-effective approach compared to alternative algorithms proposed in the literature, including recently proposed expensive deep neural network-based surrogates and can be readily applied for high-dimensional UQ in stochastic PDEs.

42 ENGINEERING↗
DOE OSTI2018

Efficient Full-Field Vibration Measurements and Operational Modal Analysis Using Neuromorphic Event-Based Imaging

Traditional vibration measurement typically requires physically attached sensors, such as accelerometers and strain gauges. However, these discrete-point sensors provide only low spatial resolution vibration measurements, potentially foregoing valuable structural information such as localized damage. Noncontact optical measurement methods such as laser vibrometers can achieve high spatial resolution vibration measurements but only through time-consuming sequential measurements and are not cost-effective. As an alternative to traditional vibration measurement methods, digital video cameras are relatively low-cost, agile, and offer noncontact, simultaneous high spatial resolution measurements where every pixel on the structure becomes a measurement point. However, regular digital video cameras are frame-based where each pixel simultaneously performs temporally uniform (synchronous) measurements containing large amounts of redundant (background) data, which consumes considerable resources for video data measurement, management, and processing. To alleviate such a challenge, this work explores the use of event-based neuromorphic imagers, specifically silicon retinas, an efficient alternative to traditional frame-based video cameras, to perform full-field vibration measurements and operational modal analysis. By imitating biological vision, each silicon retina pixel independently and asynchronously records only intensity change events that contain structural motion information while excluding redundant (background) information. Such an asynchronous event-based data measurement mechanism allows for structural motion to be captured on the microsecond scale in an extremely data-efficient manner, which could benefit real-time vibration measurement and control applications. This study takes the first step toward these applications by formulating an existing video frame-based full-field operational modal analysis technique in the event-based, asynchronous silicon retina measurement framework. Specifically, local phase-based motion extraction and blind source separation are used to automatically and efficiently extract full-field vibration and dynamics parameters from silicon retina measurements. The developed method is validated by laboratory experiments on a bench-scale cantilever beam.

42 ENGINEERING↗
DOE OSTI2014

A new look at Spitzer primary transit observations of the exoplanet HD 189733b

Blind source separation techniques are used to reanalyze two exoplanetary transit light curves of the exoplanet HD 189733b recorded with the IR camera IRAC on board the Spitzer Space Telescope at 3.6 μm during the 'cold' era. These observations, together with observations at other IR wavelengths, are crucial to characterize the atmosphere of the planet HD 189733b. Previous analyses of the same data sets reported discrepant results, hence the necessity of the reanalyses. The method we used here is based on the Independent Component Analysis (ICA) statistical technique, which ensures a high degree of objectivity. The use of ICA to detrend single photometric observations in a self-consistent way is novel in the literature. The advantage of our reanalyses over previous work is that we do not have to make any assumptions on the structure of the unknown instrumental systematics. Such 'admission of ignorance' may result in larger error bars than reported in the literature, up to a factor 1.6. This is a worthwhile tradeoff for much higher objectivity, necessary for trustworthy claims. Our main results are (1) improved and robust values of orbital and stellar parameters, (2) new measurements of the transit depths at 3.6 μm, (3) consistency between the parameters estimated from the two observations, (4) repeatability of the measurement within the photometric level of ∼2 × 10{sup –4} in the IR, and (5) no evidence of stellar variability at the same photometric level within one year.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2015

REVISITING SPITZER TRANSIT OBSERVATIONS WITH INDEPENDENT COMPONENT ANALYSIS: NEW RESULTS FOR THE GJ 436 SYSTEM

We analyzed four Spitzer/IRAC observations at 3.6 and 4.5 μm of the primary transit of the exoplanet GJ 436b, by using blind source separation techniques. These observations are important for investigating the atmospheric composition of the planet GJ 436b. Previous analyses claimed strong inter-epoch variations of the transit parameters due to stellar variability, casting doubts on the possibility of conclusively extracting an atmospheric signal. Those analyses also reported discrepant results, hence the necessity of this reanalysis. The method we used has been proposed in Morello et al. to analyze 3.6 μm transit light curves of the hot Jupiter HD 189733b. It performes an Independent Component Analysis on a set of pixel light curves, i.e., time series read by individual pixels, from the same photometric observation. Our method only assumes the independence of instrumental and astrophysical signals, and therefore guarantees a higher degree of objectivity compared to parametric detrending techniques published in the literature. The data sets we analyzed in this paper represent a more challenging test than the previous ones. Contrary to previous results reported in the literature, our results (1) do not support any detectable inter-epoch variations of orbital and stellar parameters, (2) are photometrically stable at the level ∼10{sup −4} in the IR, and (3) the transit depth measurements at the two wavelengths are consistent within 1σ. We also (4) detect a possible transit duration variation of ∼80 s (2σ significance level) that has not been pointed out in the literature, and (5) confirm no transit timing variations ≳30 s.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

A neural network for determination of latent dimensionality in Nonnegative Matrix Factorization

Non-negative Matrix Factorization (NMF) has proven to be a powerful unsupervised learning method for uncovering hidden features in complex and noisy datasets with applications in data mining, text recognition, dimension reduction, face recognition, anomaly detection, blind source separation, and many other fields. An important input for NMF is the latent dimensionality of the data, that is, the number of hidden features, K, present in the explored dataset. Unfortunately, and this quantity is rarely known a priori. The existing methods for determining latent dimensionality, such as Automatic Relevance Determination (ARD), are mostly heuristic and utilize different characteristics to estimate the number of hidden features. However, all of them require human presence to make a final determination of K. Here we utilize a supervised machine learning approach in combination with a recent method for model determination, called NMFk, to determine the number of hidden features automatically. NMFk performs a set of NMF simulations on an ensemble of matrices, obtained by bootstrapping the initial dataset, and estimates which K produces stable groups of latent features that reconstruct the initial dataset well. We then train a Multi-Layter Perceptron (MLP) classifier network to determine the correct number of latent features utilizing the statistics and characteristics of the NMF solution, obtained from NMFk. In order to train the MLP classifier, a training set of 58,660 matrices with predetermined latent features were factorized with NMFk. The MLP classifier in conjunction with NMFk maintains a greater than 95% success rate when applied to a held out test set. Additionally, when applied to two well-known benchmark datasets, the swimmer and MIT face data, NMFk/MLP correctly recovers the established number of hidden features. Finally, we compare the accuracy of our method to the ARD, AIC and Stability-based methods.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Non-Intrusive Appliance Identification with Appliance-Specific Networks

The problem of noninstrusive load monitoring (NILM) is usually formulated as a single-channel blind source separation task, whose successful solution enable fast and convenient load identification and energy disaggregation. When applied at test time, NILM algorithms aim to identify the operating characteristics of individual appliances from an aggregate power measurement of the entire house. Recent advances in deep learning gave rise to many methods that mostly focus on learning a direct mapping from aggregate measurement to individual appliance power. However, these methods are not only computationally expensive, but they often suffer from overfitting and do not generalize very well. In this article, we propose a novel NILM method that leverages advances in statistical learning that have not been properly applied in this domain before. The proposed method consists of three stages: first, a Bayesian nonparametric learning-based approach for appliance state extraction; second, synthetic minority oversampling technique for data augmentation and mitigating the heavy imbalance in switching events; and third, appliance-specific lightweight long short-term memory networks for status classification for each appliance. Here, we adopt a “differential” input (the difference before and after the switching event) to reduce the complexity of network training and make the proposed method robust to multiappliance switching events. Experiments are conducted to demonstrate the effectiveness of the proposed method, achieving superior performance when compared to recent methods. An ablation study is conducted to demonstrate the effectiveness of each module of our method. Finally, we investigate the quality of generated synthetic samples.

42 ENGINEERING↗
DOE OSTI2017

Light Water Reactor Sustainability Program Potential to Extend the Range of Established Online Monitoring Technologies, Such as Guided Waves in Nuclear Power Plant Systems

The Light Water Reactor Sustainability Program began to evaluate technologies that could be used to perform online monitoring of piping and other secondary system structural components in commercial NPPs. These online monitoring systems have the potential to identify when a more detailed inspection is needed using real-time measurements, rather than at a pre-determined inspection interval. This transition to condition-based, risk informed automated maintenance will contribute to a significant reduction of operations and maintenance costs that account for most nuclear power generation costs. This report describes the current state of research related to ultrasonic guided wave testing and its application to defect detection in commercial nuclear power plants. The report analyses the applicability of the guided wave technology to secondary piping systems and also study the potential for expanding the range of guided wave technology to include bent piping and other piping components. The ultrasonic guided waves can inspect long stretches of straight piping, however more complex geometries such as elbows, welds, and tees are causing spurious reflections and coherent noise which significantly decrease the sensitivity of the technique. The report analyses two approaches to suppression of coherent noise in guided wave systems: advanced signal processing and pattern recognition based on independent component analysis and blind source separation and hardware-based technique of piezoelectric paint which can be used to facilitate the propagation of mechanical stress waves through piping. It is demonstrated on simulated guided wave data that the independent component analysis is capable of separating different coherent noise components and segregating them from useful signal. The piezoelectric paint approach seem to be a viable alternative to the signal processing methods, however it requires significantly more complicated logistics and initial financial outlay. The future efforts will be concentrated on applying the independent component analysis to real-world guided wave data recorded by the guided wave monitoring system installed on the shell of the low-pressure feedwater heater 13A at Exelon Corporation’s Braidwood Nuclear Generating Station. Also, the joint EPRI-INL research efforts will focus on experimental evaluation of piezoelectric paint as a technique to extend the range of guided wave technology.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2019

Machine Learning

Presentation overview: Why Machine Learning?; Why ML-Informed Physics?; Why Physics-Informed ML?; LANL ML strategy related to National & Energy Security; ML-Informed Physics for climate modeling and induced seismicity (LDRD-DR); Physics-Informed ML for blind source separation (LDRD-DR); ML forecasting production from tight rock reservoirs (Chevron)

58 GEOSCIENCES↗
DOE OSTI2016

REPEATABILITY OF SPITZER/IRAC EXOPLANETARY ECLIPSES WITH INDEPENDENT COMPONENT ANALYSIS

The research of effective and reliable detrending methods for Spitzer data is of paramount importance for the characterization of exoplanetary atmospheres. To date, the totality of exoplanetary observations in the mid- and far-infrared, at wavelengths >3 μm, have been taken with Spitzer. In some cases, in past years, repeated observations and multiple reanalyses of the same data sets led to discrepant results, raising questions about the accuracy and reproducibility of such measurements. Morello et al. (2014, 2015) proposed a blind-source separation method based on the Independent Component Analysis of pixel time series (pixel-ICA) to analyze InfraRed Array Camera (IRAC) data, obtaining coherent results when applied to repeated transit observations previously debated in the literature. Here we introduce a variant to the pixel-ICA through the use of wavelet transform, wavelet pixel-ICA, which extends its applicability to low-signal-to-noise-ratio cases. We describe the method and discuss the results obtained over 12 eclipses of the exoplanet XO3b observed during the “Warm Spitzer” era in the 4.5 μm band. The final results are reported, in part, also in Ingalls et al. (2016), together with results obtained with other detrending methods, and over 10 synthetic eclipses that were analyzed for the “IRAC Data Challenge 2015.” Our results are consistent within 1σ with the ones reported in Wong et al. (2014) and with most of the results reported in Ingalls et al. (2016), which appeared on arXiv while this paper was under review. Based on many statistical tests discussed in Ingalls et al. (2016), the wavelet pixel-ICA method performs as well as or better than other state-of-art methods recently developed by other teams to analyze Spitzer/IRAC data, and, in particular, it appears to be the most repeatable and the most reliable, while reaching the photon noise limit, at least for the particular data set analyzed. Another strength of the ICA approach is its highest objectivity, as it does not use prior information about the instrument systematics, making it a promising method to analyze data from other observatories. The self-consistency of individual measurements of eclipse depth and phase curve slope over a span of more than three years proves the stability of Warm Spitzer/IRAC photometry within the error bars, at the level of 1 part in 10{sup 4} in stellar flux.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2016

Complex Signal Kurtosis and Independent Component Analysis for Wideband Radio Frequency Interference Detection

Radio-frequency interference (RFI) has negatively implicated scientific measurements across a wide variation passive remote sensing satellites. This has been observed in the L-band radiometers SMOS, Aquarius and more recently, SMAP [1, 2]. RFI has also been observed at higher frequencies such as K band [3]. Improvements in technology have allowed wider bandwidth digital back ends for passive microwave radiometry. A complex signal kurtosis radio frequency interference detector was developed to help identify corrupted measurements [4]. This work explores the use of ICA (Independent Component Analysis) as a blind source separation technique to pre-process radiometric signals for use with the previously developed real and complex signal kurtosis detectors.

microwave↗
NASA NTRS2016

RFI Detection and Mitigation using Independent Component Analysis as a Pre-Processor

Radio-frequency interference (RFI) has negatively impacted scientific measurements of passive remote sensing satellites. This has been observed in the L-band radiometers Soil Moisture and Ocean Salinity (SMOS), Aquarius and more recently, Soil Moisture Active Passive (SMAP). RFI has also been observed at higher frequencies such as K band. Improvements in technology have allowed wider bandwidth digital back ends for passive microwave radiometry. A complex signal kurtosis radio frequency interference detector was developed to help identify corrupted measurements. This work explores the use of Independent Component Analysis (ICA) as a blind source separation (BSS) technique to pre-process radiometric signals for use with the previously developed real and complex signal kurtosis detectors.

independent component analysis↗
NASA NTRS2017

An RFI Detection Algorithm for Microwave Radiometers Using Sparse Component Analysis

Radio Frequency Interference (RFI) is a threat to passive microwave measurements and if undetected, can corrupt science retrievals. The sparse component analysis (SCA) for blind source separation has been investigated to detect RFI in microwave radiometer data. Various techniques using SCA have been simulated to determine detection performance with continuous wave (CW) RFI.

radiometers↗
NASA NTRS2017

An RFI Detection Algorithm for Microwave Radiometers Using Sparse Component Analysis

Radio Frequency Interference (RFI) is a threat to passive microwave measurements and if undetected, can corrupt science retrievals. The sparse component analysis (SCA) for blind source separation has been investigated to detect RFI in microwave radiometer data. Various techniques using SCA have been simulated to determine detection performance with continuous wave (CW) RFI.

radiometers↗
NASA NTRS2018

Independent Component Analysis for Preprocessing Optical Signals in Support of Multi-User Communication

In an effort to construct an optical transceiver for supporting multi-point communication, researchers developed large field-of-view FSO transceivers with wide apertures for facilitating rapid acquisition and optical signal tracking. The design is constructed from fiber-bundle(s) intelligently arranged to provide multiple optical pathways within a single transceiver, with each pathway limited to a particular optical directionality. Because designs with wide apertures are susceptible to receiving several optical signals simultaneously from multiple transmitters, accurately decoding individual signals and achieving true multi-user communication can be difficult. The work detailed in this paper investigated the use of blind source separation techniques, mainly independent component analysis (ICA), to estimate transmitted signals from their observed, combined mixtures sans information. Effects of signal power, format, data rate, wavelength, and turbulence severity on signal separation, as well as signal demodulation accuracy was also analyzed using experimental optical signals and corresponding mixtures. Signal generators, laser sources, turbulence emulator, beam profiler, photodiodes, and oscilloscopes comprised the experiment setup. Optical signals with varying power, format, and wavelength were generated and propagated through turbulence with varying degree severity, and finally received by the fiber-bundle-based optical transceiver. Results demonstrate that an ICA technique can accurately process the combined signals into corresponding individual components. The investigation further identified signal characteristics (e.g., power levels, format, data rate) and turbulence severity under which ICA is unable to accurately perform signal separations.

Optics↗
DOE OSTI2020

System and method for automated extraction of high resolution structural dynamics from video

A method for extracting vibrational modes of a structure includes: receiving a plurality of video frames, each of the video frames including a plurality of pixels; decomposing each of the video frames on a plurality of spatial scales in accordance with complex steerable pyramid filters to obtain a filter response for each of the spatial scales; computing a plurality of local phases of the pixels of each frame; removing a temporal mean from each frame to obtain a plurality of factored vibration motion functions; performing principal component analysis on the factored vibration motion functions to obtain principal components; blind source separating the principal components to compute a plurality of modal coordinates; computing frequency and damping ratios in accordance with the modal coordinates; and outputting the computed frequency and damping ratios.

42 ENGINEERING↗
DOE OSTI2020

Source identification by non-negative matrix factorization combined with semi-supervised clustering

Machine-learning methods and apparatus are provided to solve blind source separation problems with an unknown number of sources and having a signal propagation model with features such as wave-like propagation, medium-dependent velocity, attenuation, diffusion, and/or advection, between sources and sensors. In exemplary embodiments, multiple trials of non-negative matrix factorization are performed for a fixed number of sources, with selection criteria applied to determine successful trials. A semi-supervised clustering procedure is applied to trial results, and the clustering results are evaluated for robustness using measures for reconstruction quality and cluster separation. The number of sources is determined by comparing these measures for different trial numbers of sources. Source locations and parameters of the signal propagation model can also be determined. Disclosed methods are applicable to a wide range of spatial problems including chemical dispersal, pressure transients, and electromagnetic signals, and also to non-spatial problems such as cancer mutation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Source identification by non-negative matrix factorization combined with semi-supervised clustering

Machine-learning methods and apparatus are provided to solve blind source separation problems with an unknown number of sources and having a signal propagation model with features such as wave-like propagation, medium-dependent velocity, attenuation, diffusion, and/or advection, between sources and sensors. In exemplary embodiments, multiple trials of non-negative matrix factorization are performed for a fixed number of sources, with selection criteria applied to determine successful trials. A semi-supervised clustering procedure is applied to trial results, and the clustering results are evaluated for robustness using measures for reconstruction quality and cluster separation. The number of sources is determined by comparing these measures for different trial numbers of sources. Source locations and parameters of the signal propagation model can also be determined. Disclosed methods are applicable to a wide range of spatial problems including chemical dispersal, pressure transients, and electromagnetic signals, and also to non-spatial problems such as cancer mutation.

Alexandrov, Boian S.↗