Wavelet Transform and Hidden Markov Model Application for Unsupervised Clustering of Microseismic Events from CO2 Injection
ARMA conference poster for a year-round grad intern from CSM
Willis, Rachel Marie↗
SEARCH · Engineering Papers
Results for “wavelet transform”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
A case study of denoising microseismic data in the Farnsworth, TX CO 2 EOR site
As geologic carbon sequestration projects begin to be funded with a higher degree of frequency, microseismic monitoring will become more necessary to establish caprock integrity and induced seismicity risk. The Farnsworth, TX site, which hosts enhanced oil recovery operations, provides an ideal laboratory to test essential components of microseismic monitoring such as surface station placement, denoising, and different autopicker methods. We find that despite careful optimization, the surface station placement at the Farnsworth site was insufficient given the high level of background noise from the industrial operations at the oil field. Thus, we use only borehole geophone data in our processing. Two denoising techniques were examined: the DeepDenoiser and the continuous wavelet transform. The continuous wavelet transform was shown to be a valuable tool in converting between raw waveforms to processed denoised waveforms for microseismic monitoring. In the case of the noisy waveforms, only ten detections are found, compared with 90 in the denoised data for a two-hour window. The DeepDenoiser suffered from the fact that the training data was regional earthquake data. In addition, the PhaseNet machine-learning autopicker was applied to both the noisy and the denoised data, and this algorithm detected thousands of more arrivals in the data denoised with the continuous wavelet transform technique.
58 GEOSCIENCES↗
Quantized Constant-Q Gabor Atoms for Sparse Binary Representations of Cyber-Physical Signatures
Increased data acquisition by uncalibrated, heterogeneous digital sensor systems such as smartphones present new challenges. Binary metrics are proposed for the quantification of cyber-physical signal characteristics and features, and a standardized constant-Q variation of the Gabor atom is developed for use with wavelet transforms. Two different continuous wavelet transform (CWT) reconstruction formulas are presented and tested under different signal to noise ratio (SNR) conditions. A sparse superposition of Nth order Gabor atoms worked well against a synthetic blast transient using the wavelet entropy and an entropy-like parametrization of the SNR as the CWT coefficient-weighting functions. The proposed methods should be well suited for sparse feature extraction and dictionary-based machine learning across multiple sensor modalities.
46 - INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AN↗
A Novel Fault Diagnosis Approach for Rolling Bearing Based on CWT and Adaptive Sparse Representation
Extraction and enhancement of weak impulse signature is the key of rolling bearing fault prognostics in which case the features are often weak and covered by noise. Tunable Q-factor wavelet transform (TQWT), as an emerging wavelet construction theory developed in a frequency domain explicitly, has the advantages of matching with the specific oscillation behavior of signal components. In this article, an adaptive sparse representation (ASR) method is proposed, which integrates the sparse code shrinkage (SCS) and parameter optimization into TQWT. However, direct application of ASR is difficult to extract fault signatures at the early stage or low-speed operation due to weak fault symptoms and background noise. A novel fault diagnosis strategy based on continuous wavelet transform (CWT) and ASR is investigated. CWT owns significant advantages on multiscale subdivision and weak signal detection. The results of simulated and experimental vibration signal analyses verify the effectiveness of the proposed method in accurately extracting weak impulse features from the noise environment.
Yuan, Xing↗
Precise cosmological constraints from BOSS galaxy clustering with a simulation-based emulator of the wavelet scattering transform
For this study, we perform a reanalysis of the BOSS CMASS DR12 galaxy dataset using a simulation-based emulator for the wavelet scattering transform (WST) coefficients. Moving beyond our previous works, which laid the foundation for the first galaxy clustering application of this estimator, we construct a neural net-based emulator for the cosmological dependence of the WST coefficients and the 2-point correlation function multipoles, trained from the state-of-the-art suite of abacussummit simulations combined with a flexible halo occupation distribution (HOD) galaxy model. In order to confirm the accuracy of our pipeline, we subject it to a series of thorough internal and external mock parameter recovery tests, before applying it to reanalyze the CMASS observations in the redshift range 0.46 < z < 0.57. We find that a joint WST+2-point correlation function likelihood analysis allows us to obtain marginalized 1σ errors on the Λ CDM parameters that are tighter by a factor of 2.5–6, compared to the 2-point correlation function, and by a factor of 1.4–2.5 compared to the WST-only results. This corresponds to a competitive 0.9%, 2.3% and 1% level of determination for parameters ω c , σ 8 &n s , respectively, and also to a 0.7% and 2.5% constraint on derived parameters h and ƒ(z)σ 8 (z), in agreement with the Planck 2018 results. Our results reaffirm the constraining power of the WST and highlight the exciting prospect of employing higher-order statistics in order to fully exploit the power of upcoming stage-IV spectroscopic observations.
79 ASTRONOMY AND ASTROPHYSICS↗
Improving the Transportability of a Deep Learning Denoising Model Using Transfer Learning Techniques
The adoption of machine learning techniques in the seismology community has led to great performance improvements in several areas, including signal processing. Specifically, the development of deep learning–based seismic waveform denoising models has the potential to yield improvements in signal detection capabilities for networks operating in particularly noisy environments. Recent advancements in the design of these deep learning denoising models have included the incorporation of continuous and discrete wavelet transform functions into the network architecture to improve the learning capabilities and efficiency of said models. These wavelet transform–based seismic denoising models have shown improved denoising capabilities in regions where there is good agreement between the data features present in the training and evaluation datasets. However, questions remain about the overall transportability of these models to other monitoring regions. Here, in this study, we will determine the baseline transportability of a newly developed multilevel wavelet‐transform convolutional neural network (MWCNN) seismic denoising model. We accomplish this by taking a version of the MWCNN denoising model trained on data collected from the Utah region and evaluating its denoising performance on datasets collected from the neighboring Nevada region, which differ with regard to monitoring sensor types and event histories. We find that there is a notable variability in denoising performance related to the degree of similarity between the initial and new target datasets. The most notable difference in denoising performance is the ability of the denoising model to preserve accurate amplitude information associated with the signal energy present in the waveform data. Finally, we evaluate the ability of transfer learning techniques to improve the transportability of the MWCNN denoising model. We find that although there is still a performance gap present in the denoising results of the MWCNN model, transfer learning did yield improved results.
Quinones, Louis [Sandia National Laboratories (SNL↗
Coarse-grain cluster analysis of tensors with application to climate biome identification
A tensor provides a concise way to codify the interdependence of complex data. Treating a tensor as a d-way array, each entry records the interaction between the different indices. Clustering provides a way to parse the complexity of the data into more readily understandable information. Clustering methods are heavily dependent on the algorithm of choice, as well as the chosen hyperparameters of the algorithm. However, their sensitivity to data scales is largely unknown. In this work, we apply the discrete wavelet transform to analyze the effects of coarse-graining on clustering tensor data. We are particularly interested in understanding how scale affects clustering of the Earth's climate system. The discrete wavelet transform allows classification of the Earth's climate across a multitude of spatial-temporal scales. The discrete wavelet transform is used to produce an ensemble of classification estimates, as opposed to a single classification. Each element of the ensemble is a clustering at a different spatial-temporal scale. Information theoretic approaches are used to identify important scale lengths in clustering the L15 Climate Datset. We also discover a sub-collection of the ensemble that spans the majority of the variance observed, allowing for efficient consensus clustering techniques that can be used to identify climate biomes.
54 ENVIRONMENTAL SCIENCES↗
WFSUITE: A PYTHON SOFTWARE SUITE FOR X-RAY WAVEFRONT SENDING AND AT-WAVELENGTH METROLOGY
SF-26-025 WFSuite is a graphical and command-line toolkit for coded-mask-based X-ray wavefront sensing and phase reconstruction at synchrotron beamlines. It integrates analysis tools for both relative and absolute speckle-based measurements. In the relative metrology module, WFSuite implements Wavelet-transform-based X-ray Speckle Tracking (WXST) and Wavelet-transform-based Speckle Vector Tracking (WSVT) methods to retrieve differential phase and wavefront distortions by comparing speckle patterns recorded with and without the test sample. In the absolute phase module, WFSuite uses coded-mask speckle patterns and replaces the measured reference with a numerically simulated one, enablingsingle-shot wavefront reconstruction using either WXST or a neural-network-based method (SPINNet).
Rebuffi, Luca [Argonne National Laboratory (ANL), ↗
Synchrotron X-ray based particle image velocimetry to measure multiphase streamflow and densitometry
Synchrotron-based radiation techniques are increasingly used in the field of flow condition measurements. As a complicated multiphase flow, cavitation has been investigated in a wide variety of industrial fields, to prevent damages on spillways at large dams or intensify the bacteria eradication rate during water treatments. To control the detrimental effects of cavitating flows, the dynamics of and mechanisms affecting cavitation development shall be visualized and identified in real-time. Due to the large reflection and scattering effects of multiphase flow, standard visible-light imaging technologies cannot penetrate vapor bubbles and provide extremely limited information. In this study, the synchrotron source emitted high-flux X-ray pulses are used to capture flow motion and visualize internal structures with sufficiently high spatial and temporal resolutions. The image processing procedures on raw x-ray images are developed using 2D Fourier transform (FT) and wavelet transform (WT) to implement the contrast enhancement and de-noising. Through the edge detection algorithm, tracking either seeded particles or phase interfaces inside the opaque multiphase flow can be achieved to perform the particle image velocimetry. Further, with decomposing particle-only and particle-eliminated subplots from the X-ray phase-contrast image, the time-resolved velocity and void fraction fields are obtained simultaneously, paving a way for further flow condition analysis such as densitometry.
73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
Comparing field data using Alpert multi-wavelets
In this paper we introduce a method to compare sets of full-field data using Alpert tree-wavelet transforms. The Alpert tree-wavelet methods transform the data into a spectral space allowing the comparison of all points in the fields by comparing spectral amplitudes. The methods are insensitive to translation, scale and discretization and can be applied to arbitrary geometries. This makes them especially well suited for comparison of field data sets coming from two different sources such as when comparing simulation field data to experimental field data. We have developed both global and local error metrics to quantify the error between two fields. Additionally, we verify the methods on two-dimensional and three-dimensional discretizations of analytical functions. Furthermore, we then deploy the methods to compare full-field strain data from a simulation of elastomeric syntactic foam.
42 ENGINEERING↗
Implementing Superresolution of Nonstationary Tides with Wavelets: An Introduction to CWT_Multi
Abstract Tides are often nonstationary due to nonastronomical influences. Investigating variable tidal properties implies a trade-off between separating adjacent frequencies (using long analysis windows) and resolving their time variations (short analysis windows). Previous continuous wavelet transform (CWT) tidal methods resolved tidal species. Here, we present CWT_Multi, a MATLAB code that 1) uses CWT linearity (via the “response coefficient method”) to implement superresolution, i.e., resolving tidal constituents beyond the Rayleigh criterion; 2) provides a Munk–Hasselmann constituent selection criterion appropriate for superresolution; and 3) introduces an objective, time-variable form of inference (“dynamic inference”) based on time-varying data properties. CWT_Multi resolves tidal species on time scales of days, and multiple constituents per species with fortnightly filters. It outputs astronomical phase lags and admittances, analyzes multiple records, and provides power spectra of the signal(s), residual(s), and reconstruction(s); confidence limits; and signal-to-noise ratios. Artificial data and water levels from the Lower Columbia River Estuary (LCRE) and San Francisco Bay Delta (SFBD) are used to test CWT_Multi and compare it to harmonic analysis programs NS_Tide and UTide. CWT_Multi provides superior reconstruction, detiding, dynamic analysis utility, and time resolution of constituents (but with broader confidence limits). Dynamic inference resolves closely spaced constituents (like K 1 , S 1 , and P 1 ) on fortnightly time scales, quantifying impacts of diel power peaking (with a 24-h period, like S 1 ) on water levels in the LCRE. CWT_Multi also helps quantify the impacts of high flows and a salt barrier closing on tidal properties in the SFBD. On the other hand, CWT_Multi does not excel at prediction, and results depend on analysis details, as for any method applied to nonstationary data. Significance Statement Ocean tides, especially in coastal and estuarine systems, are often nonstationary, in the sense that the mean and standard deviation of tidal properties vary over time, usually in response to some nontidal process. We introduce here a MATLAB code, CWT_Multi, that uses wavelet transforms to resolve both tidal species and constituents on time scales from a few days to months. Our code accommodates multiple scalar time series and has typical tidal analysis features like constituent selection and inference, plus two forms of uncertainty analyses. It is flexible, allowing the user to adapt analysis properties to diverse datasets. CWT_Multi is applicable to many problems involving time-variable tides, including sea level rise, compound flooding, sediment transport, and wetland habitat analyses. Application to vector data is a straightforward extension, but further development of our uncertainty analysis is merited. Because nonstationary tidal analysis is rapidly advancing, we also define the features of a “well-formed” analysis code.
Lobo, Matthew↗
Dark Energy Survey Year 3 results: Simulation-based cosmological inference with wavelet harmonics, scattering transforms, and moments of weak lensing mass maps. II. cosmological results
Here, we present a simulation-based cosmological analysis using a combination of Gaussian and non-Gaussian statistics of the weak lensing mass (convergence) maps from the first three years of the Dark Energy Survey. We implement the following: (1) second and third moments; (2) wavelet phase harmonics; (3) the scattering transform. Our analysis is fully based on simulations, spans a space of seven 𝑤 Cold Dark Matter (𝑤 CDM) cosmological parameters, and forward models the most relevant sources of systematics inherent in the data: masks, noise variations, clustering of the sources, intrinsic alignments, and shear and redshift calibration. We implement a neural network compression of the summary statistics, and we estimate the parameter posteriors using a simulation-based inference approach. Including and combining different non-Gaussian statistics is a powerful tool that strongly improves constraints over Gaussian statistics (in our case, the second moments); in particular, the figure of merit (𝑆 8 , Ω m ) is improved by 70% (Λ CDM) and 90% (𝑤 CDM). When all the summary statistics are combined, we achieve a 2% constraint on the amplitude of fluctuations parameter 𝑆 8 ≡ 𝜎 8 (Ω m /0.3) 0.5 , obtaining 𝑆 8 = 0.794 ±0.017 (Λ CDM) and 𝑆 8 = 0.817 ±0.021 (𝑤 CDM), and a ∼10% constraint on Ω m , obtaining Ω m =0.259 ±0.025 (Λ CDM) and Ω m = 0.273 ±0.029 (𝑤 CDM). In the context of the 𝑤 CDM scenario, these statistics also strengthen the constraints on the parameter 𝑤, obtaining 𝑤 <−0.72. The constraints from different statistics are shown to be internally consistent (with a 𝑝-value>0.1 for all combinations of statistics examined). We compare our results to other weak lensing results from the first three years of the Dark Energy Survey data, finding good consistency; we also compare with results from external datasets, such as planck constraints from the cosmic microwave background, finding statistical agreement, with discrepancies no greater than <2.2𝜎.
79 ASTRONOMY AND ASTROPHYSICS↗
Dark Energy Survey Year 3 results: Simulation-based cosmological inference with wavelet harmonics, scattering transforms, and moments of weak lensing mass maps. Validation on simulations
Beyond-two-point statistics contain additional information on cosmological as well as astrophysical and observational (systematics) parameters. In this methodology paper we provide an end-to-end simulationbased analysis of a set of Gaussian and non-Gaussian weak lensing statistics using detailed mock catalogs of the Dark Energy Survey (DES). Here, we implement: 1) second and third moments; 2) wavelet phase harmonics (WPH); 3) the scattering transform (ST). Our analysis is fully based on simulations, it spans a space of seven $νw$CDM cosmological parameters, and it forward models the most relevant sources of systematics of the data (masks, noise variations, clustering of the sources, intrinsic alignments, and shear and redshift calibration). We implement a neural network compression of the summary statistics, and we estimate the parameter posteriors using a likelihood-free-inference approach. We validate the pipeline extensively, and we find that WPH exhibits the strongest performance when combined with second moments, followed by ST, and then by third moments. The combination of all the different statistics further enhances constraints with respect to second moments, up to 25 percent, 15 percent, and 90 percent for S 8 , Ω m , and the figure-of-merit FoM S8;Ωm , respectively. We further find that non-Gaussian statistics improve constraints on w and on the amplitude of intrinsic alignment with respect to second moments constraints. The methodological advances presented here are suitable for application to Stage IV surveys from Euclid, Rubin-LSST, and Roman with additional validation on mock catalogs for each survey. In a companion paper we present an application to DES Year 3 data.
79 ASTRONOMY AND ASTROPHYSICS↗
Automated Framework for Groundwater Monitoring Using DWT with LSTM and Transformers
Environmental monitoring is critical for safeguarding public health and ecological well-being. Traditional data structuring and workflow monitoring methods consume significant time and effort, hindering timely insights and effective decision-making. Our study addresses this challenge by presenting an AI framework that automates data cleaning, structuring, and modeling processes, specifically targeting applications in groundwater monitoring. By leveraging automation for data processing and model training, our framework establishes a novel and efficient paradigm for environmental monitoring, with its potential application to the vast network of over a hundred Department of Energy Environmental Management (DoE-EM) cleanup sites across the country. It analyzes data streams from a network of groundwater Internet-of-Things (IoT) sensors deployed at the Savannah River Site (SRS) for prediction modeling. This allows human experts to focus on analysis and decision-making, ultimately leading to better environmental outcomes.The framework employs multivariate time-series forecasting methods to study and model the behavior of varying chemical analytes. The continuous learning process is enabled by utilizing deep learning techniques. It allows the framework to become more nuanced in its analysis over time, adapting to the specific characteristics of the environmental site and the evolving nature of contaminant behavior. Deep learning models known for sequence modeling, LSTM, and Transformers are employed for time series forecasting. Data processing and structuring are essential components significantly impacting the final model's performance. This hypothesis was proven by presenting a comparative analysis of model performance with processed and unprocessed data. The feature engineering approach utilized was the Discrete Wavelet Transform, which works well with time series data.
Discrete Wavelet Transform (DWT)↗
DESPERATE: A Python Library for Processing and Denoising NMR Spectra
NMR spectroscopy is an inherently insensitive technique with respect to the amount of observable signal. A common element in all NMR spectra is random thermal noise that is often characterized by a signal-to-noise ratio (SNR). SNR can be generically improved experimentally with repetitive signal averaging or during post-processing with apodization; the former of which often results in long experimental times and the latter results in the loss of spectral resolution. Denoising techniques can instead be used during post-processing to enhance SNR without compromising resolution. The most common approach relies on the singular-value decomposition (SVD) to discard noisy components of NMR data. SVD-based approaches work well, such as Cadzow and PCA, but are computationally expensive when used for large datasets that are often encountered in NMR (e.g., Carr-Purcell/Meiboom-Gill and nD datasets). Herein, we describe the implementation of a new wavelet transform (WT) routine for the fast and robust denoising of 1D and 2D NMR spectra. Several simulated and experimental datasets are denoised with both SVD-based Cadzow or PCA and WT’s, and the resulting SNR enhancements and spectral uniformity are compared. WT denoising offers similar and improved denoising compared with SVD and operates faster by several orders-of-magnitude in some cases. Further, all denoising and processing routines used in this work are included in a free and open-source Python library called DESPERATE.
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
Comparison of time-frequency-analysis techniques applied in building energy data noise cancellation for building load forecasting: A real-building case study
Time-frequency analysis that disaggregates a signal in both time and frequency domain is an important supporting technique for building energy analysis such as noise cancellation in data-driven building load forecasting. There is a gap in the literature related to comparing various time–frequency-analysis techniques, especially discrete wavelet transform (DWT) and empirical mode decomposition (EMD), to guide the selection and tuning of time–frequency-analysis techniques in data-driven building load forecasting. This article provides a framework to conduct a comprehensive comparison among thirteen DWT/EMD techniques with various parameters in a load forecasting modeling task. A real campus building is used as a case study for illustration. The DWT and EMD techniques are also compared under various data-driven modeling algorithms for building load forecasting. The results in the case study show that the load forecasting models trained with noise-cancelled energy data have increased their accuracy to 9.6% on average tested under unseen data. This study also shows that the effectiveness of DWT/EMD techniques depends on the data-driven algorithms used for load forecasting modeling and the training data. Hence, DWT/EMD-based noise cancellation needs customized selection and tuning to optimize their performance for data-driven building load forecasting modeling.
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
A generalized machine learning workflow to visualize mechanical discontinuity
Accurate detection and mapping of mechanical discontinuity in materials has widespread industrial and research applications. Herein, we developed a generalized machine-learning framework for visualizing single mechanical discontinuity embedded in material of any composition, velocity, density, porosity, and size with limited data. The proposed visualization of discontinuity requires accurate estimations of the length, location, and orientation of the embedded discontinuity by processing multipoint wave-transmission measurements. k-Wave simulator is used to create a large dataset of elastic waveforms recorded during multi-point wave-transmission measurements through materials containing single mechanical discontinuity. k-Wave simulator considers the wave attenuation, dispersion, and mode conversion in wave motion. Discrete wavelet transform (DWT) and statistical feature extraction are essential for data preprocessing prior to the data-driven model development. DWT also minimizes the effect of noise. Using hyper-parameter tuning and cross validation, gradient boosting regression can visualize the mechanical discontinuity with an accuracy of 0.85, in terms of coefficient of determination. A double-layered neural network-based regression has better performance with an accuracy of 0.95. Use of convolutional neural network converts the predictive task from a waveform processing to an image processing problem. Convolutional neural network achieved a generalization performance of 0.91. The proposed generalized workflow requires robust simulation of wave propagation, signal processing, feature engineering, and model evaluation. Sensors closest to the source and those located opposite the source are the most significant for the desired visualization. Notably, the sensors closest to the source capture the non-linear associations, whereas the sensor on the border opposite to the source capture the linear associations between the measured waveforms and the properties of the mechanical discontinuity.
42 ENGINEERING↗
Flow structures of the cross-flow over a five-layer helically coiled steam generator geometry
The helically-coiled heat exchanger (HCSG) offers advantages over straight tubes such as compactness in geometry, increased heat transfer coefficients, and capability to absorb thermal expansion. In this study, the time-resolved velocity field data of shell-side crossflow over a five-layer helically coiled steam generator geometry was obtained using Particle Image Velocimetry (PIV) between adjacent rods in four regions with up to 5000 frames per second (5 kHz) at approximately Re u = 3600. The slant rod bundle created different flow patterns in different regions. Proper Orthogonal Decomposition (POD) revealed high-energy-mode flow structures. Due to the confined flow channel geometry, the large flow structures were not advected resulting in no strong POD mode paring. Continuous Wavelet Transform (CWT) visualized the characteristics of flow fluctuation in time and frequency domain simultaneously, which ranged in Strouhal number, S u , between 0.03 and 1.17. In the wake regions of the rods, flows changed in both pattern and magnitude over time. Once a pattern formed, it continued for relatively shorter than straight tube arrays, before changing the pattern again. The histograms of the POD time coefficients presented this multimodal flow characteristics. The current study focuses more on whole flow field analyses in the selected regions rather than local point-wise analyses. Finally, this study revealed that various Strouhal numbers can exist in the helically coiled heat exchanger geometry, which was not observed in straight tube arrays. In particular, Strouhal numbers smaller than 0.1 do not seem to be caused by vortex shedding but seem to be the result of the combination of complex geometry and possible multimodal trends. Based on the current observation, further works would involve intensive instantaneous point-wise analyses on the interactions between important locations such as separation points, stagnation points, shear layers, etc.
42 ENGINEERING↗