Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “wavelet”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Evaluating Scalograms for Seismic Event Denoising

Denoising contaminated seismic signals for later processing is a fundamental problem in seismic signals analysis. The most straightforward denoising approach, using spectral filtering, is not effective when noise and seismic signal occupy the same frequency range. Neural network approaches have shown success denoising local signal when trained on short-time Fourier transform spectrograms (Zhu et al 2018; Tibi et al 2021). Scalograms, a wavelet-based transform, achieved ~15% better reconstruction as measured by dynamic time warping on a seismic waveform test set than spectrograms, suggesting their use as an alternative for denoising. We train a deep neural network on a scalogram dataset derived from waveforms recorded by the University of Utah Seismograph Stations network. We find that initial results are no better than a spectrogram approach, with additional overhead imposed by the significantly larger size of scalograms. A robust exploration of neural network hyperparameters and network architecture was not performed, which could be done in follow on work.

58 GEOSCIENCES↗
DOE OSTI2021

Deep Learning for Fish Identification from Sonar Data: CRADA 481 [Abstract only]

To help solve the challenges of hydropower energy production related to the potential for eel injury and mortality from passage through hydropower turbines, we will develop a deep learning method for identifying migrating eels from imaging sonar. This project continues with a prior project conducted by the Pacific Northwest National Laboratory (PNNL) and the Electric Power Research Institute (EPRI) in FY2018-2019. The proposed method employs Convolution Neural Network (CNN), a powerful deep learning method for image classification, to distinguish between images of eels and non-eel moving objects. We propose to collect more laboratory data and add more existing field data to train a powerful deep learning model. In addition to eels and sticks as classified in previous studies, we will add images containing several non-eel fish species and macrophyte mats to the training data. A multi-class classification model will be developed to distinguish these objects. Object detection algorithm will be explored and developed to locate and identify multiple objects in each sonar frame. Motion analysis will be performed to track the movement of objects in sonar video clips. We will also improve the data conversion algorithm so that it can read in both DIDSON and ARIS (both are imaging sonars developed by Sound Metrics Corp) data files and convert them to images with comparably high resolution, regardless of the varying detection ranges in different environments. The developed algorithms will be packaged as a software with a graphic user interface. The software will be evaluated by external collaborators in the field. The developed framework can be generalized for automatic monitoring of fish passage and migration using other imaging sonars like ARIS and will benefit the design and operation of ecologically friendly hydroelectric projects. The developed wavelet and CNN model configuration parameters can potentially be transferred to lamprey detection in similar riverine environments.

13 HYDRO ENERGY↗
DOE OSTI2020

DEEP CELLULAR RECURRENT NEURAL ARCHITECTURE FOR EFFICIENT MULTIDIMENSIONAL TIME-SERIES DATA PROCESSING

Efficient processing of time series data is a fundamental yet challenging problem in pattern recognition. Though recent developments in machine learning and deep learning have enabled remarkable improvements in processing large scale datasets in many application domains, most are designed and regulated to handle inputs that are static in time. Many real-world data, such as in biomedical, surveillance and security, financial, manufacturing and engineering applications, are rarely static in time, and demand models able to recognize patterns in both space and time. Current machine learning (ML) and deep learning (DL) models adapted for time series processing tend to grow in complexity and size to accommodate the additional dimensionality of time. Specifically, the biologically inspired learning based models known as artificial neural networks that have shown extraordinary success in pattern recognition, tend to grow prohibitively large and cumbersome in the presence of large scale multi-dimensional time series biomedical data such as EEG. Consequently, this work aims to develop representative ML and DL models for robust and efficient large scale time series processing. First, we design a novel ML pipeline with efficient feature engineering to process a large scale multi-channel scalp EEG dataset for automated detection of epileptic seizures. With the use of a sophisticated yet computationally efficient time-frequency analysis technique known as harmonic wavelet packet transform and an efficient self-similarity computation based on fractal dimension, we achieve state-of-the-art performance for automated seizure detection in EEG data. Subsequently, we investigate the development of a novel efficient deep recurrent learning model for large scale time series processing. For this, we first study the functionality and training of a biologically inspired neural network architecture known as cellular simultaneous recurrent neural network (CSRN). We obtain a generalization of this network for multiple topological image processing tasks and investigate the learning efficacy of the complex cellular architecture using several state-of-the?art training methods. Finally, we develop a novel deep cellular recurrent neural network (CDRNN) architecture based on the biologically inspired distributed processing used in CSRN for processing time series data. The proposed DCRNN leverages the cellular recurrent architecture to promote extensive weight sharing and efficient, individualized, synchronous processing of multi-source time series data. Experiments on a large scale multi-channel scalp EEG, and a machine fault detection dataset show that the proposed DCRNN offers state-of-the-art recognition performance while using substantially fewer trainable recurrent units.

Vidyaratne, Lasitha S.↗
DOE OSTI2020

FALCON: Framework for Anomaly Detection in Industrial Control Systems

Industrial Control Systems (ICS) are used to control physical processes in critical infrastructure. These systems are used in a wide variety of operations such as water treatment, power generation and distribution, and manufacturing. While the safety and security of these systems are of serious concern, recent reports have shown an increase in targeted attacks aimed at manipulating physical processes to cause catastrophic consequences. This trend emphasizes the need for algorithms and tools that provide resilient and smart attack detection mechanisms to protect ICS. In this paper, we propose an anomaly detection framework for ICS based on a deep neural network. The proposed methodology uses dilated convolution and long short-term memory (LSTM) layers to learn temporal as well as long term dependencies within sensor and actuator data in an ICS. The sensor/actuator data are passed through a unique feature engineering pipeline where wavelet transformation is applied to the sensor signals to extract features that are fed into the model. Additionally, this paper explores four variations of supervised deep learning models, as well as an unsupervised support vector machine (SVM) model for this problem. The proposed framework is validated on Secure Water Treatment testbed results. This framework detects more attacks in a shorter period of time than previously published methods.

97 - MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Traveling Wave Energy Analysis of Faults on Power Distribution Systems

This paper explores the most important factors that define the Traveling Wave (TW) propagation on distribution systems. The factors considered in this work are: the distance to the fault location, the fault type, and the crossing of system elements (such as regulators, capacitor banks, laterals, and extra loads within the protection zones). This work uses a realistic, yet simplified, distribution system composed of two protection zones, in which, several combinations of the previously mentioned factors are considered. The simulated fault measurements undergo a signal processing stage in which, first, they are decomposed into independent modes using the Karrenbauer transform. Second, a time–frequency representation is obtained using the Stationary Wavelet Transform (SWT), dividing the signal into several frequency bands. Finally, the Parseval’s Energy (PE) theorem is applied to calculate the signal energy in each frequency band. A qualitative analysis is performed based on the previously calculated energies to outline which are the factors that most affect the TW energy during propagation. The results show that distance, the presence of regulators, either in the propagation path or upstream, and the type of fault are the main factors that affect TW propagation across the system, and therefore they should be considered for TW-based protection schemes for distribution systems.

Jiménez-Aparicio, Miguel (ORCID:000000016864461X)↗
DOE OSTI2022

Embedded, Real-Time, and Distributed Traveling Wave Fault Location Method Using Graph Convolutional Neural Networks

This work proposes and develops an implementation of a fault location method to provide a fast and resilient protection scheme for power distribution systems. The method analyzes the transient dynamics of traveling waves (TWs) to generate features using the discrete wavelet transform (DWT), which are then used to train several graph convolutional network (GCN) models. Faults are simulated in the IEEE 34-node system, which is divided into three protection zones (PZs). The goal is to identify the PZ in which the fault occurs. The GCN models create a distributed protection scheme, as all nodes are able to retrieve a prediction. Given that message-passing between nodes occurs both during training and in the execution of the model, the resiliency of such schemes to communication losses was analyzed and demonstrated. One of the models, which only uses voltage measurements, was implemented on a Texas Instruments F28379D development board. The execution times were monitored to assess the speed of the protection scheme. It is shown that the proposed method can be executed in approximately a millisecond, which is comparable to existing TW protection in the transmission system. For experimental purposes, a DWT-based detection method is employed. A design of a setup to playback TWs using two development boards is also addressed.

Jiménez-Aparicio, Miguel (ORCID:000000016864461X)↗
DOE OSTI2022

A Novel Approach for Real-Time Quality Monitoring in Machining of Aerospace Alloy through Acoustic Emission Signal Transformation for DNN

Gamma titanium aluminide (γ-TiAl) is considered a high-performance, low-density replacement for nickel-based superalloys in the aerospace industry due to its high specific strength, which is retained at temperatures above 800 °C. However, low damage tolerance, i.e., brittle material behavior with a propensity to rapid crack propagation, has limited the application of γ-TiAl. Any cracks introduced during manufacturing would dramatically lower the useful (fatigue) life of γ-TiAl components, making the workpiece surface’s quality from finish machining a critical component to product quality and performance. To address this issue and enable more widespread use of γ-TiAl, this research aims to develop a real-time non-destructive evaluation (NDE) quality monitoring technique based on acoustic emission (AE) signals, wavelet transform, and deep neural networks (DNN). Previous efforts have opted for traditional approaches to AE signal analysis, using statistical feature extraction and classification, which face challenges such as the extraction of good/relevant features and low classification accuracy. Hence, this work proposes a novel AI-enabled method that uses a convolutional neural network (CNN) to extract rich and relevant features from a two-dimensional image representation of 1D time-domain AE signals (known as scalograms), subsequently classifying the AE signature based on pedigreed experimental data and finally predicting the process-induced surface quality. The results of the present work show good classification accuracy of 80.83% using scalogram images, in-situ experimental data, and a VGG-19 pre-trained neural network, establishing the significant potential for real-time quality monitoring in manufacturing processes.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Deep Learning for Automated Detection and Identification of Migrating American Eel Anguilla rostrata from Imaging Sonar Data

Adult American eels (Anguilla rostrata) are vulnerable to hydropower turbine mortality during outmigration from growth habitat in inland waters to the ocean where they spawn. Imaging sonar is a reliable and proven technology for monitoring of fish passage and migration; however, there is no efficient automated method for eel detection. We designed a deep learning model for automated detection of adult American eels from sonar data. The method employs convolution neural network (CNN) to distinguish between 14 images of eels and non-eel objects. Prior to image classification with CNN, background subtraction and wavelet denoising were applied to enhance sonar images. The CNN model was first trained and tested on data obtained from a laboratory experiment, which yielded overall accuracies of >98% for image-based classification. Then, the model was trained and tested on field data that were obtained near the Iroquois Dam located on the St. Lawrence River; the accuracy achieved was commensurate with that of human experts.

13 HYDRO ENERGY↗
DOE OSTI2021

Tracing the Origin of Moving Groups. III. Detecting Moving Groups in LAMOST DR7

We revisit the moving groups (MGs) in the solar neighborhood with a sample of 91,969 nearby stars constructed from LAMOST DR7. Using the wavelet technique and Monte Carlo simulations, five MGs together with a new candidate located at $V$ ≃ -130 KM s -1 are detected simultaneously in $V$ - $\sqrt{U^2 + 2V^2}$ space. Taking into account the other known MGs, we conclude that MGs in the Galactic disk are spaced by approximately 15–25 km s -1 along $V$ velocity. Furthermore, the origin of detected MGs is analyzed through the distributions of [Fe/H]-[Mg/Fe] and ages. Our results support attributing the origin to the continuous resonant mechanisms probably induced by the bar or spiral arms of the Milky Way.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Optimizing Optical Searches for Supermassive Black Hole Binaries in Active Galactic Nuclei Light Curves: Fourier versus Bayesian Periodicity Detection

Simulations predict that supermassive black hole binaries (SMBHBs) will exhibit periodic brightness variations that may exceed the stochastic variability intrinsic to active galactic nuclei (AGN). In this paper, we simulate SMBHBs with damped random walk (DRW) AGN variability and an added sinusoidal signal from the orbital motion, and test three methods—a generalized Lomb–Scargle periodogram (GLSP), a nested Bayesian sampler (NBS), and a weighted wavelet z-transform (or WWZ)—to determine which is best at recovering the periodicity. Our simulated light curves follow the properties of the Catalina Real-Time Transient Survey (or CRTS), Legacy Survey of Space and Time (LSST), and Zwicky Transient Facility (ZTF) to best inform current and future SMBHB searches. We map a broad range of parameter space and identify which DRW-only light curves best mimic periodicity and pass each method’s model selection. The NBS performs best at detecting periodicity and filtering out DRW-only light curves. Combined candidate selection with both the NBS and GLSP significantly reduces false-positive rates (FPRs) with marginal impact on true-positive rates (TPRs). With this joint model selection pipeline, we find the lowest FPRs in ZTF-like simulations and the highest detection rates in LSST-like simulations. Using a modified computation of the false-alarm probability with GLSP, we efficiently triage LSST AGN light curves (∼10 7 light curves in ∼10–30 hr) and achieve TPRs and FPRs of ∼40% and ∼0.5%, respectively.

Banaszak, Sebastian M. [Vanderbilt Univ., Nashvill↗
DOE OSTI2022

Considerations for Optimizing the Photometric Classification of Supernovae from the Rubin Observatory

The Vera C. Rubin Observatory will increase the number of observed supernovae (SNe) by an order of magnitude; however, it is impossible to spectroscopically confirm the class for all SNe discovered. Thus, photometric classification is crucial, but its accuracy depends on the not-yet-finalized observing strategy of Rubin Observatory's Legacy Survey of Space and Time (LSST). We quantitatively analyze the impact of the LSST observing strategy on SNe classification using simulated multiband light curves from the Photometric LSST Astronomical Time-Series Classification Challenge (PLAsTiCC). First, we augment the simulated training set to be representative of the photometric redshift distribution per SNe class, the cadence of observations, and the flux uncertainty distribution of the test set. Then we build a classifier using the photometric transient classification library snmachine, based on wavelet features obtained from Gaussian process fits, yielding a similar performance to the winning PLAsTiCC entry. We study the classification performance for SNe with different properties within a single simulated observing strategy. We find that season length is important, with light curves of 150 days yielding the highest performance. Cadence also has an important impact on SNe classification; events with median inter-night gap <3.5 days yield higher classification performance. Interestingly, we find that large gaps (>10 days) in light-curve observations do not impact performance if sufficient observations are available on either side, due to the effectiveness of the Gaussian process interpolation. This analysis is the first exploration of the impact of observing strategy on photometric SN classification with LSST.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Aircraft-derived particle fluxes distinguish entrainment zone and decoupled layer nucleation in marine boundary layers

The vertical distribution of freshly nucleated aerosol particles in the marine boundary layer remains poorly constrained, limiting our ability to represent new particle formation in climate models. Here we characterize 3–10 nm particle events, termed small particle events (SPEs), by deriving their vertical turbulent fluxes from aircraft measurements during the Aerosol and Cloud Experiments in the Eastern North Atlantic (ACE-ENA) campaign. To overcome stationarity limitations of traditional eddy covariance methods, we applied continuous wavelet transform analysis to data collected during June–July 2017 and January–February 2018 flights over the Azores. Our flux-based analysis revealed two distinct SPE scenarios with different vertical structures and spatial extents. The first featured nucleation in the entrainment zone, where free tropospheric air entrains into the boundary layer. The second showed nucleation in the decoupled layer, a stratified region between the well-mixed surface layer and cloud-topped upper boundary layer. In both cases, convergence of air masses from different layers diluted preexisting aerosol surface area to very low levels, creating conditions favorable for nucleation and generating strong downward particle fluxes. SPEs occurred in 15 % of flights, challenging prevailing theoretical expectations that new particle formation should rarely occur in marine boundary layers due to high condensation and coagulation sink capacity of sea spray aerosols. Aircraft-derived particle fluxes provide first observational constraints on the vertical location and source strength of likely nucleation regions in the remote marine boundary layer, improving aerosol source representations in climate models and reducing uncertainties in aerosol-cloud interactions.

Rasheeda Satheesh, Ajmal [North Carolina State Uni↗
DOE OSTI2023

Airborne flux measurements of ammonia over the southern Great Plains using chemical ionization mass spectrometry

Abstract. Ammonia (NH3) is an abundant trace gas in the atmosphere and an important player in atmospheric chemistry, aerosol formation and the atmosphere–surface exchange of nitrogen. The accurate determination of NH3 emission rates remains a challenge, partly due to the propensity of NH3 to interact with instrument surfaces, leading to high detection limits and slow response times. In this paper, we present a new method for quantifying ambient NH3, using chemical ionization mass spectrometry (CIMS) with deuterated benzene cations as reagents. The setup aimed at limiting sample–surface interactions and achieved a 1σ precision of 10–20 pptv and an immediate 1/e response rate of < 0.4 s, which compares favorably to the existing state of the art. The sensitivity exhibited an inverse humidity dependence, in particular in relatively dry conditions. Background of up to 10 % of the total signal required consideration as well, as it responded on the order of a few minutes. To showcase the method's capabilities, we quantified NH3 mixing ratios from measurements obtained during deployment on a Gulfstream I aircraft during the HI-SCALE (Holistic Interactions of Shallow Clouds, Aerosols, and Land-Ecosystems) field campaign in rural Oklahoma during May 2016. Typical mixing ratios were 1–10 parts per billion by volume (ppbv) for the boundary layer and 0.1–1 ppbv in the lower free troposphere. Sharp plumes of up to tens of ppbv of NH3 were encountered as well. We identified two of their sources as a large fertilizer plant and a cattle farm, and our mixing ratio measurements yielded upper bounds of 350 ± 50 and 0.6 kg NH3 h−1 for their respective momentary source rates. The fast response of the CIMS also allowed us to derive vertical NH3 fluxes within the turbulent boundary layer via eddy covariance, for which we chiefly used the continuous wavelet transform technique. As expected for a region dominated by agriculture, we observed predominantly upward fluxes, implying net NH3 emissions from the surface. The corresponding analysis focused on the most suitable flight, which contained two straight-and-level legs at ∼ 300 m above ground. We derived NH3 fluxes between 1 and 11 mol km−2 h−1 for these legs, at an effective spatial resolution of 1–2 km. The analysis demonstrated how flux measurements benefit from suitably arranged flight tracks with sufficiently long straight-and-level legs, and it explores the detrimental effect of measurement discontinuities. Following flux footprint estimations, comparison to the NH3 area emissions inventory provided by the U.S. Environmental Protection Agency indicated overall agreement but also the absence of some sources, for instance the identified cattle farm. Our study concludes that high-precision CIMS measurements are a powerful tool for in situ measurements of ambient NH3 mixing ratios, and even allow for the airborne mapping of the air–surface exchange of NH3.

58 GEOSCIENCES↗
DOE OSTI2022

Airborne flux measurements of ammonia over the Southern Great Plains using chemical ionization mass spectrometry

Ammonia (NH 3 ) is an abundant trace gas in the atmosphere and an important player in atmospheric chemistry, aerosol formation and the atmosphere-surface exchange of nitrogen. It is recognized as a major source of aerosol pollution, and it may limit the formation of cloud nuclei in remote or cold parts of the atmosphere. For soil and plants, NH 3 -mediated nitrogen can act as a harmful pollutant or as a desirable nutrient, mostly in natural and agricultural settings, respectively. Agriculture is also the main source of atmospheric NH 3 via volatilization from fertilizers and manure processing in livestock farming. The accurate determination of NH 3 emission rates remains a challenge, partly due to the propensity of NH 3 to interact with instrument surfaces leading to high detection limits and slow response times. In this paper, we present a new method for quantifying ambient NH 3 , using chemical ionization mass spectrometry (CIMS) with deuterated benzene cations as reagents. The setup aimed at limiting sample-surface interactions and achieved a 1-σ precision of 10–20 pptv and an immediate 1/e response rate < 0.4 s, which compares favorably to the existing state of the art. The sensitivity exhibited an inverse humidity dependence, in particular in relatively dry conditions. Background of up to 10 % of the total signal required consideration as well, as it responded on the order of a few minutes. To showcase the method’s capabilities, we quantified NH3 mixing ratios from measurements obtained during deployment on a Gulfstream I aircraft during the HI-SCALE (Holistic Interactions of Shallow Clouds, Aerosols and Land Ecosystems) field campaign in rural Oklahoma during May 2016. Typical mixing ratios were 1–10 parts per billion by volume (ppbv) for the boundary layer and 0.1–1 ppbv in the lower free troposphere. Sharp plumes of up to 10s of ppbv of NH3 were encountered as well. We identified two of their sources as a large fertilizer plant and a cattle farm, and our mixing ratio measurements yielded upper bounds of 350 ± 50 and 0.6 kg NH 3 h –1 for their respective momentary source rates. The fast response of the CIMS also allowed us to derive vertical NH 3 fluxes within the turbulent boundary layer via eddy covariance, for which we chiefly used the continuous wavelet transform technique. As expected for a region dominated by agriculture, we observed predominantly upward fluxes, implying net NH 3 emissions from surface. The corresponding analysis focused on the most suitable flight, which contained two straight-and-level legs at ~300 m above ground. We derived NH 3 fluxes between –4 and 18 mol km –2 h –1 for these legs, at an effective spatial resolution of 1–2 km. The analysis demonstrated how flux measurements benefit from suitably arranged flight tracks with sufficiently long straight-and-level legs, and explores the detrimental effect of measurement discontinuities. Following flux footprint estimations, comparison to the NH 3 area emissions inventory provided by the US Environmental Protection Agency indicated overall agreement, but also the absence of some sources, for instance the identified cattle farm. Our study concludes that high-precision CIMS measurements are a powerful tool for in-situ measurements of ambient NH 3 mixing ratios, and even allow for the airborne mapping of the air-surface exchange of NH 3 .

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

ARM SGP PBLH and MLH datasets from Raman lidar and Doppler lidar

The planetary boundary layer (PBL) plays a critical role in the atmosphere by transferring heat, moisture, and momentum. The warm PBL has a distinct diurnal cycle including the daytime convective mixing layer (ML) and nighttime residual layer developments. Thus, simultaneous determinations of PBL height (PBLH) and ML height (MLH) are necessary for studying PBL characterization and processes. Here, new approaches are developed to provide reliable PBLH and MLH estimates to characterize warm PBL evolution. The approaches use Raman lidar (RL) water vapor mixing ratio (WVMR) and Doppler lidar (DL) vertical velocity measurements at the Southern Great Plains (SGP) atmospheric observatory, which was established by the Atmospheric Radiation Measurement (ARM) User Facility. Compared to widely used lidar aerosol measurements for PBLH, WVMR is a better tracer for PBL vertical mixing. For PBLH, the approach classifies PBL water vapor structures into a few general patterns, then uses a slope method and dynamic threshold method to determine PBLH. For MLH, wavelet analysis is used to reconstruct 2D variance from DL vertical wind velocity measurements according to the turbulence eddy size to minimize the impacts of gravity wave and eddy size on variance calculations; then, a dynamic threshold method is used to determine MLH. Remotely-sensed PBLHs and MLHs are compared with radiosonde measurements based on the Richardson number method. Good agreements between them confirm that the proposed new algorithms are reliable for PBLH and MLH characterization. The algorithms are applied to warm-season RL and ML measurements at the SGP site for five years to study warm-season PBL structure and processes. The weekly composited diurnal evolutions of PBLHs and MLHs in a warm climate were provided to illustrate diurnal and seasonal PBL evolutions. This reliable data set of PBLH and MLH values will be valuable for studying PBL processes, model evolution, and PBL parameterization improvements. The MLH dataset includes the MLH in values of km above ground level. The PBLH dataset includes the PBLH in values of km above ground level, along with a flag ("situation_PBLH") to determine the state of the PBL (1 = Cloudy Condition, 2 = Stable Layer, 3 = Multi-layer WVMR structure, 4 = Well-Mixed PBL, 5 = A de-coupled layer, 6 = Other).

mixing layer height↗
DOE OSTI2020

Deep Learning for Automated Identification of Eels in Sonar Data

Freshwater eels, such as the American eel (Anguilla rostrata) present numerous challenges related to safe downstream fish passage at hydroelectric facilities. One of those challenges is effective monitoring of their abundance, movements, and behavior to facilitate design and operation of eel protection and passage facilities. A previous EPRI study documented the ability of human analysts to reliably identify American eels in data obtained with a 1100/1800 kHz, multibeam sonar. This report describes a project to develop deep learning (a subset of artificial intelligence) tools to automate the time-consuming, subjective process of eel identification in multibeam sonar data. The project exploited new data collected in the laboratory and the existing data from the prior EPRI field study to develop and test deep learning and other data analytic tools, including wavelet filtering, differencing for static object removal, and convolutional neural network analysis. The analysis of the laboratory data demonstrated feasibility of the approach, revealed object characteristics observed with the sonar that distinguish eels from similarly sized and shaped acoustic targets, and provided additional data for algorithm selection and training. Deep learning algorithms trained and tested on the laboratory data alone achieved accuracy rates of greater than 98% when classifying acoustic images of eels and similar-sized neutrally buoyant sticks. The algorithm trained and tested on the pre-existing field data alone, and yielded classification accuracy of 9.3% false positives and 13.3% false negatives when distinguishing between eels and sticks/PVC pipes based on video clips (i.e., multiple, consecutive images). This performance is comparable to the classification accuracy achieved by human analysts in the prior study. The deep learning algorithm trained on a combination of video clips obtained in the laboratory and the field and tested on video clips from the field, was able to distinguish eels from sticks and PVC pipes (a river debris analog) of similar size with 100% accuracy. Outreach to the hardware, software, and end-user communities early in the project helped to identify needs and specify the application space. Outreach to those communities at the end of the project communicated project results and opportunities for further development. The project achieved proof of concept for automated identification of eel in multibeam sonar data. Future work should focus on acquisition of additional data for more robust algorithm training and testing; modification of the software tools to accommodate multiple acoustic targets in the acoustic field at a given time; identification of additional object classes; incorporation of motion in the object identification and classification algorithms; operationalizing the software tools, including integration with other existing sonar data analysis tools; and partnering with hardware and software providers for distribution of the software tools with their commercial products.

13 HYDRO ENERGY↗
DOE OSTI2020

Completion design improvement using a deep convolutional network

Maximizing stimulated natural and hydraulic fracture network is one of the primary hydraulic fracturing concerns for economic production from a horizontal shale gas well. Geomechanical facies and preexisting fractures in each stage are identified based on similarities in formation characteristics to optimize the locations of perforation clusters. This often requires analyzing large volumes of drilling, Logging While Drilling (LWD) and Measurement While Drilling (MWD) data. In this paper, we develop a methodology that calculates the mechanical specific energy (MSE) using real-time drill string acceleration signals directly from its definition. High resolution vibration signals have been collected using a tri-axial accerlometer, which was an auxiliary tool included in acoustic borehole imager. This technique provides a cost-efficient solution for engineered completion design. Furthermore, we adopt deep Convolutional Neural Network (CNN) with signal processing to build a data pipeline that effectively extracts patterns from dynamic acceleration signals for rock lateral MSE classification. First, we apply discrete wavelet transform and Short-Time Fourier Transform (STFT) for signal denoising and pattern recognition. Then we construct an image dataset using multi-scale image fusion at pixel level from 3 sensor channels, including axial, lateral acceleration spectrograms and zero-padded revolutions per minute (RPM). The resulted RGB image dataset includes 4,000 images of 5 MSE ranges with various rock strength conditions. Our results demonstrate that the proposed deep learning model can achieve more than 90% classification accuracy. The deep learning results, as a reference source, were applied in selected Marcellus Shale Energy and Environmental Lab (MSEEL) wells engineered completion located in the Marcellus shale gas site.

03 NATURAL GAS↗
DOE OSTI2023

Efficient generalized boundary detection

Fast, efficient, and robust compression-based methods for detecting boundaries in arbitrary datasets, including sequences (1D datasets), are desired. The methods, each employing three simple algorithms, approximate the information distance between two adjacent sliding windows within a dataset. One of the algorithms calculates an initial ordered list of subsequences; while a second algorithm updates the ordered list of subsequences by dropping a first entry and appending a last entry rather than calculating completely new ordered lists with each iteration. Large values in the distance metric are indicative of boundary locations. A smoothed z-score or a wavelet-based algorithm may then be used to locate peaks in the distance metric, thereby identifying boundary locations. An adaptive version of the method employs a collection of window sizes and corresponding weighting functions, making it more amenable to real datasets with unknown, complex, and changing structures.

Ting, Christina↗