Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “pattern recognition”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28

Big Data Analytics on Fiber-Optical Distributed Acoustic Sensing with Rayleigh Enhancements

his paper presents a technique to use deep neural network on data analysis of distributed acoustic sensing (DAS) system built by phase-sensitive optical time-domain reflectometry (ϕ-OTDR) with Rayleigh enhancement. Rayleigh backscattering is enhanced by ultrafast laser direct writing technique that promise the excellent sensitivity. And the use of artificial intelligence (AI) drastically improve the efficiency of data pattern recognition.

Peng, Zhaoqiang↗

Univariate Time Series Prediction of Solar Power Using a Hybrid Wavelet-ARMA-NARX Prediction Method

This paper proposes a new hybrid method for super short-term solar power prediction. Solar output power usually has a complex, nonstationary, and nonlinear characteristic due to intermittent and time varying behavior of solar radiance. In addition, solar power dynamics is fast and is inertia less. An accurate super short-time prediction is required to compensate for the fluctuations and reduce the impact of solar power penetration on the power system. The objective is to predict one step-ahead solar power generation based only on historical solar power time series data. The proposed method incorporates discrete wavelet transform (DWT), Auto-Regressive Moving Average (ARMA) models, and Recurrent Neural Networks (RNN), while the RNN architecture is based on Nonlinear Auto-Regressive models with eXogenous inputs (NARX). The wavelet transform is utilized to decompose the solar power time series into a set of richer-behaved forming series for prediction. ARMA model is employed as a linear predictor while NARX is used as a nonlinear pattern recognition tool to estimate and compensate the error of wavelet-ARMA prediction. The proposed method is applied to the data captured from UCLA solar PV panels and the results are compared with some of the common and most recent solar power prediction methods. The results validate the effectiveness of the proposed approach and show a considerable improvement in the prediction precision.

Nazaripouya, Hamidreza↗

Challenges and Opportunities in Deep Reinforcement Learning With Graph Neural Networks: A Comprehensive Review of Algorithms and Applications

Deep reinforcement learning (DRL) has empowered a variety of artificial intelligence fields, including pattern recognition, robotics, recommendation-systems, and gaming. Similarly, graph neural networks (GNN) have also demonstrated their superior performance in supervised learning for graph-structured data. In recent times, the fusion of GNN with DRL for graph-structured environments has attracted a lot of attention. Here, this paper provides a comprehensive review of these hybrid works. These works can be classified into two categories: (1) algorithmic enhancement, where DRL and GNN complement each other for better utility; (2) application-specific enhancement, where DRL and GNN support each other. This fusion effectively addresses various complex problems in engineering and life sciences. Based on the review, we further analyze the applicability and benefits of fusing these two domains, especially in terms of increasing generalizability and reducing computational complexity. Finally, the key challenges in integrating DRL and GNN, and potential future research directions are highlighted, which will be of interest to the broader machine learning community.

97 MATHEMATICS AND COMPUTING↗

Automated isotope identification algorithm using artificial neural networks

There is a need to develop an algorithm that can determine the relative activities of radio-isotopes in a large dataset of low-resolution gamma-ray spectra that contains a mixture of many radio-isotopes. Low-resolution gamma-ray spectra that contain mixtures of radio-isotopes often exhibit feature over-lap, requiring algorithms that can analyze these features when overlap occurs. While machine learning and pattern recognition algorithms have shown promise for the problem of radio-isotope identification, their ability to identify and quantify mixtures of radio-isotopes has not been studied. Because machine learning algorithms use abstract features of the spectrum, such as the shape of overlapping peaks and Compton continuum, they are a natural choice for analyzing radio-isotope mixtures. An artificial neural network (ANN) has be trained to calculate the relative activities of 32 radio-isotopes in a spectrum. Furthermore, the ANN is trained with simulated gamma-ray spectra, allowing easy expansion of the library of target radio-isotopes. In this paper we present our initial algorithms based on an ANN and evaluate them against a series measured and simulated spectra.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

On/Off State Classification of a Reactor Facility Using Gas Effluence Measurements

Inferring on/off operational state of a reactor facility using measurements from an independent monitoring system is critical to the assessment of its compliance to agreements. In this paper, we consider the problem of inferring on/off state of a reactor facility using measurements of Ar-41, Cs-138, and Xe-138 gas effluence types collected at the facility’s off-gas stack. We present classifiers based on thresholding measurements of individual effluence types, and then present fusers that combine their outputs or measurements. We present five fusers based on simple majority rule, Chow’s pattern recognition function, Fisher’s combined p-value statistic, physics-based Poisson radiation counts model, and correlation coefficient method. In addition, we also test five machine learning methods based on non-linear classifiers, which are available as R packages. Finally, our results show that: (i) these gas effluence measurements are effective in inferring on/off state of a reactor facility; for example, best fusers achieve ~97% detection at ~1% false alarm rate, and (ii) fusers that combine all effluence types based on physics-based models, correlation coefficient and Fisher’s method outperform simple majority rule, Chow’s fusers and machine learning methods, as well as when they are applied to individual and pairs of effluence types.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

The Past, Present and Future of Structural Health Monitoring: An Overview of Three Ages

This paper presents an overview of the discipline of structural health monitoring (SHM), organised in terms of three proposed ages. The first age is delineated by the prehistory of SHM and the period where nondestructing testing methods evolved into an organised set of principles built upon physics-based models; this age ended when the model-based approaches reached an impasse in terms of their ability to properly deal with real-world problems. The second age of SHM began with a transition to data-based methods based on statistical pattern recognition, which provided a holistic approach to SHM problems for the first time. This age arguably ended when the methods foundered in situations where the necessary training data were scarce. It is argued here that the third age began with the development of population-based SHM, which has been designed to overcome the problem of data scarcity. As there is very limited space in a single article to provide a comprehensive overview, an appendix has been provided here that gives a very systematic bibliography of SHM reviews—a meta-bibliography.

60 APPLIED LIFE SCIENCES↗

SU-C-304-04: A Compact Modular Computational Platform for Automated On-Board Imager Quality Assurance

Purpose: Traditionally, the assessment of X-ray tube output and detector positioning accuracy of on-board imagers (OBI) has been performed manually and subjectively with rulers and dosimeters, and typically takes hours to complete. In this study, we have designed a compact modular computational platform to automatically analyze OBI images acquired with in-house designed phantoms as an efficient and robust surrogate. Methods: The platform was developed as an integrated and automated image analysis-based platform using MATLAB for easy modification and maintenance. Given a set of images acquired with the in-house designed phantoms, the X-ray output accuracy was examined via cross-validation of the uniqueness and integration minimization of important image quality assessment metrics, while machine geometric and positioning accuracy were validated by utilizing pattern-recognition based image analysis techniques. Results: The platform input was a set of images of an in-house designed phantom. The total processing time is about 1–2 minutes. Based on the data acquired from three Varian Truebeam machines over the course of 3 months, the designed test validation strategy achieved higher accuracy than traditional methods. The kVp output accuracy can be verified within +/−2 kVp, the exposure accuracy within 2%, and exposure linearity with a coefficient of variation (CV) of 0.1. Sub-millimeter position accuracy was achieved for the lateral and longitudinal positioning tests, while vertical positioning accuracy within +/−2 mm was achieved. Conclusion: This new platform delivers to the radiotherapy field an automated, efficient, and stable image analysis-based procedure, for the first time, acting as a surrogate for traditional tests for LINAC OBI systems. It has great potential to facilitate OBI quality assurance (QA) with the assistance of advanced image processing techniques. In addition, it provides flexible integration of additional tests for expediting other OBI quality assurance tests, such as 2D/3D image quality, making completely automated QA possible. Research Funding from Varian Medical Systems Inc. . Dr. Sasa Mutic receives compensation for providing patient safety training services from Varian Medical Systems, the sponsor of this study.

60 APPLIED LIFE SCIENCES↗

Design of a Robust Memristive Spiking Neuromorphic System with Unsupervised Learning in Hardware

Spiking neural networks (SNN) offer a power efficient, biologically plausible learning paradigm by encoding information into spikes. The discovery of the memristor has accelerated the progress of spiking neuromorphic systems, as the intrinsic plasticity of the device makes it an ideal candidate to mimic a biological synapse. Despite providing a nanoscale form factor, non-volatility, and low-power operation, memristors suffer from device-level non-idealities, which impact system-level performance. To address these issues, this article presents a memristive crossbar-based neuromorphic system using unsupervised learning with twin-memristor synapses, fully digital pulse width modulated spike-timing-dependent plasticity, and homeostasis neurons. Additionally, the implemented single-layer SNN was applied to a pattern-recognition task of classifying handwritten-digits. The performance of the system was analyzed by varying design parameters such as number of training epochs, neurons, and capacitors. Furthermore, the impact of memristor device non-idealities, such as device-switching mismatch, aging, failure, and process variations, were investigated and the resilience of the proposed system was demonstrated.

97 MATHEMATICS AND COMPUTING↗

Studying CPU and memory utilization of applications on Fujitsu A64FX and Nvidia Grace Superchip

ARM-based manycore CPU architectures are well-positioned to provide the rising memory throughput requirements of modern data intensive scientific applications in High Performance Computing (HPC). The Fujitsu A64FX CPU platform is based on the ARM v8.2A architecture, and is the processor of the flagship Japanese supercomputer - "Fugaku", which was previously ranked as the #1 supercomputer in the world according to the Top500 list. The Nvidia Grace superchip features 144 Neoverse V2 cores based on the ARMv9 architecture with 4x128b SVE2, providing exceptional computational power. The chip supports up to 480GB of memory, making it ideal for AI, machine learning, and scientific computing workloads. In this paper, we conduct a thorough performance exploration of a variety of parallel bandwidth-sensitive benchmarks and applications compiled with the native Fujitsu compiler on a Fugaku A64FX compute node and ARM (LLVM) Compiler on an NVIDIA Grace superchip compute node, engaging all the computational cores per cluster using OpenMP multithreading (assuming the cores can drive the available bandwidth). Our ultimate goals are to study the resource utilization of scientific applications and benchmarks on A64FX and Grace superchip, considering graph application scenarios ( GAP Benchmark suite) and eleven appli- cation proxies from the Rodinia heterogeneous benchmark suite (considering domains such as Data Mining, Bioinformatics, Fluid Dynamics, Pattern Recognition, etc.). Through exhaustive performance monitoring, we quantify the resource utilization of diverse OpenMP-based HPC applications on both the Fujitsu A64FX and the Nvidia Grace Superchip platforms.

benchmarking, Performance Analysis, High performan↗

Quantum Transfer Learning to Boost Dementia Detection

Dementia is a devastating condition with profound implications for individuals, families, and healthcare systems. Early and accurate detection of dementia is critical for timely intervention and improved patient outcomes. While classical machine learning and deep learning approaches have been explored extensively for dementia prediction, these solutions often struggle with high-dimensional biomedical data and large-scale datasets, quickly reaching computational and performance limitations. To address this challenge, quantum machine learning (QML) has emerged as a promising paradigm, offering faster training and advanced pattern recognition capabilities. This work aims to demonstrate the potential of quantum transfer learning (QTL) to enhance the performance of a weak classical deep learning model applied to a binary classification task for dementia detection. Besides, we show the effect of noise on the QTL-based approach, investigating the reliability and robustness of this method. Using the OASIS 2 dataset, we show how quantum techniques can transform a suboptimal classical model into a more effective solution for biomedical image classification, highlighting their potential impact on advancing healthcare technology.

Bhowmik, Sounak [University of Tennessee, Knoxvill↗

Machine Learning in Multimodal Medical Imaging

Machine learning techniques have been increasingly applied in the medical imaging field for developing computer-aided diagnosis and prognosis models. Multimodal medical imaging can provide us with separate yet complementary structure and function information of a patient study and hence has transformed the way we study living bodies. Therefore, using machine learning techniques to deal with multimodal medical images is much more challenging due to the diversity of biophysical-biochemical mechanisms. In these years, researchers mainly adapt modern machine learning and pattern recognition techniques such as supervised, unsupervised, semi-supervised, and deep learning to solve multimodal medical imaging related problems.

60 APPLIED LIFE SCIENCES↗

Quantum Cascade Laser Infrared Spectroscopy for Online Monitoring of Hydroxylamine Nitrate

We describe a new approach for high sensitivity and real-time online measurements to monitor the kinetics in the processing of nuclear materials and other chemical reactions. Mid infrared (Mid-IR) quantum cascade laser (QCL) high-resolution spectroscopy was used for rapid and continuous sampling of nitrates in aqueous and organic reactive systems, using pattern recognition analysis and high sensitivity to detect and identify chemical species. In this standoff or off-set method, the collection of a sample for analysis is not required. To perform the analysis, a flow cell was used for in situ sampling of a liquid slipstream. A prototype was designed based on attenuated total reflection (ATR) coupled with the QCL beam to detect and identify chemical changes and be deployed in hostile environments, either radiological or chemical. The limit of detection (LOD) and the limit of quantification (LOQ) at 3 σ for hydroxylamine nitrate ranged from 0.3 to 3 and from 3.5 to 10 g·L −1 , respectively, for the nitrate system at three peaks with wavelengths between 3.8 and 9.8 μ m.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Beyond PCA: Additional Dimension Reduction Techniques to Consider in the Development of Climate Fingerprints

Abstract Dimension reduction techniques are an essential part of the climate analyst’s toolkit. Due to the enormous scale of climate data, dimension reduction methods are used to identify major patterns of variability within climate dynamics, to create compelling and informative visualizations, and to quantify major named modes such as El Niño–Southern Oscillation. Principal components analysis (PCA), also known as the method of empirical orthogonal functions (EOFs), is the most commonly used form of dimension reduction, characterized by a remarkable confluence of attractive mathematical, statistical, and computational properties. Despite its ubiquity, PCA suffers from several difficulties relevant to climate science: high computational burden with large datasets, decreased statistical accuracy in high dimensions, and difficulties comparing across multiple datasets. In this paper, we introduce several variants of PCA that are likely to be of use in climate sciences and address these problems. Specifically, we introduce non-negative , sparse , and tensor PCA and demonstrate how each approach provides superior pattern recognition in climate data. We also discuss approaches to comparing PCA-family results within and across datasets in a domain-relevant manner. We demonstrate these approaches through an analysis of several runs of the E3SM climate model from 1991 to 1995, focusing on the simulated response to the Mt. Pinatubo eruption; our findings are consistent with a recently identified stratospheric warming fingerprint associated with this type of stratospheric aerosol injection.

Weylandt, Michael↗

Application of a convolutional neural network in permeability prediction: A case study in the Jacksonburg-Stringtown oil field, West Virginia, USA

Permeability is a critical parameter for understanding subsurface fluid flow behavior, managing reservoirs, enhancing hydrocarbon recovery, and sequestering carbon dioxide. In general, permeability is measured in the laboratory based on subsurface core samples, calculated from well logs or estimated from well tests. However, laboratory measurements and well tests are expensive, time-consuming, and usually limited to a few core samples or wells in a hydrocarbon field or carbon storage site. Machine-learning techniques are good options for generating a rapid, robust, and cost-effective permeability prediction model because of their strengths to recognize the potential interrelationships between input and output variables. Convolutional neural networks (CNN), as a good pattern recognition algorithm, are widely used in image processing, natural language processing, and speech recognition, but are rarely used with regression problems and even less often in reservoir characterization. We have developed a CNN regression model to estimate the permeability in the Jacksonburg-Stringtown oil field, West Virginia, which is a potential carbon storage site and enhanced oil recovery operations field. We also evaluate the concept of the geologic feature image, which is converted from geophysical well logs. Five variables, including two commonly available conventional well logs (the gamma rays [GRs] and bulk density) and three well-log-derived variables (the slopes of the GR and bulk density curves, and shale content), are used to generate a geologic feature image. The CNN treats the geologic feature image as the input and the permeability as the desired output. In addition, the permeability predicted using traditional backpropagation artificial neural networks, which are optimized by genetic algorithms and particle swarm optimization, is compared with the permeability estimated using our CNN. Our results indicate that the CNN regression model provides more accurate permeability predictions than the traditional neural network.

Geochemistry & Geophysics↗

2021 Smoky Mountains Conference Data Challenge Synthetic-to-Real Domain Adaptation for Autonomous Driving Dataset

The dataset is comprised of both real and synthetic images from a vehicle's forward-facing camera. Each camera image is accompanied by a corresponding pixel-level semantic segmentation image (all files are .png files). In total, the dataset contains 5600 images in the training/validation set and 1400 images in the testing set. The training dataset contains mostly synthetic RGB images collected with a wide range of weather and lighting conditions using the CARLA simulator [1]. In addition, the training data also includes a small pre-selected subset of data from the Cityscapes training dataset – which is comprised of RGB-segmentation image pairs from driving scenarios in various European cities [2]. The testing data is split into three sets. The first set contains synthetic CARLA images with weather/lighting conditions that were not present in the training set. The second set is a subset of the Cityscapes testing dataset. Finally, the third set is an unknown testing set which will not be revealed to the participants until after the submission deadline. [1] Dosovitskiy, A., Ros, G., Codevilla, F., Lopez, A., and Koltun, V. (2017, October). CARLA: An open urban driving simulator. In Conference on robot learning (pp. 1-16). PMLR. [2] Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., ... and Schiele, B. (2016). The cityscapes dataset for semantic urban scene understanding. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 3213-3223).

99 GENERAL AND MISCELLANEOUS↗

Stabilization of the 81-channel coherent beam combination using machine learning

We develop a rapidly converging algorithm for stabilizing a large channel-count diffractive optical coherent beam combination. An 81-beam combiner is controlled by a novel, machine-learning based, iterative method to correct the optical phases, operating on an experimentally calibrated numerical model. A neural-network is trained to detect phase errors based on interference pattern recognition of uncombined beams adjacent to the combined one. Due to the non-uniqueness of solutions in the full space of possible phases, the network is trained within a limited phase perturbation/error range. This also reduces the number of samples needed for training. Simulations have proven that the network can converge in one step for small phase perturbations. When the trained neural-network is applied to a realistic case of 360 degree full range, an iterative scheme exploits random walking at the beginning, with the accuracy of prediction on phase feedback direction, to allow the neural-network to step into the training range for fast convergence. This neural-network-based iterative method of phase detection works tens of times faster than the commonly used stochastic parallel gradient descent approach (SPGD) using a single-detector and random dither when both are tested with random phase perturbations.

Wang, Dan↗

Identifying Muon Neutrino Charged-Current Interactions in the MicroBooNE Detector

The MicroBooNE experiment is a short-baseline neutrino experiment at the Fermi National Accelerator Laboratory (FNAL) in the US, receiving a highly pure muon neutrino beam from the Booster Neutrino Beam (BNB) and taking data since October 2015. The main physics goal of MicroBooNE is to clarify the nature of the low-energy excess of electron-like events observed by the MiniBooNE Cherenkov detector, which due to its detector technology is unable to resolve whether the observed excess shower-like events are due to electrons or photons. Instead, MicrooBooNE employs cutting-edge liquid argon time projection chamber (LArTPC) technology, which offers excellent spatial and calorimetric resolution, which makes it possible to reconstruct complex neutrino interactions and to efficiently distinguish different final state particle types. This thesis presents a fully-automated event selection of interactions of the types ν μ +Ar → μ - + X and ν μ + Ar → μ - + p + X developed using the Pandora multi-algorithm approach to pattern recognition for LArTPC experiments. The analysis in this work is performed on a subset of the MicroBooNE Run 1 dataset corresponding to 4.52 × 10 19 protons on target acquired by the MicroBooNE detector between February and October 2016. The analysis quantifies the main signal and background interaction channels that produce a reconstructed neutrino interaction with one and two particles in the final state, and quantifies the extent to which different aspects of the Pandora reconstruction affect the selection performance. MicroBooNE is a surface detector, and therefore cosmic-ray tracks are the main observed background. A direction fitting procedure has been implemented in this analysis to formulate directional probabilities, using the Bethe equation and the high-resolution calorimetric information of MicroBooNE, to reduce this cosmic-ray background. This functionality is used to enhance the efficiency of the Pandora cosmic ray tagging logic, and the impact of this procedure on the reconstruction and event selection performance is analysed. The result of this study is two fully-automated selections of ν μ +Ar → μ - + X (57.91% pure) and ν μ + Ar → μ - + p + X (78.30% pure) with efficiencies of 64.35% and 62.65%, respectively.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗