Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Convolutional neural networks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Search of strong lens systems in the Dark Energy Survey using convolutional neural networks

We present our search for strong lens, galaxy-scale systems in the first data release of the Dark Energy Survey (DES), based on a color-selected parent sample of 18 745 029 luminous red galaxies (LRGs). We used a convolutional neural network (CNN) to grade this LRG sample with values between 0 (non-lens) and 1 (lens). Our training set of mock lenses is data-driven, that is, it uses lensed sources taken from HST-COSMOS images and lensing galaxies from DES images of our LRG sample. A total of 76 582 cutouts were obtained with a score above 0.9, which were then visually inspected and classified into two catalogs. The first one contains 405 lens candidates, of which 90 present clear lensing features and counterparts, while the other 315 require more evidence, such as higher resolution imaging or spectra, to be conclusive. A total of 186 candidates are newly identified by our search, of which 16 are among the 90 most promising (best) candidates. The second catalog includes 539 ring galaxy candidates. This catalog will be a useful false positive sample for training future CNNs. For the 90 best lens candidates we carry out color-based deblending of the lens and source light without fitting any analytical profile to the data. This method is shown to be very efficient in the deblending, even for very compact objects and for objects with a complex morphology. Finally, from the 90 best lens candidates, we selected 52 systems with one single deflector to test an automated modeling pipeline that has the capacity to successfully model 79% of the sample within an acceptable computing runtime.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Rotational and reflectional equivariant convolutional neural network for data-limited applications: Multiphase flow demonstration

This article deals with approximating steady-state particle-resolved fluid flow around a fixed particle of interest under the influence of randomly distributed stationary particles in a dispersed multiphase setup using convolutional neural network (CNN). The considered problem involves rotational symmetry about the mean velocity (streamwise) direction. Thus, this work enforces this symmetry using SE(3)-equivariant, special Euclidean group of dimension 3, CNN architecture, which is translation and three-dimensional rotation equivariant. This study mainly explores the generalization capabilities and benefits of a SE(3)-equivariant network. Accurate synthetic flow fields for Reynolds number and particle volume fraction combinations spanning over a range of [86.22, 172.96] and [0.11, 0.45], respectively, are produced with careful application of symmetry-aware data-driven approach.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

QuCNN : A Quantum Convolutional Neural Network with Entanglement Based Backpropagation

Quantum Machine Learning continues to be a highly active area of interest within Quantum Computing. Many of these approaches have adapted classical approaches to the quantum settings, such as QuantumFlow, etc. We push forward this trend, and demonstrate an adaption of the Classical Convolutional Neural Networks to quantum systems - namely QuCNN. QuCNN is a parameterised multi-quantum-state based neural network layer computing similarities between each quantum filter state and each quantum data state. With QuCNN, back propagation can be achieved through a single-ancilla qubit quantum routine. QuCNN is validated by applying a convolutional layer with a data state and a filter state over a small subset of MNIST images, comparing the backpropagated gradients, and training a filter state against an ideal target state.

high performance computing, quantum computing↗
DOE OSTI2020

Neutrino interaction classification with a convolutional neural network in the DUNE far detector

The Deep Underground Neutrino Experiment is a next-generation neutrino oscillation experiment that aims to measure $CP$-violation in the neutrino sector as part of a wider physics program. A deep learning approach based on a convolutional neural network has been developed to provide highly efficient and pure selections of electron neutrino and muon neutrino charged-current interactions. The electron neutrino (antineutrino) selection efficiency peaks at 90% (94%) and exceeds 85% (90%) for reconstructed neutrino energies between 2-5 GeV. The muon neutrino (antineutrino) event selection is found to have a maximum efficiency of 96% (97%) and exceeds 90% (95%) efficiency for reconstructed neutrino energies above 2 GeV. When considering all electron neutrino and antineutrino interactions as signal, a selection purity of 90% is achieved. These event selections are critical to maximize the sensitivity of the experiment to $CP$-violating effects.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

Convolutional Neural Networks for Signal Detection

Currently, traditional methods such as short-term average/long-term average (STA/LTA) are used to detect arrivals in three-component seismic waveform data. Accurately establishing the identity and arrival of these waves is helpful in detecting and locating seismic events. Convolutional Neural Networks (CNNs) have been shown to significantly improve performance at local distances. This work will expand the use of CNNs to more remote distances and lower magnitudes. Sandia National Labs (SNL) will explore the advantages and limits of a particular approach and investigate requirements for expanding this technique to different types, distances, and magnitudes of events in the future. The team will describe detailed performance results of this method tuned on a curated dataset from Utah with its expert-defined arrival picks.

58 GEOSCIENCES↗
DOE OSTI2022

Charge-density based convolutional neural networks for stacking fault energy prediction in concentrated alloys

A descriptor-less machine learning (ML) model based only on charge density images extracted from density functional theory (DFT) is developed to predict stacking fault energies (SFE) in concentrated alloys. The model is based on convolutional neural networks (CNNs) as one of the promising ML techniques for dealing with complex images and data. Identification of correct descriptors is a key bottleneck to develop ML models for predicting materials properties. Often, in most ML models, textbook physical descriptors such as atomic radius, valence charge and electronegativity are used as descriptors which have limitations because these properties change in concentrated alloys when multiple elements are mixed to form a solid solution. Here, we illustrate that, within the scope of DFT, the search for descriptors can be circumvented by electronic charge density, which is the backbone of the Kohn-Sham DFT and describes the system completely. The performance of our model is demonstrated by predicting SFE of concentrated alloys with an RMSE and R 2 of 6.18 mJ/m 2 and 0.87, respectively, validating the accuracy of the proposed approach.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Data-Driven Validation of NOvA's Convolutional Neural Network for Electron (Anti)Neutrino Selection

NOvA is a long-baseline neutrino oscillation experiment, designed to make measurements of several oscillation parameters using muon neutrino disappearance and electron neutrino appearance. It consists of two functionally equivalent detectors and utilizes the Fermilab NuMI neutrino beam. NOvA uses a convolutional neural network for particle identification of electron neutrino events with a validation process that includes several data-driven techniques. These Muon Removed studies ensure that our classifier performs the same on data as it does on simulation. In particular, Muon Removed Electron-Added studies involve selecting muon neutrino charged current events from both data and simulation and replacing the muon with a simulated electron of similar energy. For Muon Removed Bremsstrahlung and Muon Removed Decay-in-Flight studies, we remove muonic hits from cosmic muons that have either experienced Bremsstrahlung radiation or decayed in flight, producing samples of pure electromagnetic showers. Each of these electron neutrino-like samples are then evaluated by our classifier to obtain selection efficiencies. Our most recent analysis showed good agreement in the electron selection efficiency between data and simulation using these techniques. Furthermore, these cross-checks can be extended to corrections to our predicted electron neutrino signal. The impact of one such set of corrections on the overall analysis results were also evaluated in thesis.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Predicting Mechanical Properties from Microstructure Images in Fiber-Reinforced Polymers Using Convolutional Neural Networks

Evaluating the mechanical response of fiber-reinforced composites can be extremely time-consuming and expensive. Machine learning (ML) techniques offer a means for faster predictions via models trained on existing input–output pairs and have exhibited success in composite research. This paper explores a fully convolutional neural network modified from StressNet, which was originally used for linear elastic materials, and extended here for a non-linear finite element (FE) simulation to predict the stress field in 2D slices of segmented tomography images of a fiber-reinforced polymer specimen. The network was trained and evaluated on data generated from the FE simulations of the exact microstructure. The testing results show that the trained network accurately captures the characteristics of the stress distribution, especially on fibers, solely from the segmented microstructure images. The trained model can make predictions within seconds in a single forward pass on an ordinary laptop, given the input microstructure, compared to 92.5 h to run the full FE simulation on a high-performance computing cluster. These results show promise in using ML techniques to conduct fast structural analysis for fiber-reinforced composites and suggest a corollary that the trained model can be used to identify the location of potential damage sites in fiber-reinforced polymers.

Sun, Yixuan (ORCID:0000000311093380)↗
DOE OSTI2022

Convolutional neural networks for intra-hour solar forecasting based on sky image sequences

Accurate and timely solar forecasts play an increasingly critical role in power systems. Compared to longer forecasting timescales, very short-term solar forecasting has lagged behind in both research and practice. In this paper, we propose deep convolutional neural networks (CNNs) to provide operational intra-hour (10-minute-ahead to 60-minute-ahead) solar forecasts. We develop two CNN structures inspired by a widely-used CNN architecture. The CNNs are tailored to our solar forecasting regression tasks and rely solely on sky image sequences. Case studies based on six years of data (over 150,000 data points) demonstrate that the best CNN model has forecast skill scores of 20%-39% over the naive persistence of cloudiness benchmark, even at these very short timescales. The CNNs also have consistently superior performance when compared to shallow machine learning models with meteorological predictors, where the improvement averages around 7%. The sensitivity analyses show that the sky image length, resolution, and weather conditions have impacts on the deep learning model accuracy. In our intra-hour problem with specific setups, two sky images with a 10-minute 128 x 128 resolution yield the most accurate forecasts. Current limitations, future work, and deployment challenges and solutions are also discussed.

14 SOLAR ENERGY↗
DOE OSTI2022

A Convolutional Neural Network Model for Battery Capacity Fade Curve Prediction using Early Life Data

Herein, early prediction of battery performance degradation trends can facilitate research of new materials and cell designs, rapid deployment of batteries in real-world applications, timely replacement of batteries in critical applications, and even the secondary use market. In this study, we design a convolutional neural network model to predict the entire battery capacity fade curve - a critical indicator of battery performance degradation - using first 100 cycles of data (~ three weeks of testing). We use the discharge voltage-capacity curves as input to the model and automate the feature extraction process through the convolutional layers of the network. Our approach can predict the per cycle capacity fade rate and rollover cycle (knee point) in the capacity fade curve, which indicate the onset of rapid capacity decay. On the publicly available graphite/LiFePO 4 battery dataset, optimized networks predict the capacity fade curves, rollover cycle, and end of life with 3.7% (worst-case), 19%, and 17% mean absolute percentage errors, respectively.

25 ENERGY STORAGE↗
DOE OSTI2022

Predicting path-dependent diffusion barrier spectra in vast compositional space of multi-principal element alloys via convolutional neural networks

The emergent multi-principal element alloys (MPEAs) provide a vast compositional space to search for novel materials for technological advances. How to screen promising compositions from such an ample design space for targeted properties is a grand challenge. In this report, we demonstrate the state-of-the-art deep learning technology—convolutional neural network (CNN)—in predicting path-dependent vacancy migration energy barrier spectra, which are critical to diffusion behavior and many high-temperature properties, in the hyperdimensional composition space of MPEAs. The developed CNN model, fully capturing local chemical features surrounding each vacancy, accurately and efficiently predicts migration energy barrier of MPEAs with different degrees of chemical short-range order and at any unseen compositions. By varying the size of the local region encapsulating vacancy in the CNN model, we reveal that the length scale influencing vacancy migration is surprisingly extensive, up to its six nearest neighboring shells. The efforts of the CNN model make it promising for developing a database of diffusion barriers for various MPEA systems, which would have profound implications for accelerating alloy screening and discovering new compositions with desirable properties.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Identification and denoising of radio signals from cosmic-ray air showers using convolutional neural networks

Radio pulses generated by cosmic-ray air showers can be used to reconstruct key properties like the energy and depth of the electromagnetic component of cosmic-ray air showers. Radio detection threshold, influenced by natural and anthropogenic radio background, can be reduced through various techniques. In this work, we demonstrate that convolutional neural networks (CNNs) are an effective way to lower the threshold. We developed two CNNs: a classifier to distinguish radio signal waveforms from background noise and a denoiser to clean contaminated radio signals. Following the training and testing phases, we applied the networks to air-shower data triggered by scintillation detectors of the prototype station for the enhancement of IceTop, IceCube’s surface array at the South Pole. Over a four-month period, we identified 554 cosmic-ray events in coincidence with IceTop, approximately five times more compared to a reference method based on a cut on the signal-to-noise ratio. Comparisons with IceTop measurements of the same air showers confirmed that the CNNs reliably identified cosmic-ray radio pulses and outperformed the reference method. Additionally, we find that CNNs reduce the false-positive rate of air-shower candidates and effectively denoise radio waveforms, thereby improving the accuracy of the power and arrival time reconstruction of radio pulses.

Abbasi, R↗
DOE OSTI2023

Recurrent and convolutional neural networks for sequential multispectral optoacoustic tomography ( MSOT ) imaging

Abstract Multispectral optoacoustic tomography (MSOT) is a beneficial technique for diagnosing and analyzing biological samples since it provides meticulous details in anatomy and physiology. However, acquiring high through‐plane resolution volumetric MSOT is time‐consuming. Here, we propose a deep learning model based on hybrid recurrent and convolutional neural networks to generate sequential cross‐sectional images for an MSOT system. This system provides three modalities (MSOT, ultrasound, and optoacoustic imaging of a specific exogenous contrast agent) in a single scan. This study used ICG‐conjugated nanoworms particles (NWs‐ICG) as the contrast agent. Instead of acquiring seven images with a step size of 0.1 mm, we can receive two images with a step size of 0.6 mm as input for the proposed deep learning model. The deep learning model can generate five other images with a step size of 0.1 mm between these two input images meaning we can reduce acquisition time by approximately 71%.

Juhong, Aniwat↗
DOE OSTI2025

Complementing Dynamical Downscaling With Super‐Resolution Convolutional Neural Networks

Despite advancements in Artificial Intelligence (AI) methods for climate downscaling, significant challenges remain for their practicality in climate research. Current AI-methods exhibit notable limitations, such as limited application in downscaling Global Climate Models (GCMs), and accurately representing extremes. To address these challenges, we implement an AI-based methodology using super-resolution convolutional neural networks (SRCNN), trained and evaluated on 40 years of daily precipitation data from a reanalysis and a high-resolution dynamically downscaled counterpart. The dynamical downscaled simulations, constrained using spectral nudging, enable the replication of historical events at a higher resolution. This allows the SRCNN to emulate dynamical downscaling effectively. Modifications, such as incorporating elevation data and data pre-processing enhances overall model performance, while using exponential and quantile loss functions improve the simulation of extremes. Our findings show SRCNN models efficiently and skillfully downscale precipitation from GCMs. Future work will expand this methodology to downscale additional variables for future climate projections.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Defect Recognition for Eddy Current Testing of Spent Nuclear Fuel Canister using Convolutional Neural Network

This paper proposes an accurate and robust defect detection solution for 304L and 306L stainless steel (SS) weld. In the proposed solution, Eddy current testing (ECT) is employed to generate 2-dimensional (2D) data for samples under test with defects. The 2D data can be treated as images for deep learning-based defect detection. Since convolutional neural networks (CNNs) are powerful in processing images, CNN is employed in this study for defect detection. Experiments are conducted on a submerged arc welding (SAW) 304L SS weld sample with an artificial crack generated by waterjet cutting. The ECT data on this seeded fault sample is utilized to verify the proposed solution. For this purpose, the ECT measurement are separated as from Fault area and Normal area, which are used for CNN training. After training, the testing data is used for verification. Experimental results demonstrate the feasibility and effectiveness of the proposed solution.

Niu, Guangxing↗
DOE OSTI2021

Noise reduction in X-ray photon correlation spectroscopy with convolutional neural networks encoder–decoder models

Abstract Like other experimental techniques, X-ray photon correlation spectroscopy is subject to various kinds of noise. Random and correlated fluctuations and heterogeneities can be present in a two-time correlation function and obscure the information about the intrinsic dynamics of a sample. Simultaneously addressing the disparate origins of noise in the experimental data is challenging. We propose a computational approach for improving the signal-to-noise ratio in two-time correlation functions that is based on convolutional neural network encoder–decoder (CNN-ED) models. Such models extract features from an image via convolutional layers, project them to a low dimensional space and then reconstruct a clean image from this reduced representation via transposed convolutional layers. Not only are ED models a general tool for random noise removal, but their application to low signal-to-noise data can enhance the data’s quantitative usage since they are able to learn the functional form of the signal. We demonstrate that the CNN-ED models trained on real-world experimental data help to effectively extract equilibrium dynamics’ parameters from two-time correlation functions, containing statistical noise and dynamic heterogeneities. Strategies for optimizing the models’ performance and their applicability limits are discussed.

36 MATERIALS SCIENCE↗
DOE OSTI2022

DISTEMA: distance map-based estimation of single protein model accuracy with attentive 2D convolutional neural network

Abstract Background Estimation of the accuracy (quality) of protein structural models is important for both prediction and use of protein structural models. Deep learning methods have been used to integrate protein structure features to predict the quality of protein models. Inter-residue distances are key information for predicting protein’s tertiary structures and therefore have good potentials to predict the quality of protein structural models. However, few methods have been developed to fully take advantage of predicted inter-residue distance maps to estimate the accuracy of a single protein structural model. Result We developed an attentive 2D convolutional neural network (CNN) with channel-wise attention to take only a raw difference map between the inter-residue distance map calculated from a single protein model and the distance map predicted from the protein sequence as input to predict the quality of the model. The network comprises multiple convolutional layers, batch normalization layers, dense layers, and Squeeze-and-Excitation blocks with attention to automatically extract features relevant to protein model quality from the raw input without using any expert-curated features. We evaluated DISTEMA’s capability of selecting the best models for CASP13 targets in terms of ranking loss of GDT-TS score. The ranking loss of DISTEMA is 0.079, lower than several state-of-the-art single-model quality assessment methods. Conclusion This work demonstrates that using raw inter-residue distance information with deep learning can predict the quality of protein structural models reasonably well. DISTEMA is freely at https://github.com/jianlin-cheng/DISTEMA

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Convolutional neural network identification of galaxy post-mergers in UNIONS using IllustrisTNG

ABSTRACT The Canada–France Imaging Survey (CFIS) will consist of deep, high-resolution r-band imaging over ∼5000 deg2 of the sky, representing a first-rate opportunity to identify recently merged galaxies. Because of the large number of galaxies in CFIS, we investigate the use of a convolutional neural network (CNN) for automated merger classification. Training samples of post-merger and isolated galaxy images are generated from the IllustrisTNG simulation processed with the observational realism code RealSim. The CNN’s overall classification accuracy is 88 per cent, remaining stable over a wide range of intrinsic and environmental parameters. We generate a mock galaxy survey from IllustrisTNG in order to explore the expected purity of post-merger samples identified by the CNN. Despite the CNN’s good performance in training, the intrinsic rarity of post-mergers leads to a sample that is only ∼6 per cent pure when the default decision threshold is used. We investigate trade-offs in purity and completeness with a variable decision threshold and find that we recover the statistical distribution of merger-induced star formation rate enhancements. Finally, the performance of the CNN is compared with both traditional automated methods and human classifiers. The CNN is shown to outperform Gini–M20 and asymmetry methods by an order of magnitude in post-merger sample purity on the mock survey data. Although the CNN outperforms the human classifiers on sample completeness, the purity of the post-merger sample identified by humans is frequently higher, indicating that a hybrid approach to classifications may be an effective solution to merger classifications in large surveys.

Bickley, Robert W.↗