Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “convolution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,513 records · Page 84
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

An Autonomous Robot for Shell and Tube Heat Exchanger Inspection

Shell and tube heat exchangers (STHEs) are critical to energy conversion efficiency of power plants. Eddy current examination is a way to evaluate working conditions of these tubes. However, the current testing apparatus requires human to manually insert an eddy current testing (ECT) probe into and extract it out of individual tubes, and meanwhile monitor measurement results for diagnosis. It is a time-consuming and labor-intensive procedure even for an experienced technician. To tackle this challenge, in this work, we developed a robot enabled ECT system for autonomous inspection of STHEs. The robotic platform employs Mecanum wheeled chassis for high mobility, machine vision to locate tube bundle and tube inlets, a rotational Cartesian mechanism to operate at planes with all possible inclinations, and a task-specific mechanism for ECT probe delivery. Machine vision locates tube bundle and tube inlets by an April tag detection algorithm and a Circle Hough Transform (CHT) algorithm, respectively. Assisted by a guidance cone, the ECT probe is continuously fed into the tubes with a fill factor of 0.819. During this process, the eddy current data are automatically collected and real-time analyzed by convolutional neural networks (CNN), showing accuracy of nearly 100% for identifying defective and non-defective tubes and 85% for four types of defective tubes and non-defective tubes.

autonomy, deep learning, eddy current testing, hea↗
DOE OSTI2021

Stable Parallel Training of Wasserstein Conditional Generative Adversarial Neural Networks : *Full/Regular Research Paper submission for the symposium CSCI-ISAI: Artificial Intelligence

We use a stable parallel approach to train Wasserstein Conditional Generative Adversarial Neural Networks (W-CGANs). The parallel training reduces the risk of mode collapse and enhances scalability by using multiple generators that are concurrently trained, each one of them focusing on a single data label. The use of the Wasserstein metric reduces the risk of cycling by stabilizing the training of each generator. We apply the approach on the CIFAR10 and the CIFAR100 datasets, two standard benchmark datasets with images of the same resolution, but different number of classes. Performance is assessed using the inception score, the Fréchet inception distance, and image quality. An improvement in inception score and Fréchet inception distance is shown in comparison to previous results obtained by performing the parallel approach on deep convolutional conditional generative adversarial neural networks (DC-CGANs). Weak scaling is attained on both datasets using up to 100 NVIDIA V100 GPUs on the OLCF supercomputer Summit.

Lupo Pasini, Massimiliano↗
DOE OSTI2021

Forward and Off-Forward Parton Distributions from Lattice QCD

The interpretation of (semi-)inclusive and certain exclusive scattering processes relies on the factorization of hard parton level cross sections from long-range and non-perturbative parton correlations. The familiar Parton Distribution Functions (PDFs) and Generalized Parton Distributions quantify the non-perturbative dynamics in these situations and address a number of key questions surrounding the structure of hadrons. A certain class of matrix elements accessible in lattice QCD, so called Lattice Cross Sections, have been shown to factorize into these collinear distributions in a manner akin to the factorization of hadronic cross sections. In the short-distance regime, matrix elements of space-like separated two-current operators and parton bilinears can be expressed as the convolution of perturbative coefficient functions and the PDFs. Matrix elements of this type are isolated in the pion and nucleon, each offering a glimpse of the unpolarized valence quark content of these phenomenologically important hadronic states. The calculations within the nucleon represent the first application of the distillation spatial smearing paradigm to the collinear structure of hadrons, and is found to offer higher precision data compared to similar calculations in the literature. A novel method to obtain PDFs from these lattice data, while simultaneously controlling systematic effects, is developed and applied to the nucleon dataset. The coordinate space factorization of space-like separated parton bilinears has also recently been extended to include Generalized Parton Distributions. Preliminary results in off-forward nucleon matrix elements using distillation are explored.

Egerer, Colin↗
DOE OSTI2022

Occlusion-Perturbed Deep Learning for Probabilistic Solar Forecasting via Sky Images: Preprint

Solar forecasting is shifting to the probabilistic paradigm due to the inherent uncertainty within the solar resource. Input uncertainty quantification is one of the widely used and best-performing ways to model solar uncertainty. However, compared to other sources of inputs, such as numerical weather prediction models, pure sky image-based probabilistic solar forecasting lags behind. In this research, an occlusion-perturbed convolutional neural network, named the PSolarNet, is developed. The PSolarNet provides very short-term deterministic forecasts, forecast scenarios, and probabilistic forecasts of the global horizontal irradiance from sky image sequences. Case studies based on 6 years of open-source data show that the developed PSolarNet is able to generate accurate 10-minute ahead deterministic forecasts with a 5.62% normalized root mean square error, realistic and diverse forecast scenarios with a 0.966 average correlation with the actual time series, and reliable and sharp probabilistic forecasts with a 2.77% normalized continuous ranked probability score.

Bayesian model averaging↗
DOE OSTI2022

Evaluating the Durability of Balance of Systems Components Using Combined-Accelerated Stress Testing

The degradation of photovoltaic (PV) balance of systems (BoS) components is not well-studied, but the consequences include: offline-modules, -strings, -inverters; system shutdown; arc-faults; and fires. A utility provider experienced a ~30% failure rate in their power transfer chain, attributed to branch connectors. Field-failed specimen assemblies were therefore examined, consisting of cable connector, branch connector and discrete fuse components. Unused field-vintage specimens are presently being examined using combined-accelerated stress testing (C-AST) to clarify the most influential environmental stressors as well as the effect of external mechanical perturbation. A benchtop prototype fixture was used to develop the perturbation capability for C-AST. The benchtop experiments were also used to develop the in-situ data acquisition of specimen: current, voltage, and temperature. A significant increase in operating temperature, ~100 deg C from ~40 deg C, and a different failure mode was observed immediately once periodic mechanical perturbation was applied. The current at failure was decreased from 35 A (with failure occurring in the fuses) to 15 A (failure at the male/female metal pin connection). After initial examination using X-ray computed tomography, the external plastic was machined away from failed specimens to allow failure analysis, including the extraction of the internal convolute springs for morphological examination (optical- and electron-microscopy). Chemical composition analysis included: energy-dispersive X-ray spectroscopy, differential scanning calorimetry, and Fourier transform infrared spectroscopy.

balance of systems↗
DOE OSTI2022

Evaluating the Durability of Balance of Systems Components Using Combined-Accelerated Stress Testing: Preprint

The degradation of photovoltaic (PV) balance of systems (BoS) components is not well-studied, but the consequences include: offline-modules, -strings, -inverters; system shutdown; arc-faults; and fires. A utility provider experienced a ~30% failure rate in their power transfer chain, originally attributed to branch connectors. Field-failed specimen assemblies were therefore examined, consisting of cable connector, branch connector, and discrete fuse components. Unused field-vintage specimens are presently being examined using combined-accelerated stress testing (C-AST) to clarify the most influential environmental stressors as well as the effect of external mechanical perturbation. A benchtop prototype fixture was used to develop the perturbation capability for the C-AST chamber. The benchtop experiments were also used to develop the in-situ data acquisition of specimen: current, voltage, and temperature. A significant increase in operating temperature, ~100 deg C from ~40 deg C, and a different failure mode was observed promptly once periodic mechanical perturbation was applied. The current at failure was decreased from 35 A (with failure in the fuses) to 15 A (failure at the male/female metal pin connection). After initial examination using X-ray computed tomography, the external plastic was machined away from failed specimens to allow failure analysis, including the extraction of the internal convolute springs for morphological examination (optical- and electron-microscopy).

balance of systems↗
DOE OSTI2022

Automated Defect Identification for Tri-structural Isotropic Fuels (AUDIT)

During the manufacture of tri-structural isotropic (TRISO)-coated nuclear fuel particles, the potential exists for the formation of internal fissure defects in the uranium oxycarbide (UCO) kernels. These fissures result in a defective fuel particle that can fracture during subsequent fuel processing. Therefore, it is necessary to detect the presence of fissured kernels in a batch to determine if the batch meets specification prior to blending with other batches and upgrading processes. Previous attempts at identifying fissures involved manual inspection of micrographs of UCO fuel kernel cross-sections. This process is tedious, time-consuming and may introduce counting errors making it a good candidate for automation. This work presents a method for the automated detection of fissures in UCO kernels. Image segmentation is used for the extraction of relevant features in the micrographs which then serve as the input to a convolutional neural network used to automatically distinguish between fissured and non-fissured kernels.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

Progress on Machine Learning for the SNS High Voltage Converter Modulators

The High-Voltage Converter Modulators (HVCM) used to power the klystrons in the Spallation Neutron Source (SNS) linac were selected as one area to explore machine learning due to reliability issues in the past and the availability of large sets of archived waveforms. Progress in the past two years has resulted in generating a significant amount of simulated and measured data for training neural network models such as recurrent neural networks, convolutional neural networks, and variational autoencoders. Applications in anomaly detection, fault classification, and prognostics of capacitor degradation were pursued in collaboration with the Jefferson Laboratory, and early promising results were achieved. This paper will discuss the progress to date and present results from these efforts.

Pappas, Chris↗
DOE OSTI2022

Optimal Transport for Super Resolution Applied to Astronomy Imaging

Super resolution is an essential tool in optics, especially on interstellar scales, due to physical laws restricting possible imaging resolution. We propose using optimal transport and entropy for super resolution applications. We prove that the reconstruction is accurate when sparsity is known and noise or distortion is small enough. We prove that the optimizer is stable and robust to noise and perturbations. We compare this method to a state of the art convolutional neural network and get similar results for much less computational cost and greater methodological flexibility.

Rawson, Michael G.↗
DOE OSTI2022

Towards a neutron multiplicity measurement with the Accelerator Neutrino Neutron Interaction Experiment

The Accelerator Neutrino Neutron Interaction Experiment (ANNIE) is a 26 ton Gadolinium (Gd)-loaded water Cherenkov detector located on the Booster Neutrino Beam line at Fermilab. Its main goals are the measurement of the neutron multiplicity in neutrino-nucleus interactions as well as the cross-section of Charged Current Quasi-Elastic (CCQE) neutrino interactions on water. Besides the physics goals, the experiment also aims to be a testbed for new technologies such as Large Area Picosecond Photodetectors (LAPPDs) and Water-based Liquid Scintillators (WbLS). This thesis presents a preliminary measurement of the neutron multiplicity with {ANNIE}, using an analysis conducted on a fraction of the 2021 beam year. As preparatory measures, the efficiency of ANNIE's Front Muon Veto (FMV) was determined to be {$\bar{\varepsilon}_{\mathrm{FMV}} = (95.6 \pm 1.6)\%$} while the average efficiency for active scintillator paddles in the Muon Range Detector (MRD) was found to be {$\bar{\varepsilon}_ {\mathrm{MRD}} = (92.1 \pm 7.9)\%$}. Furthermore, the simulation framework used for ANNIE was validated and adapted to reproduce the experimental data by comparing the detector response for samples of Michel electrons, Americium Beryllium neutrons, and through-going muons. The analysis finds average neutron yields of {$\bar{n}_{\mathrm{data}} (\mathrm{beam}) = (0.272 \pm 0.010_{\mathrm{stat}})$} for an inclusive set of all identified muon neutrino candidates and {$\bar{n}_{\mathrm{data}} (\mathrm{beam,FV}) = (0.287 \pm 0.044_{\mathrm{stat}})$ for interactions which happened inside of the Fiducial Volume of ANNIE, which was optimized to increase the neutron detection acceptance. The presented neutron multiplicity values represent the number of detected neutrons after all event selection cuts and are not yet corrected for the neutron detection efficiency. An equivalent analysis on a simulated beam sample predicts neutron yields of $\bar{n}_{\mathrm{MC}}(\mathrm{beam}) = (0.515 \pm 0.0 07_{\mathrm{stat}})$ and $\bar{n}_{\mathrm{MC}}(\mathrm{beam,FV}) = (0.627 \pm 0.031_{\mathrm{stat}})$, indicating that the models tend to overpredict the number of neutrons produced in such interactions. Systematic errors have been briefly considered to contribute {$\sigma_{\mathrm{sys,FMV}} \sim 0.01\,$neutrons/$\nu$-interaction} due to the slight FMV inefficiency and {$\sigma_{\mathrm{sys,n}} \sim 0.05\,$neutrons/$\nu$-interaction} due to the neutron detection efficiency. Simulation studies further highlighted the importance of neutron detection in Diffuse Supernova Background (DSNB) searches. A combination of neutron tagging and Convolutional Neural Networks was found to reduce the most relevant Neutral Current Quasi-Elastic (NCQE) interaction background below the signal level, achieving a Signal-to-Background ratio of 4:1. In a further study, we investigated the positive impact of a deployment of a WbLS target on the energy reconstruction in ANNIE. WbLS provides a scintillation signal from hadronic recoils in addition to the charged lepton that can be included in neutrino energy reconstruction. It was found that a deployed WbLS volume in ANNIE improves the neutrino energy reconstruction from 14\% to 12\%, with the potential of going beyond this if more sophisticated reconstruction algorithms are developed in the future.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

A Review on the State of the Art of Machine Learning and Satellite Imaging: Detecting Scene Changes in Selected Nuclear Fuel Cycle Datasets

The timely detection of clandestine nuclear facilities is one of the greatest challenges faced by the International Atomic Energy Agency’s (IAEA). Idaho National Laboratory is currently applying machine learning (ML) to existing satellite imagery (SI) datasets to find facilities within the nuclear fuel life cycle, with primary focus placed on identifying critical predecessor (i.e., fuel fabrication and fuel enrichment) and successor (i.e., nuclear power plants) facilities. This could provide a satellite image methodology that the IAEA could leverage to discover clandestine facilities. The work presented in this paper describes the evolution of a workflow developed by this team for object detection related to critical infrastructure by expanding that workflow for the purpose of identifying nuclear fuel cycle components and automating dependency assessments. This will be done using two methods housed within a single pipeline. The first method involves implementing a DenseNet161 convolutional neural network to classify the images and explain the results using Local Interpretable Model-Agnostic Explanations (LIME). The second method implements You Only Look Once version 5 (YoloV5), to detect objects within images, provide a probability for the detection, and provide a bounding box that corresponds to the object of interest. The results of this work are anticipated to provide a clear picture of this portion of the nuclear fuel cycle and perform as a stand-alone tool for image assessment that can be expanded to additional fuel cycle components and implemented in international safeguards and national security domains. This capability addresses the IAEA’s need to detect undeclared nuclear materials and activities within a state while encompassing the entire nuclear fuel cycle.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Improvement of the NOvA Near Detector Event Reconstruction and Primary Vertexing through the Application of Machine Learning Methods

The purpose of this work is to examine the application of a deep learning model in event reconstruction of neutrino interactions. The challenges faced in event reconstruction include the placement of an accurate primary neutrino interaction vertex which is used to support the particle track and prong algorithms. The result of accurate primary vertex ensures all particles involved in a neutrino interaction are included. We propose a regression-based Convolutional Neural Network (CNN) method to predict the primary vertex of a particle interaction. We show that with raw two-dimensional pixel map views as input, the regression-based CNN can predict the primary vertex in all three coordinates. This work is applied as part of the NOvA (NuMI Off-axis $\nu_e$ Appearance) near detector reconstruction efforts. The primary vertex predicted by the regression-based CNN model shows promising results for future applications. This deep learning method can be extended to secondary vertexing through a Kernel Density Estimate algorithm discussed in this work.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Spatio-Temporal Denoising Graph Autoencoders with Data Augmentation for Missing Photovoltaic Data Imputation

The integration of the global Photovoltaic (PV) market with real time data-loggers has enabled large scale PV data analytical pipelines for power forecasting and long-term reliability assessment of PV fleets. Nevertheless, the performance of PV data analysis heavily depends on the quality of PV timeseries data. This paper proposes a novel Spatio-Temporal Denoising Graph Autoencoder (STD-GAE) framework to impute missing PV Power Data. STDGAE exploits temporal correlation, spatial coherence, and value dependencies from domain knowledge to recover missing data. It is empowered by two modules. (1) To cope with sparse yet various scenarios of missing data, STD-GAE incorporates a domain-knowledge aware data augmentation module that creates plausible variations of missing data patterns. This generalizes STD-GAE to robust imputation over different seasons and environment. (2) STD-GAE nontrivially integrates spatiotemporal graph convolution layers (to recover local missing data by observed “neighboring” PV plants) and denoising autoencoder (to recover corrupted data from augmented counterpart) to improve the accuracy of imputation accuracy at PV fleet level. We have evaluated our proposed model on two realworld PV datasets. Experimental results show that STD-GAE can achieve a gain of 43.14% in imputation accuracy and remains less sensitive to missing rate, different seasons, and missing scenarios, compared with state-of-the-art data imputation methods such as MIDA and LRTC-TNN.

Fan, Yangxin↗
DOE OSTI2022

Computational Workflow for Accelerated Molecular Design Using Quantum Chemical Simulations and Deep Learning Models

Efficient methods for searching the chemical space of molecular compounds are needed to automate and accelerate the design of new functional molecules such as pharmaceuticals. Given the high cost in both resources and time for experimental efforts, computational approaches play a key role in guiding the selection of promising molecules for further investigation. Here, we construct a workflow to accelerate design by combining approximate quantum chemical methods [i.e. density-functional tight-binding (DFTB)], a graph convolutional neural network (GCNN) surrogate model for chemical property prediction, and a masked language model (MLM) for molecule generation. Property data from the DFTB calculations are used to train the surrogate model; the surrogate model is used to score candidates generated by the MLM. The surrogate reduces computation time by orders of magnitude compared to the DFTB calculations, enabling an increased search of chemical space. Furthermore, the MLM generates a diverse set of chemical modifications based on pre-training from a large compound library. We utilize the workflow to search for near-infrared photoactive molecules by minimizing the predicted HOMO-LUMO gap as the target property. Our results show that the workflow can generate optimized molecules outside of the original training set, which suggests that iterations of the workflow could be useful for searching vast chemical spaces in a wide range of design problems.

Blanchard, Andrew↗
DOE OSTI2023

Interpretable Joint Event-Particle Reconstruction for Neutrino Physics at NOvA with Sparse CNNs and Transformers

The complex events observed at the NOvA long-baseline neutrino oscillation experiment contain vital information for understanding the most elusive particles in the standard model. The NOvA detectors observe interactions of neutrinos from the NuMI beam at Fermilab. Associating the particles produced in these interaction events to their source particles, a process known as reconstruction, is critical for accurately measuring key parameters of the standard model. Events may contain several particles, each producing sparse high-dimensional spatial observations, and current methods are limited to evaluating individual particles. To accurately label these numerous, high-dimensional observations, we present a novel neural network architecture that combines the spatial learning enabled by convolutions with the contextual learning enabled by attention. This joint approach, TransformerCVN, simultaneously classifies each event and reconstructs every individual particle's identity. TransformerCVN classifies events with 90% accuracy and improves the reconstruction of individual particles by 6% over baseline methods which lack the integrated architecture of TransformerCVN. In addition, this architecture enables us to perform several interpretability studies which provide insights into the network's predictions and show that TransformerCVN discovers several fundamental principles that stem from the standard model.

Shmakov, Alexander↗
DOE OSTI2022

Systems and methods for powder bed additive manufacturing anomaly detection

Detection and classification of anomalies for powder bed metal additive manufacturing. Anomalies, such as recoater blade impacts, binder deposition issues, spatter generation, and some porosities, are surface-visible at each layer of the building process. A multi-scaled parallel dynamic segmentation convolutional neural network architecture provides additive manufacturing machine and imaging system agnostic pixel-wise semantic segmentation of layer-wise powder bed image data. Learned knowledge is easily transferrable between different additive manufacturing machines. The anomaly detection can be conducted in real-time and provides accurate and generalizable results.

Scime, Luke R.↗
DOE OSTI2023

Measurement Of The Total Cross-Section Of Muon Neutrino Charged-Current Coherent Pion Production in NOvA Near Detector

Charged Current (CC) coherent neutrino-nucleus pion production is characterized by small momentum transferred to the nucleus, which is left in its ground state. Despite the relatively large uncertainties on the production cross-section, coherent production of mesons by neutrinos represents an important process, as it can shed light on the structure of the weak current and can also constitute a potential source of background for modern neutrino oscillation experiments and searches for Beyond Standard Model (BSM) physics. This Ph.D. thesis presents a new measurement of CC coherent pion production in the NOvA near detector at the Fermi National Accelerator Laboratory (Fermilab). The analysis is based on the use of both particle identification and kinematic selection criteria based on Convolutional Neural Networks (CNN) to achieve a selection purity of 60%. Given the energy range 1-5 GeV accessible with the available NOvA exposure in the NuMI beam, the results will also be relevant for f uture neutrino experiments like the Deep Underground Neutrino Experiment (DUNE).

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Survey of Machine Learning-Based Rotating Detonation Engine Diagnostics: Evaluation for Broad Application in Experimental Facilities

This work evaluates and compares various convolutional neural networks (CNNs) trained in previous NETL studies according to metrics effecting diagnostic feasibility, external applicability, and performance. Each CNN surveyed, including image classification, object detection, and time series classification, is used to develop total RDE diagnostics and evaluated alongside conventional techniques with respect to real-time capabilities. Real-time capable diagnostics are deployed and evaluated in the laboratory environment using an altered experimental setup, which is outlined herein for possible adaptations in external experimental facilities.

Johnson, Kristyn↗