SEARCH · Engineering Papers
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
This library of Python code is used for performing semantic segmentation of images using 6 different machine learning methods. Five of the methods are implemented entirely within the scikit-learn framework. The Convolutional Neural Network (CNN) method requires Keras with a TensorFlow backend and generally uses a different set of scripts in order to perform the complete training and evaluation.
Video surveillance is one of the most important technologies used by the International Atomic Energy Agency in international safeguards. At large, complicated facilities, multiple surveillance cameras are deployed to monitor the transfer of safeguards-relevant objects across the site. During inspections, all surveillance videos are reviewed to ensure the objects are not manipulated or diverted during transfer, a laborious, time-consuming task. This work describes using deep machine learning algorithms to track objects automatically across multiple cameras, greatly improving the efficiency of the review process. The fundamental problem in this object tracking task across multiple cameras is how to associate the same object, which may show extreme intra-class variations, such as viewpoints, occlusions, and various scales, in different and even non-overlapped cameras. Object re-identification (Re-ID) in nuclear facility video surveillance is even more challenging than classic person or vehicle Re-ID problems because different instances in the same category may display an identical appearance. One observation from nuclear facility surveillance videos is that all objects must be carted (e.g., via forklift) to move. Therefore, the spatial context information of an object, which provides the feature from the carrier, is critical for the object Re-ID task. This work proposes a two-stream convolutional neural networks model that takes features of objects and their surrounding regions into account. Moreover, the custom videos usually are gleaned from different scenes from the training data, which may have extreme variations in illumination changes and/or cluttered backgrounds. Directly applying the trained model to custom videos will dramatically decrease the performance. To tackle this problem, an advanced domain adaptation technique is proposed to mitigate the gap between the data taken from different scenes. The proposed framework will track objects of interest across a nuclear complex. The resulting tracks can be used in further analyses, such as event/activity recognition, anomaly detection, etc.
Layer-wise Relevance Propagation (LRP) is an emerging and widely-used method for interpreting the prediction results of convolutional neural networks (CNN). LRP developers often select and employ different relevance backpropagation rules and parameters, to compute relevance scores on input images. However, there exists no obvious solution to define a "best" LRP model. A satisfied model is highly reliant on pertinent images and designers' goals. We develop a visual model designer, named as VisLRPDesigner, to overcome the challenges in the design and use of LRP models. Various LRP rules are unified into an integrated framework with an intuitive workflow of parameter setup. VisLRPDesigner thus allows users to interactively configure and compare LRP models. It also facilitates relevance-based visual analysis with two important functions: relevance-based pixel flipping and neuron ablation. Several use cases illustrate the benefits of VisLRPDesigner. The usability and limitation of the visual designer is evaluated by LRP users.
Pebble Bed Reactors are fueled with fuel pebbles that are circulated multiple times through the reactor vessel before discharge. During the normal operation of a PBR, ejected pebbles are returned to the reactor or discharged depending on the fuel burnup and physical condition of the pebbles. The burnup measurement is usually based on detected radiation signatures of fission products accumulated in the pebble fuel over burnup. Previous research has shown that height of photopeaks of fission products, such as 134Cs, 137Cs, 154Eu, etc., can be used independently or in combination to infer or predict the level of burnup in the fuel. However, it remains challenging to measure such complex sources due to self-shielding effects, strong radiation background and intervening materials. Another operational challenge is the required high throughput of burnup measurement, which necessitates limited measurement time and thus impacts quality of measured gamma-ray spectra. Hence, advanced spectral analysis methods are needed to analyze the noisy gamma spectra and predict the burnup values. We propose to use machine learning (ML) method to interpret gamma-ray spectra and predict the burnup values of the pebbles. ML has achieved widespread success and adoption across a few domains that require pattern recognition and analysis in varied data types. In this work, we apply three proven ML approaches - multilayer perceptrons, convolutional neural networks, and transformers - to the task of predicting fuel burnup from measured gamma spectra, and compile a dataset of simulated spectra for training and validation of the ML models. In this paper, we will discuss the network architecture of these three ML approaches and compare the performance of the simplest of these (MLP) to a standard linear regression.
We investigate the feasibility of using deep learning techniques, in the form of a one-dimensional convolutional neural network (1D-CNN), for the extraction of signals from the raw waveforms produced by the individual channels of liquid argon time projection chamber (LArTPC) detectors. A minimal generic LArTPC detector model is developed to generate realistic noise and signal waveforms used to train and test the 1D-CNN, and evaluate its performance on low-level signals. We demonstrate that our approach overcomes the inherent shortcomings of traditional cut-based methods by extending sensitivity to signals with ADC values below their imposed thresholds. This approach exhibits great promise in enhancing the capabilities of future generation neutrino experiments like DUNE to carry out their low-energy neutrino physics programs.
Shell and tube heat exchangers (STHEs) are critical to energy conversion efficiency of power plants. Eddy current examination is a way to evaluate working conditions of these tubes. However, the current testing apparatus requires human to manually insert an eddy current testing (ECT) probe into and extract it out of individual tubes, and meanwhile monitor measurement results for diagnosis. It is a time-consuming and labor-intensive procedure even for an experienced technician. To tackle this challenge, in this work, we developed a robot enabled ECT system for autonomous inspection of STHEs. The robotic platform employs Mecanum wheeled chassis for high mobility, machine vision to locate tube bundle and tube inlets, a rotational Cartesian mechanism to operate at planes with all possible inclinations, and a task-specific mechanism for ECT probe delivery. Machine vision locates tube bundle and tube inlets by an April tag detection algorithm and a Circle Hough Transform (CHT) algorithm, respectively. Assisted by a guidance cone, the ECT probe is continuously fed into the tubes with a fill factor of 0.819. During this process, the eddy current data are automatically collected and real-time analyzed by convolutional neural networks (CNN), showing accuracy of nearly 100% for identifying defective and non-defective tubes and 85% for four types of defective tubes and non-defective tubes.
Solar forecasting is shifting to the probabilistic paradigm due to the inherent uncertainty within the solar resource. Input uncertainty quantification is one of the widely used and best-performing ways to model solar uncertainty. However, compared to other sources of inputs, such as numerical weather prediction models, pure sky image-based probabilistic solar forecasting lags behind. In this research, an occlusion-perturbed convolutional neural network, named the PSolarNet, is developed. The PSolarNet provides very short-term deterministic forecasts, forecast scenarios, and probabilistic forecasts of the global horizontal irradiance from sky image sequences. Case studies based on 6 years of open-source data show that the developed PSolarNet is able to generate accurate 10-minute ahead deterministic forecasts with a 5.62% normalized root mean square error, realistic and diverse forecast scenarios with a 0.966 average correlation with the actual time series, and reliable and sharp probabilistic forecasts with a 2.77% normalized continuous ranked probability score.
During the manufacture of tri-structural isotropic (TRISO)-coated nuclear fuel particles, the potential exists for the formation of internal fissure defects in the uranium oxycarbide (UCO) kernels. These fissures result in a defective fuel particle that can fracture during subsequent fuel processing. Therefore, it is necessary to detect the presence of fissured kernels in a batch to determine if the batch meets specification prior to blending with other batches and upgrading processes. Previous attempts at identifying fissures involved manual inspection of micrographs of UCO fuel kernel cross-sections. This process is tedious, time-consuming and may introduce counting errors making it a good candidate for automation. This work presents a method for the automated detection of fissures in UCO kernels. Image segmentation is used for the extraction of relevant features in the micrographs which then serve as the input to a convolutional neural network used to automatically distinguish between fissured and non-fissured kernels.
Super resolution is an essential tool in optics, especially on interstellar scales, due to physical laws restricting possible imaging resolution. We propose using optimal transport and entropy for super resolution applications. We prove that the reconstruction is accurate when sparsity is known and noise or distortion is small enough. We prove that the optimizer is stable and robust to noise and perturbations. We compare this method to a state of the art convolutional neural network and get similar results for much less computational cost and greater methodological flexibility.
The Accelerator Neutrino Neutron Interaction Experiment (ANNIE) is a 26 ton Gadolinium (Gd)-loaded water Cherenkov detector located on the Booster Neutrino Beam line at Fermilab. Its main goals are the measurement of the neutron multiplicity in neutrino-nucleus interactions as well as the cross-section of Charged Current Quasi-Elastic (CCQE) neutrino interactions on water. Besides the physics goals, the experiment also aims to be a testbed for new technologies such as Large Area Picosecond Photodetectors (LAPPDs) and Water-based Liquid Scintillators (WbLS). This thesis presents a preliminary measurement of the neutron multiplicity with {ANNIE}, using an analysis conducted on a fraction of the 2021 beam year. As preparatory measures, the efficiency of ANNIE's Front Muon Veto (FMV) was determined to be {$\bar{\varepsilon}_{\mathrm{FMV}} = (95.6 \pm 1.6)\%$} while the average efficiency for active scintillator paddles in the Muon Range Detector (MRD) was found to be {$\bar{\varepsilon}_ {\mathrm{MRD}} = (92.1 \pm 7.9)\%$}. Furthermore, the simulation framework used for ANNIE was validated and adapted to reproduce the experimental data by comparing the detector response for samples of Michel electrons, Americium Beryllium neutrons, and through-going muons. The analysis finds average neutron yields of {$\bar{n}_{\mathrm{data}} (\mathrm{beam}) = (0.272 \pm 0.010_{\mathrm{stat}})$} for an inclusive set of all identified muon neutrino candidates and {$\bar{n}_{\mathrm{data}} (\mathrm{beam,FV}) = (0.287 \pm 0.044_{\mathrm{stat}})$ for interactions which happened inside of the Fiducial Volume of ANNIE, which was optimized to increase the neutron detection acceptance. The presented neutron multiplicity values represent the number of detected neutrons after all event selection cuts and are not yet corrected for the neutron detection efficiency. An equivalent analysis on a simulated beam sample predicts neutron yields of $\bar{n}_{\mathrm{MC}}(\mathrm{beam}) = (0.515 \pm 0.0 07_{\mathrm{stat}})$ and $\bar{n}_{\mathrm{MC}}(\mathrm{beam,FV}) = (0.627 \pm 0.031_{\mathrm{stat}})$, indicating that the models tend to overpredict the number of neutrons produced in such interactions. Systematic errors have been briefly considered to contribute {$\sigma_{\mathrm{sys,FMV}} \sim 0.01\,$neutrons/$\nu$-interaction} due to the slight FMV inefficiency and {$\sigma_{\mathrm{sys,n}} \sim 0.05\,$neutrons/$\nu$-interaction} due to the neutron detection efficiency. Simulation studies further highlighted the importance of neutron detection in Diffuse Supernova Background (DSNB) searches. A combination of neutron tagging and Convolutional Neural Networks was found to reduce the most relevant Neutral Current Quasi-Elastic (NCQE) interaction background below the signal level, achieving a Signal-to-Background ratio of 4:1. In a further study, we investigated the positive impact of a deployment of a WbLS target on the energy reconstruction in ANNIE. WbLS provides a scintillation signal from hadronic recoils in addition to the charged lepton that can be included in neutrino energy reconstruction. It was found that a deployed WbLS volume in ANNIE improves the neutrino energy reconstruction from 14\% to 12\%, with the potential of going beyond this if more sophisticated reconstruction algorithms are developed in the future.
The timely detection of clandestine nuclear facilities is one of the greatest challenges faced by the International Atomic Energy Agency’s (IAEA). Idaho National Laboratory is currently applying machine learning (ML) to existing satellite imagery (SI) datasets to find facilities within the nuclear fuel life cycle, with primary focus placed on identifying critical predecessor (i.e., fuel fabrication and fuel enrichment) and successor (i.e., nuclear power plants) facilities. This could provide a satellite image methodology that the IAEA could leverage to discover clandestine facilities. The work presented in this paper describes the evolution of a workflow developed by this team for object detection related to critical infrastructure by expanding that workflow for the purpose of identifying nuclear fuel cycle components and automating dependency assessments. This will be done using two methods housed within a single pipeline. The first method involves implementing a DenseNet161 convolutional neural network to classify the images and explain the results using Local Interpretable Model-Agnostic Explanations (LIME). The second method implements You Only Look Once version 5 (YoloV5), to detect objects within images, provide a probability for the detection, and provide a bounding box that corresponds to the object of interest. The results of this work are anticipated to provide a clear picture of this portion of the nuclear fuel cycle and perform as a stand-alone tool for image assessment that can be expanded to additional fuel cycle components and implemented in international safeguards and national security domains. This capability addresses the IAEA’s need to detect undeclared nuclear materials and activities within a state while encompassing the entire nuclear fuel cycle.
The purpose of this work is to examine the application of a deep learning model in event reconstruction of neutrino interactions. The challenges faced in event reconstruction include the placement of an accurate primary neutrino interaction vertex which is used to support the particle track and prong algorithms. The result of accurate primary vertex ensures all particles involved in a neutrino interaction are included. We propose a regression-based Convolutional Neural Network (CNN) method to predict the primary vertex of a particle interaction. We show that with raw two-dimensional pixel map views as input, the regression-based CNN can predict the primary vertex in all three coordinates. This work is applied as part of the NOvA (NuMI Off-axis $\nu_e$ Appearance) near detector reconstruction efforts. The primary vertex predicted by the regression-based CNN model shows promising results for future applications. This deep learning method can be extended to secondary vertexing through a Kernel Density Estimate algorithm discussed in this work.
Efficient methods for searching the chemical space of molecular compounds are needed to automate and accelerate the design of new functional molecules such as pharmaceuticals. Given the high cost in both resources and time for experimental efforts, computational approaches play a key role in guiding the selection of promising molecules for further investigation. Here, we construct a workflow to accelerate design by combining approximate quantum chemical methods [i.e. density-functional tight-binding (DFTB)], a graph convolutional neural network (GCNN) surrogate model for chemical property prediction, and a masked language model (MLM) for molecule generation. Property data from the DFTB calculations are used to train the surrogate model; the surrogate model is used to score candidates generated by the MLM. The surrogate reduces computation time by orders of magnitude compared to the DFTB calculations, enabling an increased search of chemical space. Furthermore, the MLM generates a diverse set of chemical modifications based on pre-training from a large compound library. We utilize the workflow to search for near-infrared photoactive molecules by minimizing the predicted HOMO-LUMO gap as the target property. Our results show that the workflow can generate optimized molecules outside of the original training set, which suggests that iterations of the workflow could be useful for searching vast chemical spaces in a wide range of design problems.
Detection and classification of anomalies for powder bed metal additive manufacturing. Anomalies, such as recoater blade impacts, binder deposition issues, spatter generation, and some porosities, are surface-visible at each layer of the building process. A multi-scaled parallel dynamic segmentation convolutional neural network architecture provides additive manufacturing machine and imaging system agnostic pixel-wise semantic segmentation of layer-wise powder bed image data. Learned knowledge is easily transferrable between different additive manufacturing machines. The anomaly detection can be conducted in real-time and provides accurate and generalizable results.
Charged Current (CC) coherent neutrino-nucleus pion production is characterized by small momentum transferred to the nucleus, which is left in its ground state. Despite the relatively large uncertainties on the production cross-section, coherent production of mesons by neutrinos represents an important process, as it can shed light on the structure of the weak current and can also constitute a potential source of background for modern neutrino oscillation experiments and searches for Beyond Standard Model (BSM) physics. This Ph.D. thesis presents a new measurement of CC coherent pion production in the NOvA near detector at the Fermi National Accelerator Laboratory (Fermilab). The analysis is based on the use of both particle identification and kinematic selection criteria based on Convolutional Neural Networks (CNN) to achieve a selection purity of 60%. Given the energy range 1-5 GeV accessible with the available NOvA exposure in the NuMI beam, the results will also be relevant for f uture neutrino experiments like the Deep Underground Neutrino Experiment (DUNE).
This work evaluates and compares various convolutional neural networks (CNNs) trained in previous NETL studies according to metrics effecting diagnostic feasibility, external applicability, and performance. Each CNN surveyed, including image classification, object detection, and time series classification, is used to develop total RDE diagnostics and evaluated alongside conventional techniques with respect to real-time capabilities. Real-time capable diagnostics are deployed and evaluated in the laboratory environment using an altered experimental setup, which is outlined herein for possible adaptations in external experimental facilities.
This work evaluates and compares various convolutional neural networks (CNNs) trained in previous NETL studies according to metrics effecting diagnostic feasibility, external applicability, and performance. Each CNN surveyed, including image classification, object detection, and time series classification, is used to develop total RDE diagnostics and evaluated alongside conventional techniques with respect to real-time capabilities. Real-time capable diagnostics are deployed and evaluated in the laboratory environment using an altered experimental setup, which is outlined herein for possible adaptations in external experimental facilities.
High strength alloys with good ductility, hardness, and toughness are needed to meet stringent design requirements for extreme environments. One complication in this pursuit is the evidence that metals rarely exhibit both high strength and good fracture toughness as the underlying mechanisms work in opposition. An exception to this behavior is found in multiphase alloys that form complex microstructures of mixed phases with variable grain sizes and shapes that provide increased fracture toughness by the arrangement of their constituent elements. We propose to explore this phenomenon using state-of-the-art machine learning (ML) techniques in a new and novel manner to identify and correlate the critical microstructural features in a Titanium-10Vanadium-2Iron-3Aluminum (Ti-10V-2Fe-3Al) alloy that is reported to exhibit high strength and fracture toughness. Additionally, we will employ multiple, complementary characterization techniques such as optical microscopy, electron backscatter diffraction (EBSD), energy dispersive spectroscopy (EDS) and scanning electron microscopy to provide multi-layer, quantitative ground truth measures of the microstructures. This data will be used to train a Convolutional Neural Network (CNN) in a semi-supervised environment to identify key microstructural features such as ? platelet dimensions and locations and ?/? phase boundaries and correlate those features with the strength and toughness. Here the ? and ? nomenclature refers to hexagonal close pack (hcp) and body center cubic (bcc) crystal structures, respectively. Previous work has focused on popular alloys and typically used one characterization technique. This research is focused on a promising titanium alloy, uses multiple complimentary characterization tools to provide precise microstructural information and correlates to improved fracture toughness. The resulting ML tool can be trained for additional microstructural features, different alloy(s), and or target mechanical properties.