Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Convolution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,729 records · Page 96
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Improving Subsurface Stress Characterization for Carbon Dioxide Storage Projects by Incorporating Machine Learning Techniques

The overall objective of this project is to develop a framework for reliable characterization and prediction of the state of stress in the overburden and underburden (including the basement) in CO 2 storage reservoirs using machine learning and integrated geomechanics and geophysical methods. Specifically, we propose to develop workflow encompassing of technologies and/or methods to predict stress and pressure changes due to CO 2 injection in an active tertiary recovery site and their impacts on subtle fault activation, fractures and occurrence of microseismic events and compare responses to field observations. In this project, we anticipate using dataset from the Farnsworth field Unit (FWU) which is operated by Purdure Petroleum. A novel elastic-waveform VSP inversion technique will be used to estimate high-resolution spatial and temporal changes of elastic moduli in CO 2 storage reservoirs, which will be combined with velocity-stress relationship derived from laboratory tests to obtain subsurface pressure and stress. Clustered microseismic data will be jointly inverted for improved focal mechanisms. Least-squares reverse-time migration of microseismic waveform data will be performed to directly image fracture/fault zones. Additionally, a deep neural network machine learning technique with convolutional and recurrent layers will be used for learning the spectro-temporal structures in microseismic waveforms. The results of this geotechnical data analysis will be integrated to develop a high-resolution 3D mechanical earth model extending from the overburden sealing formations to the underburden including the basement. Mechanical properties will be derived through integration of mechanical logs, tests, available results from chemo-mechanical laboratory tests, and elastic inversion of seismic data using a combination of Bayesian and stochastic methods as well as machine learning technique. Failure features (faults/fractures) will be represented and/or modeled based on seismic and core data analysis. A transient hydrodynamic-geomechanical model will be developed through coupling with the calibrated FWU reservoir simulation model. The full physics coupled model will be used to train a reduced order proxy model using machine learning algorithm for estimating stress which will then be used with appropriate constitutive relationships and forward seismological models to simulate pressure changes and induced microseismicity. An advanced optimization framework will be developed to perform a history match to minimize error between field observations and simulated. The history matched proxy model will be verified against the full-physics equivalent. The field observations that will be used in the coupled model calibration process include pressure/stress inverted from VSP, moment magnitude from microseismic analysis, real time downhole pressure measurements, production and injection data. Parameter sensitivity and uncertainty analysis will be performed to characterize the impact of model parameter uncertainty on stress estimates. The proposed project will have significant impact on future field implementation of the proposed technology. Because the project field site is an ongoing CO 2 EOR development, the value of the new technology will be demonstrated in an operational context and evaluated as a viable risk mitigation strategy. Cost/benefit will be evaluated together with the various commercial incentives for CO 2 sequestration available to oil and gas operators. The extensive available dataset and ongoing data acquisition under the SWP Phase III work plan provides flexibility for investigation of multiple approaches and reduces technical risk.

58 GEOSCIENCES↗
DOE OSTI2024

Synthesis of motif and symmetry for accelerated learning, discovery, and design of electronic structures for energy conversion applications (Final Technical Report)

The overall goal of the projects is to develop a framework to incorporate structure motifs and crystal/orbital symmetries into the data-driven materials discovery infrastructure. The PI proposed to develop structure-motif- and symmetry-based graph convolutional networks for effective learning and efficient predictions of electronic structures and related properties. Fundamental understanding of the roles of structure motif and symmetry will establish new hypothesis and design rules, which will be combined with high-throughput computations based on density functional theory to discover novel light absorbers, transparent conductors, as well as 2D light emitting materials and heterojunctions for optoelectronics.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Status of the muon neutrino charged-current zero mesons cross section measurement in the NOvA near detector

NOvA is a long-baseline accelerator neutrino experiment at Fermilab whose physics goals include precision neutrino oscillation as well as cross-section measurements. We present the status of the measurement of muon neutrino charged-current cross section with zero mesons in the final state at the NOvA near detector. This measurement will be made with respect to the kinematics of the final state particles. Our chosen interaction channel is especially sensitive to quasielastic and meson exchange current interactions and will provide a handle for constraining the cross section systematic uncertainties in oscillation analyses in current and future experiments. For particle identification, we use a convolutional neural network (CNN) trained on individual particles simulated in the NOvA near detector that allows us to select the desired signal while reducing the potential bias from neutrino interaction modeling. Charged pion background constraining is further improved via Michel electron tagging.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Digital Signal Processing Using Deep Neural Networks

Currently there is great interest in the utility of deep neural networks (DNNs) for the physical layer of radio frequency (RF) communications. In this manuscript we describe a custom DNN specially designed to solve problems in the RF domain. Our model leverages the mechanisms of feature extraction and attention through the combination of an autoencoder convolutional network with a transformer network, to accomplish several important communications network and digital signals processing (DSP) tasks. We also present a new open dataset and physical data augmentation model that enables training of DNNs that can perform automatic modulation classification, infer, and correct transmission channel effects, and directly demodulate baseband RF signals.

42 ENGINEERING↗
DOE OSTI2022

Machine learning approaches to streamline and enhance the analysis of multiscale imaging data for bioaerosol and soil particles

Bioaerosol and soil particles are ubiquitous in the environment. They are multicomponent and complex in nature displaying mixed inorganic and organic components. The way components are mixed in a bioaerosol sample is referred to as its mixing state. Soil particles are also a mixture of inorganic (mineral) and organic (soil organic matter) components. Bioaerosol particles contribute to a major fraction of coarse mode atmospheric particles, especially in the tropical areas, contributing up to 80 % of the particle mass concentration. The mixing state of particles is crucial to evaluate because it impacts several important environmental processes such as warm and cold cloud formation and radiation budget. Mixing states in aerosols are accompanied by chemical reactions across solid-liquid-gas interfaces. In this study, we utilized elemental compositions and microcopy images of thousands of atmospheric particles acquired by computer-controlled scanning electron microscope equipped with an energy-dispersive x-ray spectrometer to compute the mixing state of atmospheric particles. A 2D convolutional neural network (CNN), also known as convnet, was used to model the relationship between low resolution imaging data and higher resolution spectroscopy data, with the former as training input and the latter as target output. Two types of CNNs were implemented and tested; a basic CNN and an Inception-v3 network. For binary classification, the basic CNN achieved an accuracy of 84.29 % across all atom types, and the Inception-v3-like network achieved an accuracy 85.51 %. This study demonstrates the applicability of deep learning to handle large amounts of imaging/chemical spectroscopy data efficiently and evaluate particle mixing state from a range of environmental samples.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Journey Over Destination: Differentiable Sensor Placement Enhances Generalization [Poster]

The challenge of reconstructing spatial fields that change over time from limited sensor data has been a focal point for many research studies. Various machine learning methods have been used in attempts to address this complex issue, including convolutional neural networks. All of the proposed methods share a common requirement that the user needs to manually determine the sensor positions. This requirement remains a limiting factor in the ongoing quest for efficient learning and accurate field reconstruction. This study aims to present a method that enables a model to optimize sensor positions via backpropagation, thereby facilitating the model’s exploration of the spatial domain and enhancing sensor positioning effectively. Indexing naturally incorporates discrete decisions. This operation is nondifferentiable which is a requirement for the application of gradient-based optimization methods. We showcased its effectiveness by training an attention-based neural network, which achieved top-tier performance on two separate datasets. To our knowledge, this represents the first fully end-to-end differentiable workflow for enhancing sensor placement within a neural network model.

58 GEOSCIENCES↗
DOE OSTI2020

Neural MUSE Analysis

Researchers at Oak Ridge National Laboratory (ORNL) created data as part of the MUSE (Multi-Agency Urban Search Experiment Detector and Algorithm Test Bed) project simulating illicit nuclear materials located in various buildings along a road. In the simulation, a truck containing a radiation detector drives down the road gathering listmode data (counting the and energy of incident gamma radiation). Building materials, source shielding, driving speed, truck direction, truck location on the road, source type, and source placement are all varied between runs of the data set. This data was created using deterministic neutron transport and Monte Carlo methods through a combination of SCALE, MAVRIC, MCNP, and GADRAS. As part of a follow-on NA-22 project, two Kaggle competitions were created to determine the best algorithms for finding and identifying gamma sources in this simulated urban environment. The winning algorithm was neural network-based and had a test accuracy of 76.4% accuracy for source identification. This work seeks to build upon this work and improve the results through the application of novel machine learning techniques. As a first step, the data was classified by a simple Convolutional Neural Network (CNN) To accomplish this, the data was first preprocessed into “waterfall plots.” These plots are composed of energy vs count plots that are stacked vertically to show progression in time. The horizontal axis indicating the particle energy incorporated user defined bin spacing with options for in linear-, logarithmic-, square root-, and user-spaced bins. The z or color dimension showed the number of counts corresponding the energy-time combination. This data was then used to generate more data, by generating a local estimate of the mean of the distribution for a bin and then randomly re-sampling that bin from a Poisson distribution. Once all of this data was generated, it was fed into a well-known CNN architecture, ResNet50. The output layer of this model was removed and replaced with layers corresponding to the shape desired isotope outputs. The provided training data was used to train the classifier and the remaining testing data was used to evaluate the model. Results are soon to be forthcoming.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2023

Quarknet Project: Simulating Double-Source Plane Lenses and Einstein Rings for Domain Adaptation

Double-Source Plane Lenses (DSPLs) are a form of strong gravitational lensing that can be used to uniquely constrain cosmological parameters like the dark energy equation of state. These objects are exceedingly rare: to date, only four have been discovered in astronomical surveys, like the Sloan Digital Sky Survey and the HyperSuprimeCam Survey. Additionally, the main features of these objects are typically co-located sets of arcs, which look like Einstein Rings of single-source galaxy-galaxy lenses. Larger astronomical surveys typically have low image resolution, which significantly exacerbates issues when trying to find DSPLs. Future surveys are likely to include many more of these objects and have higher image resolution. Traditional methods for finding strong lenses struggle to identify simple galaxy-galaxy lenses. Recently, neural networks have become the standard for lens identification, but these tools have not yet been used to search for DSPLs. In this work, we use the software deeplenstronomy to simulate varied images of DSPLs and Einstein Rings – with and without noise and artifacts of observational surveys, forming a comprehensive benchmark dataset of 40,000 images. We utilise this dataset to perform experiments with convolutional neural networks to discern between the two phenomena. Sofia Grimm and Jerry Zhou are co-first authors on this work.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Unsupervised Learning Based Interaction Force Model for Nonspherical Particles in Incompressible Flows

This project provides a neural network-based interaction force model for gas-solid flows from low to intermediate Reynolds numbers and concentration, which can be linked to MFiX-DEM. We have constructed a database of the interaction force between the irregular-shaped particles using a spherical harmonic method and the fluid phase based on the particle-resolved direct numerical simulation (PR-DNS) with immersed boundary-based gas kinetic scheme. Unsupervised learning method, i.e., variational auto-encoder (VAE) has been applied to extract the primitive shape factors determining the drag force, lifting forces, and torque. The interaction force model has been trained and validated with a simple but effective multi-layer feed-forward neural network: multi-layer perceptron (MLP), which will be concatenated after the encoder of the previously trained VAE for geometry feature extraction for single, irregular particles. We have trained transpose convolutional neural networks with the PR-DNS data to predict the velocity and pressure gradient of the single particle systems and utilized them to calculate drag force of multi-particle systems. This model can provide high computational efficiency because it does not require collecting multiparticle system data from PR-DNS.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2022

In-situ Characterizations of Microstructural Degradation of Perovskite Solar Cells

Rapid progress has been achieved in perovskite solar cells (PSCs), and their efficiencies have improved from 3.8 % to 24.2 % in less than a decade. With low-cost processing, PSCs have shown exciting photovoltaic (PV) properties, such as effective optical absorption, a long carrier lifetime, and unique defect tolerance. While recent studies demonstrated improved stability up to 100 days, PSC technology is still challenged to meet the stringent industry requirements for commercialization. Despite considerable efforts, the underlying physical mechanisms for the inferior stability of PSCs are not well understood. One reason for this divergence is that many established measurement techniques (e.g., quantum efficiency, photoluminescence) probe the properties on length scales far greater than that of electronic and/or structural inhomogeneity (i.e., < 1 μm near grain boundaries) and therefore characterize convoluted and/or averaged properties. Ion/electron beam-based techniques have been extensively used to access the microstructures of PSCs, enabling atomic/nanoscale structural, chemical, optical, and electrical characterizations. For example, focused ion beam (FIB) milling produces an atomically smooth surface that minimizes the artifacts attributed to the surface roughness. FIB techniques can also create a well-defined cross-section of PSCs without mechanical damage in a physical cleaving sample preparation. While powerful, there are some concerns about possible beam damage of inorganic-organic perovskites via chemical-bond breakage and local heating. This project aims to comprehensively understand how the microstructural/interfacial properties of PSCs (e.g., Methylammonium Lead Iodide [MAPbI 3 ]) are modified under the irradiating ion beams. Specifically, we investigate the sub-surface properties of PSCs before and after Ar-ion beam injections. Kelvin probe force microscopy (KPFM) measures the contact potential differences (CPDs). Photoluminescence (PL) microscopy in conjunction with Finite-Difference Time-Domain (FDTD) simulations infers the formation of a “dead layer” (< 15 nm) on the subsurface of MAPbI 3 during Ar+ milling processes while preserving the initial bulk properties. The x-ray photoemission spectroscopy (XPS) confirms this modified surface is a lead-rich and iodine-deficient surface. We initiate customizing in-situ measurement setup while measuring the local optical and electrical properties of PSC under thermal (cooling, heating) and light stressors. Our results provide in-depth knowledge of the ion-beam impact on metal-halide perovskites and how this modified sub-surface impacts their properties under accelerated stressors of light and heat. Intensive Monte Carlo simulations of an electron beam interacting with PSCs provide the beam energy distribution in PSCs, proposing possible measurement conditions of using e-beam with minimizing beam damage. Our in-situ measurement platform can accommodate the diverse architecture of PSC devices for studying deterioration mechanisms under mixed environmental stressors.

14 SOLAR ENERGY↗
DOE OSTI2024

Small Hydropower Interconnection Best Practices Guidelines and Templates

The process for development of a hydropower project can be a convoluted and lengthy process involving numerous federal, state, and local agencies and encompass a plethora of stakeholders that other renewable project development processes may not have to consider. Additionally, the process may vary depending on who the owner/operator is, such as private, nonutility companies; private utility companies; municipalities; electric cooperatives; private citizens; and state and federal government agencies.

13 HYDRO ENERGY↗
DOE OSTI2024

Photovoltaic Cable Connectors: A Comparative Assessment of the Present State of the Industry [Slides]

The consequences of failure for balance of systems (BoS) components (such as PV cable connectors) include offline module string(s); low system voltage; arc, ground, insulation, and over-temperature faults; triggered fuse(s); system shutdown; and fire. The degradation modes for connectors are studied here through an industry survey and its subsequent examination, which are compared to field-degraded specimens. 117 specimens were obtained from a variety of locations and climates or accelerated tests. A failure analysis for connectors from PV installations was developed (and applied to 54 specimens) including nondestructive examinations (photography, a custom resistance-current scan, and X-ray computed tomography) and destructive examinations (featuring milling of the external plastic, extraction of the internal convolute spring, and potting and polishing in cross-section). Surface and through-thickness composition of the metal pins and springs was quantified using scanning electron microscopy with energy-dispersive X-ray spectroscopy. Fourier-transform infrared spectroscopy was used to verify the base polymer materials and compare the chemical structure of the connector body, bushing, end nut, and o-ring. Thermogravimetric analysis and differential scanning calorimetry were used to further verify the degradation of the same polymeric components. Updated from 2023 NIST/UL Workshop on Photovoltaic Materials Durability (website: https://events.ul.com/WPMogn?rt=aAuoWsl4E0KaORLCMeOgfA) and 2024 PVRW workshop (https://pvrw.nrel.gov/past-proceedings).

14 SOLAR ENERGY↗
DOE OSTI2024

Status of the Muon Neutrino Charged-Current Mesonless Cross Section Measurement in the NOvA Near Detector

NOvA is a long-baseline accelerator neutrino experiment at Fermilab whose physics goals include precision neutrino oscillation as well as cross-section measurements. We present the status of the measurement of a muon neutrino charged-current cross section with zero mesons in the final state at the NOvA near detector. This measurement is being made with respect to the kinematics of the final state muon. The chosen interaction channel is especially sensitive to quasielastic and meson exchange current interactions and aims to provide experimental constraints for the development of models of neutrino interactions. It will also provide a handle for constraining cross section systematic uncertainties in oscillation analyses in current and future experiments. For particle identification, we use a convolutional neural network (CNN) trained on individual particles simulated in the NOvA near detector that allows us to select the desired signal while reducing the potential bias from neutrino interaction modeling. Charged pion background constraining is further improved via Michel electron tagging.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Simple and Sophisticated Models of Taylor's Cylinder Impact

We present a study based on the simplest possible models for Taylor’s cylinder impact problem, in addition to examination of using convolutional neural networks (CNNs) to map cylinder profiles to strength calibrations. We find that the approximate treatments of Taylor and Hawkyard compare well with hydrodynamic simulations using an equivalent assumption of constant flow stress. The CNN models prove to be well suited to successfully infer parameterizations of the Preston-Tonks-Wallace model of plastic deformation based on the deformed profile of an impacted cylinder

36 MATERIALS SCIENCE↗
DOE OSTI2024

Measuring thermal profiles in high explosives using neural networks

We present a new method for calculating the temperature profile of high explosive (HE) material using a Convolutional Neural Network (CNN). To train/test the CNN, we have developed a hybrid experiment/simulation method for collecting acoustic and temperature data. We experimentally heat cylindrical containers of HE material until detonation/deflagration, where we continuously measure the acoustic bursts through the HE using multiple acoustic transducers lined around the exterior container circumference. However, measuring the temperature profile in the HE in an experiment would require inserting a large number of thermal probes, which would disrupt the heating process. Thus, we use two thermal probes, one at the HE center and one at the wall. We then use numerical simulation of the heating process to calculate the temperature distribution and correct the simulated temperatures based on the experimental center and wall temperatures. We calculate temperature errors on the order of 15 °C, which is ~12% of the range of temperatures in the experiment. We also investigate how the algorithm’s accuracy is affected by the number of acoustic receivers used to collect each measurement and the resolution of the temperature prediction. This work provides a means of assessing the safety status of HE material, which cannot be achieved using existing temperature measurement methods. In addition, it has implications for a range of other applications where internal temperature profile measurements would provide critical information. These applications include detecting chemical reactions, observing thermodynamic processes such as combustion, monitoring metal or plastic casting, determining the energy density in thermal storage capsules, and identifying abnormal battery operations.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Status of the Muon Neutrino Charged-Current Zero Mesons Cross Section at the NOvA Near Detector

NOvA is a long-baseline accelerator neutrino experiment at Fermilab whose physics goals include precision neutrino oscillation as well as cross-section measurements. We present the status of the measurement of a muon neutrino charged-current cross section with zero mesons in the final state at the NOvA near detector. This measurement is being made with respect to the kinematics of the final state muon. The chosen interaction channel is especially sensitive to quasielastic and meson exchange current interactions and aims to provide experimental constraints for the development of models of neutrino interactions. It will also provide a handle for constraining cross section systematic uncertainties in oscillation analyses in current and future experiments. For particle identification, we use a convolutional neural network (CNN) trained on individual particles simulated in the NOvA near detector that allows us to select the desired signal while reducing the potential bias from neutrino interaction modeling. Charged pion background constraining is further improved via Michel electron tagging.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Muon Neutrino Reconstruction at ICARUS with Machine Learning

The ICARUS T600 LArTPC detector successfully ran for three years at the underground LNGS laboratories, providing a first sensitive search for LSND-like anomalous electron neutrino appearance in the CNGS beam. After a significant overhauling at CERN, the T600 detector has been placed in its experimental hall at Fermilab, fully commissioned, and the first events observed with full detector readout. Regular data-taking began in May 2021 with neutrinos from the Booster Neutrino Beam (BNB) and neutrinos six degrees off-axis from the Neutrinos at the Main Injector (NuMI). Modern developments in machine learning have allowed for the development of an end-to-end machine learning-based event reconstruction for ICARUS data. This reconstruction folds in 3D voxel-level feature extraction using sparse convolutional neural networks and particle clustering using graph neural networks to produce outputs suitable for physics analyses. This poster will summarize the performance of a high-purity and high-efficiency end-to-end machine learning-based selection of muon neutrinos from the BNB and highlight studies of electromagnetic shower reconstruction from a neutral pion selection.

43 PARTICLE ACCELERATORS↗
DOE OSTI2020

Progress Toward the First Search for Bound Neutron Oscillation into Antineutron in a Liquid Argon TPC

This note presents current progress for a neutron-antineutron oscillation ($n–\overline{n}$) search in MicroBooNE paving the way for the first search analysis of such process in a Liquid Argon Time Projection Chamber (LArTPC). Convolutional Neural Network (CNN) and Boosted Decision Tree (BDT) algorithms were used to select signal $n–\overline{n}$ events over cosmogenic backgrounds. The CNN-only, BDT-only, and the combined (CNN+BDT) methods were demonstrated on the Monte-Carlo signal and background events. Validation of the CNNonly and the BDT-only methods was carried out on a small dataset of MicroBooNE Run1 off-beam data, setting the starting point toward further improvement of the analysis.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗