Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “deep generative models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 667 records · Page 37
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Transport and chemistry of isoprene and its oxidation products in deep convective clouds

Deep convective clouds can transport trace gases from the planetary boundary layer into the upper troposphere where subsequent chemistry may impact aerosol particle formation and growth. In this modelling study, we investigate processes that affect isoprene and its oxidation products injected into the upper troposphere by an isolated deep convective cloud in the Amazon. We run a photochemical box model with coupled cloud microphysics along hundreds of individual air parcel trajectories sampled from a cloud-resolving model simulation of a convective event. The box model simulates gas-phase chemical reactions, gas scavenging by liquid and ice hydrometeors, and turbulent dilution inside a deep convective cloud. The results illustrate the potential importance of gas uptake to anvil ice in regulating the intensity of the isoprene oxidation and associated low volatility organic vapour concentrations in the outflow. Isoprene transport and fate also depends on the abundance of lightning-generated nitrogen oxide radicals (NO x = NO + NO 2 ). If gas uptake on ice is efficient and lightning activity is low, around 30% of the boundary layer isoprene will survive to the cloud outflow after approximately one hour of transport, while all the low volatile oxidation products will be scavenged by the cloud hydrometeors. If lightning NO x is abundant and gas uptake by ice is inefficient, then all isoprene will be oxidised during transport or in the immediate outflow region, while several low volatility isoprene oxidation products will have elevated concentrations in the cloud outflow. Reducing uncertainties associated with the uptake of vapours on ice hydrometeors, especially HO 2 and oxygenated organics, is essential to improve predictions of isoprene and its oxidation products in deep convective outflows and their potential contribution to new particle formation and growth.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Characterizing Baselines and Change in Gas Hydrate Systems using EM Methods

The objective of this project was to advance our understanding of gas hydrate systems in nature by characterizing their electrical properties in the field and in the laboratory. In the laboratory measurements, methane hydrate was synthesized from pure water ice and flash frozen seawater, with varying amounts of sand or silt added. Electrical conductivity was determined by impedance spectroscopy, using equivalent circuit modeling to separate the effects of electrodes and to gain insight into conduction mechanisms. Silt and sand increase the conductivity of pure hydrate, inferred to be contaminant NaCl contributing to conduction in hydrate, to a peak conductivity in agreement with peak resistivities observed in well logs through massive hydrate (3,000--10,000 Ωm). The addition of silt and sand lowers the conductivity of hydrate synthesized from seawater, by an amount consistent with Archie's Law. All samples were characterized using cryogenic scanning electron microscopy and energy dispersive spectroscopy, which shows good connectivity of salt and brine phases. Electrical conductivity measurements of pure hydrate and hydrate mixed with silt during pressure-induced dissociation supports previous conclusions that sediment increases dissociation rate. In order to characterize gas hydrate systems in the field, we collected 360 line kilometers of controlled-source electromagnetic data on Walker Ridge 313, Orca Basin (WR100), Mad Dog (GC781), and Green Canyon 955 in the Gulf of Mexico, all areas with known or seismically inferred gas hydrate deposits and which have be drilled or targeted for future drilling. We deep-towed an EM transmitter that generates an alternating electric field which propagates through the seafloor geology. Data were recorded on 6 receivers towed behind the transmitter at distances between 550 and 1550 m. In the presence of conductive geology, the electric fields will be attenuated, and conversely, in resistive geology the fields will be preserved. Our data were inverted using a 2D inversion method that first optimizes the model-data misfit, then finds the smoothest model fitting the data. This ensures that resistivity structures present in the final model are likely necessary. At each of the proposed drilling sites we found increased resistivity, interpreted as increased hydrate concentrations. However, not only were the primary drilling sites not always more resistive than the alternate sites, at WR313 the strongest resistors were not at the locations targeted for drilling.

03 NATURAL GAS↗
DOE OSTI2022

Artificial intelligence inferred microstructural properties from voltage–capacity curves

Abstract The quantification of microstructural properties to optimize battery design and performance, to maintain product quality, or to track the degradation of LIBs remains expensive and slow when performed through currently used characterization approaches. In this paper, a convolution neural network-based deep learning approach (CNN) is reported to infer electrode microstructural properties from the inexpensive, easy to measure cell voltage versus capacity data. The developed framework combines two CNN models to balance the bias and variance of the overall predictions. As an example application, the method was demonstrated against porous electrode theory-generated voltage versus capacity plots. For the graphite|LiMn $$_2$$ 2 O $$_4$$ 4 chemistry, each voltage curve was parameterized as a function of the cathode microstructure tortuosity and area density, delivering CNN predictions of Bruggeman’s exponent and shape factor with 0.97 $$R^2$$ R 2 score within 2 s each, enabling to distinguish between different types of particle morphologies, anisotropies, and particle alignments. The developed neural network model can readily accelerate the processing-properties-performance and degradation characteristics of the existing and emerging LIB chemistries.

25 ENERGY STORAGE↗
DOE OSTI2020

DSCOVR/EPIC-derived global hourly and daily downward shortwave and photosynthetically active radiation data at 0.1° × 0.1° resolution

Downward shortwave radiation (SW) and photosynthetically active radiation (PAR) play crucial roles in Earth system dynamics. Spaceborne remote sensing techniques provide a unique means for mapping accurate spatiotemporally continuous SW–PAR, globally. However, any individual polar-orbiting or geostationary satellite cannot satisfy the desired high temporal resolution (sub-daily) and global coverage simultaneously, while integrating and fusing multisource data from complementary satellites/sensors is challenging because of co-registration, intercalibration, near real-time data delivery and the effects of discrepancies in orbital geometry. The Earth Polychromatic Imaging Camera (EPIC) on board the Deep Space Climate Observatory (DSCOVR), launched in February 2015, offers an unprecedented possibility to bridge the gap between high temporal resolution and global coverage and characterize the diurnal cycles of SW–PAR globally. In this study, we adopted a suite of well-validated data-driven machine-learning models to generate the first global land products of SW–PAR, from June 2015 to June 2019, based on DSCOVR/EPIC data. The derived products have high temporal resolution (hourly) and medium spatial resolution (0.1°×0.1°), and they include estimates of the direct and diffuse components of SW–PAR. We used independently widely distributed ground station data from the Baseline Surface Radiation Network (BSRN), the Surface Radiation Budget Network (SURFRAD), NOAA's Global Monitoring Division and the U.S. Department of Energy's Atmospheric System Research (ASR) program to evaluate the performance of our products, and we further analyzed and compared the spatiotemporal characteristics of the derived products with the benchmarking Clouds and the Earth's Radiant Energy System Synoptic (CERES) data. We found both the hourly and daily products to be consistent with ground-based observations (e.g., hourly and daily total SWs have low biases of -3.96 and -0.71 W m -2 and root-mean-square errors (RMSEs) of 103.50 and 35.40 W m -2 , respectively). The developed products capture the complex spatiotemporal patterns well and accurately track substantial diurnal, monthly, and seasonal variations in SW–PAR when compared to CERES data. They provide a reliable and valuable alternative for solar photovoltaic applications worldwide and can be used to improve our understanding of the diurnal and seasonal variabilities of the terrestrial water, carbon and energy fluxes at various spatial scales.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Converting tabular data into images for deep learning with convolutional neural networks

Abstract Convolutional neural networks (CNNs) have been successfully used in many applications where important information about data is embedded in the order of features, such as speech and imaging. However, most tabular data do not assume a spatial relationship between features, and thus are unsuitable for modeling using CNNs. To meet this challenge, we develop a novel algorithm, image generator for tabular data (IGTD), to transform tabular data into images by assigning features to pixel positions so that similar features are close to each other in the image. The algorithm searches for an optimized assignment by minimizing the difference between the ranking of distances between features and the ranking of distances between their assigned pixels in the image. We apply IGTD to transform gene expression profiles of cancer cell lines (CCLs) and molecular descriptors of drugs into their respective image representations. Compared with existing transformation methods, IGTD generates compact image representations with better preservation of feature neighborhood structure. Evaluated on benchmark drug screening datasets, CNNs trained on IGTD image representations of CCLs and drugs exhibit a better performance of predicting anti-cancer drug response than both CNNs trained on alternative image representations and prediction models trained on the original tabular data.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

OmniXAS: A universal deep-learning framework for materials x-ray absorption spectra

X-ray absorption spectroscopy (XAS) is a powerful characterization technique for probing the local chemical environment of absorbing atoms. However, analyzing XAS data presents significant challenges, often requiring extensive, computationally intensive simulations, as well as significant domain expertise. These limitations hinder the development of fast, robust XAS analysis pipelines that are essential in high-throughput studies and for autonomous experimentation. Here, we address these challenges with OmniXAS, a framework that contains a suite of transfer learning approaches for XAS prediction, each uniquely contributing to improved accuracy and efficiency, as demonstrated on the K-edge spectra database covering eight 3⁢d transition metals (Ti–Cu). The OmniXAS framework is built upon three distinct strategies. First, we use M3GNet [Nat. Comput. Sci. 2, 718 (2022)] to derive latent representations of the local chemical environment of absorption sites as input for XAS prediction, achieving significant improvements over conventional featurization techniques. Second, we employ a hierarchical transfer learning strategy, training a universal multitask model across elements before fine-tuning for element-specific predictions. Models based on this cascaded approach after elementwise fine-tuning outperform element-specific models by up to 69%. Third, we implement cross-fidelity transfer learning, adapting a universal model to predict spectra generated by simulation of a different fidelity with a much higher computational cost. This approach improves prediction accuracy by up to 11% over models trained on the target fidelity alone. Our approach significantly boosts the throughput of XAS modeling by orders of magnitude as compared to first-principles simulations and is extendable to XAS prediction for a broader range of elements. The proposed transfer learning framework is generalizable to enhance deep-learning models that target other properties in materials research.

36 MATERIALS SCIENCE↗
DOE OSTI2020

WRF Modelling of Deep Convection and Hail for Wind Power Applications

Deep convection and the related occurrence of hail, intense precipitation and wind gusts represent a hazard to a range of energy infrastructure including wind turbine blades. Wind turbine blade leading edge erosion (LEE) is caused by the impact of falling hydrometeors onto rotating wind turbine blades. It is a major source of wind turbine maintenance costs and energy losses from wind farms. In the United States Southern Great Plains (SGP), where there is widespread wind energy development, deep convection and hail events are common, increasing the potential for precipitation-driven LEE. A 25-day Weather Research and Forecasting (WRF) model simulation conducted at convection-permitting resolution and using a detailed microphysics scheme is carried out for the SGP to evaluate the effectiveness in modelling the wind and precipitation conditions relevant to LEE potential. WRF output for these properties is evaluated using radar observations of precipitation (including hail) and reflectivity, in situ wind speed measurements and wind power generation. This research demonstrates some skill for the primary drivers of LEE. Wind speeds, rainfall rates and precipitation totals show good agreement with observations. Here, the occurrence of precipitation during power producing wind speeds is also shown to exhibit fidelity. Hail events frequently occur during periods when wind turbines are rotating and are especially important to LEE in the SGP. The presence of hail is modelled with a mean proportion correct of 0.77 and an odds ratio 4.55. Further research is needed to demonstrate sufficient model performance to be actionable for the wind energy industry and there is evidence for positive model bias in cloud reflectivity.

17 WIND ENERGY↗
DOE OSTI2021

A Deep Exon Cryptic Splice Site Promotes Aberrant Intron Retention in a Von Willebrand Disease Patient

A translationally silent single nucleotide mutation in exon 44 (E44) of the von Willebrand factor (VWF) gene is associated with inefficient removal of intron 44 in a von Willebrand disease (VWD) patient. This intron retention (IR) event was previously attributed to reordered E44 secondary structure that sequesters the normal splice donor site. We propose an alternative mechanism: the mutation introduces a cryptic splice donor site that interferes with the function of the annotated site to favor IR. We evaluated both models using minigene splicing reporters engineered to vary in secondary structure and/or cryptic splice site content. Analysis of splicing efficiency in transfected K562 cells suggested that the mutation-generated cryptic splice site in E44 was sufficient to induce substantial IR. Mutations predicted to vary secondary structure at the annotated site also had modest effects on IR and shifted the balance of residual splicing between the cryptic site and annotated site, supporting competition among the sites. Further studies demonstrated that introduction of cryptic splice donor motifs at other positions in E44 did not promote IR, indicating that interference with the annotated site is context dependent. We conclude that mutant deep exon splice sites can interfere with proper splicing by inducing IR.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Dynamic coevolution of baseflow and multiscale groundwater flow system during prolonged droughts

Field and numerical studies suggest that baseflow is composed of waters from a spectrum of groundwater flow paths termed the Groundwater Flow System (GWFS) – from shallow hillslope contributions to watershed-scale deep circulation originating in headwaters and discharging into lowland rivers. Here, we explore the evolution of the GWFS under prolonged droughts to understand its dynamics and multiscale nature, and to elucidate its role in baseflow generation and recession at the watershed scale. In this work, we consider three drought scenarios of varying severity and simulate groundwater flow in a 2-D cross-section of an idealized watershed with deep permeable bedrock, tracking the evolution of flow paths, baseflow, and residence times during the recession process. We find that baseflow generation at different drainage stages, and within different subwatersheds, is influenced distinctly by flow paths of different scales, depending on the relative strength of the flow paths and the position of the subwatersheds relative to the recharge/discharge zones of the deeper watershed-scale groundwater circulation. Despite having the same local relief, geology, and climate, baseflow from each subwatershed has a distinct recession behavior and time-dependent residence time distribution. Also, the hydraulic and transport characteristics of baseflow generation co-evolve and are strongly affected by the connection state of the water table to subwatersheds. These findings suggest that asynchrony and dissimilarity of baseflow generation from hillslopes under the impact of the watershed-scale groundwater flow, and interactions with local-scale and intermediate-scale groundwater flow, must be taken into account when interpreting baseflow recession data and building conceptual baseflow models at the watershed scale.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Inverse mapping of properties to composition through generative modeling for designing molten salts

Generative modeling (GM) has been increasingly used for the inverse design and optimization of materials, yet its application to molten salt mixtures remains unexplored despite how a successful approach to the inverse design of molten salts would contribute to efficiently exploiting their customizability and unlocking their advantages in applications, such as energy production and energy storage. This work presents a workflow for the inverse design of molten salts with targeted density values, addressing the challenge of representing these complex mixtures in GM. A dataset of critically evaluated molten salt densities is used to train a variational autoencoder coupled with a predictive deep neural network, which then can be used to generate new molten salt compositions with desired density values. The effectiveness of the approach is demonstrated by designing mixtures with distinct densities and validating the predicted values using ab initio molecular dynamics simulations.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Evaluation of Nuclear Spent Fuel Disposal in Clay-Bearing Rock - Process Model Development and Experimental Studies

This report represents the milestone deliverable M2SF-23SN010301072 “Evaluation of Nuclear Spent Fuel Disposal in Clay-Bearing Rock - Process Model Development and Experimental Studies” The report provides a status update of FY23 activities for the work package Argillite Disposal work packages for the DOE-NE Spent Fuel Waste Form Science and Technology (SFWST) Program. Clay-rich geological media (often referred as shale or argillite) are among the most abundant type of sedimentary rock near the Earth’s surface. Argillaceous rock formations have the following advantageous attributes for deep geological nuclear waste disposal: widespread geologic occurrence, found in stable geologic settings, low permeability, self-sealing properties, low effective diffusion coefficient, high sorption capacity, and have the appropriate depth and thickness to host nuclear waste repository concepts. The DOE R&D program under the Spent Fuel Waste Science Technology (SFWST) campaign has made key progress (through experiment, modeling, and testing) in the study of chemical and physical phenomena that could impact the long-term safety assessment of heat-generating nuclear waste disposition in clay/shale/argillaceous rock. International collaboration activities comprising field-scale heater tests, field data monitoring, and laboratory-scale experiments provide key information on changes to the engineered barrier system (EBS) material exposed high thermal loads. Moreover, consideration of direct disposal of large capacity dual-purpose canisters (DPCs) as part of the back-end SNF waste disposition strategy has generated interest in improving our understanding of the effects of elevated temperatures on the engineered barrier system (EBS) design concepts. Chemical and structural analyses of sampled bentonite material from laboratory tests at elevated temperatures are key to the characterization of thermal effects affecting bentonite clay barrier performance. The knowledge provided by these experiments is crucial to constrain the extent of sacrificial zones in the EBS design during the thermal period. Thermal, hydrologic, mechanical, and chemical (THMC) data collected from heater tests and laboratory experiments have been used in the development, validation, and calibration of THMC simulators to model near-field coupled processes. This information leads to the development of simulation approaches to assess issues on coupled processes involving porous media flow, transport, geomechanical phenomena, chemical interactions with barrier/geologic materials, and the development of EBS concepts. These lines of knowledge are central to the design of deep geological backfilled repository concepts where temperature plays a key role in the EBS behavior, potential interactions with host rock, and long-term performance in the safety assessment.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2020

SO(3)-invariance of informed-graph-based deep neural network for anisotropic elastoplastic materials

This work examines the frame-invariance (and the lack thereof) exhibited in simulated anisotropic elasto-plastic responses generated from supervised machine learning of classical multi-layer and informed-graph-based neural networks, and proposes different remedies to fix this drawback. The inherent hierarchical relations among physical quantities and state variables in an elasto-plasticity model are first represented as informed, directed graphs, where three variations of the graph are tested. While feed-forward neural networks are used to train path-independent constitutive relations (e.g., elasticity), recurrent neural networks are used to replicate responses that depends on the deformation history, i.e. or path dependent. In dealing with the objectivity deficiency, we use the spectral form to represent tensors and, subsequently, three metrics, the Euclidean distance between the Euler Angles, the distance from the identity matrix, and geodesic on the unit sphere in Lie algebra, can be employed to constitute objective functions for the supervised machine learning. In this, the aim is to minimize the measured distance between the true and the predicted 3D rotation entities. Following this, we conduct numerical experiments on how these metrics, which are theoretically equivalent, may lead to differences in the efficiency of the supervised machine learning as well as the accuracy and robustness of the resultant models. Neural network models trained with tensors represented in component form for a given Cartesian coordinate system are used as a benchmark. Our numerical tests show that, even given the same amount of information and data, the quality of the anisotropic elasto-plasticity model is highly sensitive to the way tensors are represented and measured. The results reveal that using a loss function based on geodesic on the unit sphere in Lie algebra together with an informed, directed graph yield significantly more accurate rotation prediction than the other tested approaches.

42 ENGINEERING↗
DOE OSTI2022

Development of a plug-and-play anti-noise module for fault diagnosis of rotating machines in nuclear power plants

The health of rotating machines is crucial to the stable operation and safety of nuclear power plants. However, research on machine learning-based fault diagnosis of rotating machines in the nuclear industry is still in its infancy. The signal noise generated in the plant may negatively affect the effectiveness of the analysis. In this paper, a plug-and-play anti-noise machine learning module is proposed to fill the knowledge and capability gap. The modules are loaded into a convolutional neural network called deep residual network (ResNet) to obtain a new model with noise reduction capability. The basic idea is that the module is able to identify noise features and include them in the subsequent analysis, effectively filtering noise at the feature level of the network. Nine variants of the new model are compared with the original ResNet as well as four classical machine learning models to test the effectiveness of the module and to examine the impact of the module's loading modes on the performance of the new model. Finally, this research helps facilitate the application of machine learning in the plant noise environment.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2021

Comparative evaluation of deep learning workloads for leadership-class systems

Deep learning (DL) workloads and their performance at scale are becoming important factors to consider as we design, develop and deploy next-generation high-performance computing systems. Since DL applications rely heavily on DL frameworks and underlying compute (CPU/GPU) stacks, it is essential to gain a holistic understanding from compute kernels, models, and frameworks of popular DL stacks, and to assess their impact on science-driven, mission-critical applications. At Oak Ridge Leadership Computing Facility (OLCF), we employ a set of micro and macro DL benchmarks established through the Collaboration of Oak Ridge, Argonne, and Livermore (CORAL) to evaluate the AI readiness of our next-generation supercomputers. In this paper, we present our early observations and performance benchmark comparisons between the Nvidia V100 based Summit system with its CUDA stack and an AMD MI100 based testbed system with its ROCm stack. We take a layered perspective on DL benchmarking and point to opportunities for future optimizations in the technologies that we consider.

Yin, Junqi↗
DOE OSTI2024

The SciDAC QuantOm Framework: A composable Workflow

As part of the Scientific Discovery through Advanced Computing (SciDAC) program, the Quantum Chromodynamics Nuclear Tomography (QuantOM) project aims to analyze data from Deep Inelastic Scattering (DIS) experiments conducted at Jefferson Lab and the upcoming Electron Ion Collider. The DIS data analysis is performed on an event-level by leveraging nuclear theory models and accounting for experimental conditions. In order to efficiently run multiple analyses under varying conditions, a composable workflow was designed where each section (theory, experiment, objective minimization, etc.) has its own dedicated module. The optimization, i.e. the fit of theory to experimental data is carried out by deep learning techniques, such as Generative Adversarial Networks (GANs) or Reinforcement Learning (RL). This presentation gives an overview of the current status of the workflow, highlights present and future challenges, and highlights possible extensions to other projects with similar requirements.

Lersch, Daniel↗
DOE OSTI2025

Virtual Reality for Shoot/No-Shoot Decision Training in Law Enforcement: A Literature Review and Research Agenda

Virtual reality (VR) can materially improve “shoot / no-shoot” (SNS) training by giving officers realistic, repeatable practice making high-stakes decisions under pressure. Traditional tools—live-fire ranges and video simulators—build basics, but they cannot adapt to each officer in real time or fully mirror the complexity of the field. VR closes that gap by creating immersive scenarios that are safer, more flexible, easier to scale across units, and able to capture objective performance data. SNS decisions are not just about marksmanship; they rely on perception, judgment, memory, and the ability to hold fire when a threat is uncertain. Effective training therefore needs realism, decision complexity, and branching outcomes that reflect the true consequences of choices. These elements strengthen recognition of hostile intent while reducing false positives and building the self-control required in ambiguous situations. VR brings specific advantages: dynamic environments, full-body interaction, and the ability to measure performance with precision—enabling targeted feedback and better transfer of learning to the street. At the same time, responsible deployment must address scenario quality (credible environments and behaviors), lawful decision models, and user wellbeing (appropriate stress levels, comfort, and safety). Sandia’s VIPER Lab is positioned to lead this work. The team combines human-performance science, AI/ML, and VR/AR development with a deep equipment bench (e.g., omnidirectional treadmill, eye-tracking, haptics, multiple HMDs). This ecosystem supports building and validating next-generation SNS training that is immersive, measurable, and trustworthy. Bottom line: Investment in VR-enabled SNS training that blends evidence-based design with careful validation and legal safeguards is expected to pay off in safer, more consistent decision-making and improved community trust, delivered through training that is practical to deploy at scale.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2021

Smart Methane Emission Detection System Development (Final Report)

Working with the Department of Energy's National Energy Technology Laboratory, Southwest Research Institute® (SwRI®) developed a system to identify methane leaks reliably, accurately, and autonomously at critical midstream sections of the natural gas distribution network in real-time for the purpose of mitigating methane emissions using Optical Gas Imaging (OGI) cameras. SwRI's Smart Leak Detection – Methane (SLED/M) adds a high degree of automation to the process of methane leak detection to minimize sources of human error, minimize response time to a leak event, and maximize midstream visibility. Furthermore, SwRI has been working towards integrating Quantitative OGI (QOGI) capabilities into this existing technology. By leveraging Deep Learning, SwRI now has the capability to estimate fugitive emission leak rates quickly and reliably, which allows operators to detect emissions, quantify leak rate, prioritize repairs, and validate the repairs in a single instrument. The next generation QOGI technology leverages the same cameras used in Leak Detection and Repair (LDAR) programs, with improvements in safety and speed for traditional quantification-based repairs, ultimately leading to less overhead cost for the operators. The goals for this research were to develop two types of models with the following goals: Run in real-time on the edge (≥ 12 Hz), Classification: Achieve less than 5% false positive detection, Classification: Achieve ≥ 95% methane plume detection rate, Regression: achieve ≤ 10 standard cubic feet per hour (scfh) prediction > 70% of the time. In order to achieve these results, multiple infrared (IR) and other sensors were investigated in tandem with the midwave IR (MWIR) OGI to provide additional information to train the underlying models. Information on atmospheric conditions including humidity, temperature, pressure, and solar radiation was provided by a weather station. Several machine learning and deep learning architectures and methods, including looking at quantized classification networks and regressions networks, were explored. As further data was collected, curated, and labeled, it allowed for more refined regressive networks to be adequately trained, leading to better insight into the true flow rates being observed. An important valuable deliverable of this research effort was the development of an advanced network which underwent multiple iterations capable of giving a continuous output. The current network has a predicted mean average percentage error (MAPE) of 12.3% just outside our target goal of 10.00%, but an accuracy of 97.78% at ±50 scfh, well within the overall goal for the Department of Energy (DOE) program. Upon closer inspection, it was observed that more than 10% of datapoints contributing to the MAPE predictions were the result of low flow rate predictions and are beyond the sensitivity of instrument measurement as a result of normal operational variation and noise.

03 NATURAL GAS↗
DOE OSTI2021

Smart Methane Emission Detection System Development (Final Report)

Working with the Department of Energy’s National Energy Technology Laboratory, Southwest Research Institute® (SwRI®) developed a system to identify methane leaks reliably, accurately, and autonomously at critical midstream sections of the natural gas distribution network in real- time for the purpose of mitigating methane emissions using Optical Gas Imaging (OGI) cameras. SwRI’s Smart Leak Detection – Methane (SLED/M) adds a high degree of automation to the process of methane leak detection to minimize sources of human error, minimize response time to a leak event, and maximize midstream visibility. Furthermore, SwRI has been working towards integrating Quantitative OGI (QOGI) capabilities into this existing technology. By leveraging Deep Learning, SwRI now has the capability to estimate fugitive emission leak rates quickly and reliably, which allows operators to detect emissions, quantify leak rate, prioritize repairs, and validate the repairs in a single instrument. The next generation QOGI technology leverages the same cameras used in Leak Detection and Repair (LDAR) programs, with improvements in safety and speed for traditional quantification-based repairs, ultimately leading to less overhead cost for the operators. The goals for this research were to develop two types of models with the following goals: 1. Run in real-time on the edge (≥ 12 Hz) 2. Classification: Achieve less than 5% false positive detection 3. Classification: Achieve ≥ 95% methane plume detection rate 4. Regression: achieve ≤ 10 standard cubic feet per hour (scfh) prediction > 70% of the time In order to achieve these results, multiple infrared (IR) and other sensors were investigated in tandem with the midwave IR (MWIR) OGI to provide additional information to train the underlying models. Information on atmospheric conditions including humidity, temperature, pressure, and solar radiation was provided by a weather station. Several machine learning and deep learning architectures and methods, including looking at quantized classification networks and regressions networks, were explored. As further data was collected, curated, and labeled, it allowed for more refined regressive networks to be adequately trained, leading to better insight into the true flow rates being observed. An important valuable deliverable of this research effort was the development of an advanced network which underwent multiple iterations capable of giving a continuous output. The current network has a predicted mean average percentage error (MAPE) of 12.3% just outside our target goal of 10.00%, but an accuracy of 97.78% at ±50 scfh, well within the overall goal for the Department of Energy (DOE) program. Upon closer inspection, it was observed that more than 10% of datapoints contributing to the MAPE predictions were the result of low flow rate predictions and are beyond the sensitivity of instrument measurement as a result of normal operational variation and noise.

03 NATURAL GAS↗