Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Deep Direct Use”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Deep learning ferroelectric polarization distributions from STEM data via with and without atom finding

Over the last decade, scanning transmission electron microscopy (STEM) has emerged as a powerful tool for probing atomic structures of complex materials with picometer precision, opening the pathway toward exploring ferroelectric, ferroelastic, and chemical phenomena on the atomic scale. Analyses to date extracting a polarization signal from lattice coupled distortions in STEM imaging rely on discovery of atomic positions from intensity maxima/minima and subsequent calculation of polarization and other order parameter fields from the atomic displacements. Here, we explore the feasibility of polarization mapping directly from the analysis of STEM images using deep convolutional neural networks (DCNNs). In this approach, the DCNN is trained on the labeled part of the image (i.e., for human labelling), and the trained network is subsequently applied to other images. We explore the effects of the choice of the descriptors (centered on atomic columns and grid-based), the effects of observational bias, and whether the network trained on one composition can be applied to a different one. This analysis demonstrates the tremendous potential of the DCNN for the analysis of high-resolution STEM imaging and spectral data and highlights the associated limitations.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Time-lapse seismic inversion for CO 2 saturation with SeisCO2Net: An application to Frio-II site

Seismic monitoring of geological CO 2 storage (GCS) involves highly nonlinear seismic inversion and petrophysical inversion, making it challenging to estimate CO 2 volume efficiently and detect possible early CO 2 leakages. Deep learning (DL) using convolutional neural networks (CNNs) has shown promise in solving highly nonlinear seismic inversion problems. However, direct estimation of CO 2 plume extent/saturation from time-lapse seismic gathers using DL is still underexplored, with no reported field applications to date. The investigation of field data is primarily hindered by scarcity of field data for neural network training. Other obstacles include highly nonlinear seismic-petrophysics inverse relationship, and presence of noise in field seismic data. We introduce SeisCO2Net, a deep CNN that predicts CO 2 saturation maps directly from time-lapse full waveform shot gathers. For training, we use site-specific geological information, fluid flow physics, rock physics, and seismic modeling to generate synthetic datasets that closely resemble the CO 2 storage site. Synthetic tests show promising results, inspiring us to apply SeisCO2Net's trained weights on field data collected at Frio-II GCS site by leveraging transfer learning principles. As reference, we compare SeisCO2Net's predicted CO 2 saturation maps with results obtained from physics-based inversion. Our analyses show both methods display similar CO 2 plume shapes, reasonable CO 2 plume characteristics, and comparable saturation values. Our results suggest pre-training CNNs on physics-informed synthetic datasets and then applying the learned weights to field data is a viable approach to estimating field CO 2 saturation. This method effectively addresses the scarcity of field training data, thus encouraging the feasibility of long-term GCS monitoring.

58 GEOSCIENCES↗
DOE OSTI2021

Deep Learning the Electromagnetic Properties of Metamaterials—A Comprehensive Review

Deep neural networks (DNNs) are empirically derived systems that have transformed traditional research methods, and are driving scientific discovery. Here, artificial electromagnetic materials (AEMs)—including electromagnetic metamaterials, photonic crystals, and plasmonics—are research fields where DNN results valorize the data driven approach; especially in cases where conventional methods have failed. In view of the great potential of deep learning for the future of artificial electromagnetic materials research, the status of the field with a focus on recent advances, key limitations, and future directions is reviewed. Strategies, guidance, evaluation, and limits of using deep networks for both forward and inverse AEM problems are presented.

14 SOLAR ENERGY↗
DOE OSTI2020

Tracking atomic structure evolution during directed electron beam induced Si-atom motion in graphene via deep machine learning

Using electron beam manipulation, we enable deterministic motion of individual Si atoms in graphene along predefined trajectories. Structural evolution during the dopant motion was explored, providing information on changes of the Si atom neighborhood during atomic motion and providing statistical information of possible defect configurations. The combination of a Gaussian mixture model and principal component analysis applied to the deep learning-processed experimental data allowed disentangling of the atomic distortions for two different graphene sublattices. This approach demonstrates the potential of e-beam manipulation to create defect libraries of multiple realizations of the same defect and explore the potential of symmetry breaking physics. The rapid image analytics enabled via a deep learning network further empowers instrumentation for e-beam controlled atom-by-atom fabrication. Here, the analysis described in the paper can be reproduced via an interactive Jupyter notebook at https://git.io/JJ3Bx.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

NETL Non-Destructive Core Characterization

This product describes the Characterization efforts since 2017; the current methods used, publication, deep dives into method applications, and future direction of the Core Characterization work.

Paronish, Thomas J.↗
DOE OSTI2023

Astronomical image time series classification using CONVolutional attENTION (ConvEntion)

Aims: The treatment of astronomical image time series has won increasing attention in recent years. Indeed, numerous surveys following up on transient objects are in progress or under construction, such as the Vera C. Rubin Observatory Legacy Survey for Space and Time (LSST), which is poised to produce huge amounts of these time series. The associated scientific topics are extensive, ranging from the study of objects in our galaxy to the observation of the most distant supernovae for measuring the expansion of the universe. With such a large amount of data available, the need for robust automatic tools to detect and classify celestial objects is growing steadily. Methods: This study is based on the assumption that astronomical images contain more information than light curves. In this paper, we propose a novel approach based on deep learning for classifying different types of space objects directly using images. We named our approach ConvEntion, which stands for CONVolutional attENTION. It is based on convolutions and transformers, which are new approaches for the treatment of astronomical image time series. Our solution integrates spatio-temporal features and can be applied to various types of image datasets with any number of bands. Results: In this work, we solved various problems the datasets tend to suffer from and we present new results for classifications using astronomical image time series with an increase in accuracy of 13%, compared to state-of-the-art approaches that use image time series, and a 12% increase, compared to approaches that use light curves.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Molecular Vision - Multimodal, multitask retrieval of molecular structure from measured signatures for reference-free compound identification

We are currently at risk of generating false conclusions based on limited methods to identify small molecules in biological systems and in chemical forensics. By definition, the chemical structures of novel small molecules have not been determined, let alone measured or synthesized. Currently, unambiguous structure determination of small molecules is constrained by the time and effort needed to isolate compounds and perform de novo structure elucidation using laboratory-based methods, significantly extending the time to inform mitigation strategies. To address this gap, we have developed a deep learning approach to directly map molecular structure to experimental signatures. We aim to unify measurement technologies employed in untargeted small molecule identification studies—such as infrared (IR) spectrometry, tandem mass spectrometry (MS/MS), ion mobility spectrometry-derived collision cross section (CCS)—through use of a multimodal, multitask deep learning architecture. Where existing methods require direct generation of information-rich spectra and/or properties, an inherently difficult task, we will simplify molecular signature-based identification by posing the problem as a recognition or retrieval task. The model is thus presented with relevant endpoints – structure and one or more molecular signatures – and need only determine whether they are semantically related. Thus, our approach offers the following advantages over existing techniques: (i) circumvents difficulties associated with direct generation of molecular signatures from structure and structure from signatures; (ii) incorporates multiple molecular signatures simultaneously, as available, to support identification; and (iii) enables rapid computation of structural embeddings toward broad coverage of known chemical space. Taken together, the approach removes the need to explicitly obtain or compute reference spectra, representing a powerful method for compound identification that requires only experimentally observed signatures.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Elevated ionizing photon production efficiency in faint high-equivalent-width Lyman-α emitters

ABSTRACT While low-luminosity galaxies dominate number counts at all redshifts, their contribution to cosmic reionization is poorly understood due to a lack of knowledge of their physical properties. We isolate a sample of 35 z ≈ 4–5 continuum-faint Lyman-α emitters from deep VLT/MUSE spectroscopy and directly measure their H α emission using stacked Spitzer/IRAC Ch. 1 photometry. Based on Hubble Space Telescope imaging, we determine that the average UV continuum magnitude is fainter than −16 (≈ 0.01 L⋆), implying a median Lyman-α equivalent width of 259 Å. By combining the H α measurement with the UV magnitude, we determine the ionizing photon production efficiency, ξion, a first for such faint galaxies. The measurement of log10 (ξion [Hz erg−1]) = 26.28 ($^{+0.28}_{-0.40}$) is in excess of literature measurements of both continuum- and emission line-selected samples, implying a more efficient production of ionizing photons in these lower luminosity, Lyman-α-selected systems. We conclude that this elevated efficiency can be explained by stellar populations with metallicities between 4 × 10−4 and 0.008, with light-weighted ages less than 3 Myr.

Maseda, Michael V.↗
DOE OSTI2022

Serendipitous Discovery of Three Millisecond Pulsars with the GMRT in Fermi-directed Survey and Follow-up Radio Timing

We report the discovery of three millisecond pulsars (MSPs): PSRs J1120–3618, J1646–2142, and J1828+0625 with the Giant Metrewave Radio Telescope (GMRT) at a frequency of 322 MHz using a 32 MHz observing bandwidth. These sources were discovered serendipitously while conducting the deep observations to search for millisecond radio pulsations in the directions of unidentified Fermi Large Area Telescope (LAT) γ-ray sources. We also present phase coherent timing models for these MSPs using ~5 yr of observations with the GMRT. PSR J1120–3618 has a 5.5 ms spin period and is in a binary system with an orbital period of 5.6 days and minimum companion mass of 0.18 M ⊙ , PSR J1646–2142 is an isolated object with a spin period of 5.8 ms, and PSR J1828+0625 has a spin period of 3.6 ms and is in a binary system with an orbital period of 77.9 days and minimum companion mass of 0.27 M ⊙ . The two binaries have very low orbital eccentricities, in agreement with expectations for MSP-helium white dwarf systems. Using the GMRT 607 MHz receivers having a 32 MHz bandwidth, we have also detected PSR J1646–2142 and PSR J1828+0625, but not PSR J1120–3618. PSR J1646–2142 has a wide profile, with significant evolution between 322 and 607 MHz, whereas PSR J1120–3618 exhibits a single peaked profile at 322 MHz and PSR J1828+0625 exhibits a single peaked profile at both the observing frequencies. These MSPs do not have γ-ray counterparts, indicating that these are not associated with the target Fermi LAT pointing emphasizing the significance of deep blind searches for MSPs.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Stress analysis using direct-S wavelets produced by a vertical vibrator

We have determined how to extract the azimuth of maximum horizontal stress (SHmax) in deep rocks by doing a simple 360° mathematical rotation of a downgoing direct-S wavelet generated at the baseplate of a surface-based vertical vibrator. We worked with direct-S wavelets that travel through stressed rocks to a deep horizontal vertical seismic profile (VSP) geophone. We find that the azimuth where a polarity reversal occurs in mathematical rotations of this downgoing direct-S wavelet defines the azimuth of the SHmax in the overlying rocks. We tested this direct-S wavelet rotation method for determining the SHmax azimuth at a site in the Illinois Basin using legacy VSP data acquired in 2013. SHmax azimuths indicated by this simple wavelet-rotation method were determined when vertical vibrators were stationed at zero offset, at far offset, and at different azimuths around a VSP receiver well. These VSP-based SHmax azimuths agreed with the azimuth of the SHmax found by traditional minifrac tests in the VSP receiver well. This simple VSP data analysis procedure for detecting the azimuth of maximum horizontal stress has never, to our knowledge, been reported or discussed in the geophysical literature. This technical finding should be of interest to the worldwide geophysical community, especially to people who need to monitor how stress fields shift when fluids are injected into, or extracted from, deep porous reservoirs.

Geochemistry & Geophysics↗
DOE OSTI2021

Statistically-informed deep learning for gravitational wave parameter estimation

We introduce deep learning models to estimate the masses of the binary components of black hole mergers, $(m_1,m_2)$, and three astrophysical properties of the post-merger compact remnant, namely, the final spin, $a_\mathrm f$, and the frequency and damping time of the ringdown oscillations of the fundamental $\ell = m = 2$ bar mode, $(\omega_\mathrm R, \omega_\mathrm I)$. Our neural networks combine a modified WaveNet architecture with contrastive learning and normalizing flow. We validate these models against a Gaussian conjugate prior family whose posterior distribution is described by a closed analytical expression. Upon confirming that our models produce statistically consistent results, we used them to estimate the astrophysical parameters $(m_1,m_2, a_\mathrm f, \omega_\mathrm R, \omega_\mathrm I)$ of five binary black holes: GW150914, GW170104, GW170814, GW190521 and GW190630. We use PyCBC Inference to directly compare traditional Bayesian methodologies for parameter estimation with our deep learning based posterior distributions. Our results show that our neural network models predict posterior distributions that encode physical correlations, and that our data-driven median results and 90% confidence intervals are similar to those produced with gravitational wave Bayesian analyses. This methodology requires a single V100 NVIDIA GPU to produce median values and posterior distributions within two milliseconds for each event. Furthermore, this neural network, and a tutorial for its use, are available at the Data and Learning Hub for Science.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Modern deep neural networks for Direct Normal Irradiance forecasting: A classification approach

The escalating energy demand and the adverse environmental impacts of fossil-fuel use necessitate a shift towards cleaner and renewable alternatives. Concentrated Solar Power (CSP) technology emerges as a promising solution, offering a carbon-free alternative for power generation. The efficiency and profitability of CSP depend on the Direct Normal Irradiance (DNI) component of solar radiation; hence, accurate DNI forecasting can help optimize CSP plants’ operations and performance. The unpredictable nature of weather phenomena, particularly cloud cover, introduces uncertainty into DNI projections. Existing DNI forecasting models use meteorological factors, which are both challenging to estimate numerically over short prediction windows and expensive to model through data at a sufficiently high spatial and temporal resolution. This research addresses the challenge by presenting a novel approach that formulates DNI prediction as a multi-class classification problem, departing from conventional regression-based methods. The primary objective of this classification framework is to identify optimal periods aligning with specific operational thresholds for CSP plants, contributing to enhanced dispatch optimization strategies. We model the DNI classification problem using four advanced deep neural networks – rectified linear unit (ReLU) networks, 1D residual networks (ResNets), bidirectional long short-term memory (BiLSTM) networks, and transformers – achieving accuracies up to 93.5% without requiring meteorological parameters.

14 SOLAR ENERGY↗
DOE OSTI2023

Improving Protein–Ligand Interaction Modeling with cryo-EM Data, Templates, and Deep Learning in 2021 Ligand Model Challenge

Elucidating protein–ligand interaction is crucial for studying the function of proteins and compounds in an organism and critical for drug discovery and design. The problem of protein–ligand interaction is traditionally tackled by molecular docking and simulation, which is based on physical forces and statistical potentials and cannot effectively leverage cryo-EM data and existing protein structural information in the protein–ligand modeling process. In this work, we developed a deep learning bioinformatics pipeline (DeepProLigand) to predict protein–ligand interactions from cryo-EM density maps of proteins and ligands. DeepProLigand first uses a deep learning method to predict the structure of proteins from cryo-EM maps, which is averaged with a reference (template) structure of the proteins to produce a combined structure to add ligands. The ligands are then identified and added into the structure to generate a protein–ligand complex structure, which is further refined. The method based on the deep learning prediction and template-based modeling was blindly tested in the 2021 EMDataResource Ligand Challenge and was ranked first in fitting ligands to cryo-EM density maps. These results demonstrate that the deep learning bioinformatics approach is a promising direction for modeling protein–ligand interactions on cryo-EM data using prior structural information.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Anisotropic jet broadening and jet shape

In this paper, we explore the use of jet substructure as a way of probing phenomena which break the isotropic behavior of jets, such as jet propagation through an anisotropically flowing quark-gluon plasma or spin correlations. We introduce two novel observables for this purpose: the azimuthal-dependent jet broadening and the azimuthal-dependent jet shape, which generalize the traditional isotropic substructure studies. Using Soft-Collinear Effective Theory, we explicitly calculate the jet functions associated with these observables with a standard jet axis and with a Winner-Take-All jet axis in both the resummed and fixed order limits. While our analysis first and foremost establishes the formalism for the azimuthal-dependent jet substructure, it also brings to light new results for jet substructure in the azimuthally integrated case, such as the semi-inclusive jet function and the exclusive jet shape for the Winner-Take-All axis, and the jet broadening in the fixed order region. As an illustrative example for the new formalism we demonstrate that the azimuthal-dependent jet broadening can be used as a direct probe of the transversity parton distribution function in deep inelastic scattering.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Applying Machine Learning to the Classification of DC-DC Converters. NA-22 Final Report

Tools are now available that enable measurement electromagnetic radiation (EMR) from active electronics in an item. This radiation may be intended WIFI or cellular network links, for example or unintended such as the switching noise generated by DC-to-DC converters. It would be extremely valuable to have the capability to discriminate between the low-voltage DC-to-DC converters or other digital noise prevalent in most modern electronics, versus the high-voltage DC-to-DC converters used in utility firesets. Previous work performed under a Sandia Laboratory Directed Research and Development (LDRD) project on Charge State Detection using a deep neural network has been continued in this effort. A state-of-the-art supervised machine learning algorithm has not only been extended to discriminate between low and high voltage converters but has been validated in determining a converters make and model.

42 ENGINEERING↗
DOE OSTI2023

Identification and characterization of deep nitrogen acceptors in β-Ga 2 O 3 using defect spectroscopies

The ability to achieve highly resistive beta-phase gallium oxide (β-Ga 2 O 3 ) layers and substrates is critical for β-Ga 2 O 3 high voltage and RF devices. To date, the most common approach involves doping with iron (Fe), which generates a moderately deep acceptor-like defect state located at E C -0.8 eV in the β-Ga 2 O 3 bandgap. Recently, there has been growing interest in alternative acceptors, such as magnesium (Mg) and nitrogen (N), due to their predicted deeper energy levels, which could avoid inadvertent charge modulation during device operation. In this work, a systematic study that makes direct correlations between the introduction of N using ion implantation and the observation of a newly observed deep level at E C -2.9 eV detected by deep-level optical spectroscopy (DLOS) is presented. The concentration of this state displayed a monotonic dependence with N concentration over a range of implant conditions, as confirmed by secondary ion mass spectrometry (SIMS). With a near 1:1 match in absolute N and E C -2.9 eV trap concentrations from SIMS and DLOS, respectively, which also matched the measured removal of free electrons from capacitance-voltage studies, this indicates that N contributes a very efficiently incorporated compensating defect. Density functional theory calculations confirm the assignment of this state to be an N (0/-1) acceptor with a configuration of N occupying the oxygen site III [N O(III) ]. The near ideal efficiency for this state to compensate free electrons and its location toward the midgap region of the β-Ga 2 O 3 bandgap demonstrates the potential of N doping as a promising approach for producing semi-insulating β-Ga 2 O 3 .

36 MATERIALS SCIENCE↗
DOE OSTI2025

Real-time well integrity monitoring in underground gas storage wells using distributed temperature and strain sensing: a field demonstration

Here, this article presents the first successful field demonstration of a combined distributed temperature and strain sensing (DTSS) system installed directly on newly replaced tubing in a 5400-ft-deep operational underground gas storage well. The DTSS system uses a single optical fiber to monitor temperature and strain in real-time, providing a cost-effective solution for long-term well integrity assessment. In this study, the strain–stress correlation of the tubing—representative of material behavior analysis—is investigated as a potential method for monitoring tubing integrity throughout its lifetime. Moreover, the DTSS system’s capability to support both continuous and discrete monitoring is evaluated by comparing future data with historical records, enabling the early detection of issues such as material fatigue, corrosion, or deformation. Overall, the work examines the effectiveness and scalability of the DTSS system for real-time monitoring of well operations and integrity in a newly replaced well.

Distributed Strain Sensing↗
DOE OSTI2022

A deep learning-based direct forecasting of CO 2 plume migration

Accurate and timely forecasts of CO 2 plume evolution in geological reservoirs are crucial for CO 2 migration detection, leakage risk assessment, and operation decision support. Conventional forecasting usually adopts a two-step strategy, first calibrating reservoir model parameters against observations using iterative inverse modeling (or history matching) and then applying the calibrated model for predictions. This method impedes real-time forecasts due to the heavy computational demand in inverse modeling and may suffer from poor prediction accuracy because of the limited observation data. In this work, we propose a deep learning-based latent space mapping framework to forecast CO 2 plume migration directly by avoiding the inverse modeling. We first use the convolutional autoencoder to map the high-dimensional complex plume extents onto low-dimensional latent space. Next, we use neural networks to learn the relationship between the observation variables and the prediction latent variables. And then for given observation data, we infer the prediction values directly. This one-step direct forecasting is computationally efficient which requires a few number of parallelizable reservoir simulations and it can provide accurate predictions with limited observations by learning the observation-prediction relationship in the reduced dimension. Therefore, our proposed method enables an in-time forecast of dynamic CO 2 plume distributions. In this work, we demonstrate the effectiveness and accuracy of our method in predicting the CO 2 plume migration using four metrics such as plume area, centroid movement distance, and plume spreading in the primary and secondary directions. And the spatio-temporal evolution patterns of plume migration under diverse geological complexities are also accurately quantified.

15 GEOTHERMAL ENERGY↗