Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Network Models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

A Deep Learning Based Framework to Identify Undocumented Orphaned Oil and Gas Wells from Historical Maps: A Case Study for California and Oklahoma

Undocumented Orphaned Wells (UOWs) are wells without an operator that have limited or no documentation with regulatory authorities. An estimated 310,000 to 800,000 UOWs exist in the United States (US), whose locations are largely unknown. These wells can potentially leak methane and other volatile organic compounds to the atmosphere, and contaminate groundwater. In this study, we developed a novel framework utilizing a state-of-the-art computer vision neural network model to identify the precise locations of potential UOWs. The U-Net model is trained to detect oil and gas well symbols in georeferenced historical topographic maps, and potential UOWs are identified as symbols that are further than 100 m from any documented well. A custom tool was developed to rapidly validate the potential UOW locations. We applied this framework to four counties in California and Oklahoma, leading to the discovery of 1301 potential UOWs across >40,000 km 2 . We confirmed the presence of 29 UOWs from satellite images and 15 UOWs from magnetic surveys in the field with a spatial accuracy on the order of 10 m. This framework can be scaled to identify potential UOWs across the US since the historical maps are available for the entire nation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Single-Point Extrapolation to the Complete Basis Set Limit through Deep Learning

Machine learning (ML) offers an attractive method for making predictions about molecular systems while circumventing the need to run expensive electronic structure calculations. Once trained on ab initio data, the promise of ML is to deliver accurate predictions of molecular properties that were previously computationally infeasible. In this work, we develop and train a graph neural network model to correct the basis set incompleteness error (BSIE) between a small and large basis set at the RHF and B3LYP levels of theory. Our results show that, when compared to fitting to the total potential, an ML model fitted to correct the BSIE is better at generalizing to systems not seen during training. We test this ability by training on single molecules while evaluating on molecular complexes. We also show that ensemble models yield better behaved potentials in situations where the training data is insufficient. However, even when only fitting to the BSIE, acceptable performance is only achieved when the training data sufficiently resemble the systems one wants to make predictions on. As a result, the test error of the final model trained to predict the difference between the cc-pVDZ and cc-pV5Z potential is 0.184 kcal/mol for the B3LYP density functional, and the ensemble model accurately reproduces the large basis set interaction energy curves on the S66x8 dataset.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Processing-Dependent Structure and Poroelasticity of Nafion in Liquid Water

Ionomers act as the solid polymer electrolyte membrane in many modern electrochemical devices, yet the role of their nanostructure in modulating the poroelastic response remains poorly understood, especially in liquid water, where few techniques can measure simultaneous transport-mechanical properties. Poroelastic Relaxation Indentation (PRI) is uniquely suited for measuring time-dependent transport-mechanical properties of porous solids, specifically hydraulic diffusivity, elastic modulus, Poisson’s ratio, and intrinsic permeability, for porous solids. While ionomers such as Nafion are not porous in the typical sense, Nafion has a nanophase-segregated structure that, when fully swollen in liquid water, behaves as a poroelastic solid with a coupled mechanical-transport response. Using a poroelastic framework, we investigate how casting and pretreatment of Nafion membranes alter their poroelastic response in liquid environments. We characterize both extruded and dispersion-cast Nafion membranes pretreated in water at 25 or 100 °C and relate the mechanical-transport properties to the ionomer structure via hydrophilic and intercrystalline domain spacing measured using Small-Angle X-ray Scattering (SAXS). At 25 °C, dispersion-cast membranes exhibit distinctly lower hydraulic diffusivity and intrinsic permeability than extruded membranes but with comparable mechanical properties. Pretreatment at 100 °C increases hydrophilic domain spacing, improving transport but at the expense of mechanical stiffness. Dispersion-cast membranes respond more strongly to pretreatment than extruded membranes. Using the Carman-Kozeny pore network model and the hydrophilic domain-spacing, we estimate the pore radius and tortuosity to show how pretreatment reduces structure-related tortuosity differences between dispersion-cast and extruded membranes. Here, in this work, we show that nanophase-segregated materials such as Nafion can be rigorously characterized using poroelasticity, resulting in physically meaningful transport-mechanical properties. Coupling PRI with SAXS provides insights into the nanostructural features that govern the coupled mechanical-transport response. By establishing PRI for a nanophase-segregated material, this approach opens avenues for this technique’s application in other hydrated polymeric materials not typically considered to be poroelastic.

Shen, Margaret [University of California, Berkeley↗
DOE OSTI2024

Quantifying Dissolution Dynamics in Porous Media Using a Spatial Flow Focusing Profile

Abstract The diverse range of patterns in porous media formed by dissolution processes depends on the relative magnitude of flow, transport, and chemical reactions at pore surfaces. However, distinguishing between regimes often relies solely on qualitative, visual comparisons of emergent structures. Here, we propose a quantitative measure capable of identifying different regimes using the concept of the spatial flow focusing profile, which segments the medium into cross sections along the flow direction to calculate the flow focusing index for each section. We employ this measure in numerical simulations of a dissolving porous medium using a pore network model. We obtain a morphological phase diagram of dissolution patterns, which we characterize using the flow focusing profile. In particular, we demonstrate that analyzing the temporal changes in the profile allows one to quantitatively distinguish between wormholing and channeling. The transition between them is shown to be affected by the heterogeneity of the system.

58 GEOSCIENCES↗
DOE OSTI2020

Scaling behavior of the quantum phase transition from a quantum-anomalous-Hall insulator to an axion insulator

The phase transitions from one plateau to the next plateau or to an insulator in quantum Hall and quantum anomalous Hall (QAH) systems have revealed universal scaling behaviors. A magnetic-field-driven quantum phase transition from a QAH insulator to an axion insulator was recently demonstrated in magnetic topological insulator sandwich samples. Here, we show that the temperature dependence of the derivative of the longitudinal resistance on magnetic field at the transition point follows a characteristic power-law that indicates a universal scaling behavior for the QAH to axion insulator phase transition. Similar to the quantum Hall plateau to plateau transition, the QAH to axion insulator transition can also be understood by the Chalker–Coddington network model. We extract a critical exponent κ ~ 0.38 ± 0.02 in agreement with recent high-precision numerical results on the correlation length exponent of the Chalker–Coddington model at ν ~ 2.6, rather than the generally-accepted value of 2.33.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Protein sequence design with a learned potential

The task of protein sequence design is central to nearly all rational protein engineering problems, and enormous effort has gone into the development of energy functions to guide design. Here, we investigate the capability of a deep neural network model to automate design of sequences onto protein backbones, having learned directly from crystal structure data and without any human-specified priors. The model generalizes to native topologies not seen during training, producing experimentally stable designs. We evaluate the generalizability of our method to a de novo TIM-barrel scaffold. The model produces novel sequences, and high-resolution crystal structures of two designs show excellent agreement with in silico models. Our findings demonstrate the tractability of an entirely learned method for protein sequence design.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

AF2Complex predicts direct physical interactions in multimeric proteins with deep learning

Abstract Accurate descriptions of protein-protein interactions are essential for understanding biological systems. Remarkably accurate atomic structures have been recently computed for individual proteins by AlphaFold2 (AF2). Here, we demonstrate that the same neural network models from AF2 developed for single protein sequences can be adapted to predict the structures of multimeric protein complexes without retraining. In contrast to common approaches, our method, AF2Complex, does not require paired multiple sequence alignments. It achieves higher accuracy than some complex protein-protein docking strategies and provides a significant improvement over AF-Multimer, a development of AlphaFold for multimeric proteins. Moreover, we introduce metrics for predicting direct protein-protein interactions between arbitrary protein pairs and validate AF2Complex on some challenging benchmark sets and the E. coli proteome. Lastly, using the cytochrome c biogenesis system I as an example, we present high-confidence models of three sought-after assemblies formed by eight members of this system.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Neutron scattering and neural-network quantum molecular dynamics investigation of the vibrations of ammonia along the solid-to-liquid transition

Abstract Vibrational spectroscopy allows us to understand complex physical and chemical interactions of molecular crystals and liquids such as ammonia, which has recently emerged as a strong hydrogen fuel candidate to support a sustainable society. We report inelastic neutron scattering measurement of vibrational properties of ammonia along the solid-to-liquid phase transition with high enough resolution for direct comparisons to ab-initio simulations. Theoretical analysis reveals the essential role of nuclear quantum effects (NQEs) for correctly describing the intermolecular spectrum as well as high energy intramolecular N-H stretching modes. This is achieved by training neural network models using ab-initio path-integral molecular dynamics (PIMD) simulations, thereby encompassing large spatiotemporal trajectories required to resolve low energy dynamics while retaining NQEs. Our results not only establish the role of NQEs in ammonia but also provide general computational frameworks to study complex molecular systems with NQEs.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Global and regional perspectives on optimizing thermo-responsive dynamic windows for energy-efficient buildings

Architectural thermo-responsive dynamic windows offer an autonomous solution for solar heat regulation, thereby reducing building energy consumption. Previous work has emphasized the significance of thermo-responsive windows in hot climates due to their role in solar heat control and subsequent energy conservation; conversely, our study provides a different perspective. Through a global-scale analysis, we explore over 100 material samples and execute more than 2.8 million simulations across over two thousand global locations. World heatmap results, derived from well-trained artificial neural network models, reveal that thermo-responsive windows are especially useful in climates where buildings demand both heating and cooling energy, whereas thermo-responsive windows with optimal transition temperatures show no dynamic features in most of low-latitude tropical regions. Additionally, this study provides a practical guideline and an open-source mapping tool to optimize the intrinsic properties of thermo-responsive materials and evaluate their energy performance for sustainable buildings at various geographical scales.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Overlapping qubits from non-isometric maps and de Sitter tensor networks

The emergence of a local effective theory from a more fundamental theory of quantum gravity with seemingly fewer degrees of freedom is a major puzzle of theoretical physics. A recent approach to this problem is to consider general features of the Hilbert space maps relating these theories. In this work, we construct approximately local observables, or overlapping qubits, from such non-isometric maps. We show that local processes in effective theories can be spoofed with a quantum system with fewer degrees of freedom, with deviations from actual locality identifiable as features of quantum gravity. For a concrete example, we construct two tensor network models of de Sitter space-time, demonstrating how exponential expansion and local physics can be spoofed for a long period before breaking down. Our results highlight the connection between overlapping qubits, Hilbert space dimension verification, degree-of-freedom counting in black holes, holography, and approximate locality in quantum gravity.

Quantum information↗
DOE OSTI2022

Coarse-grained molecular dynamics integrated with convolutional neural network for comparing shapes of temperature sensitive bottlebrushes

Quantification of shape changes in nature-inspired soft material architectures of stimuli-sensitive polymers is critical for controlling their properties but is challenging due to their softness and flexibility. Here, we have computationally designed uniquely shaped bottlebrushes of a thermosensitive polymer, poly(N-isopropylacrylamide) (PNIPAM), by controlling the length of side chains along the backbone. Coarse-grained molecular dynamics simulations of solvated bottlebrushes were performed below and above the lower critical solution temperature of PNIPAM. Conventional analyses (free volume, asphericity, etc.) show that lengths of side chains and their immediate environments dictate the compactness and bending in these architectures. We further developed 100 unique convolutional neural network models that captured molecular-level features and generated a statistically significant quantification of the similarity between different shapes. Thus, our study provides insights into the shapes of complex architectures as well as a general method to analyze them. The shapes presented here may inspire the synthesis of new bottlebrushes.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Highly sensitive 2D X-ray absorption spectroscopy via physics informed machine learning

Abstract Improving the spatial and spectral resolution of 2D X-ray near-edge absorption structure (XANES) has been a decade-long pursuit to probe local chemical reactions at the nanoscale. However, the poor signal-to-noise ratio in the measured images poses significant challenges in quantitative analysis, especially when the element of interest is at a low concentration. In this work, we developed a post-imaging processing method using deep neural network to reliably improve the signal-to-noise ratio in the XANES images. The proposed neural network model could be trained to adapt to new datasets by incorporating the physical features inherent in the latent space of the XANES images and self-supervised to detect new features in the images and achieve self-consistency. Two examples are presented in this work to illustrate the model’s robustness in determining the valence states of Ni and Co in the LiNi x Mn y Co 1-x-y O 2 systems with high confidence.

36 MATERIALS SCIENCE↗
DOE OSTI2024

A robust synthetic data generation framework for machine learning in high-resolution transmission electron microscopy (HRTEM)

Machine learning techniques are attractive options for developing highly-accurate analysis tools for nanomaterials characterization, including high-resolution transmission electron microscopy (HRTEM). However, successfully implementing such machine learning tools can be difficult due to the challenges in procuring sufficiently large, high-quality training datasets from experiments. In this work, we introduce Construction Zone, a Python package for rapid generation of complex nanoscale atomic structures which enables fast, systematic sampling of realistic nanomaterial structures and can be used as a random structure generator for large, diverse synthetic datasets. Using Construction Zone, we develop an end-to-end machine learning workflow for training neural network models to analyze experimental atomic resolution HRTEM images on the task of nanoparticle image segmentation purely with simulated databases. Further, we study the data curation process to understand how various aspects of the curated simulated data—including simulation fidelity, the distribution of atomic structures, and the distribution of imaging conditions—affect model performance across three benchmark experimental HRTEM image datasets. Using our workflow, we are able to achieve state-of-the-art segmentation performance on these experimental benchmarks and, further, we discuss robust strategies for consistently achieving high performance with machine learning in experimental settings using purely synthetic data. Construction Zone and its documentation are available at https://github.com/lerandc/construction_zone.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Database and deep-learning scalability of anharmonic phonon properties by automated brute-force first-principles calculations

Understanding the anharmonic phonon properties of crystal compounds—such as phonon lifetimes and thermal conductivities—is essential for investigating and optimizing their thermal transport behaviors. These properties also impact optical, electronic, and magnetic characteristics through interactions between phonons and other quasiparticles and fields. In this study, we develop an automated first-principles workflow to calculate anharmonic phonon properties and build a comprehensive database encompassing more than 6500 inorganic compounds. Utilizing this dataset, we train a graph neural network model to predict thermal conductivity values and spectra from structural parameters, demonstrating a scaling law in which prediction accuracy improves with increasing training data size. High-throughput screening with the model enables the identification of materials exhibiting extreme thermal conductivities—both high and low. The resulting database offers valuable insights into the anharmonic behavior of phonons, thereby accelerating the design and development of advanced functional materials.

Ohnishi, Masato [University of Tokyo (Japan); Inst↗
DOE OSTI2021

Computational scanning tunneling microscope image database

We introduce the systematic database of scanning tunneling microscope (STM) images obtained using density functional theory (DFT) for two-dimensional (2D) materials, calculated using the Tersoff-Hamann method. It currently contains data for 716 exfoliable 2D materials. Examples of the five possible Bravais lattice types for 2D materials and their Fourier-transforms are discussed. All the computational STM images generated in this work are made available on the JARVIS-STM website ( https://jarvis.nist.gov/jarvisstm ). We find excellent qualitative agreement between the computational and experimental STM images for selected materials. As a first example application of this database, we train a convolution neural network model to identify the Bravais lattice from the STM images. We believe the model can aid high-throughput experimental data analysis. These computational STM images can directly aid the identification of phases, analyzing defects and lattice-distortions in experimental STM images, as well as be incorporated in the autonomous experiment workflows.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Predictive scale-bridging simulations through active learning

Throughout computational science, there is a growing need to utilize the continual improvements in raw computational horsepower to achieve greater physical fidelity through scale-bridging over brute-force increases in the number of mesh elements. For instance, quantitative predictions of transport in nanoporous media, critical to hydrocarbon extraction from tight shale formations, are impossible without accounting for molecular-level interactions. Similarly, inertial confinement fusion simulations rely on numerical diffusion to simulate molecular effects such as non-local transport and mixing without truly accounting for molecular interactions. With these two disparate applications in mind, we develop a novel capability which uses an active learning approach to optimize the use of local fine-scale simulations for informing coarse-scale hydrodynamics. Our approach addresses three challenges: forecasting continuum coarse-scale trajectory to speculatively execute new fine-scale molecular dynamics calculations, dynamically updating coarse-scale from fine-scale calculations, and quantifying uncertainty in neural network models.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Deep learning forecasts the spatiotemporal evolution of fluid-induced microearthquakes

Microearthquakes generated by subsurface fluid injection record the evolving stress state and permeability of reservoirs. Forecasting their spatiotemporal evolution is therefore critical for applications such as enhanced geothermal systems, carbon dioxide sequestration and other geoengineering applications. Here we propose a transformer neural network model that ingests hydraulic stimulation history and prior microearthquake observations to forecast four key quantities: cumulative microearthquake count, cumulative logarithmic seismic moment, and the 50th- and 95th-percentile extents of the microearthquake cloud. Applied to the EGS Collab Experiment 1 dataset, the model achieves R2 > 0.98 for the 1-s forecast horizon and R2 > 0.88 for the 15-s forecast horizon across all targets, and supplies uncertainty estimates through a learned standard deviation term. These accurate, uncertainty-quantified forecasts enable real-time inference of fracture propagation and permeability evolution, demonstrating the strong potential of deep-learning approaches to improve seismic-risk assessment and guide mitigation strategies in future fluid-injection operations.

Chung, Jaehong↗