Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Network Models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,441 records · Page 80
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Maximizing energy efficiency in wastewater treatment plants: A data-driven approach for waste heat recovery and an economic analysis using Organic Rankine Cycle and thermal energy storage

Maximizing energy efficiency through waste heat recovery (WHR) processes is crucial for sustainable and ecofriendly operations across multiple industries, notably in wastewater treatment plants (WWTPs). This work proposes a comprehensive approach for assessing the WHR feasibility in WWTPs, structured in two main objectives. Firstly, an Artificial Neural Network (ANN) model is developed to accurately predict WHR based on operational data, including biogas temperature, biogas pressure, daily production in kWh, and WHR values in kWh th . The second objective focuses on economically evaluating the WHR feasibility based on the estimated WHR values obtained by the ANN model, and then realistically assessing the economic feasibility of integrating the Organic Rankine Cycle (ORC) and Seasonal Thermal Energy Storage (STES) systems. With an application to the As-Samra WWTP located in Jordan, the developed ANN model demonstrates promising results in the validation phase, with a root mean square error (RMSE) of 2206 kWh/day, a mean absolute error (MAE) of 1674 kWh/day, and an R-squared (R 2 ) value of 68%. On the other hand, the economic analysis reveals that an optimal ORC system of 412.14 kW e capacity yields a Net Present Value (NPV) of 2.09 million US dollars, a Levelized Cost of Energy (LCOE) of 0.0749 USD/kWh, a Payback Period (PBP) of 4.8 years, and annual revenues of 428 kUSD. This work also investigates the techno-economic feasibility of integrating ORC-STES. Results indicate that the LCOE and PBP are highly affected by the ORC's capital cost, and integrating STES increases the LCOE to 0.0824 USD/kWh, rendering its integration with ORC infeasible. In conclusion, this study aims to advance the understanding and application of WHR in WWTPs, paving the way for more efficient and sustainable practices in the field.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Vacancy diffusion barrier spectrum and diffusion correlation in multicomponent alloys

Vacancy diffusion serves a crucial role in many important kinetic behaviors and properties of multicomponent alloys. Essential questions, however, persist regarding how chemical complexity affects diffusion and what unique characteristics, if any, set these alloys apart from traditional metals. Using neural network kinetics model, we study vacancy diffusion in NbMoTa alloy across a broad temperature range (2600 to 800 K). Unlike pure metals, the two key diffusion parameters—diffusion correlation factor f and activation energy ΔG m —are not constant in alloys, but instead substantially decrease with decreasing temperature. This temperature dependence arises from a reduced number of active vacancy jump pathways at lower temperatures, leading to more correlated diffusion. Upon examining vacancy diffusion throughout the entire compositional space of the Nb-Mo-Ta system, we discover that the slowest vacancy diffusion surprisingly occurs in the non-equimolar region, rather than the equimolar concentration where the configurational entropy is highest. The diffusion barrier spectrum, characterizing the diffusion energy landscape, is an intrinsic material characteristic, which controls both f and ΔG m and, thereby, the diffusivity. Lastly, we find that the vacancy diffusion rate drops noticeably in the presence of local chemical order in the NbMoTa system, particularly for MoTa alloys with long-range B2 order.

Defects↗
DOE OSTI2021

Multi-scale Coupled Processes Modeling of Fractures as Porous, Interfacial and Granular Systems from Rock Images with the Numerical Manifold Method

Abstract The greatest challenges of rigorously modeling coupled hydro-mechanical processes in fractured rocks at different scales are associated with computational geometry. In addition, selections of continuous or discontinuous models, physical laws, and coupling priorities at different scales based on different geometric features determine the applicability of a numerical model for a certain type of problem. In this study, we present our multi-scale modeling capabilities that have been developed based on the numerical manifold method for analyzing coupled hydro-mechanical processes in fractured rocks. Based on their geometric features, the fractures are modeled as continua—finite-thickness porous zones, and discontinua—discontinuous interfaces and microscale asperities and granular systems. Different governing equations, physical laws, coupling priorities, and approaches for addressing fracture intersections and shearing are then applied to describe these. We applied these models to simulate coupled processes in fractured rocks using realistic geometry obtained from rock images at different scales. We first calculated shearing of a single fracture with different models and demonstrated the impacts of asperities on shearing. We then applied the continuous and discontinuous models to simulate a network of rough fractures, demonstrating that contact dynamics contribute significantly to the geometric, multi-physical evolution of systems where rough fractures are not mineral filled. For a discrete fracture network, our coupled processes modeling demonstrates that shearing of the discrete fractures can have a major impact on stress and pore pressure distribution. Lastly, we applied the discontinuous granular model to simulate evolution of a complex granular system with a deformation band, demonstrating that the deformation band can dominate contact dynamics, the structural and the stress evolution of the granular system.

58 GEOSCIENCES↗
DOE OSTI2020

Estimating Watershed Subsurface Permeability From Stream Discharge Data using Deep Neural Networks, Frontiers in Earth Science: Dataset

This data package contains watershed modeling inputs and outputs as well as deep neural networks training and testing results used in "Estimating Watershed Subsurface Permeability From Stream Discharge Data using Deep Neural Networks" (Cromwell et al., 2021). We train various deep neural network models with different architectures to predict subsurface permeability from stream discharge hydrograph at the watershed outlet. The training data are obtained from ensemble simulations of hydrographs corresponding to an permeability ensemble using a fully-distributed, integrated surface-subsurface hydrologic model. The trained model is then applied to estimate the permeability of the real watershed using its observed hydrograph at the outlet. Our study demonstrates that the permeabilities of the soil and geologic facies that make significant contributions to the outlet discharge can be more accurately estimated from the discharge data. Their estimations are also more robust with observation errors. Compared to the traditional ensemble smoother method, DNNs show stronger performance in capturing the nonlinear relationship between permeability and stream hydrograph to accurately estimate permeability. Our study sheds new light on the value of the emerging deep learning methods in assisting integrated watershed modeling by improving parameter estimation, which will eventually reduce the uncertainty in predictive watershed models. For detailed information regarding watershed model description and DNNs setup, please refer to Cromwell et al., 2021. The deep_learning.zip file contains the inputs and outputs for the different deep neural networks. The watershed_model.zip file contains the inputs and outputs for watershed simulation using ATS. The figures.zip file contains raw figures and their corresponding scripts. For a more detailed description, please see the README.md file within each compressed file.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Characterization of flow and transport in a fracture network at the EGS Collab field experiment through stochastic modeling of tracer recovery

Energy extraction from subsurface reservoirs is important for addressing the increasing energy demand and environmental concerns such as global warming. However, the characterization of subsurface reservoirs, particularly reservoirs dominated by fracture networks remains a challenge due to the lack of means to directly observe subsurface processes. This study explores the feasibility and efficacy of characterizing fracture flow and transport processes in an enhanced geothermal system (EGS) testbed through stochastic tracer modeling. There are two enabling factors that allow application of stochastic modeling to characterize a subsurface reservoir. First, an abundance of geological and geophysical measurements enables the development of a high-fidelity and well-constrained fracture network model. Second, high-performance computing (HPC) allows running massive realizations efficiently. Six conservative tracer tests were stochastically modeled and produced satisfactory realizations that successfully reproduce field tracer recovery data from each tracer test. The evolution of flow and transport processes in the fracture network was then analyzed from these satisfactory realizations. This work demonstrates that stochastic tracer modeling on a high-fidelity fracture network model is feasible and can provide important insights regarding flow and transport characteristics in subsurface fractured reservoirs.

58 GEOSCIENCES↗
DOE OSTI2022

Learning generative neural networks with physics knowledge

Deep generative neural networks have enabled modeling complex distributions, but incorporating physics knowledge into the neural networks is still challenging and is at the core of current physics-based machine learning research. To this end, we propose a physics generative neural network (PhysGNN), a new class of generative neural networks for learning unknown distributions in a physical system described by partial differential equations (PDE). PhysGNN couples PDE systems with generative neural networks. It is a fully differentiable model that allows back-propagation of gradients through both numerical PDE solvers and generative neural networks, and is trained by minimizing the discrete Wasserstein distance between generated and observed probability distributions of the PDE outputs using the stochastic gradient descent method. Moreover, PhysGNN does not require adversarial training like standard generative neural networks, which offers better stability than adversarial training. We show that PhysGNN can learn complex distributions in stochastic inverse problems, where conventional methods such as maximum likelihood estimation and momentum matching methods may be inapplicable when little knowledge is known about the form of unknown distributions or the physical model is too complex. Furthermore, our method allows physics-based generative neural network training for learning complex distributions in the context of differential equations.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Quantitative assessment of distant recurrence risk in early stage breast cancer using a nonlinear combination of pathological, clinical and imaging variables

Abstract Use of genomic assays to determine distant recurrence risk in patients with early stage breast cancer has expanded and is now included in the American Joint Committee on Cancer staging manual. Algorithmic alternatives using standard clinical and pathology information may provide equivalent benefit in settings where genomic tests, such as OncotypeDx, are unavailable. We developed an artificial neural network (ANN) model to nonlinearly estimate risk of distant cancer recurrence. In addition to clinical and pathological variables, we enhanced our model using intraoperatively determined global mammographic breast density (MBD) and local breast density (LBD). LBD was measured with optical spectral imaging capable of sensing regional concentrations of tissue constituents. A cohort of 56 ER+ patients with an OncotypeDx score was evaluated. We demonstrated that combining MBD/LBD measurements with clinical and pathological variables improves distant recurrence risk prediction accuracy, with high correlation ( r = 0.98) to the OncotypeDx recurrence score.

Nichols, Brandon S.↗
DOE OSTI2025

Machine Learning‐Guided Discovery of High‐Entropy Perovskite Oxide Electrocatalysts via Oxygen Vacancy Engineering

Abstract High‐entropy perovskite oxides (HEPOs) have recently emerged as multifunctional catalysts. However, the HEPOs’ structural and compositional complexity hinders the easy and accurate extrapolation of activity indicators, which are essential for establishing structure‐property correlations. Here, OxiGraphX, is introduced as a novel graph neural network (GNN) model designed to capture the complex relationships among structure, composition, and atomic chemical environments for accurate prediction of oxygen vacancy formation energies (OVFEs) in HEPOs. By integrating machine learning (ML), density functional theory (DFT), and experimental validation, this work demonstrates an efficient framework for rapidly and accurately screening HEPO electrocatalysts for oxygen evolution reaction (OER). The OxiGraphX predicts OVFEs with a precision exceeding existing data, enabling the identification of compositions of higher oxygen vacancy content (OVC) and, thus, higher catalytic activity. Furthermore, the model explores latent spaces that translate effectively into experimental domains, bridging computational predictions with real‐world applications. This approach accelerates the discovery of high‐performance HEPO catalysts while providing deeper insights into their catalytic mechanisms.

Chemistry↗
DOE OSTI2020

Petz reconstruction in random tensor networks

We illustrate the ideas of bulk reconstruction in the context of random tensor network toy models of holography. Specifically, we demonstrate how the Petz reconstruction map works to obtain bulk operators from the boundary data by exploiting the replica trick. We also take the opportunity to comment on the differences between coarse-graining and random projections.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Cosmology from random entanglement

We construct entangled microstates of a pair of holographic CFTs whose dual semiclassical description includes big bang-big crunch AdS cosmologies in spaces without boundaries. The cosmology is supported by inhomogeneous heavy matter and it partially purifies the bulk entanglement of two disconnected auxiliary AdS spacetimes. We show that the island formula for the fine grained entropy of one of the CFTs follows from a standard gravitational replica trick calculation. In generic settings, the cosmology is contained in the entanglement wedge of one of the two CFTs. We then investigate properties of the cosmology-to-boundary encoding map, and in particular, its non-isometric character. Restricting our attention to a specific class of states on the cosmology, we provide an explicit, and state-dependent, boundary representation of operators acting on the cosmology. Finally, under genericity assumptions, we argue for a non-isometric to approximately-isometric transition of the cosmology-to-boundary map for “simple” states on the cosmology as a function of the bulk entanglement, with tensor network toy models of our setup as a guide.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Analysis-Specific Fast Simulation at the LHC with Deep Learning

Abstract We present a fast-simulation application based on a deep neural network, designed to create large analysis-specific datasets. Taking as an example the generation of W + jet events produced in $$\sqrt{s}=$$ s = 13 TeV proton–proton collisions, we train a neural network to model detector resolution effects as a transfer function acting on an analysis-specific set of relevant features, computed at generation level, i.e., in absence of detector effects. Based on this model, we propose a novel fast-simulation workflow that starts from a large amount of generator-level events to deliver large analysis-specific samples. The adoption of this approach would result in about an order-of-magnitude reduction in computing and storage requirements for the collision simulation workflow. This strategy could help the high energy physics community to face the computing challenges of the future High-Luminosity LHC.

Chen, C.↗
DOE OSTI2023

Convergence of Hyperbolic Neural Networks Under Riemannian Stochastic Gradient Descent

Abstract We prove, under mild conditions, the convergence of a Riemannian gradient descent method for a hyperbolic neural network regression model, both in batch gradient descent and stochastic gradient descent. We also discuss a Riemannian version of the Adam algorithm. We show numerical simulations of these algorithms on various benchmarks.

Whiting, Wes (ORCID:0000000247505060)↗
DOE OSTI2021

Striving to translate shale physics across ten orders of magnitude: What have we learned?

Shales will play an important role in the successful transition of energy from fossil-based resources to renewables in the coming decades. Aside from being a significant source of low-carbon intensity fuels, like natural gas, they also serve as geologic seals of subsurface formations that may be used to isolate nuclear waste, sequester CO 2 , or store intermittent energy (e.g., solar hydrogen). Despite their importance, shales pose significant engineering and environmental challenges due to their nanoporous structure and extreme heterogeneity that spans at least ~10 orders of magnitude in spatial scale. Two challenges inhibit a system-level understanding: (1) the physics of fluid flow and phase behavior in shales are poorly understood due to the dominant molecular interactions between minerals and fluids under confinement, and (2) the apparent lack of scale separation that prevents a reliable (closed) description of the physics at any single scale of observation. In this review, we focus on the latter issue and discuss scale translation, which in its broadest sense is transforming data or simulations from one spatiotemporal scale to another. While effective scale translation is not exclusive to shales, but all geologic porous media, the need for it is especially acute in shales given their high degree of heterogeneity. Classical theories like homogenization, while indispensable, fail when scales are not separated. Other methods, like numerical upscaling, scale-translate in only one direction: small to large, but not the reverse, called downscaling. However, the confluence of advances in three areas are bringing challenging problems such as shales within reach: increased computational power and scalable algorithms; high-resolution imaging and multi-modal data acquisition; and machine learning to process massive amounts of data. While these advances equip geoscientists with a wide array of experimental and computational tools, no individual tool can probe the entire gamut of heterogeneity in shales. Their effective use, therefore, requires an ability to bridge between various data types obtained at different scales. The aim of this review is to present a coherent account of computational and experimental methods that may be used to achieve just that, i.e., to perform scale translation. We provide a broader definition of scale translation, one that transcends classical homogenization and upscaling methods, but is consistent with them and accommodates notions like downscaling and data translation. After a brief introduction to homogenization, we review hybrid methods, numerical upscaling and its recent extensions, multiscale computing, high-resolution imaging, and machine learning. We place particular emphasis on multiscale computing and propose an algorithmic framework to bridge between the pore (micro) and Darcy (macro) scales. Throughout the paper, we draw comparisons between the various methods and highlight their (often hidden) similarities, differences, benefits, and pitfalls. We finally conclude with two case studies on shales that exemplify some of the methods presented.

58 GEOSCIENCES↗
DOE OSTI2023

Influence of building heat distribution temperatures on the energy performance and sizing of 5th generation district heating and cooling networks

This paper investigates the energy performance and sizing criteria of 5th generation district heating and cooling (5GDHC) networks as a function of the heat distribution temperature in the building systems connected to the district network. An energy simulation model of a 5GDHC network was developed in Modelica for a case study located in Denmark. Calculations were carried out for four different building heating systems. Simulation results show that reducing the heat distribution temperatures from 70 °C to 23 °C leads to around 40% annual electric energy savings (from 10.4 kWh/m 2 to 6.2 kWh/m 2 ) for the operation of the heat pumps. Heat distribution temperatures of 23 °C cause higher water mass flow rates through the network, leading to annual electric energy consumption for the circulation pumps that are almost doubled (from 0.16 kWh/m 2 to 0.3 kWh/m 2 ) compared to the reference case at 70 °C. Furthermore, the paper discusses how the results obtained from the Danish case study can be generalized and applied to other cases using a simplified mathematical approach. In conclusion, it is found that about 1.5% of electric energy savings can be achieved for each temperature degree reduction in the heat distribution system.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

Soil porous microstructure control over soil organic matter mobility: A multimethod workflow for understanding chemistry-dependent organic matter binding in soil

Soil organic matter (SOM) has attracted a great deal of interest; particularly for its potential to mitigate human derived CO 2 emissions. Studies have demonstrated that SOM plays a critical role in carbon storage and CO 2 sequestration. However, the sorption properties of SOM, which influence its transport in pore water and stabilization within the soil, remain poorly understood. This study develops a workflow to: (1) examine compound-specific advective and diffusive transport and desorption behaviors, (2) quantify desorption rates through stop-flow and continuous-flow column experiments, and (3) evaluate the impact of soil microporosity on SOM mobility using high-resolution imaging and extractions. Intact core column experiments were conducted on Uncultivated (Natural) and Cultivated soil samples, both were arid soils, collected in Washington State. X-ray computed tomography was employed to measure porosity and pore connectivity, while Fourier-transform ion cyclotron resonance mass spectrometry was used to analyze SOM composition. The findings revealed that cultivation increased total carbon and nitrogen levels due to irrigation and fertilization, enhancing carbon capture potential in arid soils. In contrast, the Natural soil, characterized by higher porosity and connectivity, contained more oxidized carbon. Pore network analysis indicated that soil compaction in the Cultivated soil may lead to longer diffusion pathways, significantly influencing SOM transport and stability.

Hydraulic Properties↗
DOE OSTI2026

Beyond interpolation: Physics-inspired gating transformers for extrapolating irradiation conditions to novel nuclear fuels

The qualification of advanced nuclear fuels relies on irradiation experiments in test reactors that emulate commercial conditions. Designing these tests requires accurate prediction of key irradiation quantities, particularly heat generation rate and burnup, yet obtaining them typically involves computationally expensive multi-step simulation workflows. We propose a physics-inspired gating transformer (PIGT) that integrates an inverse-square, distance-based attenuation into the encoder representation to bias attention toward physically relevant spatial relationships while retaining data-driven flexibility. Using MiniFuel irradiation data from the High Flux Isotope Reactor at Oak Ridge National Laboratory, we benchmark against ensemble methods, feedforward and recurrent networks, convolutional models, and standard transformers. While baseline models perform well under interpolation, they exhibit a pronounced generalization gap when evaluated on fuels not included in the training set. The proposed model consistently improves extrapolative accuracy and stability, yielding the strongest performance on unseen fuel configurations. These results indicate that a lightweight physics structure embedded within attention mechanisms can substantially improve robustness, enabling more reliable surrogate predictions to accelerate the design of nuclear fuel irradiation experiments.

Fuel qualification↗