Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Network Models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

High-Energy Collision of Quarks and Mesons in the Schwinger Model: From Tensor Networks to Circuit QED

With the aim of studying nonperturbative out-of-equilibrium dynamics of high-energy particle collisions on quantum simulators, we investigate the scattering dynamics of lattice quantum electrodynamics in 1 + 1 dimensions. Working in the bosonized formulation of the model and in the thermodynamic limit, we use uniform-matrix-product-state tensor networks to construct multiparticle wave-packet states, evolve them in time, and detect outgoing particles post collision. This facilitates the numerical simulation of scattering experiments in both confined and deconfined regimes of the model at different energies, giving rise to rich phenomenology, including inelastic production of quark and meson states, meson disintegration, and dynamical string formation and breaking. We obtain elastic and inelastic scattering cross sections, together with time-resolved momentum and position distributions of the outgoing particles. Furthermore, we propose an analog circuit-QED implementation of the scattering process that is native to the platform, requires minimal ingredients and approximations, and enables practical schemes for particle wave-packet preparation and evolution. Furthermore, this study highlights the role of classical and quantum simulation in enhancing our understanding of scattering processes in quantum field theories in real time.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

A fast and accurate physics-informed neural network reduced order model with shallow masked autoencoder

Traditional linear subspace reduced order models (LS-ROMs) are able to accelerate physical simulations in which the intrinsic solution space falls into a subspace with a small dimension, i.e., the solution space has a small Kolmogorov n-width. However, for physical phenomena not of this type, e.g., any advection-dominated flow phenomena such as in traffic flow, atmospheric flows, and air flow over vehicles, a low-dimensional linear subspace poorly approximates the solution. To address cases such as these, we have developed a fast and accurate physics-informed neural network ROM, namely nonlinear manifold ROM (NM-ROM), which can better approximate high-fidelity model solutions with a smaller latent space dimension than the LS-ROMs. Our method takes advantage of the existing numerical methods that are used to solve the corresponding full order models. The efficiency is achieved by developing a hyper-reduction technique in the context of the NM-ROM. Numerical results show that neural networks can learn a more efficient latent space representation on advection-dominated data from 1D and 2D Burgers' equations. A speedup of up to 2.6 for 1D Burgers' and a speedup of 11.7 for 2D Burgers' equations are achieved with an appropriate treatment of the nonlinear terms through a hyper-reduction technique. Lastly, a posteriori error bounds for the NM-ROMs are derived that take account of the hyper-reduced operators.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Distributionally Robust Bilevel Optimization Model for Distribution Network With Demand Response Under Uncertain Renewables Using Wasserstein Metrics

Here, we consider a distribution network integrating demand response (DR) participants in the presence of uncertain renewable suppliers and outdoor temperatures. A bilevel optimization model is proposed to capture the intricate dynamics between price-incentivized DR participants and distribution system operations, including energy procurement and active/reactive power flows. The model is formulated as a distributional robust bilevel optimization using Wasserstein metrics. We show favorable data-driven properties including out-of-sample guarantee and asymptotic consistency. Furthermore, we present a tractable mixed-integer linear programming reformulation and characterize the worst-case distribution. Computational experiments are conducted on a modified 33-bus system. Our findings underscore the efficacy of the pricing strategies derived from the proposed bilevel optimization model. These strategies not only effectively manage DR participants' behavior but also bring equity considerations among households with various characteristics to light. The results contribute to a deeper understanding of the interplay between distribution system operators and DR participants.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Characterizing the Impacts of Multi-Scale Heterogeneity on Solute Transport in Fracture Networks

We model flow and transport in fracture networks with varying degrees of fracture-to-fracture aperture heterogeneity and network intensity to show how changes in these properties can cause the emergence of anomalous flow and transport behavior. If fracture-to-fracture aperture heterogeneity is increased in sparse networks, velocity fluctuations inhibit high flow rates and solute transport can be delayed. Surprisingly, transport can be slowed even in cases where hydraulic aperture is monotonically increased. As the intensity of the networks is increased, more connected pathways allow for particles to bypass these effects. There exists transition behavior where with relatively few connected pathways in a network, first arrival times of particles are not heavily affected by fracture-to-fracture aperture heterogeneity, but the scaling behavior of the tails is strongly influenced. These results reinforce the importance of considering multi-scale effects in fractured systems and can inform flow and transport processes in both natural and engineered fractured systems.

58 GEOSCIENCES↗
DOE OSTI2021

Collective Nanoparticle Dynamics Associated with Bridging Network Formation in Model Polymer Nanocomposites

The addition of nanoparticles (NPs) to polymers is a powerful method to improve the mechanical and other properties of macromolecular materials. Such hybrid polymer–particle systems are also rich in fundamental soft matter physics. Among several factors contributing to mechanical reinforcement, a polymer-mediated NP network is considered to be the most important in polymer nanocomposites (PNCs). Here, we present an integrated experimental–theoretical study of the collective NP dynamics in model PNCs using X-ray photon correlation spectroscopy and microscopic statistical mechanics theory. Silica NPs dispersed in unentangled or entangled poly(2-vinylpyridine) matrices over a range of NP loadings are used. Static collective structure factors of the NP subsystems at temperatures above the bulk glass transition temperature reveal the formation of a network-like microstructure via polymer-mediated bridges at high NP loadings above the percolation threshold. The NP collective relaxation times are up to 3 orders of magnitude longer than the self-diffusion limit of isolated NPs and display a rich dependence with observation wavevector and NP loading. A mode-coupling theory dynamical analysis that incorporates the static polymer-mediated bridging structure and collective motions of NPs is performed. It captures well both the observed scattering wavevector and NP loading dependences of the collective NP dynamics in the unentangled polymer matrix, with modest quantitative deviations emerging for the entangled PNC samples. Here, we identify an unusual and weak temperature dependence of collective NP dynamics, in qualitative contrast with the mechanical response. Hence, the present study has revealed key aspects of the collective motions of NPs connected by polymer bridges in contact with a viscous adsorbing polymer medium and identifies some outstanding remaining challenges for the theoretical understanding of these complex soft materials.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Physics-guided neural networks with engineering domain knowledge for hybrid process modeling

As neural networks are more frequently used to solve problems in science and engineering, the methods used to incorporate scientific knowledge into these networks are becoming increasingly complex. Here, this work breaks down these complicated techniques into a set of basic strategies which can easily be applied to diverse situations. Several novel neural networks are built using the categories laid out in this work. These networks are tested on simulated data from a continuous stirred tank reactor (CSTR) model to evaluate the advantages provided by each network. The three points demonstrated in this work are: (1) architectural hybrid models can speed up convergence and reduce the amount of data necessary to train a model; (2) adding a physics-guided loss function can improve model generalization and make models more physically consistent; (3) using physics-guided initialization and transfer learning improves accuracy and speeds up convergence, but can harm generalizability if used incorrectly.

42 ENGINEERING↗
DOE OSTI2023

Solving the nuclear pairing model with neural network quantum states

In this work, we present a variational Monte Carlo method that solves the nuclear many-body problem in the occupation number formalism exploiting an artificial neural network representation of the groundstate wave function. A memory-efficient version of the stochastic reconfiguration algorithm is developed to train the network by minimizing the expectation value of the Hamiltonian. We benchmark this approach against widely used nuclear many-body methods by solving a model used to describe pairing in nuclei for different types of interaction and different values of the interaction strength. Despite its polynomial computational cost, our method outperforms coupled-cluster and provides energies that are in excellent agreement with the numerically-exact full configuration interaction values.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Multiverse: Bayesian model selection for neural networks

Multiverse is a code repository for a set of tools for Bayesian model selection for neural networks. The goal of the tools is to provide capabilities for selecting among prior and model specifications for Bayesian neural networks. Multiverse will include tools for creating Bayesian neural networks, evaluating the Bayesian model evidence, and performing inference in Bayesian neural networks. These components are written in Python, a high-level programming language that takes advantage of the Python ecosystem of high-quality open-source packages for machine learning and signal processing.

Klein, Natalie↗
DOE OSTI2023

When Spectral Modeling Meets Convolutional Networks: A Method for Discovering Reionization-era Lensed Quasars in Multiband Imaging Data

Over the last two decades, around 300 quasars have been discovered at z ≳ 6, yet only one has been identified as being strongly gravitationally lensed. We explore a new approach—enlarging the permitted spectral parameter space, while introducing a new spatial geometry veto criterion—which is implemented via image-based deep learning. We first apply this approach to a systematic search for reionization-era lensed quasars, using data from the Dark Energy Survey, the Visible and Infrared Survey Telescope for Astronomy Hemisphere Survey, and the Wide-field Infrared Survey Explorer. Our search method consists of two main parts: (i) the preselection of the candidates, based on their spectral energy distributions (SEDs), using catalog-level photometry; and (ii) relative probability calculations of the candidates being a lens or some contaminant, utilizing a convolutional neural network (CNN) classification. The training data sets are constructed by painting deflected point-source lights over actual galaxy images, to generate realistic galaxy–quasar lens models, optimized to find systems with small image separations, i.e., Einstein radii of θ E ≤ 1''. Visual inspection is then performed for sources with CNN scores of P lens > 0.1, which leads us to obtain 36 newly selected lens candidates, which are awaiting spectroscopic confirmation. These findings show that automated SED modeling and deep learning pipelines, supported by modest human input, are a promising route for detecting strong lenses from large catalogs, which can overcome the veto limitations of primarily dropout-based SED selection approaches.

High-redshift galaxies↗
NASA NTRS1987

Ka-band (32-GHz) performance of 70-meter antennas in the Deep Space Network

Two models are provided of the Deep Space Network (DSN) 70 m antenna performance at Ka-band (32 GHz) and, for comparison purposes, one at X-band (8.4 GHz). The baseline 70 m model represents expected X-band and Ka-band performance at the end of the currently ongoing 64 m to 70 m mechanical upgrade. The improved 70 m model represents two sets of Ka-band performance estimates (the X-band performance will not change) based on two separately developed improvement schemes: the first scheme, a mechanical approach, reduces tolerances of the panels and their settings, the reflector structure and subreflector, and the pointing and tracking system. The second, an electronic/mechanical approach, uses an array feed scheme to compensate fo lack of antenna stiffness, and improves panel settings using microwave holographic measuring techniques. Results are preliminary, due to remaining technical and cost uncertainties. However, there do not appear to be any serious difficulties in upgrading the baseline DSN 70 m antenna network to operate efficiently in an improved configuration at 32 GHz (Ka-band). This upgrade can be achieved by a conventional mechanical upgrade or by a mechanical/electronic combination. An electronically compensated array feed system is technically feasible, although it needs to be modeled and demonstrated. Similarly, the mechanical upgrade requires the development and demonstration of panel actuators, sensors, and an optical surveying system.

Imbriale, W. A.↗
DOE OSTI2021

0D Modeling of Reactor Networks Within Zuzax

We report on progress in developing macroscopic balance equations for combustion and electrochemistry systems. A steady state solution capability is described for the macroscopic reactor network, with an associated steady state continuation method and solution storage capability added in. An example is provided of continuation of a hydrogen flame versus the equivalence ratio. The reactor modeling capability is extended to charged fluid systems, with a description of the new ChargedFluidReactor, SubstrateElement, and MetalCurrentElement reactor classes and novel setup of unknowns within these reactors that preserve charge neutrality. Zuzax's setup for electrochemistry is explained including the specification of the electron chemical potential and the adherence to the SHE Reference electrode specification. The description of the different ways to enter electrochemical reaction rates are described, contrasted, and their derivations with respect to one another are derived. An example of using the ChargedFluidReactor within corrosion problems is provided. We present a description of calculations to understand the phenomena of corrosion of copper from a micron sized droplet of NaCl water droplet, where secondary spreading occurs. An analysis of the discrepancies with experiment is carried out, demonstrating that macroscopic balances can be an important tool for understanding what major factors need to be addressed for a better understanding of a physical system.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS1985

System Analysis for the Huntsville Operation Support Center, Distributed Computer System

HOSC as a distributed computing system, is responsible for data acquisition and analysis during Space Shuttle operations. HOSC also provides computing services for Marshall Space Flight Center's nonmission activities. As mission and nonmission activities change, so do the support functions of HOSC change, demonstrating the need for some method of simulating activity at HOSC in various configurations. The simulation developed in this work primarily models the HYPERchannel network. The model simulates the activity of a steady state network, reporting statistics such as, transmitted bits, collision statistics, frame sequences transmitted, and average message delay. These statistics are used to evaluate such performance indicators as throughout, utilization, and delay. Thus the overall performance of the network is evaluated, as well as predicting possible overload conditions.

Ingels, F. M.↗
DOE OSTI2022

Sparse Deep Neural Network Inference using different Programming Models

Sparse deep neural networks have gained increasing attention recently in achieving speedups on inference with reduced memory footprints. However, the real-world applications are little shown with specialized optimizations, yet a wide variety of DNN tasks remain dense without exploiting the advantages of sparsity in networks. Recent work presented by MIT/IEEE/Amazon GraphChallenge has demonstrated significant speedups and various techniques. Still, we find that there is limited investigation of the impact of various Python and C\slash C++ based programming models to explore new opportunities in general cases. In this work, we provide performance evaluation through different programming models using CuPy, cuSPARSE, and OpenMP to discuss the advantages and disadvantages of our sparse implementations on single-GPU and multiple GPUs of NVIDIA DGX-A100 40GB/80GB platforms.

machine learning, HPC↗
DOE OSTI2025

Discrete generative diffusion models without stochastic differential equations: A tensor network approach

Diffusion models (DMs) are a class of generative machine learning methods that sample a target distribution by transforming samples of a trivial (often Gaussian) distribution using a learned stochastic differential equation. In standard DMs, this is done by learning a “score function” that reverses the effect of adding diffusive noise to the distribution of interest. Here we consider the generalisation of DMs to lattice systems with discrete degrees of freedom, and where noise is added via Markov chain jump dynamics. We show how to use tensor networks (TNs) to efficiently define and sample such “discrete diffusion models” (DDMs) without explicitly having to solve a stochastic differential equation. We show the following: (i) by parametrising the data and evolution operators as TNs, the denoising dynamics can be represented exactly; (ii) the auto-regressive nature of TNs allows to generate samples efficiently and without bias; (iii) for sampling Boltzmann-like distributions, TNs allow to construct an efficient learning scheme that integrates well with Monte Carlo. We illustrate this approach to study the equilibrium of two models with non-trivial thermodynamics, the d = 1 constrained Fredkin chain and the d = 2 Ising model. Published by the American Physical Society 2025

Causer, Luke (ORCID:0000000194243473)↗
DOE OSTI2024

a priori uncertainty quantification of reacting turbulence closure models using Bayesian neural networks

While many physics-based closure model forms have been posited for the sub-filter scale (SFS) in large eddy simulation (LES), vast amounts of data available from direct numerical simulations (DNS) create opportunities to leverage data-driven modeling techniques. Albeit flexible, data-driven models still depend on the dataset and the functional form of the model chosen. Increased adoption of such models requires reliable uncertainty estimates both in the data-informed and out-of-distribution regimes. Here, in this work, we employ Bayesian neural networks (BNNs) to capture both epistemic and aleatoric uncertainties in a reacting flow model. In particular, we model the filtered progress variable scalar dissipation rate which plays a key role in the dynamics of turbulent premixed flames. We demonstrate that BNN models can provide unique insights about the structure of uncertainty of the data-driven closure models. We also propose a method for the incorporation of out-of-distribution information in a BNN, which can be used for out-of-distribution query detection. The efficacy of the model is demonstrated by a priori evaluation on a dataset consisting of a variety of flame conditions and fuels.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Topological Relationship–Based Flow Direction Modeling: Mesh–Independent River Networks Representation

River networks are important features in surface hydrology. However, accurately representing river networks in spatially distributed hydrologic and Earth system models is often sensitive to the model's spatial resolution. Specifically, river networks are often misrepresented because of the mismatch between the model's spatial resolution and river network details, resulting in significant uncertainty in the projected flow direction. In this study, we developed a topological relationship-based river network representation method for spatially distributed hydrologic models. This novel method uses (a) graph theory algorithms to simplify real-world vector-based river networks and assist in mesh generation; and (b) a topological relationship-based method to reconstruct conceptual river networks. The main advantages of our method are that (a) it combines the strengths of vector-based and DEM raster-based river network extraction methods; and (b) it is mesh-independent and can be applied to both structured and unstructured meshes. This method paves a path for advanced terrain analysis and hydrologic modeling across different scales.

54 ENVIRONMENTAL SCIENCES↗