SEARCH · Engineering Papers
Results for “Network Models”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Establishing Digital Twins for Non-Proliferation of Secure Facilities under Low Data Availability with Agent-Based Modeling, Deep Neural Network Surrogates, and Virtual Reality
Explore the source record for details and available documents.
Communications network design and costing model technical manual
This computer model provides the capability for analyzing long-haul trunking networks comprising a set of user-defined cities, traffic conditions, and tariff rates. Networks may consist of all terrestrial connectivity, all satellite connectivity, or a combination of terrestrial and satellite connectivity. Network solutions provide the least-cost routes between all cities, the least-cost network routing configuration, and terrestrial and satellite service cost totals. The CNDC model allows analyses involving three specific FCC-approved tariffs, which are uniquely structured and representative of most existing service connectivity and pricing philosophies. User-defined tariffs that can be variations of these three tariffs are accepted as input to the model and allow considerable flexibility in network problem specification. The resulting model extends the domain of network analysis from traditional fixed link cost (distance-sensitive) problems to more complex problems involving combinations of distance and traffic-sensitive tariffs.
Hybrid-LLM-GNN: integrating large language models and graph neural networks for enhanced materials property prediction
This study combines Graph Neural Networks (GNNs) and Large Language Models (LLMs) to improve material property predictions. By leveraging both embeddings, this hybrid approach achieves up to a 25% improvement over GNN-only model in accuracy.
Deciphering enhancer sequence using thermodynamics-based models and convolutional neural networks
Abstract Deciphering the sequence-function relationship encoded in enhancers holds the key to interpreting non-coding variants and understanding mechanisms of transcriptomic variation. Several quantitative models exist for predicting enhancer function and underlying mechanisms; however, there has been no systematic comparison of these models characterizing their relative strengths and shortcomings. Here, we interrogated a rich data set of neuroectodermal enhancers in Drosophila, representing cis- and trans- sources of expression variation, with a suite of biophysical and machine learning models. We performed rigorous comparisons of thermodynamics-based models implementing different mechanisms of activation, repression and cooperativity. Moreover, we developed a convolutional neural network (CNN) model, called CoNSEPT, that learns enhancer ‘grammar’ in an unbiased manner. CoNSEPT is the first general-purpose CNN tool for predicting enhancer function in varying conditions, such as different cell types and experimental conditions, and we show that such complex models can suggest interpretable mechanisms. We found model-based evidence for mechanisms previously established for the studied system, including cooperative activation and short-range repression. The data also favored one hypothesized activation mechanism over another and suggested an intriguing role for a direct, distance-independent repression mechanism. Our modeling shows that while fundamentally different models can yield similar fits to data, they vary in their utility for mechanistic inference. CoNSEPT is freely available at: https://github.com/PayamDiba/CoNSEPT.
Forecasting Solar-Thermal Systems Performance under Transient Operation Using a Data-Driven Machine Learning Approach Based on the Deep Operator Network Architecture
Modeling and prediction of the dynamic behavior of thermal systems operating under intermittent energy input and variable load requirements represent one of the greatest challenges in the development of efficient and reliable renewable-based power generation technologies. In this work, a data-driven machine learning modeling framework was developed based on a modified version of the Deep Operator Network architecture where the time coordinate in the trunk net is replaced with historical data of the predicting quantity. The modeling framework can be used to accurately predict the performance of renewable-based energy conversion technologies including wind- and solar-based power plants. This novel framework was applied on a solar-thermal system that consists of a solar collection loop using a flat plate collector, a power generation loop comprising an Organic Rankine Cycle, and a thermal energy storage tank connecting both loops. Variable solar irradiance, air temperature, and power load profiles were used by the Deep Operator Network to predict the State-of-Charge and the efficiency of the thermal system for several days. The results were compared with the State-of-Charge and efficiency functions calculated using a physics-based model. For a simple operation scenario, characterized by a clear sky solar irradiance profile and constant load, the standard deviation in the State-of-Charge prediction by Deep Operator Network is below 0.9% during a seven-day prediction time horizon. For the most realistic operation scenario that considers real solar irradiance and a rough load profile, the maximum standard deviation in the predictions for the State-of-Charge and efficiency are below 6.8% and 2.5%, respectively. A comparison between Deep Operator Network and Long Short Term Memory network was also performed. In general, both networks predict very well the State-of-Charge for different data density conditions; however, a higher accuracy, with a standard deviation below 2.0%, is obtained by the Deep Operator Network during three and half days using sparser training data of 20-minute points. The same accuracy for the State-of-Charge prediction with the Long Short Term Memory network is achieved only for 14 h. Average standard deviations for the State-of-Charge prediction of 1.1% with the Deep Operator Network and 1.5% with the Long Short Term Memory network are obtained for a four-day prediction time using a denser training data of 5-minute points.
Modeling Ring Current Proton Fluxes Using Artificial Neural Network and Van Allen Probe Measurements
Abstract Terrestrial ring current dynamics are a critical part of the near‐space environment, in that they directly drive geomagnetic field variations that control particle drifts, and define geomagnetic storms. The present study aims to specify a global and time‐varying distribution of ring current proton using geomagnetic indices and solar wind parameters with their history as input. We train an artificial neural network (ANN) model to reproduce proton fluxes measured by the Radiation Belt Storm Probes Ion Composition Experiment instrument onboard Van Allen Probes. By choosing optimal feature parameters and their history length, the model results show a high correlation and a small error between model specifications and satellite measurements. The modeled results well capture energy‐dependent proton dynamics in association with geomagnetic storms, including inward radial diffusion, acceleration and decay. Our ANN model produces proton fluxes with their corresponding 3D spatiotemporal variations, capturing the latitudinal distribution and local time asymmetry that are consistent with observations and that can further inform theory.
Pathfinder Networks for Measuring Operator Mental Model Structure with a Simple Autopilot System
Pathfinder networks are a method to represent mental models from empirically generated pairwise relatedness ratings. This study examined the effects of training exposure on mental model structures based on relatedness ratings collected using the Target Rating method. Forty-eight participants read instruction slides with or without explicit information on the functionality of an autopilot system (Advanced Mental Model or Basic Mental Model groups, respectively). Participants provided relatedness ratings and completed a comprehension test. The Advanced Mental Model group had more common links with the expected model, higher within-group network similarity scores, and higher mental model assessment questionnaire scores than the Basic Mental Model group. Both groups had coherence scores above the minimum threshold for internal consistency. Pathfinder network analysis was sensitive to changes produced by a simple exposure training intervention. In practice, a simple training program may effectively influence operator mental models in novel technological environments such as Advanced Air Mobility.
Exploring the nexus of many-body theories through neural network techniques: the tangent model
Abstract In this paper, we present a physically informed neural network (NN) representation of the effective interactions associated with coupled-cluster downfolding models to describe chemical systems and processes. The NN representation not only allows us to evaluate the effective interactions efficiently for various geometrical configurations of chemical systems corresponding to various levels of complexity of the underlying wave functions, but also reveals that the bare and effective interactions are related by a tangent function of some latent variables. We refer to this characterization of the effective interaction as a tangent model. We discuss the connection between this tangent model for the effective interaction with the previously developed theoretical analysis that examines the difference between the bare and effective Hamiltonians in the corresponding active spaces.
Surrogate construction via weight parameterization of residual neural networks
Surrogate model development is a critical step for uncertainty quantification or other sample-intensive tasks for complex computational models. Here, in this work, we develop a multi-output surrogate form using a class of neural networks (NNs) that employ shortcut connections, namely Residual NNs (ResNets). ResNets are known to regularize the surrogate learning problem and improve the efficiency and accuracy of the resulting surrogate. Inspired by the continuous, Neural ODE analogy, we augment ResNets with weight parameterization strategy with respect to ResNet depth. Weight-parameterized ResNets regularize the NN surrogate learning problem and allow better generalization with a drastically reduced number of learnable parameters. We demonstrate that weight-parameterized ResNets are more accurate and efficient than conventional feed-forward multi-layer perceptron networks. We also compare various options for parameterization of the weights as functions of ResNet depth. We demonstrate the results on both synthetic examples and a large scale earth system model of interest.
Suppressing simulation bias in multi-modal data using transfer learning
Abstract Many problems in science and engineering require making predictions based on few observations. To build a robust predictive model, these sparse data may need to be augmented with simulated data, especially when the design space is multi-dimensional. Simulations, however, often suffer from an inherent bias. Estimation of this bias may be poorly constrained not only because of data sparsity, but also because traditional predictive models fit only one type of observed outputs, such as scalars or images, instead of all available output data modalities, which might have been acquired and simulated at great cost. To break this limitation and open up the path for multi-modal calibration, we propose to combine a novel, transfer learning technique for suppressing the bias with recent developments in deep learning, which allow building predictive models with multi-modal outputs. First, we train an initial neural network model on simulated data to learn important correlations between different output modalities and between simulation inputs and outputs. Then, the model is partially retrained, or transfer learned, to fit the experiments; a method that has never been implemented in this type of architecture. Using fewer than 10 inertial confinement fusion experiments for training, transfer learning systematically improves the simulation predictions while a simple output calibration, which we design as a baseline, makes the predictions worse. We also offer extensive cross-validation with real and carefully designed synthetic data. The method described in this paper can be applied to a wide range of problems that require transferring knowledge from simulations to the domain of experiments.
A New Simplified Discrete Fracture Model for Shearing of Intersecting Fractures and Faults
Abstract Shearing of fractures and faults is important because it can result in permeability change or even induce seismicity—both are keys for efficient and safe energy recovery and storage in Earth systems. Quantitative analysis of shearing of intersecting fractures and faults is challenging because it can involve dynamic frictional contacts that are complicated by deformation of the rock matrix. To predict the shearing of intersecting fractures/faults, we attempt to answer the question of how intersections impact the shearing of a fracture network and whether we can simplify the description as compared to classical discrete fracture network (DFN) models. To answer these questions, we conducted a series of numerical simulations on scenarios for variable numbers of intersecting fractures. All these examples yield consistent results: the results of using DFNs are consistent with those of using hypothetical major paths. This leads to a new model, which we name simplified discrete fracture network model , to analyze shearing of intersecting fractures/faults using major path(s). We found that the intersections of fractures do not fundamentally change the shearing of two intersecting fractures if the intersecting angles are small. Furthermore, increasing the number of fractures/faults may relax the stress as more fractures/faults become available for shearing and distributing the stress. The simplified DFN model, which can capture efficiently the shearing behavior of each major paths from a large number of intersecting fractures/faults, will be a promising conceptual model that is complementary to existing equivalent continuum and discrete fracture models to analyze shearing of intersecting fractures/faults.
Solving inverse problems in stochastic models using deep neural networks and adversarial training
Inverse problems associated with stochastic models constitute a significant portion of scientific and engineering applications. In such cases the unknown quantities are distributions. The applicability of traditional methods is limited because of their demanding assumptions or prohibitive computational consumption; for example, maximum likelihood methods require closed-form density functions, and Markov Chain Monte Carlo needs a large number of simulations. We propose a new method that estimates the unknown distribution by matching the statistical properties between observed and simulated random processes. We leverage the expressive power of neural networks to approximate the unknown distribution and use a discriminative neural network for computing the statistical discrepancies between the observed and simulated random processes. Here we demonstrated numerically that the proposed methods can estimate both the model parameters and learn complicated unknown distributions.
Modeling Single and Two-Phase Transport in Thin Porous Layers Using a Composite Continuum-Pore Network Formulation
In this work, a composite continuum-pore network formulation is presented to model single and two-phase transport thin porous layers, such as gas diffusion layers in polymer electrolyte fuel cells (PEFCs) and active electrodes in redox flow batteries (RFBs). The formulation can be integrated into CFD codes, thus combining the ease of implementation of continuum-based modeling and the computational power of pore-network modeling. The composite model includes a control volume (CV) mesh at the layer scale, which embeds a cubic pore network [1,2]. The pore-network model is used to determine analytically local anisotropic effective transport properties (local effective diffusivity and permeability), which are mapped onto the CV mesh to simulate transport in the porous transport layer [3,4]. Good agreement is found between the predicted global effective transport properties (global effective diffusivity and permeability) under dry and wet conditions and previous experimental data reported in the literature for Toray TGP-H series carbon paper. Water saturation distributions are also compared with results obtained using X-ray computed tomography [4]. [1] P.A. García-Salaberri, I.V. Zenyuk, J.T. Gostick, A.Z. Weber, Modeling Gas Diffusion Layer in Polymer Electrolyte Fuel Cells Using a Continuum-Based Pore-Network Formulation, ECS Trans. 97 (2020) 615. [2] P.A. García-Salaberri, Modeling diffusion and convection in thin porous transport layers using a composite continuum-network model: Application to gas diffusion layers in polymer electrolyte fuel cells, Int J. Heat Mass Transf. (2020), submitted. [3] P.A. García-Salaberri, J.T. Gostick, G. Hwang, A.Z. Weber, M. Vera, Effective diffusivity in partially-saturated carbon-fiber gas diffusion layers: Effect of local saturation and application to macroscopic continuum models, J. Power Sources 296 (2015) 440–453. [4] P.A. García-Salaberri, G. Hwang, M. Vera, A.Z. Weber, J.T. Gostick, Effective diffusivity in partially-saturated carbon-fiber gas diffusion layers: Effect of through-plane saturation distribution, Int. J. Heat Mass Transf. 86 (2015) 319–333.
MULTISTEP AND CONTINUOUS PHYSICS-INFORMED NEURAL NETWORK METHODS FOR LEARNING GOVERNING EQUATIONS AND CONSTITUTIVE RELATIONS
In this work, we investigate the applicability and relative merit of discrete and continuous versions of physics-informed neural network (PINN) methods for learning unknown governing equations or constitutive relations in a nonlinear dynamical system. In the case of unknown dynamics, entire right-hand-side (RHS) equations of the ordinary differential equations are unknown. In the case of unknown constitutive relations, however, the RHS equations are known up to the specification of constitutive relations (that may depend on the state of the system). We use a deep neural network to model unknown governing equations or constitutive relations. The discrete PINN approach combines classical multistep discretization methods for dynamical systems with neural-network-based machine learning methods. On the other hand, the continuous versions utilize deep neural networks to minimize the residual function for the continuous governing equations. We use the case of a fedbatch bioreactor system to study the effectiveness of these approaches and discuss conditions for their applicability. Our results indicate that the accuracy of the trained neural network models is much higher for the cases where we only have to learn a constitutive relation instead of all dynamics. This finding corroborates the well-known fact from scientific computing that building as much structural information as is available into an algorithm can enhance its efficiency and/or accuracy.
Traffic Modeling for Deep Space Network in the Human Mars Exploration Era
In this article we describe the analysis and simulation effort of the end-to-end traffic flow for the Deep Space Network (DSN) in the Human Exploration Era, when DSN will provide communication and navigation services for human missions to distant celestial objects like the Moon, asteroids, and Mars. Using the network traffic derived for the 30-day period within July/August 2039 from the Space Communications Mission Model (SCMM), we simulate the bandwidths of the ground links and the buffer profiles of the network nodes. We also use a 2-state Markov scheme that models the store-and-forward mechanism that regulates the ground network traffic. The network traffic modeling and simulation generates ground bandwidth and buffer statistics, which in turn are used to formulate the future DSN ground network bandwidth and storage requirements.
Unified Lunar Control Network 2005 and Topographic Model
There are currently two generally accepted lunar control networks. These are the Unified Lunar Control Network (ULCN) and the Clementine Lunar Control Network (CLCN), both derived by M. Davies and T. Colvin at RAND. We address here our efforts to merge and improve these networks into a new ULCN. The ULCN was described in the last major publication about a lunar control network. The statistics on this and the other networks discussed here. Images for this network are from the Apollo, Mariner 10, and Galileo missions, and Earth-based photographs. The importance of this network is that its accuracy is relatively well quantified and published information on the network is available. The CLCN includes measurements on 43,871 Clementine 750-nm images - the largest planetary control network ever computed. This purpose of this network was to determine the geometry for the Clementine Basemap Mosiac (CBM). The geometry of that mosaic was used to produce the Clementine UVVIS digital image model and the Near-Infrared Global Multispectral Map of the Moon from Clementine. Through the extensive use of these products, they and the underlying CLCN in effect define the generally accepted current coordinate system for reporting and describing the location of lunar coordinates. However, no publication describes the CLCN itself.
Utah FORGE: Documentation on Discrete Fracture Network and Fracture Propagation Modelling
This dataset includes reports and a slide presentation on discrete fracture network (DFN) generation and hydraulic fracture modeling at the Utah FORGE site. It details the characterization of natural fractures using well log and core data, as well as stochastic modeling techniques. The reports describe simulations of hydraulic fracture propagation, fluid-mechanical interactions, and induced microseismicity. The dataset also includes history-matching of net pressure and analyses of fracture growth in naturally fractured geothermal reservoirs. The slides summarize key findings and future research directions.