Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Network simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Large-Scale Modeling of Epileptic Seizures: Scaling Properties of Two Parallel Neuronal Network Simulation Algorithms

Our limited understanding of the relationship between the behavior of individual neurons and large neuronal networks is an important limitation in current epilepsy research and may be one of the main causes of our inadequate ability to treat it. Addressing this problem directly via experiments is impossibly complex; thus, we have been developing and studying medium-large-scale simulations of detailed neuronal networks to guide us. Flexibility in the connection schemas and a complete description of the cortical tissue seem necessary for this purpose. In this paper we examine some of the basic issues encountered in these multiscale simulations. We have determined the detailed behavior of two such simulators on parallel computer systems. The observed memory and computation-time scaling behavior for a distributed memory implementation were very good over the range studied, both in terms of network sizes (2,000 to 400,000 neurons) and processor pool sizes (1 to 256 processors). Our simulations required between a few megabytes and about 150 gigabytes of RAM and lasted between a few minutes and about a week, well within the capability of most multinode clusters. Therefore, simulations of epileptic seizures on networks with millions of cells should be feasible on current supercomputers.

59 BASIC BIOLOGICAL SCIENCES↗

Benchmarking the Performance of Neuromorphic and Spiking Neural Network Simulators

Software simulators play a critical role in the development of new algorithms and system architectures in any field of engineering. Neuromorphic computing, which has shown potential in building brain-inspired energy-efficient hardware, suffers a slow-down in the development cycle due to a lack of flexible and easy-to-use simulators of either neuromorphic hardware itself or of spiking neural networks (SNNs), the type of neural network computation executed on most neuromorphic systems. While there are several openly available neuromorphic or SNN simulation packages developed by a variety of research groups, they have mostly targeted computational neuroscience simulations, and only a few have targeted small-scale machine learning tasks with SNNs. Evaluations or comparisons of these simulators have often targeted computational neuroscience-style workloads. In this work, we seek to evaluate the performance of several publicly available SNN simulators with respect to non-computational neuroscience workloads, in terms of speed, flexibility, and scalability. We evaluate the performance of the NEST, Brian2, Brian2GeNN, BindsNET and Nengo packages under a common front-end neuromorphic framework. Our evaluation tasks include a variety of different network architectures and workload types to mimic the computation common in different algorithms, including feed-forward network inference, genetic algorithms, and reservoir computing. We also study the scalability of each of these simulators when running on different computing hardware, from single core CPU workstations to multi-node supercomputers. Our results show that the BindsNET simulator has the best speed and scalability for most of the SNN workloads (sparse, dense, and layered SNN architectures) on a single core CPU. However, when comparing the simulators leveraging the GPU capabilities, Brian2GeNN outperforms the others for these workloads in terms of scalability. NEST performs the best for small sparse networks and is also the most flexible simulator in terms of reconfiguration capability NEST shows a speedup of at least 2x compared to the other packages when running evolutionary algorithms for SNNs. The multi-node and multi-thread capabilities of NEST show at least 2x speedup compared to the rest of the simulators (single core CPU or GPU based simulators) for large and sparse networks. We conclude our work by providing a set of recommendations on the suitability of employing these simulators for different tasks and scales of operations. We also present the characteristics for a future generic ideal SNN simulator for different neuromorphic computing workloads.

97 MATHEMATICS AND COMPUTING↗

Code for Experiment in Publication “Sensitivity Analysis in the Presence of Intrinsic Stochasticity for Discrete Fracture Network Simulations”

Following the Open Research requirements for AGU journals, we must release the code used to perform the experiment described in our recent publication, posted at (https://arxiv.org/abs/2312.04722). This code fits a joint emulator to data from a Discrete Fracture Network (DFN) simulation, performed using the open-source software DFNworks (https://dfnworks.lanl.gov/). All code to be released implements existing methods; there are no novel algorithms nor any major innovations to existing software.

Murph, Alexander↗

Water dissociation at the water–rutile TiO 2 (110) interface from ab initio-based deep neural network simulations

The interaction of water with TiO 2 surfaces is of crucial importance in various scientific fields and applications, from photocatalysis for hydrogen production and the photooxidation of organic pollutants to self-cleaning surfaces and bio-medical devices. In particular, the equilibrium fraction of water dissociation at the TiO 2 –water interface has a critical role in the surface chemistry of TiO 2 , but is difficult to determine both experimentally and computationally. Among TiO 2 surfaces, rutile TiO 2 (110) is of special interest as the most abundant surface of TiO 2 ’s stable rutile phase. While surface-science studies have provided detailed information on the interaction of rutile TiO 2 (110) with gas-phase water, much less is known about the TiO 2 (110)–water interface, which is more relevant to many applications. In this work, we characterize the structure of the aqueous TiO 2 (110) interface using nanosecond timescale molecular dynamics simulations with ab initio-based deep neural network potentials that accurately describe water/TiO 2 (110) interactions over a wide range of water coverages. Simulations on TiO 2 (110) slab models of increasing thickness provide insight into the dynamic equilibrium between molecular and dissociated adsorbed water at the interface and allow us to obtain a reliable estimate of the equilibrium fraction of water dissociation. We find a dissociation fraction of 22 ± 6% with an associated average hydroxyl lifetime of 7.6 ± 1.8 ns. These quantities are both much larger than corresponding estimates for the aqueous anatase TiO 2 (101) interface, consistent with the higher water photooxidation activity that is observed for rutile relative to anatase.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Structure of disordered TiO 2 phases from ab initio based deep neural network simulations

Amorphous TiO 2 (a-TiO 2 ) is widely used in many fields, ranging from photo-electrochemistry to bio-engineering, hence detailed knowledge of its atomic structure is of scientific and technological interest. Here we use an ab initio-based deep neural network potential (DP) to simulate large scale atomic models of crystalline and disordered TiO 2 with molecular dynamics. Our DP reproduces the structural properties of all (11) TiO 2 crystalline phases, predicts the densities and structure factors of molten and amorphous TiO 2 with only a few percent deviation from experiments, and describes the pressure dependence of the amorphous structure in agreement with recent observations. Furthermore, it can be extended to model additional structures and compositions and can be thus of great value in the study of TiO 2 -based (nano-)materials.

36 MATERIALS SCIENCE↗

Viscosity in water from first-principles and deep-neural-network simulations

Abstract We report on an extensive study of the viscosity of liquid water at near-ambient conditions, performed within the Green-Kubo theory of linear response and equilibrium ab initio molecular dynamics (AIMD), based on density-functional theory (DFT). In order to cope with the long simulation times necessary to achieve an acceptable statistical accuracy, our ab initio approach is enhanced with deep-neural-network potentials (NNP). This approach is first validated against AIMD results, obtained by using the Perdew–Burke–Ernzerhof (PBE) exchange-correlation functional and paying careful attention to crucial, yet often overlooked, aspects of the statistical data analysis. Then, we train a second NNP to a dataset generated from the Strongly Constrained and Appropriately Normed (SCAN) functional. Once the error resulting from the imperfect prediction of the melting line is offset by referring the simulated temperature to the theoretical melting one, our SCAN predictions of the shear viscosity of water are in very good agreement with experiments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Seizure-induced alterations in fast-spiking basket cell GABA currents modulate frequency and coherence of gamma oscillation in network simulations

Gamma frequency oscillations have been proposed to contribute to memory formation and retrieval. Fast-spiking basket cells (FS-BCs) are known to underlie development of gamma oscillations. Fast, high amplitude GABA synapses and gap junctions have been suggested to contribute to gamma oscillations in FS-BC networks. Recently, we identified that, apart from GABAergic synapses, FS-BCs in the hippocampal dentate gyrus have GABAergic currents mediated by extrasynaptic receptors. Our experimental studies demonstrated two specific changes in FS-BC GABA currents following experimental seizures [Yu et al., J. Neurophysiol. 109, 1746 (2013)]: increase in the magnitude of extrasynaptic (tonic) GABA currents and a depolarizing shift in GABA reversal potential (E{sub GABA}). Here, we use homogeneous networks of a biophysically based model of FS-BCs to examine how the presence of extrasynaptic GABA conductance (g{sub GABA-extra}) and experimentally identified, seizure-induced changes in g{sub GABA-extra} and E{sub GABA} influence network activity. Networks of FS-BCs interconnected by fast GABAergic synapses developed synchronous firing in the dentate gamma frequency range (40–100 Hz). Systematic investigation revealed that the biologically realistic range of 30 to 40 connections between FS-BCs resulted in greater coherence in the gamma frequency range when networks were activated by Poisson-distributed dendritic synaptic inputs rather than by homogeneous somatic current injections, which were balanced for FS-BC firing frequency in unconnected networks. Distance-dependent conduction delay enhanced coherence in networks with 30–40 FS-BC interconnections while inclusion of gap junctional conductance had a modest effect on coherence. In networks activated by somatic current injections resulting in heterogeneous FS-BC firing, increasing g{sub GABA-extra} reduced the frequency and coherence of FS-BC firing when E{sub GABA} was shunting (−74 mV), but failed to alter average FS-BC frequency when E{sub GABA} was depolarizing (−54 mV). When FS-BCs were activated by biologically based dendritic synaptic inputs, enhancing g{sub GABA-extra} reduced the frequency and coherence of FS-BC firing when E{sub GABA} was shunting and increased average FS-BC firing when E{sub GABA} was depolarizing. Shifting E{sub GABA} from shunting to depolarizing potentials consistently increased network frequency to and above high gamma frequencies (>80 Hz). Since gamma oscillations may contribute to learning and memory processing [Fell et al., Nat. Neurosci. 4, 1259 (2001); Jutras et al., J. Neurosci. 29, 12521 (2009); Wang, Physiol. Rev. 90, 1195 (2010)], our demonstration that network oscillations are modulated by extrasynaptic inhibition in FS-BCs suggests that neuroactive compounds that act on extrasynaptic GABA receptors could impact memory formation by modulating hippocampal gamma oscillations. The simulation results indicate that the depolarized FS-BC GABA reversal, observed after experimental seizures, together with enhanced spillover extrasynaptic GABA currents are likely to promote generation of focal high frequency activity associated with epileptic networks.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Union: An Automatic Workload Manager for Accelerating Network Simulation

With the rapid growth of the machine learning applications, the workloads of future HPC systems are anticipated to be a mix of scientific simulation, big data analytics, and machine learning applications. Simulation is a great research vehicle to understand the performance implications of co-running scientific applications with big data and machine learning workloads on large-scale systems. In this paper, we present Union, a workload manager that provides an automatic framework to facilitate hybrid workload simulation in CODES. Furthermore, we use Union, along with CODES, to investigate various hybrid workloads composed of traditional simulation applications and emerging learning applications on two dragonfly systems. The experiment results show that both message latency and communication time are important performance metrics to evaluate network interference. Network interference on HPC applications is more reflected by the message latency variation, whereas ML application performance depends more on the communication time.

heterogeneous workloads↗

Tensor network simulations of quasi-GPDs in the massive Schwinger model

Generalized parton distribution functions (GPDs) are off-diagonal light-cone matrix elements that encode the internal structure of hadrons in terms of quark and gluon degrees of freedom. In this work, we present the first nonperturbative study of quasi-GPDs in the massive Schwinger model, quantum electrodynamics in 1+1 dimensions (QED 2 ), within the Hamiltonian formulation of lattice field theory. Quasidistributions are spatial correlation functions of boosted states, which approach the relevant light-cone distributions in the luminal limit. Using tensor networks, we prepare the first excited state in the strongly coupled regime and boost it to close to the light-cone on lattices of up to 400 lattice sites. We compute both quasiparton distribution functions and, for the first time, quasi-GPDs, and study their convergence for increasingly boosted states. In addition, we perform analytic calculations of GPDs in the two-particle Fock-space approximation and in the Reggeized limit, providing qualitative benchmarks for the tensor network results. Our analysis establishes computational benchmarks for accessing partonic observables in low-dimensional gauge theories, offering a starting point for future extensions to higher dimensions, non-Abelian theories, and quantum simulations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Heat transport in liquid water from first-principles and deep neural network simulations

In this work, we compute the thermal conductivity of water within linear response theory from equilibrium molecular dynamics simulations, by adopting two different approaches. In one, the potential energy surface (PES) is derived on the fly from the electronic ground state of density functional theory (DFT) and the corresponding analytical expression is used for the energy flux. In the other, the PES is represented by a deep neural network (DNN) trained on DFT data, whereby the PES has an explicit local decomposition and the energy flux takes a particularly simple expression. By virtue of a gauge invariance principle, established by Marcolongo, Umari, and Baroni, the two approaches should be equivalent if the PES were reproduced accurately by the DNN model. We test this hypothesis by calculating the thermal conductivity, at the GGA (PBE) level of theory, using the direct formulation and its DNN proxy, finding that both approaches yield the same conductivity, in excess of the experimental value by approximately 60%. Besides being numerically much more efficient than its direct DFT counterpart, the DNN scheme has the advantage of being easily applicable to more sophisticated DFT approximations, such as meta-GGA and hybrid functionals, for which it would be hard to derive analytically the expression of the energy flux. We find in this way that a DNN model, trained on meta-GGA (SCAN) data, reduces the deviation from experiment of the predicted thermal conductivity by about 50%, leaving the question open as to whether the residual error is due to deficiencies of the functional, to a neglect of nuclear quantum effects in the atomic dynamics, or, likely, to a combination of the two.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Localized reactive flow in carbonate rocks: Core-flood experiments and network simulations

We conducted four core-flood experiments on samples of a micritic, reef limestone from Abu Dhabi under conditions of constant flow rate. The pore fluid was water in equilibrium with CO 2 , which, because of its lowered pH, is chemically reactive with the limestone. Flow rates were between 0.03 and 0.1 mL/min. The difference between up and downstream pore pressures dropped to final values <<1 MPa over periods of 3–18 h. Scanning electron microscope and microtomography imaging of the starting material showed that the limestone is mostly calcite and lacks connected macroporosity and that the prevailing pores are few microns large. During each experiment, a wormhole formed by localized dissolution, an observation consistent with the decreases in pressure head between the up and downstream reservoirs. Moreover, we numerically modeled the changes in permeability during the experiments. We devised a network approach that separated the pore space into competing subnetworks of pipes. Thus, the problem was framed as a competition of flow of the reactive fluid among the adversary subnetworks. The precondition for localization within certain time is that the leading subnetwork rapidly becomes more transmissible than its competitors. This novel model successfully simulated features of the shape of the wormhole as it grew from few to about 100 µm, matched the pressure history patterns, and yielded the correct order of magnitude of the breakthrough time. Finally, we systematically studied the impact of changing the statistical parameters of the subnetworks. Larger mean radius and spatial correlation of the leading subnetwork led to faster localization.

58 GEOSCIENCES↗