Engineering Papers⌕ Search

DOE OSTI · 1839037

Computing Bottleneck Structures at Scale for High-Precision Network Performance Analysis

Abstract

The Theory of Bottleneck Structures is a recently-developed framework for studying the performance of data networks. It describes how local perturbations in one part of the network propagate and interact with others. This framework is a powerful analytical tool that allows network operators to make accurate predictions about network behavior and thereby optimize performance. Previous work implemented a software package for bottleneck structure analysis, but applied it only to toy examples. In this work, we introduce the first software package capable of scaling bottleneck structure analysis to production-size networks. Here, we benchmark our system using logs from ESnet, the Department of Energy's high-performance data network that connects research institutions in the U.S. Using the previously published tool as a baseline, we demonstrate that our system achieves vastly improved performance, constructing the bottleneck structure graphs in 0.21 s and calculating link derivatives in 0.09 s on average. We also study the asymptotic complexity of our core algorithms, demonstrating good scaling properties and strong agreement with theoretical bounds. These results indicate that our new software package can maintain its fast performance when applied to even larger networks. They also show that our software is efficient enough to analyze rapidly changing networks in real time. Overall, we demonstrate the feasibility of applying bottleneck structure analysis to solve practical problems in large, real-world data networks.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Amsel, Noah, Ros-Giralt, Jordi, Yellamraju, Sruthi, Ezick, James, von Hofe, Brendan, Ryan, Alison, Lethin, Richard. 2020-11-12. Computing Bottleneck Structures at Scale for High-Precision Network Performance Analysis. https://doi.org/10.1109/indis51933.2020.00012. https://engineeringpapers.com/record/osti%3A1839037/computing-bottleneck-structures-at-scale-for-high-precision-network-performance-analysis

Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Engineering Papers by Indiciae: BibTeX · RIS.

KEEP EXPLORING

Related reports

A code-to-code benchmark for magneto-convection in a horizontal duct

Liquid metals and magnetic fields are used in many technical applications such as metallurgy, crystal growth and nuclear fusion reactors. When an electrically conducting fluid moves in a magnetic environment, electric currents and electromagnetic forces are generated that affect velocity and pressure losses in the flow. These magnetohydrodynamic (MHD) interactions have to be investigated to optimize the engineering processes. The characteristics of MHD flows depend on the geometrical configuration, the strength of the applied magnetic field, the electrical properties of fluid and structural materials and the thermal conditions. In the so-called blankets for fusion reactors, where liquid metals are used to breed the plasma fuel component tritium and to extract the generated heat, magneto-convective flows play a crucial role in determining heat and mass transfer. Therefore, the availability of numerical codes to simulate this type of flow is mandatory and their validation is a necessary step to guarantee the reliability of the results. For that reason, a benchmark problem has been defined to simulate liquid metal flows in a horizontal rectangular duct heated from below and exposed to a non-uniform magnetic field. Results obtained by five research groups using different codes are compared.

benchmark↗

A Comparison of Preconstruction and Operational Wake Loss Estimates for Land-Based Wind Plants

Recent studies suggest that biases between wind plant pre-construction energy yield estimates and actual energy production are decreasing over time. However, variability in energy yield prediction accuracy across different projects and wind energy consultants remains high. Wake effects are one of the largest categories comprising the pre-construction energy yield assessment process. To assess the accuracy of wake loss predictions, we compare pre-construction wake loss estimates provided by 8 consultants to the estimated operational wake losses for 10 North American wind plants, as part of the Wind Plant Performance Prediction (WP3) Benchmark project. We estimate operational wake losses using supervisory control and data acquisition (SCADA) data by comparing total wind plant energy production to the potential energy production based on the power produced by freestream wind turbines. In the presentation, we will discuss the overall wake loss prediction bias as well as the project-to-project variability in the prediction accuracy. Further, we will highlight challenges encountered when estimating operational wake losses, including the impact of complex terrain and the presence of neighboring wind plants.

benchmark↗

Pore-scale and Continuum Simulations of Solute Transport Micromodel Benchmark Experiments

Four sets of micromodel nonreactive solute transport experiments were conducted with flow velocity, grain diameter, pore-aspect ratio, and flow focusing heterogeneity as the variables. The data sets were offered to pore-scale modeling groups to test their simulators. Each set consisted of two learning experiments, for which all results was made available, and a challenge experiment, for which only the experimental description and base input parameters were provided. The experimental results showed a nonlinear dependence of the dispersion coefficient on the Peclet number, a negligible effect of the pore-aspect ratio on transverse mixing, and considerably enhanced mixing due to flow focusing. Five pore-scale models and one continuum-scale model were used to simulate the experiments. Of the pore-scale models, two used a pore-network (PN) method, two others are based on a lattice-Boltzmann (LB) approach, and one employed a computational fluid dynamics (CFD) technique. The learning experiments were used by the PN models to modify the standard perfect mixing approach in pore bodies into approaches to simulate the observed incomplete mixing. The LB and CFD models used these experiments to appropriately discretize the grid representations. The continuum model use published non-linear relations between transverse dispersion coefficients and Peclet numbers to compute the required dispersivity input values. Comparisons between experimental and numerical results for the four challenge experiments show that all pore-scale models were all able to satisfactorily simulate the experiments. The continuum model underestimated the required dispersivity values and, resulting in less dispersion. The PN models were able to complete the simulations in a few minutes, whereas the direct models needed up to several days on supercomputers to resolve the more complex problems.

benchmark↗