Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “concurrent tools”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

PythonFOAM: In-situ data analyses with OpenFOAM and Python

Here, we outline the development of a general-purpose Python-based data analysis tool for OpenFOAM. Our implementation relies on the construction of OpenFOAM applications that have bindings to data analysis libraries in Python. Double precision data in OpenFOAM is cast to a NumPy array using the NumPy C-API and Python modules may then be used for arbitrary data analysis and manipulation on flow-field information. We highlight how the proposed wrapper may be used for an in-situ online singular value decomposition (SVD) implemented in Python and accessed from the OpenFOAM solver PimpleFOAM. Here, 'in-situ' refers to a programming paradigm that allows for a concurrent computation of the data analysis on the same computational resources utilized for the partial differential equation solver. In addition, to demonstrate parallel deployments, we deploy a distributed SVD, which collects snapshot data across the ranks of a distributed simulation to compute the global left singular vectors. Crucially, both OpenFOAM and Python share the same message passing interface (MPI) communicator for this deployment which allows Python objects and functions to exchange NumPy arrays across ranks. Subsequently, we provide scaling assessments of this distributed SVD on multiple nodes of Intel Broadwell and KNL architectures for canonical test cases such as the large eddy simulations of a backward facing step and a channel flow at friction Reynolds number of 395. Finally, we demonstrate the deployment of a deep neural network for compressing the flow-field information using an autoencoder to demonstrate an ability to use state-of-the-art machine learning tools in the Python ecosystem.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Making a Monkey out of Human Immunodeficiency Virus/Simian Immunodeficiency Virus Pathogenesis: Immune Cell Depletion Experiments as a Tool to Understand the Immune Correlates of Protection and Pathogenicity in HIV Infection

Understanding the underlying mechanisms of HIV pathogenesis is critical for designing successful HIV vaccines and cure strategies. However, achieving this goal is complicated by the virus’s direct interactions with immune cells, the induction of persistent reservoirs in the immune system cells, and multiple strategies developed by the virus for immune evasion. Meanwhile, HIV and SIV infections induce a pandysfunction of the immune cell populations, making it difficult to untangle the various concurrent mechanisms of HIV pathogenesis. Over the years, one of the most successful approaches for dissecting the immune correlates of protection in HIV/SIV infection has been the in vivo depletion of various immune cell populations and assessment of the impact of these depletions on the outcome of infection in non-human primate models. Here, we present a detailed analysis of the strategies and results of manipulating SIV pathogenesis through in vivo depletions of key immune cells populations. Although each of these methods has its limitations, they have all contributed to our understanding of key pathogenic pathways in HIV/SIV infection.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Heterologous expression of formate dehydrogenase enables photoformatotrophy in the emerging model microalga, Picochlorum renovo

Rising global greenhouse gas emissions and the impacts of resultant climate change necessitate development and deployment of carbon capture and conversion technologies. Amongst the myriad of bio-based conversion approaches under evaluation, a formate bio-economy has recently been proposed, wherein CO 2 -derived formate serves as a substrate for concurrent carbon and energy delivery to microbial systems. To date, this approach has been explored in chemolithotrophic and heterotrophic organisms via native or engineered formatotrophy. However, utilization of this concept in phototrophic organisms has yet to be reported. Herein, we have taken the first steps to establish formate utilization in Picochlorum renovo, a recently characterized eukaryotic microalga with facile genetic tools and promising applied biotechnology traits. Plastidial heterologous expression of a formate dehydrogenase (FDH) enabled P. renovo growth on formate as a carbon and energy source. Further, FDH expression enhanced cultivation capacity on ambient CO 2 , underscoring the potential for bypass of conventional CO 2 capture and concentration limitations. This work establishes a photoformatotrophic cultivation regime that leverages light energy-driven formate utilization. The resultant photosynthetic formate platform has widespread implications for applied phototrophic cultivation systems and the bio-economy at large.

09 BIOMASS FUELS↗
DOE OSTI2021

Atacama Cosmology Telescope measurements of a large sample of candidates from the Massive and Distant Clusters of WISE Survey

Galaxy clusters are an important tool for cosmology, and their detection and characterization are key goals for current and future surveys. Using data from the Wide-field Infrared Survey Explorer (WISE), the Massive and Distant Clusters of WISE Survey (MaDCoWS) located 2839 significant galaxy overdensities at redshifts 0.7 ≲ z ≲ 1.5, which included extensive follow-up imaging from the Spitzer Space Telescope to determine cluster richnesses. Concurrently, the Atacama Cosmology Telescope (ACT) has produced large area millimeter-wave maps in three frequency bands along with a large catalog of Sunyaev-Zeldovich (SZ)-selected clusters as part of its Data Release 5 (DR5). Aims. We aim to verify and characterize MaDCoWS clusters using measurements of, or limits on, their thermal SZ effect signatures. Here, we also use these detections to establish the scaling relation between SZ mass and the MaDCoWS-defined richness.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Influence of wind turbine design parameters on linearized physics-based models in OpenFAST

Abstract. While most physics involved in wind energy are nonlinear, linearization of the underlying nonlinear wind system equations is often important for understanding the system response and exploiting well-established methods and tools for analyzing linear systems. Linearized models are important for eigenanalysis (to derive structural natural frequencies, damping ratios, and mode shapes), controls design (based on linear state-space models), etc. In controls co-design, wherein methods often rely on linearized time-domain models of the physics, the physical structure (often called the plant) and controller are designed and optimized concurrently, so it is important to understand how changes to the physical design affect the linearized system. This work summarizes efforts done to understand the impact of design parameter variations in the physical system (e.g., mass, stiffness, geometry, and aerodynamic and hydrodynamic coefficients) on the linearized system using OpenFAST.

17 WIND ENERGY↗
DOE OSTI2026

Investigating the Adsorption–Desorption Kinetics of a Molecular Water Oxidation Catalyst at an Electrode Interface

Probing the dynamics of molecular catalysts at electrode–electrolyte interfaces is essential for understanding catalytic mechanisms. Structure-specific spectroscopic methods are particularly powerful for examining electrocatalytic interfaces but are mostly used under steady-state conditions. Herein, we combined surface-enhanced infrared absorption spectroscopy (SEIRAS) with phase-sensitive detection (PSD) to investigate the dynamics of a molecular Ir-based water oxidation catalyst at the Au–electrolyte interface. We found that the amplitude of the absorbance of the catalyst is anticorrelated to that of interfacial water. This anticorrelation can be understood by the adsorption of the electrooxidized catalyst on the electrode and concurrent displacement of interfacial water. The infrared signals from the interface exhibit an increasing phase lag with respect to the electrode potential with an increasing scan rate of the potential. Kinetic modeling suggests that the potential-dependent adsorption–desorption kinetics of the molecular catalyst on the electrode gives rise to this phase lag. Furthermore, this study shows that PSD-SEIRAS is a powerful tool for investigating the interfacial dynamics of electrocatalytic systems.

Catalysts↗
DOE OSTI2026

Online task-space motion control for positioner-coordinated multi-robot manufacturing systems

Incorporating multiple robotic manipulators into large-scale manufacturing systems enhances production efficiency and expands manufacturing capabilities beyond those of single-robot systems. Workpiece positioners in robotic manufacturing have demonstrated significant benefits for process optimization, but coordination strategies for multi-robot systems with shared positioners have received limited attention. This work presents a task-space coordinated trajectory-tracking control framework for multi-robot manufacturing systems, in which robots coordinate their motions within a shared, dynamic workpiece positioning frame. A workpiece positioner actively adjusts the pose of the manufactured component to enable greater operational concurrency and improve overall production efficiency. The proposed motion-coordination scheme employs a distributed and scalable architecture, supporting coordination across heterogeneous multi-robot systems. Two optimization methodologies are introduced to manage kinematic redundancies and maintain continuous, near-optimal operation throughout the manufacturing process. The first strategy exploits a task-space dimensionality reduction to achieve locally optimal configurations by leveraging symmetry-axis rotations of the tool. The second strategy utilizes the workpiece positioner to drive the coordinated robots toward stable and kinematically favorable configurations. For both optimization strategies, multiple objectives are defined to improve key performance metrics, including manipulability, configuration consistency, proximity to mechanical limits, and motion efficiency. Addressing a key limitation of existing coordination approaches, the framework is designed around online setpoint modification, allowing coordinated robots to respond effectively to in-situ process feedback. The proposed control framework is validated using the Robot Operating System (ROS) middleware on a combination of physical and simulated multi-robot system hardware.

Arbogast, Alex [ORNL] (ORCID:0000000154740723)↗
DOE OSTI2025

Building Datasets and Training Methods for ML Based Magnet Quench Detection

Detecting quenches in superconducting (SC) magnets during training is a challenging process that involves capturing physical events that occur at different frequencies and appear as various signal features. These events may be correlated across instrumentation type, thermal cycle, and ramp. These events together build a more complete picture of continuous processes occurring in the magnet, and may allow us to flag potential precursors for quench detection. We present our work on building an automatic machine learning (ML) based quench detection system. We build upon our existing work on unsupervised auto-encoders for acoustic sensors and quench antenna (QA) by first establishing a supervised ML training pipeline. We show the results of an event tagging, analysis, and simulation framework on our QA and acoustic data which are used concurrently to build a training dataset for a supervised implementation. We then show how this supervised training can be used as a prior in a semi-supervised framework and compare this to the unsupervised neural network auto-encoder performance.This allows us to have a more concrete understanding of the performance of our algorithms relative to physical events occurring in the magnet, and also provides a baseline software tool to generically evaluate our quench prediction autoencoders under completely unsupervised, supervised, and semi-supervised training conditions.

Khan, Maira [Fermilab]↗
DOE OSTI2026

Evaluation of Best Practices in Mitigating Startup Costs on Leadership-Class Supercomputers

Supercomputers at Department of Energy (DOE) National Laboratories face a widening range of workloads, from traditional modeling and simulation to Artificial Intelligence model training or complex multi-stage workflows, and beyond. At DOE Leadership Computing Facilities like the Oak Ridge Leadership Computing Facility (OLCF), these workloads demand concurrent access to large portions of the supercomputer’s resources. Launching a job across massive supercomputers is challenging from the start; the file system struggles with a large backlog of metadata requests as tens of thousands of processes read thousands of the same files, and the compute job cannot start until this is completed. There are multiple existing approaches to calm this metadata storm, ranging from vendor-developed tools like sbcast to National Laboratory-developed tools like Spindle and Copper. In this paper, we benchmark and discuss three common approaches to improving compute job launch latencies on Frontier: Slurm’s sbcast tool, Spindle, and Copper. We evaluate these tools by measuring the launch latencies of four workloads: OSU Microbenchmark’s osu_init, Pynamic, Python import mpi4py, and Python import torch. We provide discussion of the results, highlighting data that meet expectations and that do not meet expectations.

Hagerty, Nick [ORNL] (ORCID:0000000330014414)↗
DOE OSTI2026

Compositional Reasoning for Hierarchical State Machines

Harel statecharts and its derivatives are popular graphical languages for specifying discrete control systems via hierarchical state machines. Separately, there has been a long line of work on specifying concurrent systems with process calculi which come equipped with an algebraic theory, the ability reason compositionally about various temporal properties, and strong type systems. While these two approaches to modeling systems are tantalizingly similar, the integrated reasoning principles that exist for process calculi have not been demonstrated in hierarchical state machines. A key issue is that operational theories for process calculi do not behave like control systems, and thus, there is virtually no tool support for modeling control systems with such languages. For a control system designer, bringing the integrated, more scalable reasoning from the process calculi to state-machine languages would enable the specification of more complex systems and a more modular systems development process. Our insight is that we can recover many important results from the process calculi in hierarchical state machines with local scope. We employ a structural operational semantics, which is ubiquitous in process and 𝜆-calculi but uncommon in hierarchical statemachine formalizations, to enable inductive reasoning about behavior. Taking inspiration from the structure of process calculi metatheories, we define a calculus of refinement and equivalence that we prove sound with respect to local notion of (bi)simulation. Furthermore, we prove that the calculus preserves the behavioral properties of reactivity, observational determinism, traces, and linear temporal properties. Our results are mechanized in the Rocq proof assistant.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Fluorescence-coupled micropipette aspiration assay to examine calcium mobilization caused by red blood cell mechanosensing

Abstract Mechanical stimuli such as tension, compression, and shear stress play critical roles in the physiological functions of red blood cells (RBCs) and their homeostasis, ATP release, and rheological properties. Intracellular calcium (Ca 2+ ) mobilization reflects RBC mechanosensing as they transverse the complex vasculature. Emerging studies have demonstrated the presence of mechanosensitive Ca 2+ permeable ion channels and their function has been implicated in the regulation of RBC volume and deformability. However, how these mechanoreceptors trigger Ca 2+ influx and subsequent cellular responses are still unclear. Here, we introduce a fluorescence-coupled micropipette aspiration assay to examine RBC mechanosensing at the single-cell level. To achieve a wide range of cell aspirations, we implemented and compared two negative pressure adjusting apparatuses: a homemade water manometer (− 2.94 to 0 mmH 2 O) and a pneumatic high-speed pressure clamp (− 25 to 0 mmHg). To visualize Ca 2+ influx, RBCs were pre-loaded with an intensiometric probe Cal-520 AM, then imaged under a confocal microscope with concurrent bright-field and fluorescent imaging at acquisition rates of 10 frames per second. Remarkably, we observed the related changes in intracellular Ca 2+ levels immediately after aspirating individual RBCs in a pressure-dependent manner. The RBC aspirated by the water manometer only displayed 1.1-fold increase in fluorescence intensity, whereas the RBC aspirated by the pneumatic clamp showed up to threefold increase. These results demonstrated the water manometer as a gentle tool for cell manipulation with minimal pre-activation, while the high-speed pneumatic clamp as a much stronger pressure actuator to examine cell mechanosensing directly. Together, this multimodal platform enables us to precisely control aspiration and membrane tension, and subsequently correlate this with intracellular calcium concentration dynamics in a robust and reproducible manner.

Wang, Haoqing↗
DOE OSTI2021

Unpacking the drivers of diurnal dynamics of sun-induced chlorophyll fluorescence (SIF): Canopy structure, plant physiology, instrument configuration and retrieval methods

Sun-induced chlorophyll fluorescence (SIF) from spaceborne sensors is a promising tool for global carbon cycle monitoring, but its application is constrained by insufficient understanding of the drivers underlying diurnal SIF dynamics. SIF measurements from ground-based towers can reveal diurnal SIF dynamics across biomes and environmental conditions; however, meaningful interpretation of diurnal variations requires disentangling impacts from canopy structure, plant physiology, instrument configuration and retrieval methods, which often interact with and confound each other. This study aims to unpack these drivers using 1) concurrent ground and airborne canopy-scale and leaf-scale measurements at a corn field, 2) a mechanistic SIF model that explicitly considers the dynamics of photochemistry (via the fraction of open photosystem II reaction centers, qL) and photoprotection (via nonphotochemical quenching, NPQ) as well as their interactive dependence on the sub-canopy light environment, and 3) cross-comparison of SIF instrument configurations and retrieval methods. We found that crop row orientations and sun angles can introduce a distinctive midday dip in SIF in absence of stress, due to a midday drop of absorbed photosynthetically active radiation (APAR) when crop rows are north-south oriented. Canopy structure caused distinctive responses in both qL and NPQ at different positions within the vertical canopy that collectively influenced fluorescence quantum yield (Φ F ) at the leaf scale. Once integrated at the canopy scale, diurnal dynamics of both APAR and canopy escape probability (ε) are critical for accurately shaping diurnal SIF variations. While leaf-level qL and NPQ exhibited strong diurnal dynamics, their influence was attenuated at the canopy scale due to opposing effects on SIF at different canopy layers. Furthermore, different system configurations (i.e., bi-hemispherical vs. hemispherical-conical) and retrieval methods can bias the SIF magnitude and distort its diurnal shapes, therefore confounding the interpretation of inherent strength and dynamics of SIF emission. Our findings demonstrate the importance of crop row structures, interactive variations in canopy structure and plant physiology, instrument configuration, and retrieval method in shaping the measured dynamics of diurnal SIF. This study highlights the necessity to account for these factors to accurately interpret satellite SIF, and informs future synthesis work with different SIF instrumentation and retrieval methods across sites.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Model-based Hierarchical Reinforcement Learning for Improved Physical Security Design: A Prototype

Prior work in FY24 developed an adversarial AI agent aid in path analysis of physical protection systems. This agent, trained using a model-based reinforcement learning algorithm, was able to successfully learn the most vulnerable path in facilities. It was able to extend the current state of practice for physical protection design by exhibiting dynamic behavior based on current environmental conditions. Whereas PathTrace largely performs a static, graph-based analysis, the AI agent was able to make decisions based on relative position in the facility, current conditions (was the adversarial agnet discovered?), and proximity to secondary targets. The agent demonstrated some novel capabilities, but had limitations that need to be resolved before it can be used for production purposes. For example, the adversarial agent generalizes poorly and takes a relatively long time to train. Nonetheless, there is still considerable promise for developing the adversarial agent further in order to explore even richer, more dynamic behaviors (e.g., adversary motivations, environmental debris, and more). This work considers a complementary idea; development of a planning agent. The planning agent is envisioned as an auto-complete-like tool that can help accelerate security system design by human experts. The agent would respect existing barriers and sensors placed by a human expert while offering cost-effective suggestions (i.e., implicitly balancing effectiveness with cost) to improve the design. The goal is for this agent to be part of an expert’s toolbox, not to totally upend the current state-of-practice, or to displace human experts. The ultimate goal would be concurrent training of both the adversarial and planning agent together, to learn entirely through self-play. This would represent an entirely new way of performing system deign. We selected a hierarchical, model-based reinforcement learning algorithm to serve as the planning agent. This is an extension of concepts used in the prior FY24 adversarial agent work. There, we had a single agent acting an environment. Here, we have two different sub-agents (policies), working together, to form a complete agent. There is a manager policy, which can select abstract goals on slower time scales, and a worker, which performs primitive actions to reach goals selected by the manager. It is worth noting that this class of algorithm is challenging to work with. From our understanding, our work is one of the first successful uses of model-based reinforcement learning (MBRL) in nuclear energy1 , and likely the first hierarchical model-based reinforcement learning application in nuclear energy. Further, this work is one of the first known attempts to apply AI to perform a design tasks in nuclear energy. Consequently, there were significant implementation challenges and the bulk of the work was focused on successful implementation and algorithm design. The results presented here are very low technology readiness level as a consequence of the lack of related literature, but still represent a significant step forward in the pursuit of applied AI for design.

42 ENGINEERING↗
DOE OSTI2022

Mechanistic Insights into the Interplay between Ion Intercalation and Water Electrolysis in Aqueous Batteries

Improving electrolyte stability to suppress water electrolysis represents a basic principle for designing aqueous batteries. Herein, we investigate counterintuitive roles that water electrolysis plays in regulating intercalation chemistry. Using the Na x Fe[Fe(CN) 6 ]∥NaTi 2 (PO 4 ) 3 (x < 1) aqueous battery as a platform, we report that high-voltage overcharging can serve as an electrochemical activation approach to achieving concurrent Na-ion intercalation and an electrolytic oxygen evolution reaction. When the cell capacity is intrinsically limited by deficient cyclable Na ions, the electrolytic water oxidation on the cathode allows for extra Na-ion intercalation from the electrolyte to the NaTi 2 (PO 4 ) 3 anode, leading to a major increase in cyclable Na ions and specific capacity. Furthermore, the parasitic oxygen generation and potential transition-metal dissolution, as proved by our synchrotron and imaging tools, can be significantly mitigated with a simple reassembling approach, which enables stable electrochemical performance and sheds light on manipulating ion intercalation and water electrolysis for battery fast charging and recycling.

25 ENERGY STORAGE↗
DOE OSTI2021

Deforestation reshapes land-surface energy-flux partitioning

Land-use and land-cover change significantly modify local land-surface characteristics and water/energy exchanges, which can lead to atmospheric circulation and regional climate changes. In particular, deforestation accounts for a large portion of global land-use changes, which transforms forests into other land cover types, such as croplands and grazing lands. Many previous efforts have focused on observing and modeling land–atmosphere–water/energy fluxes to investigate land–atmosphere coupling induced by deforestation. However, interpreting land–atmosphere–water/energy-flux responses to deforestation is often complicated by the concurrent impacts from shifts in land-surface properties versus background atmospheric forcings. In this study, we used 29 paired FLUXNET sites, to improve understanding of how deforested land surfaces drive changes in surface-energy-flux partitioning. Each paired sites included an intact forested and non-forested site that had similar background climate. We employed transfer entropy, a method based on information theory, to diagnose directional controls between coupling variables, and identify nonlinear cause–effect relationships. Transfer entropy is a powerful tool to detective causal relationships in nonlinear and asynchronous systems. The paired eddy covariance flux measurements showed consistent and strong information flows from vegetation activity (gross primary productivity (GPP)) and physical climate (e.g. shortwave radiation, air temperature) to evaporative fraction (EF) over both non-forested and forested land surfaces. More importantly, the information transfers from radiation, precipitation, and GPP to EF were significantly reduced at non-forested sites, compared to forested sites. We then applied these observationally constrained metrics as benchmarks to evaluate the Energy Exascale Earth System Model (E3SM) land model (ELM). ELM predicted vegetation controls on EF relatively well, but underpredicted climate factors on EF, indicating model deficiencies in describing the relationships between atmospheric state and surface fluxes. Moreover, changes in controls on surface energy flux partitioning due to deforestation were not detected in the model. We highlight the need for benchmarking model simulated surface-energy fluxes and the corresponding causal relationships against those of observations, to improve our understanding of model predictability on how deforestation reshapes land surface energy fluxes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Software Bill of Materials (SBOM) Sharing Lifecycle Report

As Software Bill of Materials (SBOM) adoption efforts mature, SBOM sharing continues to occur, but no single solution or set of solutions have become ubiquitous. The purpose of this report is to enumerate and describe the different parties and phases of the SBOM sharing lifecycle and assist readers in choosing suitable SBOM sharing solutions based on the amount of time, resources, subject-matter expertise, effort, and access to tooling that is available to the reader to implement a phase of the SBOM sharing lifecycle. The SBOM sharing lifecycle consists of the Discovery, Access, and Transport of an SBOM and this report details these individual phases and how an SBOM goes from author to the consumer. This report also details how potential enrichment activities may be performed on an SBOM to create a new product before or after it has been shared. The concept of a sophistication classification for SBOM sharing solutions is concurrently introduced with a focus on the inclusion or lack of certain features and effort associated with their implementation. Examples of low, medium, and high-sophistication solutions are provided; however, these examples and associated categorizations should not be seen as a qualitative judgment meant to push the reader towards a particular adoption strategy since sharing solutions are chosen based on the unique needs of the user. This report does recommend the SBOM community consider how to make current and future sharing solutions interoperable with each other as well as more automated methods to facilitate sharing and broader SBOM adoption. This report also highlights an SBOM sharing survey results obtained from interviews with stakeholders to understand the current SBOM sharing landscape. The categorized results of the survey suggest that SBOMs are currently transported directly to the receiver through email or similar informal communication mechanisms or alternatively the SBOM resides on a repository available to consumers. In addition to these transport methods, this report captures industry efforts to create private sharing solutions and services that can store and transport enrichment data and may use higher sophistication features that are cloud-based or using distributed ledger technologies.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Watching the Watchers with Verified Formal-Assurance Tools (Abbreviated Final Report)

The “Watching the Watchers” project studied the problem of establishing assurance cases for tools that are used to assure other things. Specifically, we were interested in understanding the tools and techniques one could apply to software to build an assurance case to evaluate their applicability, difficulty, level of assurance provided, and scalability. To do so we chose a set of use cases of relevance to LLNL and our various DOE and non-DOE partners and developed demonstrators to perform this evaluation. Our key focal point was around additive manufacturing problems and assurance gaps that we identified in the additive manufacturing workflow from start to completion. We also explored other areas related to AI, data analysis, and concurrent programming. Follow-on research is planned to take our prototypes from this project and adapt and mature them to fit LLNL mission applications.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

eCounter: Inline Per-IP Network Monitoring at Millisecond Resolution via eBPF

Scientific data acquisition (SciDAQ) systems are shifting from archive-based workflows to streaming paradigms, where real-time, fine-grained network monitoring becomes essential. While P4-enabled devices offer per-packet in-band observability, they require specialized switches and routers. Host-side tools like Prometheus exporters lack sufficient temporal granularity. To bridge this gap, we present eCounter, a lightweight, hardware-agnostic, inline telemetry agent built on extended Berkeley Packet Filter (eBPF). eCounter captures per-interface ingress and egress traffic, categorized by IP address and protocol, at millisecond to sub-millisecond resolution. In a 100 Gbps environment, it continuously exports up to 3,257 time-series bins per second with only 4% CPU utilization at a 35¿KiB/s data rate. We evaluate eCounter across diverse NIC MTU settings, hook types, CPU architectures and operating systems, and observed negligible impact on concurrent high-throughput streaming applications. Complexity analysis confirms that it can be readily scaled to distributed SciDAQ deployments.

Mei, Xinxin [Computational Sciences and Technology↗