Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “TCP”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
DOE OSTI2015

MO-G-304-04: Generating Well-Dispersed Representations of the Pareto Front for Multi-Criteria Optimization in Radiation Treatment Planning

Purpose: To present a novel multi-criteria optimization (MCO) solution approach that generates well-dispersed representation of the Pareto front for radiation treatment planning. Methods: Different algorithms have been proposed and implemented in commercial planning software to generate MCO plans for external-beam radiation therapy. These algorithms consider convex optimization problems. We propose a grid-based algorithm to generate well-dispersed treatment plans over Pareto front. Our method is able to handle nonconvexity in the problem to deal with dose-volume objectives/constraints, biological objectives, such as equivalent uniform dose (EUD), tumor control probability (TCP), normal tissue complication probability (NTCP), etc. In addition, our algorithm is able to provide single MCO plan when clinicians are targeting narrow bounds of objectives for patients. In this situation, usually none of the generated plans were within the bounds and a solution is difficult to identify via manual navigation. We use the subproblem formulation utilized in the grid-based algorithm to obtain a plan within the specified bounds. The subproblem aims to generate a solution that maps into the rectangle defined by the bounds. If such a solution does not exist, it generates the solution closest to the rectangle. We tested our method with 10 locally advanced head and neck cancer cases. Results: 8 objectives were used including 3 different objectives for primary target volume, high-risk and low-risk target volumes, and 5 objectives for each of the organs-at-risk (OARs) (two parotids, spinal cord, brain stem and oral cavity). Given tight bounds, uniform dose was achieved for all targets while as much as 26% improvement was achieved in OAR sparing comparing to clinical plans without MCO and previously proposed MCO method. Conclusion: Our method is able to obtain well-dispersed treatment plans to attain better approximation for convex and nonconvex Pareto fronts. Single treatment plan can be achieved when given bounds on the objectives.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2015

Robust PET-guided intensity-modulated radiation therapy

Purpose: Functional image guided intensity-modulated radiation therapy has the potential to improve cancer treatment quality by basing treatment parameters such as heterogeneous dose distributions information derived from imaging. However, such heterogeneous dose distributions are subject to imaging uncertainty. In this paper, the authors develop a robust optimization model to design plans that are desensitized to imaging uncertainty. Methods: Starting from the pretreatment fluorodeoxyglucose-positron emission tomography scans, the authors use the raw voxel standard uptake values (SUVs) as input into a series of intermediate functions to transform the SUV into a desired dose. The calculated desired doses were used as an input into a robust optimization model to generate beamlet intensities. For each voxel, the authors assume that the true SUV cannot be observed but instead resides in an interval centered on the nominal (i.e., observed) SUV. Then the authors evaluated the nominal and robust solutions through a simulation study. The simulation considered the effect of the true SUV being different from the nominal SUV on the quality of the treatment plan. Treatment plans were compared on the metrics of objective function value and tumor control probability (TCP). Results: Computational results demonstrate the potential for improvements in tumor control probability and deviation from the desired dose distribution compared to a nonrobust model while maintaining acceptable tissue dose. Conclusions: Robust optimization can help design treatment plans that are more stable in the presence of image value uncertainties.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

Potential benefits of dosimetric VMAT tracking verified with 3D film measurements

Purpose: To evaluate three different plan adaptation strategies using 3D film-stack dose measurements of both focal boost and hypofractionated prostate VMAT treatments. The adaptation strategies (a couch shift, geometric tracking, and dosimetric tracking) were applied for three realistic intrafraction prostate motions. Methods: A focal boost (35 × 2.2 and 35 × 2.7 Gy) and a hypofractionated (5 × 7.25 Gy) prostate VMAT plan were created for a heterogeneous phantom that allows for internal prostate motion. For these plans geometric tracking and dosimetric tracking were evaluated by ionization chamber (IC) point dose measurements (zero-D) and measurements using a stack of EBT3 films (3D). The geometric tracking applied translations, rotations, and scaling of the MLC aperture in response to realistic prostate motions. The dosimetric tracking additionally corrected the monitor units to resolve variations due to difference in depth, tissue heterogeneity, and MLC-aperture. The tracking was based on the positions of four fiducial points only. The film measurements were compared to the gold standard (i.e., IC measurements) and the planned dose distribution. Additionally, the 3D measurements were converted to dose volume histograms, tumor control probability, and normal tissue complication probability parameters (DVH/TCP/NTCP) as a direct estimate of clinical relevance of the proposed tracking. Results: Compared to the planned dose distribution, measurements without prostate motion and tracking showed already a reduced homogeneity of the dose distribution. Adding prostate motion further blurs the DVHs for all treatment approaches. The clinical practice (no tracking) delivered the dose distribution inside the PTV but off target (CTV), resulting in boost dose errors up to 10%. The geometric and dosimetric tracking corrected the dose distribution’s position. Moreover, the dosimetric tracking could achieve the planned boost DVH, but not the DVH of the more homogeneously irradiated prostate. A drawback of both the geometric and dosimetric tracking was a reduced MLC blocking caused by the rotational component of the MLC aperture corrections. Because of the used CTV to PTV margins and the high doses in the considered fractionation schemes, the TCP differed less than 0.02 from the planned value for all targets and all correction methods. The rectal NTCP constraints, however, could not be realized using any of these methods. Conclusions: The geometric and dosimetric tracking use only a limited input, but they deposit the dose distribution with higher geometric accuracy than the clinical practice. The latter case has boost dose errors up to 10%. The increased accuracy has a modest impact [Δ(NT)CP < 0.02] because of the applied margins and the high dose levels used. To allow further margin reduction tracking methods are vital. The proposed methodology could further be improved by implementing a rotational correction using collimator rotations.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

SU-F-T-148: Are the Approximations in Analytic Semi-Empirical Dose Calculation Algorithms for Intensity Modulated Proton Therapy for Complex Heterogeneities of Head and Neck Clinically Significant?

Purpose: Evaluate the differences in dose distributions between the proton analytic semi-empirical dose calculation algorithm used in the clinic and Monte Carlo calculations for a sample of 50 head-and-neck (H&N) patients and estimate the potential clinical significance of the differences. Methods: A cohort of 50 H&N patients, treated at the University of Texas Cancer Center with Intensity Modulated Proton Therapy (IMPT), were selected for evaluation of clinical significance of approximations in computed dose distributions. H&N site was selected because of the highly inhomogeneous nature of the anatomy. The Fast Dose Calculator (FDC), a fast track-repeating accelerated Monte Carlo algorithm for proton therapy, was utilized for the calculation of dose distributions delivered during treatment plans. Because of its short processing time, FDC allows for the processing of large cohorts of patients. FDC has been validated versus GEANT4, a full Monte Carlo system and measurements in water and for inhomogeneous phantoms. A gamma-index analysis, DVHs, EUDs, and TCP and NTCPs computed using published models were utilized to evaluate the differences between the Treatment Plan System (TPS) and FDC. Results: The Monte Carlo results systematically predict lower dose delivered in the target. The observed differences can be as large as 8 Gy, and should have a clinical impact. Gamma analysis also showed significant differences between both approaches, especially for the target volumes. Conclusion: Monte Carlo calculations with fast algorithms is practical and should be considered for the clinic, at least as a treatment plan verification tool.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

SU-F-T-681: Does the Biophysical Modeling for Immunological Aspects in Radiotherapy Precisely Predict Tumor and Normal Tissue Responses?

Purpose: Recent advances in immunotherapy make possible to combine with radiotherapy. The aim of this study was to assess the TCP/NTCP model with immunological aspects including stochastic distribution as intercellular uncertainties. Methods: In the clinical treatment planning system (Eclipse ver.11.0, Varian medical systems, US), biological parameters such as α/β, D50, γ, n, m, TD50 including repair parameters (bi-exponential repair) can be set as any given values to calculate the TCP/NTCP. Using a prostate cancer patient data with VMAT commissioned as a 6-MV photon beam of Novalis-Tx (BrainLab, US) in clinical use, the fraction schedule were hypothesized as 70–78Gy/35–39fr, 72–81Gy/40–45fr, 52.5–66Gy/16–22fr, 35–40Gy/5fr of 5–7 fractions in a week. By use of stochastic biological model applying for Gaussian distribution, the effects of the TCP/NTCP variation of repair parameters of the immune system as well as the intercellular uncertainty of tumor and normal tissues have been evaluated. Results: As respect to the difference of the α/β, the changes of the TCP/NTCP were increased in hypo-fraction regimens. The difference between the values of n and m affect the variation of the NTCP with the fraction schedules, independently. The elongation of repair half-time (long) increased the TCP/NTCP twice or much higher in the case of hypo-fraction scheme. For tumor, the repopulation parameters such as Tpot and Tstart, which is immunologically working to the tumor, improved TCP. Conclusion: Compared to default fixed value, which has affected by the probability of cell death and cure, hypo-fractionation schemes seemed to have advantages for the variations of the values of m. The possibility of an increase of the α/β or TD50 and repair parameters in tumor and normal tissue by immunological aspects were highly expected. For more precise prediction, treatment planning systems should be incorporated the complicated biological optimization in clinical practice combined with basic experiments data.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2016

SU-G-TeP3-11: Radiobiological-Cum-Dosimetric Quality Assurance of Complex Radiotherapy Plans

Purpose: Dosimetric gamma-analysis used for QA of complex radiotherapy plans tests the dosimetric equivalence of a delivered plan with the treatment planning system (TPS) optimized plan. It does not examine whether a dosimetric difference results in any radiobiological difference. This study introduces a method to test the radiobiological and dosimetric equivalence between a delivered and the TPS optimized plan. Methods: Six head and neck and seven lung cancer VMAT or IMRT plans optimized for patient treatment were calculated and delivered to an ArcCheck phantom. ArcCheck measured dose distributions were compared with the TPS calculated dose distributions using a 2-D gamma-analysis. Dose volume histograms (DVHs) for various patient structures were obtained by using measured data in 3DVH software and compared against the TPS calculated DVHs using 3-D gamma analysis. DVH data were used in the Poisson model to calculate tumor control probability (TCP) for the treatment targets and in the sigmoid dose response model to calculate normal tissue complication probability (NTCP) for the normal structures. Results: Two-D and three-D gamma passing rates among six H&N patient plans differed by 0 to 2.7% and among seven lung plans by 0.1 to 4.5%. Average ± SD TCPs based on measurement and TPS were 0.665±0.018 and 0.674±0.044 for H&N, and 0.791±0.027 and 0.733±0.031 for lung plans, respectively. Differences in NTCPs were usually negligible. The differences in dosimetric results, TCPs and NTCPs were insignificant. Conclusion: The 2-D and 3-D gamma-analysis based agreement between measured and planned dose distributions may indicate their dosimetric equivalence. Small and insignificant differences in TCPs and NTCPs based on measured and planned dose distributions indicate the radiobiological equivalence between the measured and optimized plans. However, patient plans showing larger differences between 2-D and 3-D gamma-analysis can help us make a more definite conclusion through our ongoing research with a larger number of patients.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Cation and Anion Channelrhodopsins: Sequence Motifs and Taxonomic Distribution

Cation and anion channelrhodopsins (CCRs and ACRs, respectively) primarily from two algal species, Chlamydomonas reinhardtii and Guillardia theta, have become widely used as optogenetic tools to control cell membrane potential with light. We mined algal and other protist polynucleotide sequencing projects and metagenomic samples to identify 75 channelrhodopsin homologs from four channelrhodopsin families, including one revealed in dinoflagellates in this study. We carried out electrophysiological analysis of 33 natural channelrhodopsin variants from different phylogenetic lineages and 10 metagenomic homologs in search of sequence determinants of ion selectivity, photocurrent desensitization, and spectral tuning in channelrhodopsins. Our results show that association of a reduced number of glutamates near the conductance path with anion selectivity depends on a wider protein context, because prasinophyte homologs with a glutamate pattern identical to that in cryptophyte ACRs are cation selective. Desensitization is also broadly context dependent, as in one branch of stramenopile ACRs and their metagenomic homologs, its extent roughly correlates with phylogenetic relationship of their sequences. Regarding spectral tuning, we identified two prasinophyte CCRs with red-shifted spectra to 585 nm. They exhibit a third residue pattern in their retinal-binding pockets distinctly different from those of the only two types of red-shifted channelrhodopsins known (i.e., the CCR Chrimson and RubyACRs). In cryptophyte ACRs we identified three specific residue positions in the retinal-binding pocket that define the wavelength of their spectral maxima. Lastly, we found that dinoflagellate rhodopsins with a TCP motif in the third transmembrane helix and a metagenomic homolog exhibit channel activity. Channelrhodopsins are widely used in neuroscience and cardiology as research tools and are considered prospective therapeutics, but their natural diversity and mechanisms remain poorly characterized. Genomic and metagenomic sequencing projects are producing an ever-increasing wealth of data, whereas biophysical characterization of the encoded proteins lags behind. In this study, we used manual and automated patch clamp recording of representative members of four channelrhodopsin families, including a family in dinoflagellates that we report in this study. Our results contribute to a better understanding of molecular determinants of ionic selectivity, photocurrent desensitization, and spectral tuning in channelrhodopsins.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2010

Efficient pattern matching on GPUs for intrusion detection systems

Pattern matching is at the core of many security applications, like Network Intrusion Detection Systems (NIDS), spam filters and virus scanner. The always growing traffic on networks requires the ability to recognize potentially malicious signatures effectively, fastly and possibly in real time, without afftecting the performance and the latencies of the connections. Unfortunately, pattern matching is a computationally intensive procedure which poses significant challenges on current software and hardware implementations. Graphic Processing Units (GPU) have become an interesting target for such high-througput applications, but the algorithms and the data structures need to be redesigned to be parallelized and adapted to the underlining hardware, coping with the limitations imposed by these architectures. In this paper we present an efficient implementation of the Aho-Corasick pattern matching algorithm on GPU, showing how we progressively redesigned the algorithm and the data structures to fit on the architecture and comparing it with equivalent implementations on the CPU and with previous work. We show that with realistic TCP-IP workloads and signatures, our implementation obtains a speedup of 6.5 with respect to CPU implementations and of two times when compared to previous GPU solutions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Shape-shifting Elephants: Multi-modal Transport for Integrated Research Infrastructure

Data Acquisition (DAQ) workloads form an important class of scientific network traffic that by its nature (1) flows across different research infrastructure, including remote instruments and supercomputer clusters, (2) has ever-increasing throughput demands, and (3) has ever-increasing integration demands---for example, observations at one instrument could trigger a reconfiguration of another instrument. Today's DAQ transfers rely on UDP and (heavily tuned) TCP, but this is driven by convenience rather than suitability. The mismatch between Internet transport protocols and scientific workloads becomes more stark with the steady increase in link capacities, data generation, and integration across research infrastructure.This position paper argues the importance of developing specialized transport protocols for DAQ workloads. It proposes a new transport feature for this kind of elephant flow: multi-modality involves the network actively configuring the transport protocol to change how DAQ flows are processed across different underlying networks that connect scientific research infrastructure. Multi-modality is a layering violation that is proposed as a pragmatic technique for DAQ transport protocol design. It takes advantage of programmable network hardware that is increasingly being deployed in scientific research infrastructure. The paper presents an initial evaluation through a pilot study that includes a Tofino2 switch and Alveo FPGA cards, and using data from a particle detector.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2014

HC-NIDS: signatures and simulations for detecting cyber-attacks aiming to cause damage against cyber-physical energy systems

Physical device safety is typically implemented locally using embedded controllers, while operations safety is primarily performed in control centers. Safe operations can be enhanced by correct design of device-level control algorithms, and protocols, procedures and operator training at the control-room level, but all can fail. Moreover, these elements exchange data and issue commands via vulnerable communication layers. In order to secure these gaps and enhance operational safety, we believe monitoring of command sequences must be combined with an awareness of physical device limitations and automata models that capture safety mechanisms. One way of doing this is by leveraging specification-based intrusion detection to monitor for physical constraint violations. The method can also verify that physical infrastructure state is consistent with monitoring information and control commands exchanged between field devices and control centers. This additional security layer enhances protection from both outsider attacks and insider mistakes. We implemented specification-based SCADA command analyzers using physical constraint algorithms directly in the Bro framework and Broccoli APIs for three separate scenarios: a water heater, an automated distribution system, and an over-current protection scheme. To accomplish this, we added low-level analyzers capable of examining control system-specific protocol packets for both Modbus TCP and DNP3, and also higher-level analyzers able to interpret device command and data streams within the context of each device's physical capabilities and present operational state. Thus the software that we are making available includes the Bro/Broccoli scripts for these three scenarios, as well as simulators, written in C, of those scenarios that generate sample traffic that is monitored by the Bro/Broccoli scripts. In addition, we have also implemented systems to directly pull cyber-physical information from the OSIsoft PI historian system. We have included the Python scripts used to perform that monitoring.

Source record↗
DOE OSTI2011

Bulk Data Mover

Bulk Data Mover (BDM) is a high-level data transfer management tool. BDM handles the issue of large variance in file sizes and a big portion of small files by managing the file transfers with optimized transfer queue and concurrency management algorithms. For example, climate simulation data sets are characterized by large volume of files with extreme variance in file sizes. The BDN achieves high performance using a variety of techniques, including multi-threaded concurrent transfer connections, data channel caching, load balancing over multiple transfer servers, and storage i/o pre-fetching. Logging information from the BDM is collected and analyzed to study the effectiveness of the transfer management algorithms. The BDM can accept a request composed of multiple files or an entire directory. The request also contains the target site and directory where the replicated files will reside. If a directory is provided at the source, then the BDM will replicate the structure of the source directory at the target site. The BDM is capable of transferring multiple files concurrently as well as using parallel TCP streams. The optimal level of concurrency or parallel streams depends on the bandwidth capacity of the storage systems at both ends of the transfer as well as achievable bandwidth of the wide-area network. Hardware req.-PC, MAC, Multi-platform & Workstation; Software req.: Compile/version-Java 1.50_x or above; Type of files: source code, executable modules, installation instructions other, user guide; URL: http://sdm.lbl.gov/bdm/

Natarajan, Vijaya↗
DOE OSTI2017

GEECS (Generalized Equipment and Experiment Control System)

GEECS (Generalized Equipment and Experiment Control System) monitors and controls equipment distributed across a network, performs experiments by scanning input variables, and collects and stores various types of data synchronously from devices. Examples of devices include cameras, motors and pressure gauges. GEEKS is based upon LabView graphical object oriented programming (GOOP), allowing for a modular and scalable framework. Data is published for subscription of an arbitrary number of variables over TCP. A secondary framework allows easy development of graphical user interfaces for a combined control of any available devices on the control system without the need of programming knowledge. This allows for rapid integration of GEECS into a wide variety of systems. A database interface provides for devise and process configuration while allowing the user to save large quantities of data to local or network drives.

Gonsalves, Anthony↗
DOE OSTI2024

RMEM-REMOTE MEMORY

RMEM - a prototyping platform to explore the usage of RMA-based strategies in GPU-to-GPU communication. The implementation relies on libfabric (BSD-2 or GNUv2) to explore different synchronization approach and their associated performance. It is compatible with different network technologies such as InfiniBand, SlingShot-11, and TCP. It provides to the user host-to-host and device-to-device communication. The latter can be initiated either from the host, or from the device.

Gillis, Thomas↗
DOE OSTI2024

M-node Polarization Control (MPC) v1.0

The M-node Polarization Control program interfaces with electronic polarization controllers and polarimeters to adjust and compensate for the polarization drift of light within optical fiber. The code implements a gradient ascent control loop to calibrate to a desired state of polarization. A key advantage of this program is that it provides a TCP socket interface that allows external clients to drive the calibration routines.

Kissel, Ezra↗
DOE OSTI2022

areaDetector/ADTimePix3

ADTimePix3 is an open‑source EPICS areaDetector driver for TimePix3 pixel detectors from Advanced Scientific Instruments (ASI). It provides a complete control and data‑acquisition interface between EPICS and the Serval server, supporting both real detectors (single‑chip and 2×2 quad configurations) and the TimePix3 emulator. The driver configures measurements via an HTTP/JSON REST API and acquires data through high‑rate TCP streams for raw events, images, and histograms. It offers real‑time preview and accumulated images, Time‑of‑Flight histogram processing, pixel masking (including Binary Pixel Configuration files and hot‑pixel tools), extensive health and status monitoring, and integration with standard areaDetector plugins for file saving and downstream analysis. ADTimePix3 is designed for Linux 64‑bit systems (tested on Ubuntu and RHEL) and is distributed under an MIT license with additional institutional disclaimers, enabling reuse and extension in photon science beamlines and other TimePix3‑based experimental facilities.

Gofron, Kaz↗
DOE OSTI2024

Definition of the IEA Wind 22-Megawatt Offshore Reference Wind Turbine

This technical report describes the design of a new 22 Megawatt reference wind turbine (RWT). The turbine model was designed collaboratively by two teams at the Denmark Technical University and at the National Renewable Energy Laboratory within the International Energy Agency (IEA) Wind Technology Commercialization Programme (TCP) Task 55 on Reference Wind Turbines and Farms. RWTs serve an important purpose in the wind energy community, since they provide openly available data for models representative of current wind turbine technology, which can be used by practitioners for a variety of modeling purposes, ranging from aerodynamic, structural, and aeroelastic turbine modeling to wind farm flow modeling, across a range of fidelities. The IEA 22 RWT aims to model machines with projected installation in the 2025-2030 time frame. The turbine has a rotor diameter of 284 meters and a hub height of 170 meters. It is a class 1-B machine with a rotor specific power nearing 350 W m -2 and it is mounted on either a fixed-bottom offshore foundation or a semi-submersible floating platform.

17 WIND ENERGY↗
DOE OSTI2024

Portable, heterogeneous ensemble workflows at scale using libEnsemble

libEnsemble is a Python-based toolkit for running dynamic ensembles, developed as part of the DOE Exascale Computing Project. The toolkit utilizes a unique generator–simulator–allocator paradigm, where generators produce input for simulators, simulators evaluate those inputs, and allocators decide whether and when a simulator or generator should be called. The generator steers the ensemble based on simulation results. Generators may, for example, apply methods for numerical optimization, machine learning, or statistical calibration. libEnsemble communicates between a manager and workers. Flexibility is provided through multiple manager–worker communication substrates each of which has different benefits. These include Python’s multiprocessing, mpi4py, and TCP. Multisite ensembles are supported using Balsam or Globus Compute. We overview the unique characteristics of libEnsemble as well as current and potential interoperability with other packages in the workflow ecosystem. We highlight libEnsemble’s dynamic resource features: libEnsemble can detect system resources, such as available nodes, cores, and GPUs, and assign these in a portable way. These features allow users to specify the number of processors and GPUs required for each simulation; and resources will be automatically assigned on a wide range of systems, including Frontier, Aurora, and Perlmutter. Such ensembles can include multiple simulation types, some using GPUs and others using only CPUs, sharing nodes for maximum efficiency. We also describe the benefits of libEnsemble’s generator–simulator coupling, which easily exposes to the user the ability to cancel, and portably kill, running simulations based on models that are updated with intermediate simulation output. We demonstrate libEnsemble’s capabilities, scalability, and scientific impact via a Gaussian process surrogate training problem for the longitudinal density profile at the exit of a plasma accelerator stage. In conclusion, the study uses gpCAM for the surrogate model and employs either Wake-T or WarpX simulations, highlighting efficient use of resources that can easily extend to exascale.

Dynamic ensembles↗
DOE OSTI2025

If We Build Them, They Will Run: Automated HPC Apps Deployment and Profiling with eBPF in Cloud

The high performance computing (HPC) community is in a period of transition. The rise of AI/ML coupled with a changing landscape of resources deems portability a new metric of performance, and methods to move between on-premises and cloud environments and assess compatibility are paramount. Here we design and test a strategy for bridging the gap between traditional HPC and Kubernetes environments – first containerizing applications, providing automated orchestration to run studies, and packaging the setup with automated means to assess performance using low overhead eXtended Berkeley Packet Filter (eBPF) programs. We first assess different designs for eBPF collection, demonstrating a tradeoff between number of programs deployed on a node and overhead added. We develop 5 low overhead eBPF programs that combine with streaming ML models to assess CPU, futex, TCP, shared memory, and file access across four different builds of an HPC application for CPU and GPU. We use eBPF data to generate insights into the possible underlying etiology of scaling issues. We then assess compatibility of a well-known benchmark, HPCG, across matrices of micro-architectures and optimization levels (217 containers across 24 instance types and over 7500 runs). We provide to the community 30 applications to deploy in our automated setup and perform a scaling study from 4 to a maximum of 256 nodes for both CPU and GPU applications. Finally, we use our gained knowledge about performance to generate compatibility artifacts that are used by a newly developed Kubernetes controller to intelligently select instance type based on optimizing a figure of merit. Along with insights to scaling in this environment with a collection of applications and templates to work from, we provide an overall strategy for approaching HPC application deployment and image selection based on compatibility in cloud.

Computer science↗