Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Bandwidth”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48

The Scalable Checkpoint/Restart Library

The Scalable Checkpoint/Restart (SCR) library provides an interface that codes may use to worite our and read in application-level checkpoints in a scalable fashion. In the current implementation, checkpoint files are cached in local storage (hard disk or RAM disk) on the compute nodes. This technique provides scalable aggregate bandwidth and uses storage resources that are fully dedicated to the job. This approach addresses the two common drawbacks of checkpointing a large-scale application to a shared parallel file system, namely, limited bandwidth and file system contention. In fact, on current platforms, SCR scales linearly with the number of compute nodes. It has been benchmarked as high as 720GB/s on 1094 nodes of Atlas, which is nearly two orders of magnitude faster thanthe parallel file system.

ECP↗

Livermore Big Artificial Neural Network Toolkit

LBANN is a toolkit that is designed to train artificial neural networks efficiently on high performance computing architectures. It is optimized to take advantages of key High Performance Computing features to accelerate neural network training. Specifically it is optimized for low-latency, high bandwidth interconnects, node-local NVRAM, node-local GPU accelerators, and high bandwidth parallel file systems. It is built on top of the open source Elemental distributed-memory dense and spars-direct linear algebra and optimization library that is released under the BSD license. The algorithms contained within LBANN are drawn from the academic literature and implemented to work within a distributed-memory framework.

Essen, BrianVan↗

RMA-MT Benchmarks

The RMA-MT benchmarks are a suite of performance tests for multi-threaded Message Passing Interface (MPI) Remote Memory Access (RMA) implementations. The suite includes tests for bandwidth and latency with any number of threads. This suite was originally developed and release by Sandia National Laboratory. LANL modifications to the suite include a complete re-write of much of the source code, bi-directional bandwidth, and message rate tests.

Hjelm, Nathan↗

Bulk Data Mover

Bulk Data Mover (BDM) is a high-level data transfer management tool. BDM handles the issue of large variance in file sizes and a big portion of small files by managing the file transfers with optimized transfer queue and concurrency management algorithms. For example, climate simulation data sets are characterized by large volume of files with extreme variance in file sizes. The BDN achieves high performance using a variety of techniques, including multi-threaded concurrent transfer connections, data channel caching, load balancing over multiple transfer servers, and storage i/o pre-fetching. Logging information from the BDM is collected and analyzed to study the effectiveness of the transfer management algorithms. The BDM can accept a request composed of multiple files or an entire directory. The request also contains the target site and directory where the replicated files will reside. If a directory is provided at the source, then the BDM will replicate the structure of the source directory at the target site. The BDM is capable of transferring multiple files concurrently as well as using parallel TCP streams. The optimal level of concurrency or parallel streams depends on the bandwidth capacity of the storage systems at both ends of the transfer as well as achievable bandwidth of the wide-area network. Hardware req.-PC, MAC, Multi-platform & Workstation; Software req.: Compile/version-Java 1.50_x or above; Type of files: source code, executable modules, installation instructions other, user guide; URL: http://sdm.lbl.gov/bdm/

Natarajan, Vijaya↗

MLEC-Sim: A Simulator for Evaluating Multi-Level Erasure Coding

We present MLEC-Sim, a sophisticated simulator for Multi-Level Erasure Coding (MLEC), developed in approximately 13 KLOC. The simulator is engineered to analyze the impact of various system configurations and erasure coding policies on system durability and network overhead. It supports a comprehensive range of parameters including disk capacity, disk I/O bandwidth, failure rates, network bandwidth, and system scale, accommodating various erasure coding approaches such as Single-Level Erasure Coding (SLEC), Multi-Level Erasure Coding (MLEC), and Local Reconstruction Codes (LRC). MLEC-Sim provides support for multiple chunk placement policies, including clustered parity and declustered parity, and encompasses a variety of repair methods like Repair-ALL, Repair-FCO, Repair-HYB, and Repair-MIN. It is capable of simulating disk failures through a variety of means, including distribution-based or trace-based mechanisms, and can handle complex multi-level (de)clustered placements and repair processes. A key feature of MLEC-Sim is its adoption of the splitting simulation method for evaluating system durabilities at extremely high levels, which are challenging to assess with traditional simulation approaches. This feature allows for a detailed evaluation of system resilience under a range of conditions, aiding in the selection of appropriate erasure coding solutions for enhancing system durability. MLEC-Sim contributes to the field of data storage and reliability by providing a tool for the detailed evaluation of the durability and efficiency of erasure coding configurations, intended for use by researchers and practitioners in the design and optimization of storage systems.

Wang, Meng↗

Detector Interface for Streaming, Control, and Open-source integration (DISCO) v1.0.0

This suite consists of a multi-package ecosystem featuring detector emulators, EPICS areaDetector drivers, and remote server frameworks designed for the Advanced Light Source (ALS). Engineered for high-bandwidth devices—including VFCCD, Timepix3, Timepix4, and related pixel detectors—the software simulates hardware, wraps vendor SDKs into remote-callable servers, and integrates with open-source control systems. Key Capabilities: Distributed SDK Architecture: Server packages wrap hardware-specific SDKs, allowing areaDetector drivers to execute remote framework calls. This isolates proprietary libraries from the EPICS IOC, enhancing stability and enabling distributed computing across beamline networks. Device Support: Custom drivers for VFCCD, the Timepix family, and similar sensors optimize the data path from hardware control to high-speed transport. Full-Stack Emulation: Sophisticated emulator packages allow end-to-end pipeline testing and software development without requiring physical hardware or beam time. Integrated Workflows: Supports high-bandwidth streaming for real-time analysis and robust, metadata-rich file-based workflows (e.g., HDF5/NeXus). By standardizing interfaces across heterogeneous hardware, this suite reduces technical debt. It provides the ALS with a scalable, open-source solution to manage massive data rates within a unified control environment.

Mahl, Johannes [Lawrence Berkeley National Laborat↗

A Global Climate Model Agent for High Spatial and Temporal Resolution Data

Fine cell granularity in modern climate models can produce terabytes of data in each snapshot, causing significant I/O overhead. To address this issue, a method of reducing the I/O latency of high-resolution climate models by identifying and selectively outputting regions of interest is presented. Working with a Global Cloud Resolving Model and running with up to 10240 processors on a Cray XE6, this method provides significant I/O bandwidth reduction depending on the frequency of writes and size of the region of interest. The implementation challenges of determining global parameters in a strictly core-localized model and properly formatting output files that only contain subsections of the global grid are addressed, as well as the overall bandwidth impact and benefits of the method. The gains in I/O throughput provided by this method allow dual output rates for high-resolution climate models: a low-frequency global snapshot as well as a high-frequency regional snapshot when events of particular interest occur.

global cloud resolving model↗

Collective input/output under memory constraints

Compared with current high-performance computing (HPC) systems, exascale systems are expected to have much less memory per node, which can significantly reduce necessary collective input/output (I/O) performance. In this study, we introduce a memory-conscious collective I/O strategy that takes into account memory capacity and bandwidth constraints. The new strategy restricts aggregation data traffic within disjointed subgroups, coordinates I/O accesses in intranode and internode layers, and determines I/O aggregators at run time considering memory consumption among processes. We have prototyped the design and evaluated it with commonly used benchmarks to verify its potential. The evaluation results demonstrate that this strategy holds promise in mitigating the memory pressure, alleviating the contention for memory bandwidth, and improving the I/O performance for projected extreme-scale systems. Given the importance of supporting increasingly data-intensive workloads and projected memory constraints on increasingly larger scale HPC systems, this new memory-conscious collective I/O can have a significant positive impact on scientific discovery productivity.

collective input/output↗

Epidemic failure detection and consensus for extreme parallelism

Future extreme-scale high-performance computing systems will be required to work under frequent component failures. The MPI Forum s User Level Failure Mitigation proposal has introduced an operation, MPI Comm shrink, to synchronize the alive processes on the list of failed processes, so that applications can continue to execute even in the presence of failures by adopting algorithm-based fault tolerance techniques. This MPI Comm shrink operation requires a failure detection and consensus algorithm. This paper presents three novel failure detection and consensus algorithms using Gossiping. The proposed algorithms were implemented and tested using the Extreme-scale Simulator. The results show that in all algorithms the number of Gossip cycles to achieve global consensus scales logarithmically with system size. The second algorithm also shows better scalability in terms of memory and network bandwidth usage and a perfect synchronization in achieving global consensus. The third approach is a three-phase distributed failure detection and consensus algorithm and provides consistency guarantees even in very large and extreme-scale systems while at the same time being memory and bandwidth efficient.

97 MATHEMATICS AND COMPUTING↗

Demystifying asynchronous I/O Interference in HPC applications

With increasing complexity of HPC workflows, data management services need to perform expensive I/O operations asynchronously in the background, aiming to overlap the I/O with the application runtime. However, this may cause interference due to competition for resources: CPU, memory/network bandwidth. The advent of multi-core architectures has exacerbated this problem, as many I/O operations are issued concurrently, thereby competing not only with the application but also among themselves. Furthermore, the interference patterns can dynamically change as a response to variations in application behavior and I/O subsystems (e.g. multiple users sharing a parallel file system). Without a thorough understanding, I/O operations may perform suboptimally, potentially even worse than in the blocking case. To fill this gap, here we investigate the causes and consequences of interference due to asynchronous I/O on HPC systems. Specifically, we focus on multi-core CPUs and memory bandwidth, isolating the interference due to each resource. Then, we perform an in-depth study to explain the interplay and contention in a variety of resource sharing scenarios such as varying priority and number of background I/O threads and different I/O strategies: sendfile, read/write, mmap/write underlining trade-offs. The insights from this study are important both to enable guided optimizations of existing background I/O, as well as to open new opportunities to design advanced asynchronous I/O strategies.

97 MATHEMATICS AND COMPUTING↗

Three-beam rotational coherent anti-Stokes Raman spectroscopy thermometry in scattering environments

Three-beam rotational coherent anti-Stokes Raman scattering (CARS) measurements performed in highly scattering environments are susceptible to contamination by two-beam CARS signals generated by the pump–probe and Stokes–probe interactions at the measurement volume. If this occurs, differences in the Raman excitation bandwidth between the two-beam and three-beam CARS signals can add significant errors to the spectral analysis. This interference to the best of our knowledge has not been acknowledged in previous three-beam rotational CARS experiments, but may introduce measurement errors up to 25% depending on the temperature, amount of scattering, and differences between the two-beam and three-beam Raman excitation bandwidths. Here, the presence of two-beam CARS signal contamination was experimentally verified using a femtosecond–picosecond rotational CARS instrument in two scattering environments: (1) a fireball generated by a laboratory-scale explosion that contained particulate matter, metal fragments, and soot, and (2) a flow of air and small liquid droplets. A polarization scheme is presented to overcome this interference. By rotating the pump and Stokes polarizations +55° and –55° from the probe, respectively, the two-beam and three-beam CARS signals are orthogonally polarized and can be separated using a polarization analyzer. Using this polarization arrangement, the Raman-resonant three-beam CARS signal amplitude is reduced by a factor of 2.3 compared to the case where all polarizations are parallel. This method is successfully demonstrated in both scattering environments. A theoretical model is presented, and the temperature measurement error is studied for different experimental conditions. The criteria for when this interference may be present are discussed.

42 ENGINEERING↗

Excess noise reduction by optical technique in amplitude-sensitive heterodyne interferometer for small differential phase detection

An amplitude-sensitive technique associated with a heterodyne interferometer for detecting small differential phase is reported. The excess noise with the amplitude-sensitive technique is reduced by optical subtraction instead of electronic subtraction. The differential phase introduced by the orthogonally polarized laser beams is converted to the amplitudes of two heterodyne interferometric signals, which presents amplitude and phase quadrature simultaneously. Thus the excess noise power and quantum noise power are both differential phase dependent. The advantages of differential and additive operations by optical technique and the real time differential phase determination without phase lock in are demonstrated experimentally. The theoretical signal-to-noise ratio (SNR) and minimum detectable differential phase are derived, which takes quantum noise and excess noise into consideration. The experimental results demonstrated the resolutions of differential phase detection closes to 10{sup -6} rad/{radical}Hz (10{sup -13} m/{radical}Hz) level over 100 kHz bandwidth and at 10{sup -8} rad/{radical}Hz (10{sup -15} m/{radical}Hz) level over 125 MHz bandwidth, respectively, under 2.5 mW incident power.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Transparent conducting oxides: from all-dielectric plasmonics to a new paradigm in integrated photonics

During the past few years, the optics and photonics communities have renewed their attention toward transparent conducting oxides (TCOs), which for over two decades have been broadly employed for the fabrication of transparent electrodes in photovoltaic and communication technologies. This reinvigorated research curiosity is twofold: on the one hand, TCOs, with their metal-like properties, low optical absorption, and fabrication flexibility, represent an appealing alternative to noble metals for designing ultra-compact plasmonic devices. On the other hand, this class of hybrid compounds has been proved to possess exceptionally high optical nonlinearities when operating on a frequency window centered around their crossover point, the wavelength point at which the real part of the dielectric permittivity switches sign. Because TCOs are wide-bandgap materials with the Fermi level located in the conduction band, they are hybrid in nature, thus presenting both interband and intraband nonlinearities. This is the cause of a very rich nonlinear physics that is yet to be fully understood and explored. In addition to this, TCOs are epsilon-near-zero (ENZ) materials within a broad near-infrared spectral range, including the entire telecom bandwidth. In this operational window a myriad of novel electromagnetic phenomena have been demonstrated experimentally such as supercoupling, wavefront freezing, and photon doping. Furthermore, TCOs stand out among all other ENZ systems due to one fundamental characteristic, which is hardly attainable even by using structured materials. In fact, around their ENZ wavelength and for a quite generous operational range, these materials can be engineered to have an extremely small real index. This peculiarity leads to a slow-light effect that is ultimately responsible for a significant enhancement of the material nonlinear properties and is the cornerstone of the emerging field of near-zero-index photonics. In this regard, the recent history of nonlinear optics in conductive oxides is growing extremely fast due to a great number of experiments reporting unprecedentedly remarkable effects, including unitary index change, bandwidth-large frequency shift, efficient ultra-low-power frequency conversion, and many others. This review is meant to guide the reader through the exciting journey of TCOs, starting as an industrial material for transparent electrodes, then becoming a new alternative for low-loss plasmonics, and recently opening up new frontiers in integrated nonlinear optics. The present review is mainly focused on experimental observations.

42 ENGINEERING↗

An intra-node HPC network architecture with nanosecond-scale photonic switches

We propose a single-stage network architecture for intra-node connectivity that makes use of nanosecond-scale photonic switches. Although buffering at the switch points is of vital importance for complex multi-stage networks, this is not the case for smaller-scale single-stage networks where the end nodes are located only one hop apart. By limiting the buffering to the end points, the proposed architecture manages to minimize the required electro-optic and opto-electronic conversions, leading in this way to both low end-to-end latency and better energy efficiency. Combining these advantages with nanosecond-scale switching times can allow for high-throughput operation even for frequent switch reconfigurations. The performance of the proposed architecture is evaluated via discrete-event simulations for a wide range of synthetic-traffic cases. The simulation results show that high-throughput operation of ≥90% can be achieved even for small message sizes, i.e., 32 KB for all-to-all communication and 2 KB for uniform random traffic, at a data rate of 400 Gb/s and a switch reconfiguration time of ≤72 ns. Moreover, if 100-ns reconfiguration times are achievable as opposed to 150-ns, then for the all-to-all traffic case a 16% and 28% reduction in completion time can be achieved for message sizes of 8 KB and 1 KB, respectively. In a forthcoming era of optically interfaced processors and accelerators, nanosecond-scale photonic switches appear as a highly promising solution for keeping up with the intra-node bandwidth scaling due to their high-bandwidth, low-latency and fast-switching capabilities.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Performance trade-offs in reconfigurable networks for HPC

Designing efficient interconnects to support high-bandwidth and low-latency communication is critical toward realizing high performance computing (HPC) and data center (DC) systems in the exascale era. At extreme computing scales, providing the requisite bandwidth through overprovisioning becomes impractical. These challenges have motivated studies exploring reconfigurable network architectures that can adapt to traffic patterns at runtime using optical circuit switching. Despite the plethora of proposed architectures, surprisingly little is known about the relative performances and trade-offs among different reconfigurable network designs. We aim to bridge this gap by tackling two key issues in reconfigurable network design. First, we study how cost, power consumption, network performance, and scalability vary based on optical circuit switch (OCS) placement in the physical topology. Specifically, we consider two classes of reconfigurable architectures: one that places OCSs between top-of-rack (ToR) switches—ToR-reconfigurable networks (TRNs)—and one that places OCSs between pods of racks—pod-reconfigurable networks (PRNs). Second, we tackle the effects of reconfiguration frequency on network performance. Our results, based on network simulations driven by real HPC and DC workloads, show that while TRNs are optimized for low fan-out communication patterns, they are less suited for carrying high fan-out workloads. PRNs exhibit better overall trade-off, capable of performing comparably to a fully non-blocking fat tree for low fan-out workloads, and significantly outperform TRNs for high fan-out communication patterns.

Teh, Min Yee↗

Different measures of speckle and coherence at the output of a multimode optical fiber

Excitation of a multimode fiber with a focused spatially coherent light of finite bandwidth results in a partially coherent light at the output of the fiber. In this report, we observe the properties of speckle and classical coherence of such light with analytical theory, numerical modeling, and experimentally. Of particular interest is the relationship between measures of coherence and speckle and their dependence on input source bandwidth and fiber length. Speckle contrast is easy to measure experimentally and there exist at least two different methods to generate ensembles of random speckles. We demonstrate that speckle contrast evaluated over the ensemble of external diffusers is related to the number of effective modes—one of the characteristics of beam global coherence. The other speckle contrast measure evaluated over the ensemble of random bends and twists of the fiber is related to residual coherence, which is the pedestal on the average modulus of the complex degree of the coherence function on the output endface of the fiber.

47 OTHER INSTRUMENTATION↗

Silicon photonic chip for 16-channel wavelength division (de-)multiplexing in the O-band

We experimentally demonstrate a silicon photonic chip-scale 16-channel wavelength division multiplexer (WDM) operating in the O-band. The silicon photonic chip consists of a common-input bus waveguide integrated with a sequence of 16 spectral add-drop filters implemented by 4-port contra-directional Bragg couplers and resonant cladding modulated perturbations. The combination of these features reduces the spectral bandwidth of the filters and improves the crosstalk. An apodization of the cladding modulated perturbations between the bus and the add/drop waveguides is used to optimize the strength of the coupling coefficient in the propagation direction to reduce the intra-channel crosstalk on adjacent channels. The fabricated chip was validated experimentally with a measured intra-channel crosstalk of ∼−18.9 dB for a channel spacing of 2.6 nm. The multiplexer/demultiplexer chip was also experimentally tested with a 10 Gbps data waveform. The resulting eye-pattern indicates that this approach is suitable for datacenter WDM-based interconnects in the O-band with large aggregate bandwidths.

Davis, Jordan A. (ORCID:0000000343483295)↗

Broadband spectral combining of three pulse-shaped fiber amplifiers with 42fs compressed pulse duration

We demonstrate ultra-broadband spectral combining of ultrashort pulses from Yb-doped fiber amplifiers, with coherently spectrally synthesized pulse shaping, to achieve tens-of-fs pulses. This method can fully compensate for gain narrowing and high order dispersion over broad bandwidth. We produce 42fs pulses by spectrally synthesizing three chirped-pulse fiber amplifiers and two programmable pulse shapers across an 80nm overall bandwidth. To the best of our knowledge, this is the shortest pulse duration achieved from a spectrally combined fiber system at one-micron wavelength. This work provides a path toward high-energy, tens-of-fs fiber chirped-pulse amplification systems.

43 PARTICLE ACCELERATORS↗