Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “hardware efficiency”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Tandem Photovoltaics Core Program Final Technical Report

The Tandem Photovoltaics Core Program was a multi-year initiative aimed at advancing hybrid tandem solar cell technologies to enhance solar module efficiency beyond the limits of single junction devices. This project focused on the development, testing, and scaling of prototype photovoltaic devices, with the goal of achieving commercial relevance and driving industry adoption. The work was divided into three tasks: 1) Comparative Analysis of Tandem Technologies: This task focused on quantifying energy yield under real-world conditions and assessing economic viability of tandems relative to silicon-based modules. The project's modeling framework incorporated performance data, cost of materials, and manufacturing process impacts to optimize tandem designs 2) Tandem Integration and Prototyping: In this task, we developed innovative tandem designs by combining metal halide perovskite (MHP) top cells and silicon (Si) bottom cells. The project focuses on both mechanical integration and direct deposition techniques to enable compatibility with commercially relevant Si technologies, such as passivated contact or PERC cells. 3) Scale-up and Reliability: This task addressed the challenges of large-area fabrication by developing scalable deposition methods and robust interconnection schemes for tandems. The project looked at different accelerated testing such as thermal cycling, damp heat exposure, and potential induced degradation, to ensure long-term stability of devices in field conditions. Tandem solar cells can greatly increase module efficiency beyond conventional single junction (SJ) devices, which are approaching their theoretical limit. There are many ways to fabricate a tandem cell or module in terms of materials used, configuration, and terminal connection. This SETO core project focused critical factors in enabling tandems to enter the market, including hardware integration, technoeconomic analysis (TEA), and energy yield analysis. We focused on MHP/Si hybrid tandem solar cells and modules as a model system for their versatility in module design comparisons, providing valuable insights for other tandem options. While champion cells with areas <1cm2 are regularly demonstrated by groups around the world, it is significantly more challenging to translate these advances into modules, and fewer institutions and companies are working at the module level. This project addressed questions about module fabrication, testing, and reliability that are hard to answer without actually fabricating prototypes. We also performed analysis and road-mapping activities to understand the potential for a wider variety of tandems, including all-perovskite tandems fabricated in collaboration with the Perovskite PV core program. Detailed technical results from this project are described for each task in Section 7.

14 SOLAR ENERGY↗
DOE OSTI2023

Transient Efficiency, Flexibility, and Reliability Optimization of Coal-Fired Power Plants - Final Report

This program developed an advanced model-based monitoring and model-predictive control algorithms for a coal fired power plant (CFPP), and deployed these algorithms in a real-time platform to demonstrate performance benefits for transient flexibility and plant operation efficiency. More specifically, the objectives were successfully achieved through a combination of (i) developing a high-fidelity transient plant model in Apros, which was used as a high-fidelity plant simulation between $100-50\% TMCR$ where TMCR denotes the turbine maximum continuous rating, i.e., baseload, (ii) developing a very fast physics-based reduced-order model (ROM) of the plant, which ran more than $100\times$ faster than real-time, enabling its use as real-time embedded model for model-based estimation (MBE) and model predictive control (MPC) (iii) implementing a real-time MBE based on ROM using a robust unscented Kalman filter (UKF) to continuously tune the ROM to match the measurements from high-fidelity Apros plant model despite significant plant-model mismatch, and thus, obtain a Digital Twin of the plant (iv) designing and implementing a real-time MPC with dual objectives of transient plant load tracking with high ramp rates and minimizing coal consumption, i.e., improving plant efficiency in the baseload-partload operation range of $100-50\% TMCR$. Each key element above was developed and tested individually, and has been reported in corresponding Topical Reports. Finally, all the individual elements were integrated in an overall closed-loop system, that was successfully tested in desktop Simulink test harness simulations with ROM or high-fidelity model as the plant. Thereafter, the Simulink implementation was used to auto-generate C-code and deploy as real-time Docker microservice containers in Linux, and validate that they can run in real-time in the hardware-in-the loop (HIL) setup and produce the same results as in Simulink. The results of the integrated simulation tests in Simulink as well as the real-time HIL deployment are documented in this final report, showing good load tracking for load ramps at $3-4\%/min$ ramp rates, and achieving up to $5.5\%$ reduction in coal relative to baseline operation at $50\% TMCR$ load. The desktop and HIL simulations show successful performance of the overall model based estimation and control solution and achieve the key objectives of the program for flexible, efficient and reliable operation of subcritical coal fired power plants.

20 FOSSIL-FUELED POWER PLANTS↗
DOE OSTI2023

Transient Efficiency, Flexibility, and Reliability Optimization of Coal-Fired Power Plants - Final Program Review

This program developed an advanced model-based monitoring and model-predictive control algorithms for a coal fired power plant (CFPP), and deployed these algorithms in a real-time platform to demonstrate performance benefits for transient flexibility and plant operation efficiency. More specifically, the objectives were successfully achieved through a combination of (i) developing a high-fidelity transient plant model in Apros, which was used as a high-fidelity plant simulation between $100-50\% TMCR$ where TMCR denotes the turbine maximum continuous rating, i.e., baseload, (ii) developing a very fast physics-based reduced-order model (ROM) of the plant, which ran more than $100\times$ faster than real-time, enabling its use as real-time embedded model for model-based estimation (MBE) and model predictive control (MPC) (iii) implementing a real-time MBE based on ROM using a robust unscented Kalman filter (UKF) to continuously tune the ROM to match the measurements from high-fidelity Apros plant model despite significant plant-model mismatch, and thus, obtain a Digital Twin of the plant (iv) designing and implementing a real-time MPC with dual objectives of transient plant load tracking with high ramp rates and minimizing coal consumption, i.e., improving plant efficiency in the baseload-partload operation range of $100-50\% TMCR$. Each key element above was developed and tested individually, and has been reported in corresponding Topical Reports. Finally, all the individual elements were integrated in an overall closed-loop system, that was successfully tested in desktop Simulink test harness simulations with ROM or high-fidelity model as the plant. Thereafter, the Simulink implementation was used to auto-generate C-code and deploy as real-time Docker microservice containers in Linux, and validate that they can run in real-time in the hardware-in-the loop (HIL) setup and produce the same results as in Simulink. The results of the integrated simulation tests in Simulink as well as the real-time HIL deployment are documented in this final report, showing good load tracking for load ramps at $3-4\%/min$ ramp rates, and achieving up to $5.5\%$ reduction in coal relative to baseline operation at $50\% TMCR$ load. The desktop and HIL simulations show successful performance of the overall model based estimation and control solution and achieve the key objectives of the program for flexible, efficient and reliable operation of sub-critical coal fired power plants.

20 FOSSIL-FUELED POWER PLANTS↗
DOE OSTI2023

TomocuPy – efficient GPU-based tomographic reconstruction with asynchronous data processing

Fast 3D data analysis and steering of a tomographic experiment by changing environmental conditions or acquisition parameters require fast, close to real-time, 3D reconstruction of large data volumes. Here a performance-optimized TomocuPy package is presented as a GPU alternative to the commonly used central processing unit (CPU) based TomoPy package for tomographic reconstruction. TomocuPy utilizes modern hardware capabilities to organize a 3D asynchronous reconstruction involving parallel read/write operations with storage drives, CPU–GPU data transfers, and GPU computations. In the asynchronous reconstruction, all the operations are timely overlapped to almost fully hide all data management time. Since most cameras work with less than 16-bit digital output, the memory usage and processing speed are furthermore optimized by using 16-bit floating-point arithmetic. As a result, 3D reconstruction with TomocuPy became 20–30 times faster than its multi-threaded CPU equivalent. Full reconstruction (including read/write operations and methods initialization) of a 2048 3 tomographic volume takes less than 7 s on a single Nvidia Tesla A100 and PCIe 4.0 NVMe SSD, and scales almost linearly increasing the data size. To simplify operation at synchrotron beamlines, TomocuPy provides an easy-to-use command-line interface. Efficacy of the package was demonstrated during a tomographic experiment on gas-hydrate formation in porous samples, where a steering option was implemented as a lens-changing mechanism for zooming to regions of interest.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2022

Smart sensors using artificial intelligence for on-detector electronics and ASICs

Cutting edge detectors push sensing technology by further improving spatial and temporal resolution, increasing detector area and volume, and generally reducing backgrounds and noise. This has led to a explosion of more and more data being generated in next-generation experiments. Therefore, the need for near-sensor, at the data source, processing with more powerful algorithms is becoming increasingly important to more efficiently capture the right experimental data, reduce downstream system complexity, and enable faster and lower-power feedback loops. In this paper, we discuss the motivations and potential applications for on-detector AI. Furthermore, the unique requirements of particle physics can uniquely drive the development of novel AI hardware and design tools. We describe existing modern work for particle physics in this area. Finally, we outline a number of areas of opportunity where we can advance machine learning techniques, codesign workflows, and future microelectronics technologies which will accelerate design, performance, and implementations for next generation experiments.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Demand Response Optimization and Management System for Real-TIme (DROMS-RT)

To design and demonstrate DROMS-RT, a highly distributed Demand Response Optimization and Management System for Real-Time (DROMS-RT) power flow control to support large scale integration of distributed renewable generation into the grid. AutoGrid developed a novel control and communications platform to allow highly dispatchable demand response (DR) services in time frames suitable for providing ancillary services to the transmission grid. These services will be substantially less expensive and more efficient than other forms of ancillary services options currently available to manage the intermittency associated with large-scale renewable integration. DROMSRT successfully leveraged Automated Demand Response (ADR) by fundamentally re-thinking the architecture of the DR platform from the ground up and by developing innovative new technologies in a number of areas related to DR. DROMS-RT leveraged the low-cost, open, interoperable DR signaling technology, OpenADR, and low-cost, internet-protocol based telemetry solutions to reduce the cost of hardware. This allowed DROMS-RT to provide dynamic price signals to millions of OpenADR clients. Statistically rigorous signal processing techniques were developed to reliably detect even small load reductions in the presence of noisy baseline profiles. Novel forecasting engines based on modern online machine learning algorithms enabled accurate individualized forecasts for customer loads in the presence of dynamic pricing signals, and a real-time decision engines enabled continuous optimization and optimal dispatch of DR resources across a large portfolio of heterogeneous loads that respond at varying time-scales. Moreover, the real-time optimization conducted by the decision engine can utilize grid physics to maximize load reduction at the transmission system in addition to the distribution sites, for more efficient grid operation. Finally, the Software-as-a-Service (SaaS) availability of the DROMS-RT platform has reduced the cost of deployment and enable participation of small commercial and residential customers in DR who otherwise would not be able to do so.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Innovating the next generation of commercial smart building software

Nearly 30% of commercial building energy use is wasted due to equipment faults and HVAC controls problems. The result is increased emissions, compromised comfort and productivity, and less reliable coordination of building power needs with a clean grid. The energy impact alone represents $17 billion in potential savings. Today’s smart building software provides a robust solution to address these operational deficiencies. Energy management and information systems (EMIS) are saving up to 9% on average, with two-year paybacks. They are being incorporated into energy management processes, commissioning services, and utility programs. As effective as they are, two barriers prevent even deeper benefits; limited personnel to fix problems once they are identified, and the expense and time to manually implement changes in control systems. In partnership with the research community, the EMIS industry is developing new capabilities to overcome these barriers. Moving beyond siloed products for either fault detection and diagnostics, or optimal control, these new capabilities empower users to not only automatically identify faults, but also to push corrective action, and control improvements to their buildings. In this paper, several areas for enhancements are documented: ‘one-time’ correction of faults such as setpoints, schedules, and economizer lockouts; short-term active testing for automated proportional integral derivative (PID) loop tuning and functional testing; and continuous supervisory control for demand flexibility and year-round efficiency. Results are presented from a pair of partner implementations out of a dozen providers integrating these enhancements into their products, including field tests from across the country, and insights into operator acceptance and integration into operations and maintenance practices.

Casillas, Armando↗
DOE OSTI2020

AWB-GCN: A Graph Convolutional Network Accelerator with Runtime Workload Rebalancing

The recent development of deep learning has been mostly focusing on Euclidean data, such as images, videos, audios, etc. However, most real-world information and relation are often expressed as graphs. To efficiently learn from graph data, graph convolutional networks (GCNs) emerge as a promising approach, showing advantages in several practical applications such as social network analysis, knowledge discovery, 3D modeling, motion capturing, etc. Real-world graphs are usually extremely large and imbalanced, posting significant performance demand and design challenges on the hardware dedicated for GCN inference. In this paper, we propose an architecture design called UW-GCN to accelerate graph convolutional network inference. To tackle the major performance bottleneck from workload imbalance, we propose dynamic neighborhood stealing and remote chunk shuffling techniques, relying on hardware flexibility to achieve hardware auto-tuning under negligible area or delay overhead. Specifically, UW-GCN is able to smartly profile the sparse graph pattern while continuously adjusting the workload distribution via routing reconfiguration among parallel processing elements (PEs). The ideal configuration is then reused in the remaining iterations. To the best of our knowledge, this is the first accelerator design particularly for GCN and the first work relying on hardware auto-tuning, which is normally based on software, to achieve near-optimal workload balance in processing sparse structures.

Geng, Tong↗
DOE OSTI2024

The Case for Co-Designing Model Architectures with Hardware

While GPUs are responsible for training the vast majority of state-of-the-art deep learning models, the implications of their architecture are often overlooked when designing new deep learning (DL) models. As a consequence, modifying a DL model to be more amenable to the target hardware can significantly improve the runtime performance of DL training and inference. In this paper, we provide a set of guidelines for users to maximize the runtime performance of their transformer models. These guidelines have been created by carefully considering the impact of various model hyperparameters controlling model shape on the efficiency of the underlying computation kernels executed on the GPU. We find the throughput of models with “efficient” model shapes is up to 39% higher while preserving accuracy compared to models with a similar number of parameters but with unoptimized shapes.

Yin, Junqi↗
DOE OSTI2024

BeyondFingerprinting: AI-guided discovery of robust materials & processes

BeyondFingerprinting was a 2021-2024 Sandia Grand Challenge LDRD exploring the potential to develop new resilient materials and manufacturing processes by taking an artificial-intelligence (AI)-guided approach that integrates human-subject-matter expertise with algorithms enriched with physics-based constraints to unearth process-structure-property correlations. Such algorithms, trained on high-throughput experiments and simulations, are shown to serve as surrogate models that efficiently detect key “fingerprints” in materials data, prognose material performance, and guide effective process improvements. To accelerate broader adoption across mission areas, this AI-guided approach was demonstrated with three complex process-centric exemplars: electroplating, physical vapor deposition, and laser powder bed fusion. Together, these exemplars impact nearly every hardware component relevant to DOE and NNSA national security missions.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Flexible Pilot Jobs Framework for Distributed High Throughput Computing

Experimental particle physics has been at the forefront of analyzing the world’s largest datasets for decades. The high-energy physics (HEP) community was among the first to develop suitable software and computing tools for this purpose. GlideinWMS is a Glidein-based workload management system whose purpose is to provide experiments like CMS at CERN, DUNE at Fermilab, and others, a way to access and efficiently use vast amounts of computing resources. This system wants to provide a simple way to submit jobs to a set of computing resources, that will be provided to users behind the scenes. Glideins are the pilot jobs executed on the worker nodes at the grid sites, performing operations such as hardware detection, environment setup, and error handling. After all these operations, they will launch the actual user job. Many grid sites are supported, such as shared clusters, Google CE, and AWS. My internship aimed to design and code a flexible pilot jobs framework that will replace the one used by GlideinWMS, developing a modular and flexible skeleton of the Glidein and adding further functionalities. My project also focused on the application of machine learning techniques as support to this management system.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Converter-Interfaced CHP Plant for Improved Grid-Integration, Flexibility and Resiliency

GE Research and its partner GE Renewables have proposed the use of an interface converter solution to increase the penetration of small to medium-sized CHP (1MWe to 20MWe) into distribution grids and improve their flexibility and grid support capability. Indeed, the proposed interface converter solution thanks to presence of the grid-ready inverter, allows to streamline the compliance to grid codes requirements, reduce the interconnection delays and costs and ultimately one of the main barriers for CHP adoption by commercial and industrial facilities. An additional benefit provided by the interface converter is the use of the grid-ready inverter for reactive power which eliminates the need of sizing the generator for that capability. These two benefits highly favor the economic feasibility of converter-interfaced CHP. Five user cases, each in one of the leading U.S states for CHP potential reported by the DOE in its estimation of the U.S Technical Potential of CHP, were selected to compare the economic performances of converter-interfaced CHP as compared with directly-coupled. They include a college campus in California, a hospital in New York, a water reclamation plant in Texas, a hotel in Minnesota, and a large office building in Pennsylvania. Results showed that, the presence of the interface converter allows to increase the return on investment (ROI) by 0.5 to 2 percentage points in most of the cases (4 of 5). Indeed, the interface converter by shortening the interconnection process allows to accelerate revenues while reducing interconnection costs. Added to the reduced cost of the required generator these savings trade favorably the capital cost of the converter. The analysis also showed that the profitability of the converter-interfaced CHP is highly sensitive to the energy price, interconnection delay, and converter cost. However, it appears that if the interface converter can shorten the interconnection process by at least 6 months, adopting this solution will be more economically viable than directly-coupled configuration in almost all the +23,000 sites of the U.S Technical Potential CHP. The evaluation of the benefits of a converter-interfaced CHP also showed that it enables higher ROI when coupled with other distributed energy resources (DER) such as battery energy systems (BESS) or solar photovoltaic (PV). Indeed, in those scenario, the grid-ready inverter included in the interface converter eliminates the need of separate inverters if DC-coupling is used. On the technical performance, it has been verified that the presence of the interface converter allows to reduce by 70% to 80% the CHP short-circuit contribution to grid faults. This not only reduces the mechanical and thermal stresses exposed to the CHP electrical components but also increases the grid hosting capacity which ultimately enables higher penetrations CHP. Another key benefit of the interface converter validated with hardware-in-the-loop simulations and testing is its superior capability for reactive power support. Indeed, using a power hardware testbed with two +700kW inverters configured in back-to-back, a microgrid controller and actual facilities loads it was demonstrated that the presence of the interface converter can help maintain a power factor near ~1 or regulate the voltage to ~1.0pu at the point of common coupling. This benefit can be highly valuable if in the future, due to higher penetration of renewable distributed energy resources (DER), utilities start billing demand charge based on kVA instead of kW as currently. It was also validated that converter-interfaced CHP can dispatch heat and power commands and seamlessly switch between the two modes while consistently controlling the power factor or voltage at PCC. Indeed, the power hardware testing showed that grid-connected converter-interfaced CHP can follow either the power or heat demand while maintaining a unity power factor at converter output. This research proved that the adoption of an interface converter as the solution for interconnection of CHP system into the distribution grid can greatly improve the economic feasibility of small to medium-sized CHP as well as the plant power quality, flexibility and resiliency. Additionally, it allows increased penetrations of CHP into the distribution grid, extends their grid support capability, and facilitates the integration of BESS and PV DER by streamlining their collocation within the same facilities. This ultimately provides an opportunity for commercial and small industrial facilities in the U.S to accelerate their energy transition thanks to the high energy efficiency of CHP systems and its reliable, flexible, and resilient microgrid operation when interconnected with an interface converter.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Energy-Efficient Neuromorphic Architectures for Nuclear Radiation Detection Applications

A comprehensive analysis and simulation of two memristor-based neuromorphic architectures for nuclear radiation detection is presented. Both scalable architectures retrofit a locally competitive algorithm to solve overcomplete sparse approximation problems by harnessing memristor crossbar execution of vector–matrix multiplications. The proposed systems demonstrate excellent accuracy and throughput while consuming minimal energy for radionuclide detection. To ensure that the simulation results of our proposed hardware are realistic, the memristor parameters are chosen from our own fabricated memristor devices. Based on these results, we conclude that memristor-based computing is the preeminent technology for a radiation detection platform.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2020

Software Framework for Federated Science Instruments

There is an unprecedented promise of enhanced capabilities for federations of leadership computing systems and experimental science facilities by leveraging software technologies for fast and efficient operations. These federations seek to unify different science instruments, both computing and experimental, to effectively support science users and operators to execute complex workflows. The FedScI project addresses the software challenges associated with the formation and operation of federated environments by leveraging recent advances in containerization of software and softwarization of hardware. We propose a software framework to streamline the federation usage by science users and it’s provisioning and operations by facility providers. A distinguishing element of our work is the support for improved interaction between experimental devices, such as beam-line instruments, and more traditional high-performance computing resources, including compute, network, storage systems. We present guiding principles for the software framework and highlight portions of a current prototype implementation. We describe our science use case involving neutron imaging beam-lines (SNAP/BL-3, Imaging/CG-1D) at the Spallation Neutron Source and High Flux Isotope Reactor facilities at Oak Ridge National Laboratory. Additionally, we detail plans for a more direct instrument interaction within a federated environment, which could enable more advanced workflows with feedback loops to shorten the time to science.

Naughton III, Thomas↗
DOE OSTI2025

Simulators for quantum network modeling: A comprehensive review

Quantum network research is exploring new networking protocols, physics-based hardware and novel experiments to demonstrate how quantum distribution will work over large distances. Current work explores much of these concepts in simulations, that are developed to understand how quantum networking will be set up and researchers can experiment virtually. Exposing flaws in network designs, like unsustainable topologies, or develop protocols that efficiently utilize network resources, simulators can also help assess whether workloads are balanced across virtual machines in the network. However, much of these simulation models come without reliable verification methods, for testing performance in real deployments. Here, in this paper, we present a review of, to the best of our knowledge, currently used toolkits for modeling quantum networks. With these toolkits and standardized validation techniques, we can lay down the foundations for more accurate and reliable quantum network simulators.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Modeling Photovoltaics Innovation and Deployment Dynamics

PV’s historically rapid cost reduction is exceptional among technologies. Further cost reductions could play a major role in increasing deployment in the future. To enable such cost reductions, new modeling frameworks are needed to understand the determinants of innovation in PV. In this project, we study the mechanisms driving PV module and system cost reductions, delving deeply into the specific technological innovations that have occurred in the past and the policies that encouraged them, and also opportunities for future cost reduction and widespread deployment. The project contributes new fundamental insight on the determinants of technological innovation by developing novel methods and insights that are generalizable and can therefore be applied to other technologies. The results will allow policy makers, engineers, and other stakeholders to better prioritize their efforts and investments in the future. The project is organized around four journal articles as described below. The first article [1] identifies ‘low-level’ (e.g. conversion efficiency improvement) and ‘high- level’ (e.g. R&D efforts) mechanisms of cost reduction in PV systems (Tasks 1-4). This work builds on a previous DOE grant, where we developed a framework for technological innovation leading to PV module cost reduction [2]. We advance a method to disentangle the contributions of physical (‘hardware’) and non-physical (‘soft technology’) changes. Our results uncover reasons behind the relatively slow evolution of soft technology and can inform new innovation approaches to these technologies. The second article [3] identifies specific engineering or institutional innovations that enabled the low-level mechanisms of cost reduction in PV module and balance-of-systems (BOS) (Tasks 5, 9, 10). We identify 85 innovations and connect them to the cost variables they affected. By developing an innovations typology, this study shows the differences between the types of innovations affecting PV modules and BOS components. Finally, by analyzing the industry origins of innovations, this study also finds that PV was well-positioned within an ecosystem of continuously advancing technologies. The third article [4] studies prospective cost reduction opportunities (Task 10). We explore how design approaches that emphasize standardization and automation, such as plug-and-play PV systems, can create cost reduction opportunities by reducing interactions and speeding up activities with high process costs. We show that this can lead to cost reduction in cost components with the most untapped opportunity for improvement such as installation labor, overhead, electrical BOS, and customer acquisition. The fourth article [5] analyzes how various policies supporting PV deployment and R&D contributed to PV’s cost improvement by enabling high-level mechanisms, specific innovations, and ultimately low-level mechanisms of cost reduction (Tasks 8, 13, 14). We investigate examples from different countries and connect these policies to quantifiable cost change mechanisms. Our study sheds light on the roles that different nations played over time, through a diverse set of policy approaches.

14 SOLAR ENERGY↗
DOE OSTI2024

Containers on Switches: A Cluster School Experience

Network switches, such as those from Arista and Mellanox, often have underutilized computational resources in the form of built-in processors and memory. By leveraging these untapped resources, we can optimize functionality and efficiency of computational cluster networks. Our research focuses on deploying containers directly onto these switches to execute various auxiliary tasks ranging from metric logging to system-wide management via post-boot configuration. By doing so, we can significantly enchance the capabilities of the cluster without the need for additional dedicated hardware. Our research involved five distinct scenarios where switch utilization could have a profound impact on HPC Clusters: run cloud-init services via link-local connection; configuring a Telegraf container to export metrics; deploying a caching proxy; creating a reconfigurable IPv6 DHCP/DNS provider for VLAN; and implementing a client detection with Magellan discovery. These scenarios were containerized with podman and docker, and tested both physically on the switch virtually on a QEMU VM both running SONiC OS. Testing and findings indicate that network switches can indeed be used for these scenarios. They offer a wide range of possibilities beyond these applications. They run as expected as containers on the switches, and although there were some minor issues, work-arounds were implemented. Overall, this is a positive result that can be further explored with more scenarios.

97 MATHEMATICS AND COMPUTING↗